00000800:00000200:0.1F:1715330100.764037:0:3686:0:(socklnd.c:247:ksocknal_find_peer_locked()) got peer_ni [ffff8800b4333e40] -> 12345-192.168.204.149@tcp (2) 00000800:00000200:0.1:1715330100.766446:0:3677:0:(socklnd.c:247:ksocknal_find_peer_locked()) got peer_ni [ffff8800b4333e40] -> 12345-192.168.204.149@tcp (2) 00000800:00000200:0.1:1715330100.766449:0:3677:0:(socklnd.c:208:ksocknal_destroy_peer()) peer_ni 12345-192.168.204.149@tcp ffff880076664c00 deleted 00000800:00000010:0.1:1715330100.766451:0:3677:0:(socklnd.c:217:ksocknal_destroy_peer()) kfreed 'peer_ni': 184 at ffff880076664c00. 00000800:00000200:0.1:1715330100.766454:0:3677:0:(socklnd.c:431:ksocknal_incr_conn_count()) Add conn type 1, ksnr_connected 2 ksnr_max_conns 1 00000800:00000200:0.1:1715330100.766461:0:3677:0:(socklnd_cb.c:757:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.149@tcp ip 192.168.204.149:1023 00000800:00000200:0.1:1715330100.766464:0:3677:0:(socklnd_cb.c:776:ksocknal_queue_tx_locked()) Packet ffff880070247a00 type 2, nob 96 niov 1 nkiov 0 00000800:00000200:1.1F:1715330100.766816:0:3676:0:(socklnd.c:431:ksocknal_incr_conn_count()) Add conn type 1, ksnr_connected 2 ksnr_max_conns 1 00000800:00000200:0.1:1715330100.770997:0:3678:0:(socklnd.c:247:ksocknal_find_peer_locked()) got peer_ni [ffff8800b4333e40] -> 12345-192.168.204.149@tcp (4) 00000800:00000200:0.1:1715330100.771000:0:3678:0:(socklnd.c:208:ksocknal_destroy_peer()) peer_ni 12345-192.168.204.149@tcp ffff880076664c00 deleted 00000800:00000010:0.1:1715330100.771002:0:3678:0:(socklnd.c:217:ksocknal_destroy_peer()) kfreed 'peer_ni': 184 at ffff880076664c00. 00000800:00000200:0.1:1715330100.771006:0:3678:0:(socklnd.c:431:ksocknal_incr_conn_count()) Add conn type 3, ksnr_connected a ksnr_max_conns 1 00000800:00000200:0.1:1715330100.771104:0:3676:0:(socklnd.c:431:ksocknal_incr_conn_count()) Add conn type 2, ksnr_connected e ksnr_max_conns 1 00010000:00000010:2.1F:1715330100.843865:0:11:0:(ldlm_resource.c:1478:__ldlm_resource_free()) slab-freed '(res)': 240 at ffff880070247900. 00010000:00000010:2.1:1715330100.843877:0:11:0:(ldlm_lock.c:196:lock_handle_free()) slab-freed 'lock': 560 at ffff8800a91b4480. 00010000:00000010:1.1:1715330100.958101:0:11:0:(ldlm_resource.c:1478:__ldlm_resource_free()) slab-freed '(res)': 240 at ffff88013734f500. 00010000:00000010:1.1:1715330100.958109:0:11:0:(ldlm_lock.c:196:lock_handle_free()) slab-freed 'lock': 560 at ffff880078ab4900. 00010000:00000010:2.1:1715330100.958260:0:27:0:(ldlm_lock.c:196:lock_handle_free()) slab-freed 'lock': 560 at ffff8800a91b4b40. 00010000:00000010:2.1:1715330100.958265:0:27:0:(ldlm_resource.c:1478:__ldlm_resource_free()) slab-freed '(res)': 240 at ffff8800b2570100. 00010000:00000010:2.1:1715330100.958267:0:27:0:(ldlm_lock.c:196:lock_handle_free()) slab-freed 'lock': 560 at ffff880078ab4fc0. 00080000:00000010:1.1:1715330100.969346:0:11:0:(osd_handler.c:1615:osd_oxc_free()) kfreed 'oxe': 68 at ffff8800b42f48a0. 00010000:00010000:1.0:1715330282.603061:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2640/0xd895711d66d6369 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330282.603066:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2640/0xd895711d66d6369 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00000004:00010000:1.0:1715330282.603077:0:7134:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008b160700 reply state ffff88009d664000 transno 4294968263 ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f06c0/0xd895711d66d6370 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x664526f0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330282.603085:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f06c0/0xd895711d66d6370 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x664526f0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330282.603090:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x664526f0 (ffff88009ef18a00) 00010000:00010000:1.0:1715330282.603092:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330282.603094:0:7134:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1715330282.603138:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b160700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+10:16697:x1798653937987328:12345-192.168.204.49@tcp:36:rmdir.0 Request processed in 24477us (24793us total) trans 4294968263 rc 0/0 00000100:00100000:1.0:1715330282.603144:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23009 00010000:00010000:1.0:1715330282.603208:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715330282.603213:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f3840/0xd895711d66d6385 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d638c expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.603218:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f3840 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330282.603221:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f3840/0xd895711d66d6385 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d638c expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330282.603227:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f3840/0xd895711d66d6385 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d638c expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.603245:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f3840/0xd895711d66d6385 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d638c expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.603250:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330282.607899:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f3840/0xd895711d66d6385 lrc: 1/0,0 mode: --/EX res: [0x200000401:0xb3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d638c expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.607909:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f3840/0xd895711d66d6385 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d638c expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.607923:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330282.607925:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330282.607928:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330282.616137:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330282.635312:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942379456 00000100:00100000:1.0:1715330282.635317:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942379456 00000100:00100000:1.0:1715330282.635335:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2058 00000100:00100000:1.0:1715330282.635340:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:7135:x1798653942379456:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330282.635349:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330282.635361:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d63d9 lrc: 2/0,0 mode: --/PW res: [0x240000401:0xb6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d63d2 expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.635374:0:9408:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d63d9 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d63d2 expref: 9 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.635382:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d63d9 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d63d2 expref: 9 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.635388:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xb6:0x0].0x0 (ffff880129cafb00) 00010000:00010000:1.0:1715330282.635390:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330282.635392:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bff600, rc 0) 00000100:00100000:1.0:1715330282.635421:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7135:x1798653942379456:12345-0@lo:101:mdt00_002.0 Request processed in 81us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330282.635427:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2058 00000001:00080000:1.0:1715330282.663400:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968264 is committed 00000001:00080000:1.0:1715330282.663423:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968263 is committed 00000020:00080000:1.0:1715330282.663429:0:8267:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0001: 338 batchid updated 00000020:00080000:1.0:1715330282.663434:0:8267:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff880091ffc780 refcount 2 committed 0 result 0 batchid 339 00000020:00080000:1.0:1715330282.663437:0:8267:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009ef18900 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880091ffca80 00000020:00080000:1.0:1715330282.663440:0:8267:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].341 00000020:00080000:1.0:1715330282.663442:0:8267:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009ef18c00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88008d737200 00000020:00080000:1.0:1715330282.663444:0:8267:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].339 00000020:00080000:1.0:1715330282.663453:0:8267:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0001: 337 batchid updated 00010000:00010000:1.0:1715330282.664166:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0480/0xd895711d66d6411 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xb6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330282.664172:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0480/0xd895711d66d6411 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xb6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000004:00200000:1.0:1715330282.664205:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000401:0xb6:0x0]: returning size 4096 00000004:00200000:1.0:1715330282.664209:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1715330282.664238:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f21c0/0xd895711d66d640a lrc: 0/0,0 mode: --/CR res: [0x240000401:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfafd9 expref: 9 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.664248:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0480/0xd895711d66d6411 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xb6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfafd9 expref: 8 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.664254:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xb6:0x0].0x0 (ffff880129cafb00) 00010000:00010000:1.0:1715330282.664256:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1715330282.664257:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f0480, rc 0) 00000100:00100000:1.0:1715330282.664298:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+8:16709:x1798653937988032:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 3570us (3750us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330282.664304:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23016 00000100:00100000:1.0:1715330282.667167:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937988160 00000100:00100000:1.0:1715330282.667173:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937988160 00000100:00100000:1.0:1715330282.667261:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23017 00000100:00100000:1.0:1715330282.667268:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:16709:x1798653937988160:12345-192.168.204.49@tcp:36:rmdir.0 00010000:00010000:1.0:1715330282.667300:0:7135:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330282.667395:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d63f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x14f0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfafcb expref: 17 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.667428:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14f0:0x0].0x0 (ffff8800ab6b5b00) 00010000:00010000:1.0:1715330282.667432:0:7135:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330282.667452:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d6418 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.667461:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d6418 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.667469:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d6418 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.667477:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d641f lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x664526f1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.667483:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d641f lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x664526f1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.667488:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d641f lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x664526f1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.667538:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d6426 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14f0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.667543:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d6426 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14f0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.667553:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d6426 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14f0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.667564:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66d642d lrc: 3/0,1 mode: --/EX res: [0x200000400:0xb6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.667571:0:7135:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66d6403 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xb6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfafd2 expref: 16 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.667577:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66d642d lrc: 4/0,1 mode: --/EX res: [0x200000400:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.667598:0:7135:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66d6403 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xb6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfafd2 expref: 16 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.667628:0:7135:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66d6403 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xb6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfafd2 expref: 16 pid: 7135 timeout: 357 lvb_type: 0 00000100:00100000:1.0:1715330282.667641:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b161500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7135:1798653942379904:192.168.204.49@tcp:104: 00000100:00100000:1.0:1715330282.667682:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009d7e3480 going to sleep for 11 seconds 00010000:00010000:1.0:1715330282.672139:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66d642d lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.672146:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66d642d lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.672175:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfef40/0xd895711d66d6434 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xb6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.672181:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfef40/0xd895711d66d6434 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.672192:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfef40/0xd895711d66d6434 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT0 00000100:00100000:1.0:1715330282.672282:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b160380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942379968:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1715330282.672310:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330282.672321:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1715330282.674695:0:7135:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968264 gen 2 00000004:00080000:1.0:1715330282.674699:0:7135:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968260 committed transno 4294968264 00000020:00080000:1.0:1715330282.674703:0:7135:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88012f47e240 refcount 2 committed 0 result 0 batchid 334 00000020:00080000:1.0:1715330282.674706:0:7135:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008b0d2000 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88012f47e9c0 00000020:00080000:1.0:1715330282.674709:0:7135:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].320 00000020:00080000:1.0:1715330282.674711:0:7135:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008b0d2300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88008d40a000 00000020:00080000:1.0:1715330282.674713:0:7135:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].321 00000004:00080000:1.0:1715330282.674754:0:7135:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968262 committed transno 4294968264 00000004:00080000:1.0:1715330282.674766:0:7135:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968264 committed transno 4294968264 00000100:00100000:1.0:1715330282.674777:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b160380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942379968:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330282.674786:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfef40/0xd895711d66d6434 lrc: 4/0,1 mode: --/EX res: [0x240000401:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d643b expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.674791:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfef40/0xd895711d66d6434 lrc: 4/0,1 mode: --/EX res: [0x240000401:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d643b expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.729381:0:9415:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715330282.729386:0:9415:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457ef40/0xd895711d66d6481 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d6488 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.729392:0:9415:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457ef40 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330282.729396:0:9415:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457ef40/0xd895711d66d6481 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb4:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd895711d66d6488 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330282.729403:0:9415:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457ef40/0xd895711d66d6481 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb4:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd895711d66d6488 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.729423:0:9415:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457ef40/0xd895711d66d6481 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb4:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d6488 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.729428:0:9415:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330282.729448:0:9415:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457ef40/0xd895711d66d6481 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb4:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d6488 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.729453:0:9415:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457ef40/0xd895711d66d6481 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb4:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d6488 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.729469:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330282.729470:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330282.729472:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330282.729492:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801345a6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7134:1798653942380608:0@lo:104: 00010000:00010000:1.0:1715330282.729503:0:7134:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d64c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000001:00080000:1.0:1715330282.731063:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983316 is committed 00000001:00080000:1.0:1715330282.731084:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983315 is committed 00000020:00080000:1.0:1715330282.731090:0:7116:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 334 batchid updated 00000020:00080000:1.0:1715330282.731097:0:7116:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88008b04c480 refcount 2 committed 0 result 0 batchid 335 00000020:00080000:1.0:1715330282.731101:0:7116:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800ab6b5500 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88008b04c300 00000020:00080000:1.0:1715330282.731103:0:7116:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].321 00000020:00080000:1.0:1715330282.731105:0:7116:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880091c70e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8800939ac800 00000020:00080000:1.0:1715330282.731107:0:7116:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].322 00000020:00080000:1.0:1715330282.731473:0:7116:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 333 batchid updated 00010000:00010000:1.0:1715330282.732065:0:7134:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d64c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330282.732071:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d64c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000004:00200000:1.0:1715330282.732105:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xb4:0x0]: returning size 4096 00000004:00200000:1.0:1715330282.732108:0:7134:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1715330282.732139:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d64b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfaffc expref: 16 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.732150:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d64c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfaffc expref: 15 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.732155:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb4:0x0].0x0 (ffff88009ef18a00) 00010000:00010000:1.0:1715330282.732157:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1715330282.732159:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f2ac0, rc 0) 00000100:00100000:1.0:1715330282.732200:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+15:16713:x1798653937988864:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 3247us (3503us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330282.732205:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23024 00000100:00100000:1.0:1715330282.736473:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000020:00080000:1.0:1715330282.749525:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 340 committed batchid 338 00000020:00080000:1.0:1715330282.749627:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 338 00000100:00100000:1.0:1715330282.751938:0:9413:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942381184 00000100:00100000:1.0:1715330282.751942:0:9413:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942381184 00000100:00100000:1.0:1715330282.751977:0:9413:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1036 00000100:00100000:1.0:1715330282.751982:0:9413:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:7121:x1798653942381184:12345-0@lo:105: 00010000:00010000:1.0:1715330282.751990:0:9413:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f600/0xd895711d66d64e3 lrc: 5/0,1 mode: --/EX res: [0x200000401:0xb4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d64ea expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.751997:0:9413:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f600/0xd895711d66d64e3 lrc: 5/0,1 mode: --/EX res: [0x200000401:0xb4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d64ea expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.752004:0:9413:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f600/0xd895711d66d64e3 lrc: 5/0,1 mode: --/EX res: [0x200000401:0xb4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d64ea expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.752010:0:9413:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f600/0xd895711d66d64e3 lrc: 5/0,1 mode: EX/EX res: [0x200000401:0xb4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d64ea expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.752016:0:9413:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f600/0xd895711d66d64e3 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xb4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d64ea expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.752023:0:9413:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f600/0xd895711d66d64e3 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xb4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d64ea expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.752046:0:9413:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88013457f600) 00000100:00100000:1.0:1715330282.752075:0:9413:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:7121:x1798653942381184:12345-0@lo:105: Request processed in 92us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330282.752081:0:9413:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1036 00010000:00010000:1.0:1715330282.756172:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715330282.756178:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f600/0xd895711d66d64e3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d64ea expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.756186:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457f600 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330282.756189:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f600/0xd895711d66d64e3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d64ea expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330282.756196:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f600/0xd895711d66d64e3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d64ea expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.756215:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f600/0xd895711d66d64e3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d64ea expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.756220:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330282.756368:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f600/0xd895711d66d64e3 lrc: 1/0,0 mode: --/EX res: [0x200000401:0xb4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d64ea expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.756375:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f600/0xd895711d66d64e3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d64ea expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.756387:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330282.756388:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330282.756390:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330282.799031:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937989568 00000100:00100000:1.0:1715330282.799040:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937989568 00000100:00100000:1.0:1715330282.799075:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23030 00000100:00100000:1.0:1715330282.799082:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+15:16716:x1798653937989568:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:1.0:1715330282.799098:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330282.799115:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d653e lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb011 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.799165:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66d6545 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.799175:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66d6545 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.799184:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66d6545 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.799195:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66d654c lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x664526f3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.799200:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66d654c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x664526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.799205:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66d654c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x664526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.799261:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe400/0xd895711d66d6553 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x14f2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.799267:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe400/0xd895711d66d6553 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14f2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.799272:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe400/0xd895711d66d6553 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14f2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00200000:1.0:1715330282.799339:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x14f2:0x0]: returning size 4096 00000004:00200000:1.0:1715330282.799343:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1715330282.799357:0:7135:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe400/0xd895711d66d6553 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14f2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.799366:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66d6545 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.799371:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66d6545 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.799376:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66d6545 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.799381:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66d6545 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.799389:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bff3c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330282.799393:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66d6545 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.799399:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66d6545 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.799407:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88008b091a00) 00010000:00010000:1.0:1715330282.799410:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330282.799413:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66d6545 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.799418:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66d6545 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.799427:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66d654c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x664526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.799431:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66d654c lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x664526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.799435:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66d654c lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x664526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.799439:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfc6c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330282.799441:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66d654c lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x664526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.799446:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66d654c lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x664526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.799452:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x664526f3 (ffff88009d5e7900) 00010000:00010000:1.0:1715330282.799454:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330282.799456:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66d654c lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x664526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.799461:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66d654c lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x664526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.799480:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d653e lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb011 expref: 17 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.799493:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe400/0xd895711d66d6553 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x14f2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb011 expref: 16 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.799499:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14f2:0x0].0x0 (ffff88009d5e7a00) 00010000:00010000:1.0:1715330282.799501:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1715330282.799503:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfe400, rc 0) 00000100:00100000:1.0:1715330282.799554:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+16:16716:x1798653937989568:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 472us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330282.799561:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23030 00000100:00100000:1.0:1715330282.809633:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937989696 00000100:00100000:1.0:1715330282.809642:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937989696 00000100:00100000:1.0:1715330282.809684:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23032 00000100:00100000:1.0:1715330282.809690:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d619c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+11:16716:x1798653937989696:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:1.0:1715330282.809704:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330282.809719:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd440/0xd895711d66d6568 lrc: 2/0,0 mode: --/CR res: [0x240000401:0xb7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb01f expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.809777:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d656f lrc: 3/1,0 mode: --/PR res: [0x240000401:0xb7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.809788:0:7135:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f180/0xd895711d66d6537 lrc: 2/0,0 mode: PW/PW res: [0x240000401:0xb7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6530 expref: 9 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.809794:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d656f lrc: 4/1,0 mode: --/PR res: [0x240000401:0xb7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330282.809818:0:7135:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f180/0xd895711d66d6537 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xb7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd895711d66d6530 expref: 9 pid: 24873 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330282.809831:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b160e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7135:1798653942381696:0@lo:104: 00000100:00100000:1.0:1715330282.809864:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330282.809889:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1715330282.810076:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b160e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7135:1798653942381696:0@lo:104: 00010000:00010000:1.0:1715330282.810094:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d656f lrc: 3/1,0 mode: --/PR res: [0x240000401:0xb7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000100:00100000:1.0:1715330282.810479:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942381760 00000100:00100000:1.0:1715330282.810482:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942381760 00010000:00010000:1.0:1715330282.810493:0:7121:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f180/0xd895711d66d6537 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xb7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd895711d66d6530 expref: 10 pid: 24873 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330282.810511:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1363 00000100:00100000:1.0:1715330282.810514:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801345a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+10:3691:x1798653942381760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330282.810521:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00080000:1.0:1715330282.813496:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 341 committed batchid 340 00000004:00080000:1.0:1715330282.813565:0:8285:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88012f47ef00 with version 656 00000020:00080000:1.0:1715330282.813579:0:8285:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 339 cancel update log [0x200000401:0x3:0x0].341: rc = 0 00000020:00080000:1.0:1715330282.813622:0:8285:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 339 cancel update log [0x240000400:0x3:0x0].339: rc = 0 00000004:00080000:1.0:1715330282.813636:0:8285:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88012f47e6c0 with version 657 00000020:00080000:1.0:1715330282.813638:0:8285:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 340 cancel update log [0x200000401:0x3:0x0].342: rc = 0 00000020:00080000:1.0:1715330282.813651:0:8285:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 340 cancel update log [0x240000400:0x3:0x0].340: rc = 0 00000020:00080000:1.0:1715330282.813656:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 340 00010000:00010000:1.0:1715330282.813693:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f180/0xd895711d66d6537 lrc: 0/0,0 mode: --/PW res: [0x240000401:0xb7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd895711d66d6530 expref: 6 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.813703:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xb7:0x0].0x0 (ffff88012ca48d00) 00010000:00010000:1.0:1715330282.814694:0:7121:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d656f lrc: 3/1,0 mode: --/PR res: [0x240000401:0xb7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330282.814702:0:7121:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d656f lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xb7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330282.814707:0:7121:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d656f lrc: 4/1,0 mode: PR/PR res: [0x240000401:0xb7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330282.814741:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330282.814766:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801345a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942381760:12345-0@lo:103:ldlm_bl.0 Request processed in 4250us (4323us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330282.814772:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1363 00000100:00100000:1.0:1715330282.821111:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937989888 00000100:00100000:1.0:1715330282.821116:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937989888 00010000:00010000:1.0:1715330282.821136:0:7121:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d6561 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xb7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb018 expref: 17 pid: 7134 timeout: 357 lvb_type: 0 00000100:00100000:1.0:1715330282.821375:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1364 00000100:00100000:1.0:1715330282.821381:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d61bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+17:2011:x1798653937989888:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1715330282.821391:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330282.821396:0:7121:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d6561 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xb7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb018 expref: 17 pid: 7134 timeout: 357 lvb_type: 0 00010000:00010000:1.0:1715330282.821408:0:7121:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d6561 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xb7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb018 expref: 17 pid: 7134 timeout: 357 lvb_type: 0 00010000:00010000:1.0:1715330282.821424:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d6561 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xb7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb018 expref: 17 pid: 7134 timeout: 357 lvb_type: 0 00010000:00010000:1.0:1715330282.821438:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xb7:0x0].0x0 (ffff88009d5e7500) 00010000:00010000:1.0:1715330282.821441:0:7121:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66d658b lrc: 3/0,1 mode: --/EX res: [0x200000400:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.821448:0:7121:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66d658b lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.821453:0:7121:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66d658b lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.821467:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330282.821504:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d61bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+16:2011:x1798653937989888:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 123us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330282.821509:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1364 00000100:00100000:1.0:1715330282.825174:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937989952 00000100:00100000:1.0:1715330282.825179:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937989952 00010000:00010000:1.0:1715330282.825194:0:7121:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d656f lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xb7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb01f expref: 8 pid: 7135 timeout: 357 lvb_type: 0 00000100:00100000:1.0:1715330282.825210:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1365 00000100:00100000:1.0:1715330282.825216:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d61ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+8:2012:x1798653937989952:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1715330282.825225:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330282.825229:0:7121:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d656f lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xb7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb01f expref: 8 pid: 7135 timeout: 357 lvb_type: 0 00010000:00010000:1.0:1715330282.825237:0:7121:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d656f lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xb7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb01f expref: 8 pid: 7135 timeout: 357 lvb_type: 0 00010000:00010000:1.0:1715330282.825251:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d656f lrc: 0/0,0 mode: --/PR res: [0x240000401:0xb7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb01f expref: 8 pid: 7135 timeout: 357 lvb_type: 0 00010000:00010000:1.0:1715330282.825261:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xb7:0x0].0x0 (ffff88012ca48d00) 00010000:00010000:1.0:1715330282.825265:0:7121:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d6599 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6592 expref: 5 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.825272:0:7121:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d6599 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d6592 expref: 5 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.825277:0:7121:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d6599 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d6592 expref: 5 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.825296:0:7121:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d6599 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6592 expref: 5 pid: 9408 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330282.825306:0:7121:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b160e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:7121:1798653942382272:0@lo:105: 00000100:00100000:1.0:1715330282.825328:0:7121:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330282.825349:0:7121:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1715330282.825782:0:7121:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b160e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:7121:1798653942382272:0@lo:105: 00010000:00010000:1.0:1715330282.825792:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330282.825923:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d61ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+7:2012:x1798653937989952:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 606us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330282.825933:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1365 00000004:00200000:1.0:1715330282.830595:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x14f2:0x0]: returning size 4096 00010000:00010000:1.0:1715330282.830625:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66d658b lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.830632:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66d658b lrc: 2/0,0 mode: EX/EX res: [0x200000400:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.830638:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66d658b lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.830643:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f2880 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330282.830647:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66d658b lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.830653:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66d658b lrc: 4/0,0 mode: EX/EX res: [0x200000400:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.830664:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xb7:0x0].0x0 (ffff88009d5e7500) 00010000:00010000:1.0:1715330282.830666:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330282.830669:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66d658b lrc: 2/0,0 mode: --/EX res: [0x200000400:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.830673:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66d658b lrc: 0/0,0 mode: --/EX res: [0x200000400:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.830684:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db64900/0xd895711d66d6592 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6599 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.830690:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db64900/0xd895711d66d6592 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d6599 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.830695:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db64900/0xd895711d66d6592 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d6599 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.830717:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1715330282.830723:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0xb7:0x0] 00010000:00010000:1.0:1715330282.830728:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d6584 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14f2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.830759:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d6584 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x14f2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.830763:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d6584 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14f2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.830767:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f1680 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330282.830769:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d6584 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14f2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.830774:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d6584 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x14f2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.830785:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14f2:0x0].0x0 (ffff88009d5e7a00) 00010000:00010000:1.0:1715330282.830787:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330282.830789:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d6584 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x14f2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.830794:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d6584 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x14f2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.831026:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66d6576 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.831032:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66d6576 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.831036:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66d6576 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.831041:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66d6576 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.831045:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f1440 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330282.831047:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66d6576 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.831052:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66d6576 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.831058:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88009d434900) 00010000:00010000:1.0:1715330282.831060:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330282.831062:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66d6576 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.831066:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66d6576 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00000004:00010000:1.0:1715330282.831077:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008d61a680 reply state ffff880091e56000 transno 4294983321 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d657d lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x664526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.831086:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d657d lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x664526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.831091:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x664526f3 (ffff88009d5e7900) 00010000:00010000:1.0:1715330282.831093:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330282.831095:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1715330282.831136:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d61a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:16716:x1798653937989824:12345-192.168.204.49@tcp:36:rmdir.0 Request processed in 13559us (13625us total) trans 4294983321 rc 0/0 00000100:00100000:1.0:1715330282.831142:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23033 00000100:00100000:1.0:1715330282.840467:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937990016 00000100:00100000:1.0:1715330282.840475:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937990016 00000100:00100000:1.0:1715330282.840527:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23034 00000100:00100000:1.0:1715330282.840533:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+7:16717:x1798653937990016:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:1.0:1715330282.840550:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330282.840566:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d65a0 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb026 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.840632:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff840/0xd895711d66d65a7 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.840642:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff840/0xd895711d66d65a7 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330282.840651:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff840/0xd895711d66d65a7 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330282.840662:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe400/0xd895711d66d65ae lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x664526f4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.840667:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe400/0xd895711d66d65ae lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x664526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330282.840672:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe400/0xd895711d66d65ae lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x664526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330282.840710:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff840/0xd895711d66d65a7 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330282.840715:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff840/0xd895711d66d65a7 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330282.840719:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff840/0xd895711d66d65a7 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330282.840724:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff840/0xd895711d66d65a7 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330282.840754:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bff840 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330282.840757:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff840/0xd895711d66d65a7 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330282.840763:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff840/0xd895711d66d65a7 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330282.840771:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88009d5e7d00) 00010000:00010000:1.0:1715330282.840774:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330282.840777:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff840/0xd895711d66d65a7 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330282.840782:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff840/0xd895711d66d65a7 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330282.840793:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe400/0xd895711d66d65ae lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x664526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330282.840798:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe400/0xd895711d66d65ae lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x664526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330282.840802:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe400/0xd895711d66d65ae lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x664526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330282.840805:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfe400 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330282.840807:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe400/0xd895711d66d65ae lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x664526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330282.840811:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe400/0xd895711d66d65ae lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x664526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330282.840815:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x664526f4 (ffff88008b091600) 00010000:00010000:1.0:1715330282.840817:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330282.840819:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe400/0xd895711d66d65ae lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x664526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330282.840823:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe400/0xd895711d66d65ae lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x664526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330282.841495:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d65a0 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb026 expref: 8 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.841502:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d65a0 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb026 expref: 8 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.841511:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfdb00, rc 0) 00000100:00100000:1.0:1715330282.841572:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+7:16717:x1798653937990016:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 1038us (1168us total) trans 0 rc 301/301 00000100:00100000:1.0:1715330282.841579:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23034 00000100:00100000:1.0:1715330282.847814:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937990080 00000100:00100000:1.0:1715330282.847824:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937990080 00000100:00100000:1.0:1715330282.847874:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23035 00000100:00100000:1.0:1715330282.847882:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d61b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:16717:x1798653937990080:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:1.0:1715330282.847903:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330282.847920:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d65b5 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb02d expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.847963:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d65bc lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.847973:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d65bc lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.847982:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d65bc lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00200000:1.0:1715330282.848024:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1715330282.848028:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1715330282.848052:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d65b5 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb02d expref: 19 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.848066:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d65bc lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb02d expref: 18 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.848071:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88008b091300) 00010000:00010000:1.0:1715330282.848074:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1715330282.848076:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bffa80, rc 0) 00000100:00100000:1.0:1715330282.848113:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d61b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+18:16717:x1798653937990080:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 232us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330282.848119:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23035 00000100:00100000:1.0:1715330282.879349:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937990528 00000100:00100000:1.0:1715330282.879357:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937990528 00000100:00100000:1.0:1715330282.879390:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23040 00000100:00100000:1.0:1715330282.879396:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801345a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+18:16719:x1798653937990528:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:1.0:1715330282.879412:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330282.879427:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d6617 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb042 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.879469:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe400/0xd895711d66d661e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330282.879479:0:7134:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d65e6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d65df expref: 9 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.879489:0:7134:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe400/0xd895711d66d661e lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330282.879512:0:7134:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d65e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd895711d66d65df expref: 9 pid: 24873 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330282.879524:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b160e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7134:1798653942382784:0@lo:104: 00000100:00100000:1.0:1715330282.879558:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330282.879582:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330282.879987:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b160e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7134:1798653942382784:0@lo:104: 00010000:00010000:1.0:1715330282.880000:0:7134:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe400/0xd895711d66d661e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000001:00080000:1.0:1715330282.881400:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983322 is committed 00000001:00080000:1.0:1715330282.881447:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983321 is committed 00000020:00080000:1.0:1715330282.881454:0:7116:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 336 batchid updated 00000020:00080000:1.0:1715330282.881462:0:7116:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88008b04c3c0 refcount 2 committed 0 result 0 batchid 337 00000020:00080000:1.0:1715330282.881465:0:7116:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009d5e7b00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88008b04c000 00000020:00080000:1.0:1715330282.881468:0:7116:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].323 00000020:00080000:1.0:1715330282.881470:0:7116:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009d5e7c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8800939ace00 00000020:00080000:1.0:1715330282.881472:0:7116:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].324 00000020:00080000:1.0:1715330282.881485:0:7116:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 335 batchid updated 00010000:00010000:1.0:1715330282.881969:0:7134:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe400/0xd895711d66d661e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330282.881976:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe400/0xd895711d66d661e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000004:00200000:1.0:1715330282.882010:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xb5:0x0]: returning size 4096 00000004:00200000:1.0:1715330282.882014:0:7134:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1715330282.882043:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d6617 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb042 expref: 16 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.882054:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe400/0xd895711d66d661e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb042 expref: 15 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.882059:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb5:0x0].0x0 (ffff88009d434800) 00010000:00010000:1.0:1715330282.882061:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1715330282.882063:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfe400, rc 0) 00000100:00100000:1.0:1715330282.882096:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801345a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+15:16719:x1798653937990528:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 2699us (2818us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330282.882102:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23040 00000100:00100000:1.0:1715330282.885038:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937990656 00000100:00100000:1.0:1715330282.885045:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937990656 00000100:00100000:1.0:1715330282.885071:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23041 00000100:00100000:1.0:1715330282.885076:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+10:16719:x1798653937990656:12345-192.168.204.49@tcp:36:rmdir.0 00010000:00010000:1.0:1715330282.885111:0:7134:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330282.885129:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67a80/0xd895711d66d6602 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x163:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb034 expref: 10 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.885143:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x163:0x0].0x0 (ffff88009b985600) 00010000:00010000:1.0:1715330282.885146:0:7134:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330282.885169:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff840/0xd895711d66d6625 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330282.885179:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff840/0xd895711d66d6625 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330282.885186:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff840/0xd895711d66d6625 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330282.885195:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d662c lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x664526f4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330282.885199:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d662c lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x664526f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330282.885203:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d662c lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x664526f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330282.885250:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d6633 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x163:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330282.885253:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d6633 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x163:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330282.885256:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d6633 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x163:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330282.885265:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd200/0xd895711d66d663a lrc: 3/0,1 mode: --/EX res: [0x240000400:0xb5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330282.885270:0:7134:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0000/0xd895711d66d6610 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb03b expref: 9 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.885275:0:7134:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd200/0xd895711d66d663a lrc: 4/0,1 mode: --/EX res: [0x240000400:0xb5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330282.885293:0:7134:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0000/0xd895711d66d6610 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb03b expref: 9 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.885304:0:7134:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0000/0xd895711d66d6610 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb03b expref: 9 pid: 7134 timeout: 357 lvb_type: 0 00000100:00100000:1.0:1715330282.885320:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b160e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7134:1798653942383168:192.168.204.49@tcp:104: 00000100:00100000:1.0:1715330282.885367:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47ecc0 going to sleep for 11 seconds 00000020:00080000:1.0:1715330282.897318:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 342 committed batchid 340 00000020:00080000:1.0:1715330282.897355:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 340 00010000:00010000:1.0:1715330282.904010:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715330282.904016:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64900/0xd895711d66d6641 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d6648 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.904022:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64900 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330282.904026:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64900/0xd895711d66d6641 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d6648 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330282.904033:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64900/0xd895711d66d6641 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d6648 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.904053:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64900/0xd895711d66d6641 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6648 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.904058:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330282.904085:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64900/0xd895711d66d6641 lrc: 1/0,0 mode: --/EX res: [0x200000401:0xb5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6648 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.904091:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64900/0xd895711d66d6641 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6648 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.904103:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330282.904104:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330282.904105:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330282.947549:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330282.947575:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937991168 00000100:00100000:1.0:1715330282.947582:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937991168 00000100:00100000:1.0:1715330282.947638:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23045 00000100:00100000:1.0:1715330282.947645:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+13:16722:x1798653937991168:12345-192.168.204.49@tcp:36:mkdir.0 00010000:00010000:1.0:1715330282.947752:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d6680 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.947764:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d6680 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.947774:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d6680 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.947782:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d6687 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x664526f5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.947786:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d6687 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x664526f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.947790:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d6687 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x664526f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.948115:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66d668e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x14f5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.948121:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66d668e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14f5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.948127:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66d668e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14f5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00010000:1.0:1715330282.948138:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008b162300 reply state ffff880091c40000 transno 4294983324 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66d668e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14f5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.948149:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66d668e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x14f5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.948155:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14f5:0x0].0x0 (ffff88009ef25900) 00010000:00010000:1.0:1715330282.948157:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330282.948160:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1715330282.948164:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x14f5:0x0]: returning size 4096 00010000:00010000:1.0:1715330282.948169:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d6680 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.948174:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d6680 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.948179:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d6680 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.948184:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d6680 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.948189:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfc240 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330282.948192:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d6680 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.948197:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d6680 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.948204:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88009ef25500) 00010000:00010000:1.0:1715330282.948206:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330282.948208:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d6680 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.948212:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d6680 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00000004:00010000:1.0:1715330282.948226:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008b162300 reply state ffff880091c40000 transno 4294983324 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d6687 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x664526f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.948232:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d6687 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x664526f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.948236:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x664526f5 (ffff88009ef25300) 00010000:00010000:1.0:1715330282.948237:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330282.948239:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1715330282.948292:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+15:16722:x1798653937991168:12345-192.168.204.49@tcp:36:mkdir.0 Request processed in 647us (746us total) trans 4294983324 rc 0/0 00000100:00100000:1.0:1715330282.948298:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23045 00000100:00100000:1.0:1715330282.961996:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330282.967514:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330282.983288:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937991488 00000100:00100000:1.0:1715330282.983297:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937991488 00000100:00100000:1.0:1715330282.983333:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23049 00000100:00100000:1.0:1715330282.983340:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:16732:x1798653937991488:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:1.0:1715330282.983359:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330282.983376:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d66db lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb065 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.983423:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66d66e2 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.983434:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66d66e2 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.983442:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66d66e2 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00200000:1.0:1715330282.983475:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1715330282.983479:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1715330282.983504:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d66db lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb065 expref: 19 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.983517:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66d66e2 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb065 expref: 18 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.983525:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88009ef25d00) 00010000:00010000:1.0:1715330282.983527:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1715330282.983530:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bff600, rc 0) 00000100:00100000:1.0:1715330282.983723:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+18:16732:x1798653937991488:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 381us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330282.984371:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23049 00000100:00100000:1.0:1715330282.991024:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330282.991056:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937991616 00000100:00100000:1.0:1715330282.991063:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937991616 00000100:00100000:1.0:1715330282.991099:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23050 00000100:00100000:1.0:1715330282.991105:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+11:16732:x1798653937991616:12345-192.168.204.49@tcp:36:lfs.0 00010000:00010000:1.0:1715330282.991148:0:7135:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330282.991167:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457eac0/0xd895711d66d666b lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb050 expref: 11 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.991179:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88012ca48e00) 00010000:00010000:1.0:1715330282.991187:0:7135:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330282.991236:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d66e9 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.991250:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d66e9 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330282.991257:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d66e9 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330282.991266:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d66f0 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x664526f6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.991271:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d66f0 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x664526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330282.991275:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d66f0 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x664526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000040:00080000:1.0:1715330282.991929:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].346, 2168 off526456 00000040:00080000:1.0:1715330282.991990:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].347, 2368 off574984 00000004:00080000:1.0:1715330282.991994:0:7135:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88012f47e6c0 with version 660 00000100:00100000:1.0:1715330282.995409:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942383808 00000100:00100000:1.0:1715330282.995418:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942383808 00000100:00100000:1.0:1715330282.995457:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2086 00000100:00100000:1.0:1715330282.995463:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801345a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:8278:x1798653942383808:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1715330282.995896:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801345a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:8278:x1798653942383808:12345-0@lo:1000:osp_up0-1.0 Request processed in 432us (3620us total) trans 4294983326 rc 0/0 00000100:00100000:1.0:1715330282.995902:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2086 00000100:00100000:1.0:1715330282.995954:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d61ad80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942383808:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1715330282.996037:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffcc0/0xd895711d66d66f7 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x165:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.996048:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffcc0/0xd895711d66d66f7 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x165:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330282.996058:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffcc0/0xd895711d66d66f7 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x165:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330282.996071:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d66fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.996076:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d66fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330282.996080:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d66fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330282.996101:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc480/0xd895711d66d6705 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330282.996106:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc480/0xd895711d66d6705 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330282.996113:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc480/0xd895711d66d6705 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT1 00000100:00100000:1.0:1715330282.996126:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b162680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942383872:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1715330282.996151:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330282.996160:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47e240 going to sleep for 11 seconds 00000100:00100000:1.0:1715330282.996183:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942383872 00000100:00100000:1.0:1715330282.996185:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942383872 00000100:00100000:1.0:1715330282.996199:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2087 00000100:00100000:1.0:1715330282.996204:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7135:x1798653942383872:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330282.996214:0:24873:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330282.996225:0:24873:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d670c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d6705 expref: -99 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.996243:0:24873:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d670c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d6705 expref: 8 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.996251:0:24873:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d670c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6705 expref: 8 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.996258:0:24873:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb6:0x0].0x0 (ffff88009ef25400) 00010000:00010000:1.0:1715330282.996260:0:24873:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330282.996262:0:24873:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfcfc0, rc 0) 00000100:00100000:1.0:1715330282.996283:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:7135:x1798653942383872:12345-0@lo:101:mdt00_002.0 Request processed in 78us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330282.996287:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2087 00000100:00100000:1.0:1715330282.996307:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b162680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942383872:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330282.996315:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc480/0xd895711d66d6705 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d670c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.996322:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc480/0xd895711d66d6705 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d670c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330282.996336:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008b160e00 reply state ffff880091c41000 transno 4294968276 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d66fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330282.996344:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d66fe lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330282.996349:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xb6:0x0].0x0 (ffff88009ef25b00) 00010000:00010000:1.0:1715330282.996351:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330282.996353:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1715330282.996357:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc480/0xd895711d66d6705 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d670c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330282.996363:0:7135:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc480/0xd895711d66d6705 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d670c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330282.996370:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000401:0xb6:0x0] 00000004:00010000:1.0:1715330282.996373:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008b160e00 reply state ffff880091c41000 transno 4294968276 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffcc0/0xd895711d66d66f7 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x165:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330282.996378:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffcc0/0xd895711d66d66f7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x165:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330282.996383:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x165:0x0].0x0 (ffff88009ef25500) 00010000:00010000:1.0:1715330282.996385:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330282.996386:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1715330282.996389:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x165:0x0]: returning size 4096 00010000:00010000:1.0:1715330282.996395:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d66e9 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330282.996399:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d66e9 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330282.996403:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d66e9 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330282.996408:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d66e9 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330282.996412:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfcb40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330282.996415:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d66e9 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330282.996420:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d66e9 lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330282.996428:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88009ef25600) 00010000:00010000:1.0:1715330282.996430:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330282.996432:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d66e9 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330282.996437:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d66e9 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00000004:00010000:1.0:1715330282.996448:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008b160e00 reply state ffff880091c41000 transno 4294968276 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d66f0 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x664526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330282.996454:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d66f0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x664526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330282.996459:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x664526f6 (ffff88009ef25a00) 00010000:00010000:1.0:1715330282.996460:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330282.996461:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00000100:00100000:1.0:1715330282.996510:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+12:16732:x1798653937991616:12345-192.168.204.49@tcp:36:lfs.0 Request processed in 5403us (5491us total) trans 4294968276 rc 0/0 00000100:00100000:1.0:1715330282.996517:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23050 00000100:00100000:1.0:1715330283.018814:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330283.026449:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942384128 00000100:00100000:1.0:1715330283.026454:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942384128 00000100:00100000:1.0:1715330283.026478:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2088 00000100:00100000:1.0:1715330283.026483:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ba3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:8587:x1798653942384128:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330283.026573:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ba3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:8587:x1798653942384128:12345-0@lo:1000:osp_up1-0.0 Request processed in 89us (269us total) trans 4294968277 rc 0/0 00000100:00100000:1.0:1715330283.026579:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2088 00000100:00100000:1.0:1715330283.039616:0:24873:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801345a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:24873:1798653942384320:192.168.204.49@tcp:104: 00010000:00010000:1.0:1715330283.039638:0:24873:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d676e lrc: 3/0,0 mode: --/EX res: [0x200000401:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6767 expref: 6 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.039653:0:24873:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb6:0x0].0x0 (ffff88009ef25400) 00010000:00010000:1.0:1715330283.039656:0:24873:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330283.039659:0:24873:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d676e lrc: 3/0,0 mode: --/EX res: [0x200000401:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6767 expref: 6 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.039667:0:24873:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d676e lrc: 3/0,0 mode: --/EX res: [0x200000401:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6767 expref: 6 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.039672:0:24873:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f1f80, rc 0) 00000100:00100000:1.0:1715330283.039707:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:7134:x1798653942384256:12345-0@lo:101:mdt00_001.0 Request processed in 4056us (4160us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.039714:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2089 00000100:00100000:1.0:1715330283.039782:0:9413:0:(service.c:168:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1715330283.039791:0:9413:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942384384 00000100:00100000:1.0:1715330283.039794:0:9413:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942384384 00000100:00100000:1.0:1715330283.039818:0:9413:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1042 00000100:00100000:1.0:1715330283.039823:0:9413:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b4a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:7121:x1798653942384384:12345-0@lo:105: 00010000:00010000:1.0:1715330283.039967:0:9413:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db67180/0xd895711d66d6767 lrc: 5/0,1 mode: --/EX res: [0x200000401:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d676e expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.039974:0:9413:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db67180/0xd895711d66d6767 lrc: 5/0,1 mode: --/EX res: [0x200000401:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d676e expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.039981:0:9413:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db67180/0xd895711d66d6767 lrc: 5/0,1 mode: --/EX res: [0x200000401:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d676e expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.039990:0:9413:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db67180/0xd895711d66d6767 lrc: 5/0,1 mode: EX/EX res: [0x200000401:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d676e expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.039996:0:9413:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db67180/0xd895711d66d6767 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d676e expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.040003:0:9413:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db67180/0xd895711d66d6767 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xb6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d676e expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.040147:0:9413:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88011db67180) 00000100:00100000:1.0:1715330283.040179:0:9413:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b4a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:7121:x1798653942384384:12345-0@lo:105: Request processed in 355us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.040185:0:9413:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1042 00000100:00100000:1.0:1715330283.040978:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942384448 00000100:00100000:1.0:1715330283.040982:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942384448 00000100:00100000:1.0:1715330283.040999:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2090 00000100:00100000:1.0:1715330283.041003:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:7134:x1798653942384448:12345-0@lo:403:mdt00_001.0 00000100:00100000:1.0:1715330283.042351:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:7134:x1798653942384448:12345-0@lo:403:mdt00_001.0 Request processed in 1345us (1561us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.042359:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2090 00000004:00080000:1.0:1715330283.043555:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 661 rpc_version 661 00000020:00100000:1.0:1715330283.043573:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1715330283.043578:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012fa87100 x1798653942384576/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1448/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1715330283.043590:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa87100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942384576:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1715330283.043630:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.043641:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.043992:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa87100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942384576:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1715330283.062720:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937992320 00000100:00100000:1.0:1715330283.062788:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937992320 00000100:00100000:1.0:1715330283.062822:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23057 00000100:00100000:1.0:1715330283.062829:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+14:16735:x1798653937992320:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:1.0:1715330283.062850:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330283.062867:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc000/0xd895711d66d678a lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb088 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.062913:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d6791 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.062923:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d6791 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330283.062933:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d6791 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000004:00200000:1.0:1715330283.062970:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000401:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1715330283.062974:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1715330283.062998:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc000/0xd895711d66d678a lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb088 expref: 16 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.063278:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d6791 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb088 expref: 15 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.063285:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff880092d89900) 00010000:00010000:1.0:1715330283.063287:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1715330283.063289:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfe1c0, rc 0) 00000100:00100000:1.0:1715330283.063337:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+15:16735:x1798653937992320:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 508us (1187us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.063342:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23057 00000100:00100000:1.0:1715330283.073210:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937992448 00000100:00100000:1.0:1715330283.073218:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937992448 00000100:00100000:1.0:1715330283.073256:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23058 00000100:00100000:1.0:1715330283.073261:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d79b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+14:16735:x1798653937992448:12345-192.168.204.49@tcp:36:lfs.0 00010000:00010000:1.0:1715330283.073300:0:7135:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330283.073316:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66d66e2 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb065 expref: 14 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.073340:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88009ef25d00) 00010000:00010000:1.0:1715330283.073347:0:7135:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330283.073451:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d6798 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.073459:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d6798 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.073464:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d6798 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.073470:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66d679f lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x664526f7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.073473:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66d679f lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x664526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.073476:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66d679f lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x664526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000040:00080000:1.0:1715330283.073982:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].326, 2168 off503136 00000040:00080000:1.0:1715330283.074025:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].325, 2368 off540136 00000004:00080000:1.0:1715330283.074028:0:7135:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88012f47ea80 with version 620 00000100:00100000:1.0:1715330283.074229:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942384768 00000100:00100000:1.0:1715330283.074233:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942384768 00000100:00100000:1.0:1715330283.074253:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2092 00000100:00100000:1.0:1715330283.074257:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:8587:x1798653942384768:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330283.074713:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:8587:x1798653942384768:12345-0@lo:1000:osp_up1-0.0 Request processed in 454us (555us total) trans 4294968279 rc 0/0 00000100:00100000:1.0:1715330283.074720:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2092 00010000:00010000:1.0:1715330283.074881:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66d67a6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x14f6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.074889:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66d67a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14f6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.074895:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66d67a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14f6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.074908:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66d67ad lrc: 3/0,1 mode: --/PW res: [0x200000400:0xb9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.074913:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66d67ad lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xb9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.074918:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66d67ad lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xb9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.074937:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe880/0xd895711d66d67b4 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xb9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.074942:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe880/0xd895711d66d67b4 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xb9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.074949:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe880/0xd895711d66d67b4 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xb9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT0 00000100:00100000:1.0:1715330283.074959:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa86d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942384832:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1715330283.074977:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.074997:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.075286:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa86d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942384832:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330283.075296:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe880/0xd895711d66d67b4 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xb9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d67bb expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.075303:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe880/0xd895711d66d67b4 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xb9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d67bb expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330283.075316:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008d79b480 reply state ffff880091c44000 transno 4294983328 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66d67ad lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xb9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.075322:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66d67ad lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xb9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.075325:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xb9:0x0].0x0 (ffff880092d89700) 00010000:00010000:1.0:1715330283.075326:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330283.075328:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1715330283.075331:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe880/0xd895711d66d67b4 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xb9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d67bb expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.075334:0:7135:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe880/0xd895711d66d67b4 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xb9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d67bb expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330283.075339:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0xb9:0x0] 00000004:00010000:1.0:1715330283.075341:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008d79b480 reply state ffff880091c44000 transno 4294983328 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66d67a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14f6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.075344:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66d67a6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x14f6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.075347:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14f6:0x0].0x0 (ffff880092d89200) 00010000:00010000:1.0:1715330283.075349:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330283.075349:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1715330283.075352:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x14f6:0x0]: returning size 4096 00010000:00010000:1.0:1715330283.075355:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d6798 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.075358:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d6798 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.075360:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d6798 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.075364:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d6798 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.075367:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfdf80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330283.075369:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d6798 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.075372:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d6798 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.075376:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff880092d89400) 00010000:00010000:1.0:1715330283.075377:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330283.075379:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d6798 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.075381:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d6798 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00000004:00010000:1.0:1715330283.075389:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008d79b480 reply state ffff880091c44000 transno 4294983328 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66d679f lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x664526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.075395:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66d679f lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x664526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.075397:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x664526f7 (ffff880092d89000) 00010000:00010000:1.0:1715330283.075398:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330283.075399:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00000100:00100000:1.0:1715330283.075441:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d79b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+15:16735:x1798653937992448:12345-192.168.204.49@tcp:36:lfs.0 Request processed in 2179us (3678us total) trans 4294983328 rc 0/0 00000100:00100000:1.0:1715330283.075445:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23058 00000100:00100000:1.0:1715330283.085211:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937992576 00000100:00100000:1.0:1715330283.085220:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937992576 00000100:00100000:1.0:1715330283.085271:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23059 00000100:00100000:1.0:1715330283.085279:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d79aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+15:16736:x1798653937992576:12345-192.168.204.49@tcp:36:mkdir.0 00000100:00100000:1.0:1715330283.085435:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d79aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+15:16736:x1798653937992576:12345-192.168.204.49@tcp:36:mkdir.0 Request processed in 155us (332us total) trans 0 rc -17/-17 00000100:00100000:1.0:1715330283.085441:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23059 00000100:00100000:1.0:1715330283.094786:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937992640 00000100:00100000:1.0:1715330283.094795:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937992640 00000100:00100000:1.0:1715330283.094846:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23060 00000100:00100000:1.0:1715330283.094853:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+15:16737:x1798653937992640:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:1.0:1715330283.094871:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330283.094890:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d67c2 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb08f expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.095203:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d67c9 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.095218:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d67c9 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.095226:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d67c9 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.095265:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66d67d0 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x664526f7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.095270:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66d67d0 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x664526f7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.095275:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66d67d0 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x664526f7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.096106:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc000/0xd895711d66d67d7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x14f6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.096114:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc000/0xd895711d66d67d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14f6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.096121:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc000/0xd895711d66d67d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14f6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00200000:1.0:1715330283.096319:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x14f6:0x0]: returning size 4096 00000004:00200000:1.0:1715330283.096324:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1715330283.096343:0:7135:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc000/0xd895711d66d67d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14f6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.096352:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d67c9 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.096356:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d67c9 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.096364:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d67c9 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.096369:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d67c9 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.096373:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfdf80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330283.096377:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d67c9 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.096383:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d67c9 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.096391:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88008b233e00) 00010000:00010000:1.0:1715330283.096393:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330283.096396:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d67c9 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.096401:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d67c9 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.096410:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66d67d0 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x664526f7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.096414:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66d67d0 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x664526f7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.096418:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66d67d0 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x664526f7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.096423:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bff600 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330283.096424:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66d67d0 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x664526f7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.096431:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66d67d0 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x664526f7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.096437:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x664526f7 (ffff880092d89000) 00010000:00010000:1.0:1715330283.096438:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330283.096441:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66d67d0 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x664526f7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.096445:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66d67d0 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x664526f7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.096466:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d67c2 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb08f expref: 17 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.096480:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc000/0xd895711d66d67d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x14f6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb08f expref: 16 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.096486:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14f6:0x0].0x0 (ffff880092d89200) 00010000:00010000:1.0:1715330283.096488:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1715330283.096490:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfc000, rc 0) 00000100:00100000:1.0:1715330283.096555:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+16:16737:x1798653937992640:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 1697us (1899us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.096561:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23060 00000100:00100000:1.0:1715330283.099937:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937992704 00000100:00100000:1.0:1715330283.099945:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937992704 00000100:00100000:1.0:1715330283.099984:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23061 00000100:00100000:1.0:1715330283.099991:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+16:16737:x1798653937992704:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:1.0:1715330283.100007:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330283.100022:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66d67de lrc: 2/0,0 mode: --/CR res: [0x200000400:0xb9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb096 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.100060:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d67e5 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xb9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.100067:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d67e5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xb9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.100074:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d67e5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xb9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00200000:1.0:1715330283.100108:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0xb9:0x0]: returning size 4096 00000004:00200000:1.0:1715330283.100111:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1715330283.100129:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66d67de lrc: 0/0,0 mode: --/CR res: [0x200000400:0xb9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb096 expref: 18 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.100139:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d67e5 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xb9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb096 expref: 17 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.100144:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xb9:0x0].0x0 (ffff880092d89700) 00010000:00010000:1.0:1715330283.100145:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1715330283.100148:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfc900, rc 0) 00000100:00100000:1.0:1715330283.100188:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:16737:x1798653937992704:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 198us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.100192:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23061 00000100:00100000:1.0:1715330283.102656:0:9413:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942384896 00000100:00100000:1.0:1715330283.102659:0:9413:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942384896 00000100:00100000:1.0:1715330283.102689:0:9413:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1043 00000100:00100000:1.0:1715330283.102692:0:9413:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801345a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:7134:x1798653942384896:12345-0@lo:104: 00010000:00010000:1.0:1715330283.102700:0:9413:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe880/0xd895711d66d67b4 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xb9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d67bb expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.102747:0:9413:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1715330283.102750:0:9413:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801345a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:7134:x1798653942384896:12345-0@lo:104: Request processed in 58us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.102754:0:9413:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1043 00010000:00010000:1.0:1715330283.102773:0:9415:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715330283.102777:0:9415:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe880/0xd895711d66d67b4 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xb9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d67bb expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.102781:0:9415:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfe880 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330283.102784:0:9415:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe880/0xd895711d66d67b4 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0xb9:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd895711d66d67bb expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330283.102788:0:9415:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe880/0xd895711d66d67b4 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0xb9:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd895711d66d67bb expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.102802:0:9415:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe880/0xd895711d66d67b4 lrc: 2/0,0 mode: --/PW res: [0x240000401:0xb9:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d67bb expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.102809:0:9415:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330283.102831:0:9415:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe880/0xd895711d66d67b4 lrc: 1/0,0 mode: --/PW res: [0x240000401:0xb9:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d67bb expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.102835:0:9415:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe880/0xd895711d66d67b4 lrc: 0/0,0 mode: --/PW res: [0x240000401:0xb9:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d67bb expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.102844:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330283.102844:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330283.102845:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1715330283.104352:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968279 is committed 00000001:00080000:1.0:1715330283.104379:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968278 is committed 00000020:00080000:1.0:1715330283.104387:0:8267:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff88012f47ed80 refcount 2 committed 0 result 0 batchid 345 00000020:00080000:1.0:1715330283.104391:0:8267:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009ef25200 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff88012f47e6c0 00000020:00080000:1.0:1715330283.104394:0:8267:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].347 00000020:00080000:1.0:1715330283.104396:0:8267:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009ef25f00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88008d40a400 00000020:00080000:1.0:1715330283.104398:0:8267:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].346 00000020:00080000:1.0:1715330283.104417:0:8267:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff88008d667240 refcount 2 committed 0 result 0 batchid 344 00000020:00080000:1.0:1715330283.104420:0:8267:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88012ca48c00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff88008d667c00 00000020:00080000:1.0:1715330283.104422:0:8267:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].346 00000020:00080000:1.0:1715330283.104423:0:8267:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88012ca48900 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8800939ac000 00000020:00080000:1.0:1715330283.104425:0:8267:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].344 00000020:00080000:1.0:1715330283.104429:0:8267:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0001: 342 batchid updated 00000020:00080000:1.0:1715330283.104434:0:8267:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff880091ffcf00 refcount 2 committed 0 result 0 batchid 343 00000020:00080000:1.0:1715330283.104436:0:8267:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009b985c00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880091ffc900 00000020:00080000:1.0:1715330283.104438:0:8267:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].345 00000020:00080000:1.0:1715330283.104440:0:8267:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009b985500 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88011da7ec00 00000020:00080000:1.0:1715330283.104442:0:8267:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].343 00000020:00080000:1.0:1715330283.104447:0:8267:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0001: 341 batchid updated 00010000:00010000:0.0:1715330283.104592:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66880/0xd895711d66d65d1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x163:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.104597:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x163:0x0].0x0 (ffff88009b985600) 00010000:00010000:0.0:1715330283.104598:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.104617:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66880/0xd895711d66d65d1 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x163:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.104622:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66880/0xd895711d66d65d1 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x163:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.104634:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66f40/0xd895711d66d65d8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xb5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.104639:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66f40/0xd895711d66d65d8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xb5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.104643:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66f40/0xd895711d66d65d8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xb5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.104647:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66f40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330283.104649:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66f40/0xd895711d66d65d8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xb5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.104654:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66f40/0xd895711d66d65d8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xb5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.104659:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xb5:0x0].0x0 (ffff88009b985200) 00010000:00010000:0.0:1715330283.104661:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.104663:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66f40/0xd895711d66d65d8 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xb5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.104667:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66f40/0xd895711d66d65d8 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xb5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.104676:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d662c lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x664526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.104681:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d662c lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x664526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.104685:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d662c lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x664526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.104688:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfc6c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330283.104690:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d662c lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x664526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.104693:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d662c lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x664526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.104697:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x664526f4 (ffff88009b985100) 00010000:00010000:0.0:1715330283.104699:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.104700:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d662c lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x664526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.104703:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d662c lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x664526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.104713:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d66f0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x664526f6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330283.104717:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d66f0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x664526f6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330283.104721:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d66f0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x664526f6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330283.104724:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfdd40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330283.104726:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d66f0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x664526f6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330283.104753:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d66f0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x664526f6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330283.104759:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x664526f6 (ffff88009ef25a00) 00010000:00010000:0.0:1715330283.104760:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.104762:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d66f0 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x664526f6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330283.104767:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d66f0 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x664526f6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330283.104775:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffcc0/0xd895711d66d66f7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x165:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00000004:00080000:1.0:1715330283.104776:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 662 rpc_version 662 00010000:00010000:0.0:1715330283.104779:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffcc0/0xd895711d66d66f7 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x165:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330283.104783:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffcc0/0xd895711d66d66f7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x165:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330283.104786:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bffcc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330283.104788:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffcc0/0xd895711d66d66f7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x165:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330283.104792:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffcc0/0xd895711d66d66f7 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x165:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00000020:00100000:1.0:1715330283.104793:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:0.0:1715330283.104797:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x165:0x0].0x0 (ffff88009ef25500) 00000100:00100000:1.0:1715330283.104799:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012fa87480 x1798653942385088/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:0.0:1715330283.104799:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.104801:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffcc0/0xd895711d66d66f7 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x165:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330283.104805:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffcc0/0xd895711d66d66f7 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x165:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00000100:00100000:1.0:1715330283.104813:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa87480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942385088:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1715330283.104815:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d66fe lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330283.104818:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d66fe lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330283.104822:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d66fe lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330283.104825:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfed00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330283.104827:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d66fe lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330283.104830:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d66fe lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330283.104834:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xb6:0x0].0x0 (ffff88009ef25b00) 00010000:00010000:0.0:1715330283.104836:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.104838:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d66fe lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330283.104841:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d66fe lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00000100:00100000:1.0:1715330283.104843:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1715330283.104851:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66ac0/0xd895711d66d6752 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x664526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00000100:00100000:1.0:1715330283.104853:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47e9c0 going to sleep for 11 seconds 00010000:00010000:0.0:1715330283.104855:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66ac0/0xd895711d66d6752 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x664526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.104859:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66ac0/0xd895711d66d6752 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x664526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.104862:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66ac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330283.104865:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66ac0/0xd895711d66d6752 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x664526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.104868:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66ac0/0xd895711d66d6752 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x664526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.104874:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x664526f6 (ffff88009ef25a00) 00010000:00010000:0.0:1715330283.104875:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.104877:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66ac0/0xd895711d66d6752 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x664526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.104881:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66ac0/0xd895711d66d6752 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x664526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00000100:00100000:0.0:1715330283.104898:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942385088 00000100:00100000:0.0:1715330283.104902:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942385088 00000100:00100000:0.0:1715330283.104922:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2094 00000100:00100000:0.0:1715330283.104927:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:8278:x1798653942385088:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1715330283.104998:0:7134:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d67f3 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xb9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.105005:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d67f3 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xb9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00000100:00100000:0.0:1715330283.105016:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:8278:x1798653942385088:12345-0@lo:1000:osp_up0-1.0 Request processed in 89us (172us total) trans 4294983329 rc 0/0 00000100:00100000:0.0:1715330283.105021:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2094 00000100:00100000:1.0:1715330283.105038:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa87480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942385088:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1715330283.105043:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 663 rpc_version 663 00000020:00100000:1.0:1715330283.105051:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1715330283.105054:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012fa87800 x1798653942385216/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1715330283.105063:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa87800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942385216:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1715330283.105078:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.105085:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.105092:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942385216 00000100:00100000:0.0:1715330283.105095:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942385216 00000100:00100000:0.0:1715330283.105107:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2095 00000004:00200000:1.0:1715330283.105110:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000401:0xb9:0x0]: returning size 4096 00000100:00100000:0.0:1715330283.105111:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:8278:x1798653942385216:12345-0@lo:1000:osp_up0-1.0 00000004:00200000:1.0:1715330283.105114:0:7134:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1715330283.105144:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1f80/0xd895711d66d67ec lrc: 0/0,0 mode: --/CR res: [0x240000401:0xb9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb09d expref: 9 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.105155:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d67f3 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xb9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb09d expref: 8 pid: 7134 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330283.105160:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:8278:x1798653942385216:12345-0@lo:1000:osp_up0-1.0 Request processed in 48us (80us total) trans 4294983330 rc 0/0 00010000:00010000:1.0:1715330283.105161:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xb9:0x0].0x0 (ffff88008d699900) 00010000:00010000:1.0:1715330283.105162:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1715330283.105164:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f1d40, rc 0) 00000100:00100000:0.0:1715330283.105165:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2095 00000100:00100000:1.0:1715330283.105192:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d79b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+8:16737:x1798653937992768:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 2958us (3217us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.105197:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23062 00000100:00100000:1.0:1715330283.108632:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937992896 00000100:00100000:1.0:1715330283.108643:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937992896 00000100:00100000:1.0:1715330283.108792:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23063 00000100:00100000:1.0:1715330283.108799:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+17:16737:x1798653937992896:12345-192.168.204.49@tcp:36:rmdir.0 00010000:00010000:1.0:1715330283.108839:0:7134:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330283.108865:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc000/0xd895711d66d67d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x14f6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb08f expref: 17 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.108880:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14f6:0x0].0x0 (ffff880092d89200) 00010000:00010000:1.0:1715330283.108884:0:7134:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330283.108906:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d67fa lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.108915:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d67fa lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.108923:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d67fa lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.108931:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d6801 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x664526f7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.108937:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d6801 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x664526f7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.108942:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d6801 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x664526f7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.109000:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcb40/0xd895711d66d6808 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14f6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.109006:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcb40/0xd895711d66d6808 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14f6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.109011:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcb40/0xd895711d66d6808 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14f6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.109024:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d680f lrc: 3/0,1 mode: --/EX res: [0x200000400:0xb9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.109030:0:7134:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d67e5 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xb9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb096 expref: 16 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.109036:0:7134:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d680f lrc: 4/0,1 mode: --/EX res: [0x200000400:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.109059:0:7134:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d67e5 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xb9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb096 expref: 16 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.109070:0:7134:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d67e5 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xb9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb096 expref: 16 pid: 7135 timeout: 357 lvb_type: 0 00000100:00100000:1.0:1715330283.109081:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d61ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7134:1798653942385280:192.168.204.49@tcp:104: 00000100:00100000:1.0:1715330283.109135:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.111488:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d61ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7134:1798653942385280:192.168.204.49@tcp:104: 00010000:00010000:1.0:1715330283.111507:0:7134:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d680f lrc: 3/0,1 mode: --/EX res: [0x200000400:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000100:00100000:0.0:1715330283.111877:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00010000:00010000:1.0:1715330283.112201:0:7134:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d680f lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.112208:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d680f lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.112236:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc240/0xd895711d66d6816 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xb9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.112245:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc240/0xd895711d66d6816 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.112253:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc240/0xd895711d66d6816 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT0 00000100:00100000:1.0:1715330283.112267:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d61ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942385344:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1715330283.112293:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.112315:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.112390:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942385344 00000100:00100000:0.0:1715330283.112394:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942385344 00000100:00100000:0.0:1715330283.112414:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2096 00000100:00100000:0.0:1715330283.112419:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d618a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:7134:x1798653942385344:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330283.112430:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330283.112441:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f21c0/0xd895711d66d681d lrc: 2/0,0 mode: --/EX res: [0x240000401:0xb9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d6816 expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.112454:0:9407:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d67f3 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0xb9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb09d expref: 7 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.112461:0:9407:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f21c0/0xd895711d66d681d lrc: 4/0,0 mode: --/EX res: [0x240000401:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d6816 expref: 6 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.112477:0:9407:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d67f3 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xb9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb09d expref: 7 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.112486:0:9407:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d67f3 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xb9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb09d expref: 7 pid: 7134 timeout: 357 lvb_type: 0 00000100:00100000:0.0:1715330283.112494:0:9407:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801345a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:9407:1798653942385408:192.168.204.49@tcp:104: 00000100:00100000:0.0:1715330283.112519:0:9407:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa180 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.114107:0:9407:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801345a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:9407:1798653942385408:192.168.204.49@tcp:104: 00010000:00010000:1.0:1715330283.114125:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f21c0/0xd895711d66d681d lrc: 3/0,0 mode: --/EX res: [0x240000401:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6816 expref: 6 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.114133:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xb9:0x0].0x0 (ffff88008d699900) 00010000:00010000:1.0:1715330283.114135:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330283.114137:0:9407:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f21c0/0xd895711d66d681d lrc: 3/0,0 mode: --/EX res: [0x240000401:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6816 expref: 6 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.114144:0:9407:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f21c0/0xd895711d66d681d lrc: 3/0,0 mode: --/EX res: [0x240000401:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6816 expref: 6 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.114149:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f21c0, rc 0) 00000100:00100000:0.0:1715330283.114318:0:7134:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968279 gen 2 00000004:00080000:0.0:1715330283.114324:0:7134:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968271 committed transno 4294968279 00000020:00080000:0.0:1715330283.114328:0:7134:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff880091ffaf00 refcount 2 committed 0 result 0 batchid 338 00000020:00080000:0.0:1715330283.114332:0:7134:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009d434700 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff880091ffacc0 00000020:00080000:0.0:1715330283.114334:0:7134:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].324 00000020:00080000:0.0:1715330283.114336:0:7134:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009d434f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88011dad5400 00000020:00080000:0.0:1715330283.114338:0:7134:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].325 00000004:00080000:0.0:1715330283.114364:0:7134:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968273 committed transno 4294968279 00000004:00080000:0.0:1715330283.114375:0:7134:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968274 committed transno 4294968279 00000004:00080000:0.0:1715330283.114388:0:7134:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968277 committed transno 4294968279 00000100:00100000:1.0:1715330283.114642:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d618a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7134:x1798653942385344:12345-0@lo:101:mdt00_001.0 Request processed in 2221us (2346us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.114649:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2096 00000004:00080000:0.0:1715330283.114686:0:7134:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968279 committed transno 4294968279 00000100:00100000:0.0:1715330283.114704:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d61ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942385344:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330283.114716:0:7134:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc240/0xd895711d66d6816 lrc: 4/0,1 mode: --/EX res: [0x240000401:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d681d expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.114722:0:7134:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc240/0xd895711d66d6816 lrc: 4/0,1 mode: --/EX res: [0x240000401:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d681d expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330283.114753:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937993024 00000100:00100000:0.0:1715330283.114757:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937993024 00010000:00010000:0.0:1715330283.114770:0:7122:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d67f3 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xb9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb09d expref: 8 pid: 7134 timeout: 357 lvb_type: 0 00000100:00100000:0.0:1715330283.114791:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1374 00000100:00100000:0.0:1715330283.114796:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d798700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72de1896-1df4-4b3a-930a-9116d2c66168+8:2011:x1798653937993024:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1715330283.114805:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330283.114808:0:7122:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d67f3 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xb9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb09d expref: 8 pid: 7134 timeout: 357 lvb_type: 0 00010000:00010000:0.0:1715330283.114816:0:7122:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d67f3 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xb9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb09d expref: 8 pid: 7134 timeout: 357 lvb_type: 0 00010000:00010000:0.0:1715330283.114830:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d67f3 lrc: 0/0,0 mode: --/PR res: [0x240000401:0xb9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb09d expref: 8 pid: 7134 timeout: 357 lvb_type: 0 00010000:00010000:0.0:1715330283.114971:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xb9:0x0].0x0 (ffff88008d699900) 00010000:00010000:0.0:1715330283.114976:0:7122:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f21c0/0xd895711d66d681d lrc: 2/0,0 mode: --/EX res: [0x240000401:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6816 expref: 5 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.114983:0:7122:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f21c0/0xd895711d66d681d lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d6816 expref: 5 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.114989:0:7122:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f21c0/0xd895711d66d681d lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d6816 expref: 5 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.115010:0:7122:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f21c0/0xd895711d66d681d lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6816 expref: 5 pid: 9407 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330283.115018:0:7122:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801345a6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:7122:1798653942385472:0@lo:105: 00000100:00100000:0.0:1715330283.115040:0:7122:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.115062:0:7122:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffacc0 going to sleep for 11 seconds 00010000:00010000:0.0:1715330283.115234:0:7134:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc240/0xd895711d66d6816 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d681d expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.115240:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc240/0xd895711d66d6816 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d681d expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330283.115287:0:7122:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801345a6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:7122:1798653942385472:0@lo:105: 00010000:00010000:1.0:1715330283.115294:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330283.115322:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d798700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72de1896-1df4-4b3a-930a-9116d2c66168+7:2011:x1798653937993024:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 525us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.115328:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1374 00000100:00100000:0.0:1715330283.115794:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801345a6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942385536:0@lo:403:mdt00_001.0 00000100:00100000:0.0:1715330283.115825:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.115833:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffae40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.115841:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942385536 00000100:00100000:1.0:1715330283.115844:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942385536 00000100:00100000:1.0:1715330283.115864:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2097 00000100:00100000:1.0:1715330283.115868:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801345a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7134:x1798653942385536:12345-0@lo:403:mdt00_001.0 00000100:00100000:1.0:1715330283.117296:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801345a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7134:x1798653942385536:12345-0@lo:403:mdt00_001.0 Request processed in 1424us (1471us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.117304:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2097 00000100:00100000:0.0:1715330283.117340:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801345a6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942385536:0@lo:403:mdt00_001.0 00000040:00080000:0.0:1715330283.118410:0:7134:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].327, 664 off503800 00000040:00080000:0.0:1715330283.118528:0:7134:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].326, 744 off540880 00000004:00080000:0.0:1715330283.118532:0:7134:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880091ffae40 with version 621 00000100:00100000:1.0:1715330283.118785:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942385664 00000100:00100000:1.0:1715330283.118789:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942385664 00000100:00100000:1.0:1715330283.118816:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2098 00000100:00100000:1.0:1715330283.118821:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:8587:x1798653942385664:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330283.119077:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:8587:x1798653942385664:12345-0@lo:1000:osp_up1-0.0 Request processed in 254us (412us total) trans 4294968280 rc 0/0 00000100:00100000:1.0:1715330283.119084:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2098 00000004:00200000:0.0:1715330283.119195:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x14f6:0x0]: returning size 4096 00010000:00010000:0.0:1715330283.119331:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d680f lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.119339:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d680f lrc: 2/0,0 mode: EX/EX res: [0x200000400:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.119345:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d680f lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.119349:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfef40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330283.119353:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d680f lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.119359:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d680f lrc: 4/0,0 mode: EX/EX res: [0x200000400:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.119375:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xb9:0x0].0x0 (ffff880092d89700) 00010000:00010000:0.0:1715330283.119378:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715330283.119381:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d680f lrc: 2/0,0 mode: --/EX res: [0x200000400:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.119386:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d680f lrc: 0/0,0 mode: --/EX res: [0x200000400:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.119396:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc240/0xd895711d66d6816 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d681d expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.119401:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc240/0xd895711d66d6816 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d681d expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.119406:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc240/0xd895711d66d6816 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d681d expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.119428:0:7134:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1715330283.119434:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0xb9:0x0] 00010000:00010000:0.0:1715330283.119439:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcb40/0xd895711d66d6808 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14f6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.119444:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcb40/0xd895711d66d6808 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x14f6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.119449:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcb40/0xd895711d66d6808 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14f6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.119457:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfcb40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330283.119460:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcb40/0xd895711d66d6808 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14f6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.119477:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcb40/0xd895711d66d6808 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x14f6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.119484:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14f6:0x0].0x0 (ffff880092d89200) 00010000:00010000:0.0:1715330283.119486:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715330283.119488:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcb40/0xd895711d66d6808 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x14f6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.119492:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcb40/0xd895711d66d6808 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x14f6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.119598:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d67fa lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.119663:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715330283.119669:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc240/0xd895711d66d6816 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d681d expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.119676:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfc240 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330283.119680:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc240/0xd895711d66d6816 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d681d expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330283.119692:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc240/0xd895711d66d6816 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d681d expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.119711:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc240/0xd895711d66d6816 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d681d expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.119718:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330283.119762:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc240/0xd895711d66d6816 lrc: 1/0,0 mode: --/EX res: [0x240000401:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d681d expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.119767:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc240/0xd895711d66d6816 lrc: 0/0,0 mode: --/EX res: [0x240000401:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d681d expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.119782:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330283.119783:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330283.119785:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330283.119929:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942385728 00000100:00100000:1.0:1715330283.119933:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942385728 00000100:00100000:1.0:1715330283.119965:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1170 00000100:00100000:1.0:1715330283.119970:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d798e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+7:3691:x1798653942385728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330283.119978:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330283.119988:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f21c0/0xd895711d66d681d lrc: 0/0,0 mode: --/EX res: [0x240000401:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d6816 expref: 7 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.119997:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xb9:0x0].0x0 (ffff88008d699900) 00010000:00010000:1.0:1715330283.120003:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330283.120032:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d798e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+6:3691:x1798653942385728:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.120038:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1170 00010000:00010000:0.0:1715330283.120838:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d67fa lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.120845:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d67fa lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.120850:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d67fa lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.120855:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfcfc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330283.120857:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d67fa lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.120863:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d67fa lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.120871:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88009bbf0300) 00010000:00010000:0.0:1715330283.120873:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.120876:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d67fa lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.120880:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d67fa lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00000004:00010000:0.0:1715330283.120893:0:7134:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008d799f80 reply state ffff8800939e3000 transno 4294983331 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d6801 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x664526f7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.120901:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d6801 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x664526f7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.120906:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x664526f7 (ffff880092d89000) 00010000:00010000:0.0:1715330283.120908:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330283.120910:0:7134:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1715330283.120964:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+17:16737:x1798653937992896:12345-192.168.204.49@tcp:36:rmdir.0 Request processed in 12164us (12633us total) trans 4294983331 rc 0/0 00000100:00100000:0.0:1715330283.120970:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23063 00000100:00100000:1.0:1715330283.130884:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937993088 00000100:00100000:1.0:1715330283.130893:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937993088 00000100:00100000:1.0:1715330283.130932:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23064 00000100:00100000:1.0:1715330283.130939:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+7:16738:x1798653937993088:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:1.0:1715330283.130956:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330283.130971:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d6824 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb0a4 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.131019:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff840/0xd895711d66d682b lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.131029:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff840/0xd895711d66d682b lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.131037:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff840/0xd895711d66d682b lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.131047:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d6832 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x664526f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.131052:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d6832 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x664526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.131056:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d6832 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x664526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.131088:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff840/0xd895711d66d682b lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.131093:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff840/0xd895711d66d682b lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.131103:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff840/0xd895711d66d682b lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.131107:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff840/0xd895711d66d682b lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.131112:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bff840 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330283.131115:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff840/0xd895711d66d682b lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.131120:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff840/0xd895711d66d682b lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.131130:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff880092d89900) 00010000:00010000:1.0:1715330283.131132:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330283.131136:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff840/0xd895711d66d682b lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.131140:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff840/0xd895711d66d682b lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.131150:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d6832 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x664526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.131154:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d6832 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x664526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.131159:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d6832 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x664526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.131163:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bff3c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330283.131165:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d6832 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x664526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.131169:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d6832 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x664526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.131175:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x664526f8 (ffff88009bbf0600) 00010000:00010000:1.0:1715330283.131176:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330283.131178:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d6832 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x664526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.131182:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d6832 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x664526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.131207:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d6824 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb0a4 expref: 8 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.131213:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d6824 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb0a4 expref: 8 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.131221:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bffa80, rc 0) 00000100:00100000:1.0:1715330283.131269:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+7:16738:x1798653937993088:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 329us (1210us total) trans 0 rc 301/301 00000100:00100000:1.0:1715330283.131276:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23064 00000100:00100000:1.0:1715330283.134702:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937993152 00000100:00100000:1.0:1715330283.134709:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937993152 00000100:00100000:1.0:1715330283.134752:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23065 00000100:00100000:1.0:1715330283.134759:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+17:16738:x1798653937993152:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:1.0:1715330283.134775:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330283.134791:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d6839 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb0ab expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.134828:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe400/0xd895711d66d6840 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.134838:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe400/0xd895711d66d6840 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.134846:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe400/0xd895711d66d6840 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000004:00200000:1.0:1715330283.134879:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1715330283.135211:0:7134:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1715330283.135324:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d6839 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb0ab expref: 19 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.135337:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe400/0xd895711d66d6840 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb0ab expref: 18 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.135343:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88009bbf0f00) 00010000:00010000:1.0:1715330283.135346:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1715330283.135348:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfe400, rc 0) 00000100:00100000:1.0:1715330283.135773:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+18:16738:x1798653937993152:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 1012us (1137us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.135779:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23065 00000100:00100000:1.0:1715330283.141587:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937993280 00000100:00100000:1.0:1715330283.141595:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937993280 00000100:00100000:1.0:1715330283.141641:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23066 00000100:00100000:1.0:1715330283.141648:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+7:16738:x1798653937993280:12345-192.168.204.49@tcp:36:lfs.0 00010000:00010000:1.0:1715330283.141690:0:7134:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330283.141711:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d6791 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb088 expref: 7 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.141724:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff880092d89900) 00010000:00010000:1.0:1715330283.141888:0:7134:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330283.141935:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d6847 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.141946:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d6847 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.141953:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d6847 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.141963:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd440/0xd895711d66d684e lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x664526f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.141968:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd440/0xd895711d66d684e lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x664526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.141972:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd440/0xd895711d66d684e lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x664526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00000040:00080000:1.0:1715330283.142839:0:7134:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].348, 2168 off529288 00000040:00080000:1.0:1715330283.142899:0:7134:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].349, 2368 off578096 00000004:00080000:1.0:1715330283.142903:0:7134:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88012f47ecc0 with version 664 00000100:00100000:1.0:1715330283.143596:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942385856 00000100:00100000:1.0:1715330283.143609:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942385856 00000100:00100000:1.0:1715330283.143676:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2099 00000100:00100000:1.0:1715330283.143681:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:8278:x1798653942385856:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1715330283.144511:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:8278:x1798653942385856:12345-0@lo:1000:osp_up0-1.0 Request processed in 827us (978us total) trans 4294983332 rc 0/0 00000100:00100000:1.0:1715330283.144518:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2099 00010000:00010000:1.0:1715330283.144935:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d6855 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x167:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.144945:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d6855 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x167:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.144953:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d6855 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x167:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.144965:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d685c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.144974:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d685c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.144978:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d685c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.144999:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcb40/0xd895711d66d6863 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.145004:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcb40/0xd895711d66d6863 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.145010:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcb40/0xd895711d66d6863 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT1 00000100:00100000:1.0:1715330283.145020:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d61bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942385920:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1715330283.145042:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.145051:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435180 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.145128:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942385920 00000100:00100000:0.0:1715330283.145132:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942385920 00000100:00100000:0.0:1715330283.145150:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2100 00000100:00100000:0.0:1715330283.145155:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d619880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7134:x1798653942385920:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330283.145166:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330283.145177:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d686a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d6863 expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.145190:0:9407:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d686a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d6863 expref: 10 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.145197:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d686a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6863 expref: 10 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.145203:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb7:0x0].0x0 (ffff88009d434200) 00010000:00010000:0.0:1715330283.145206:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.145208:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f06c0, rc 0) 00000100:00100000:0.0:1715330283.145229:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d619880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:7134:x1798653942385920:12345-0@lo:101:mdt00_001.0 Request processed in 74us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.145233:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2100 00000100:00100000:1.0:1715330283.145286:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d61bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942385920:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330283.145294:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcb40/0xd895711d66d6863 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d686a expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.145301:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcb40/0xd895711d66d6863 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d686a expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330283.145313:0:7134:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012faee680 reply state ffff8800939e4000 transno 4294968281 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d685c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.145320:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d685c lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xb7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.145324:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xb7:0x0].0x0 (ffff88009bbf0c00) 00010000:00010000:1.0:1715330283.145327:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330283.145329:0:7134:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1715330283.145333:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcb40/0xd895711d66d6863 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d686a expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.145338:0:7134:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcb40/0xd895711d66d6863 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d686a expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330283.145345:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000401:0xb7:0x0] 00000004:00010000:1.0:1715330283.145348:0:7134:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012faee680 reply state ffff8800939e4000 transno 4294968281 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d6855 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x167:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.145352:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d6855 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x167:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.145356:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x167:0x0].0x0 (ffff88009bbf0d00) 00010000:00010000:1.0:1715330283.145358:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330283.145359:0:7134:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1715330283.145362:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x167:0x0]: returning size 4096 00010000:00010000:1.0:1715330283.145368:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d6847 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.145372:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d6847 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.145376:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d6847 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.145381:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d6847 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.145385:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfdb00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330283.145387:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d6847 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.145396:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d6847 lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.145402:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88009bbf0500) 00010000:00010000:1.0:1715330283.145404:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330283.145406:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d6847 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.145410:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d6847 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00000004:00010000:1.0:1715330283.145421:0:7134:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012faee680 reply state ffff8800939e4000 transno 4294968281 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd440/0xd895711d66d684e lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x664526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.145426:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd440/0xd895711d66d684e lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x664526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.145429:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x664526f8 (ffff88009bbf0900) 00010000:00010000:1.0:1715330283.145430:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330283.145432:0:7134:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00000100:00100000:1.0:1715330283.145708:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+8:16738:x1798653937993280:12345-192.168.204.49@tcp:36:lfs.0 Request processed in 4058us (4175us total) trans 4294968281 rc 0/0 00000100:00100000:1.0:1715330283.145714:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23066 00000100:00100000:0.0:1715330283.152599:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937993408 00000100:00100000:0.0:1715330283.152616:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937993408 00000100:00100000:0.0:1715330283.152652:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23067 00000100:00100000:0.0:1715330283.152659:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+8:16739:x1798653937993408:12345-192.168.204.49@tcp:36:mkdir.0 00000100:00100000:0.0:1715330283.152829:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+8:16739:x1798653937993408:12345-192.168.204.49@tcp:36:mkdir.0 Request processed in 169us (300us total) trans 0 rc -17/-17 00000100:00100000:0.0:1715330283.152835:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23067 00000100:00100000:0.0:1715330283.159846:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330283.166569:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937993536 00000100:00100000:0.0:1715330283.166576:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937993536 00000100:00100000:0.0:1715330283.166621:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23069 00000100:00100000:0.0:1715330283.166627:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d79a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+9:16740:x1798653937993536:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:0.0:1715330283.166642:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330283.166657:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d688d lrc: 2/0,0 mode: --/CR res: [0x240000400:0xb7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb0b9 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.166698:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3840/0xd895711d66d6894 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.166708:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3840/0xd895711d66d6894 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.166716:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3840/0xd895711d66d6894 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00000004:00200000:0.0:1715330283.166787:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000400:0xb7:0x0]: returning size 4096 00000004:00200000:0.0:1715330283.166791:0:7134:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1715330283.166879:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d688d lrc: 0/0,0 mode: --/CR res: [0x240000400:0xb7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb0b9 expref: 11 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.166892:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3840/0xd895711d66d6894 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb0b9 expref: 10 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.166899:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xb7:0x0].0x0 (ffff88009bbf0c00) 00010000:00010000:0.0:1715330283.166901:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1715330283.166903:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f3840, rc 0) 00000100:00100000:0.0:1715330283.166944:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d79a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+10:16740:x1798653937993536:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 317us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.166950:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23069 00000100:00100000:0.0:1715330283.169049:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937993600 00000100:00100000:0.0:1715330283.169054:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937993600 00000100:00100000:0.0:1715330283.169081:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23070 00000100:00100000:0.0:1715330283.169085:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+18:16740:x1798653937993600:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:0.0:1715330283.169095:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330283.169105:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1b00/0xd895711d66d689b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb0c0 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.169132:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d68a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.169138:0:7134:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d686a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6863 expref: 9 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.169142:0:7134:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d68a2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.169161:0:7134:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d686a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd895711d66d6863 expref: 9 pid: 9407 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330283.169170:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801345a6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7134:1798653942385984:0@lo:104: 00000100:00100000:0.0:1715330283.169195:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.169206:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa540 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.169887:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801345a6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7134:1798653942385984:0@lo:104: 00010000:00010000:0.0:1715330283.169902:0:7134:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d68a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.170718:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66d679f lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x664526f7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330283.170725:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66d679f lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x664526f7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330283.170742:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66d679f lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x664526f7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330283.170747:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfeac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330283.170751:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66d679f lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x664526f7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330283.170756:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66d679f lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x664526f7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330283.170766:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x664526f7 (ffff880092d89000) 00010000:00010000:0.0:1715330283.170768:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.170771:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66d679f lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x664526f7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330283.170774:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66d679f lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x664526f7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330283.170781:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66d67a6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x14f6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330283.170786:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66d67a6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x14f6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330283.170790:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66d67a6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x14f6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330283.170793:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfd680 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330283.170796:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66d67a6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x14f6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330283.170799:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66d67a6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x14f6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330283.170804:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14f6:0x0].0x0 (ffff880092d89200) 00010000:00010000:0.0:1715330283.170806:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.170808:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66d67a6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x14f6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330283.170812:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66d67a6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x14f6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330283.170821:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66d67ad lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xb9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.170847:0:7134:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d68a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.170853:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d68a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000004:00200000:1.0:1715330283.170885:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xb7:0x0]: returning size 4096 00000004:00200000:1.0:1715330283.170888:0:7134:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1715330283.170913:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1b00/0xd895711d66d689b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb0c0 expref: 18 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.170923:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d68a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb0c0 expref: 17 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.170928:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb7:0x0].0x0 (ffff88009d434200) 00010000:00010000:1.0:1715330283.170930:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1715330283.170931:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f3a80, rc 0) 00000100:00100000:1.0:1715330283.170962:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+17:16740:x1798653937993600:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 1875us (1959us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.170968:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23070 00010000:00010000:0.0:1715330283.171011:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66d67ad lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xb9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330283.171015:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66d67ad lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xb9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330283.171019:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfe640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330283.171021:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66d67ad lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xb9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330283.171025:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66d67ad lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xb9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330283.171030:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xb9:0x0].0x0 (ffff880092d89700) 00010000:00010000:0.0:1715330283.171032:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.171033:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66d67ad lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xb9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330283.171037:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66d67ad lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xb9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330283.171049:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d6801 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x664526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.171053:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d6801 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x664526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.171057:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d6801 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x664526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.171060:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfc480 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330283.171062:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d6801 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x664526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.171066:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d6801 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x664526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.171072:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x664526f7 (ffff880092d89000) 00010000:00010000:0.0:1715330283.171073:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.171075:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d6801 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x664526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.171078:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d6801 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x664526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00000100:00100000:0.0:1715330283.171148:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d79ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942386048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330283.171322:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942386176 00000100:00100000:1.0:1715330283.171329:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942386176 00000100:00100000:1.0:1715330283.171349:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2101 00000100:00100000:1.0:1715330283.171353:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f579500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:8587:x1798653942386176:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330283.171435:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f579500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:8587:x1798653942386176:12345-0@lo:1000:osp_up1-0.0 Request processed in 80us (147us total) trans 4294968282 rc 0/0 00000100:00100000:1.0:1715330283.171440:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2101 00000100:00100000:1.0:1715330283.176399:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937993728 00000100:00100000:1.0:1715330283.176410:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937993728 00000100:00100000:1.0:1715330283.176560:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23071 00000100:00100000:1.0:1715330283.176567:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f579180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+10:16740:x1798653937993728:12345-192.168.204.49@tcp:36:rmdir.0 00010000:00010000:1.0:1715330283.176620:0:7134:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330283.176640:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457cd80/0xd895711d66d6886 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x167:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb0b2 expref: 10 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.176655:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x167:0x0].0x0 (ffff88009bbf0d00) 00010000:00010000:1.0:1715330283.176659:0:7134:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330283.177291:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfef40/0xd895711d66d68a9 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.177302:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfef40/0xd895711d66d68a9 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.177310:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfef40/0xd895711d66d68a9 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.177320:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc900/0xd895711d66d68b0 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x664526f8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.177326:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc900/0xd895711d66d68b0 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x664526f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.177331:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc900/0xd895711d66d68b0 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x664526f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.177386:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc000/0xd895711d66d68b7 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x167:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.177391:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc000/0xd895711d66d68b7 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x167:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.177396:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc000/0xd895711d66d68b7 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x167:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.177408:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe880/0xd895711d66d68be lrc: 3/0,1 mode: --/EX res: [0x240000400:0xb7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.177415:0:7134:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3840/0xd895711d66d6894 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb0b9 expref: 9 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.177421:0:7134:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe880/0xd895711d66d68be lrc: 4/0,1 mode: --/EX res: [0x240000400:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.177446:0:7134:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3840/0xd895711d66d6894 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb0b9 expref: 9 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.177456:0:7134:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3840/0xd895711d66d6894 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb0b9 expref: 9 pid: 7134 timeout: 357 lvb_type: 0 00000100:00100000:1.0:1715330283.177468:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d61bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7134:1798653942386240:192.168.204.49@tcp:104: 00000100:00100000:1.0:1715330283.177525:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435180 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.179876:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d61bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7134:1798653942386240:192.168.204.49@tcp:104: 00010000:00010000:1.0:1715330283.179895:0:7134:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe880/0xd895711d66d68be lrc: 3/0,1 mode: --/EX res: [0x240000400:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.180211:0:7134:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe880/0xd895711d66d68be lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.180301:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe880/0xd895711d66d68be lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.180332:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfed00/0xd895711d66d68c5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.180337:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfed00/0xd895711d66d68c5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.180344:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfed00/0xd895711d66d68c5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT1 00000100:00100000:1.0:1715330283.180357:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d61bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942386304:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1715330283.180387:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.180410:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435180 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.180506:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942386304 00000100:00100000:0.0:1715330283.180509:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942386304 00000100:00100000:0.0:1715330283.180527:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2102 00000100:00100000:0.0:1715330283.180532:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d61ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:7134:x1798653942386304:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330283.180544:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330283.180556:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d68cc lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d68c5 expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.180570:0:9407:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d68a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb0c0 expref: 14 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.180580:0:9407:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d68cc lrc: 4/0,0 mode: --/EX res: [0x200000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d68c5 expref: 6 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.180595:0:9407:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d68a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb0c0 expref: 14 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.180913:0:9407:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d68a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb0c0 expref: 14 pid: 7134 timeout: 357 lvb_type: 0 00000100:00100000:0.0:1715330283.180922:0:9407:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801345a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:9407:1798653942386368:192.168.204.49@tcp:104: 00000100:00100000:0.0:1715330283.180957:0:9407:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa540 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.182952:0:9407:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801345a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:9407:1798653942386368:192.168.204.49@tcp:104: 00010000:00010000:0.0:1715330283.183099:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d68cc lrc: 3/0,0 mode: --/EX res: [0x200000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d68c5 expref: 6 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.183110:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb7:0x0].0x0 (ffff88009d434200) 00010000:00010000:0.0:1715330283.183113:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715330283.183116:0:9407:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d68cc lrc: 3/0,0 mode: --/EX res: [0x200000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d68c5 expref: 6 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.183123:0:9407:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d68cc lrc: 3/0,0 mode: --/EX res: [0x200000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d68c5 expref: 6 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.183129:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f21c0, rc 0) 00000100:00100000:0.0:1715330283.183187:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d61ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:7134:x1798653942386304:12345-0@lo:101:mdt00_001.0 Request processed in 2654us (2799us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.183194:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2102 00000100:00100000:1.0:1715330283.183277:0:7134:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983332 gen 2 00000004:00080000:1.0:1715330283.183283:0:7134:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983327 committed transno 4294983332 00000020:00080000:1.0:1715330283.183288:0:7134:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff88011db63480 refcount 2 committed 0 result 0 batchid 346 00000020:00080000:1.0:1715330283.183291:0:7134:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008d699a00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff88011db636c0 00000020:00080000:1.0:1715330283.183295:0:7134:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].348 00000020:00080000:1.0:1715330283.183297:0:7134:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008d699800 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88009d6a9400 00000020:00080000:1.0:1715330283.183299:0:7134:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].347 00000004:00080000:1.0:1715330283.183337:0:7134:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983329 committed transno 4294983332 00000004:00080000:1.0:1715330283.183350:0:7134:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983330 committed transno 4294983332 00000004:00080000:1.0:1715330283.183362:0:7134:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983332 committed transno 4294983332 00000100:00100000:1.0:1715330283.183379:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d61bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942386304:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330283.183393:0:7134:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfed00/0xd895711d66d68c5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d68cc expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.183402:0:7134:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfed00/0xd895711d66d68c5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d68cc expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330283.183641:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330283.184174:0:9413:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942386432 00000100:00100000:1.0:1715330283.184178:0:9413:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942386432 00000100:00100000:1.0:1715330283.184452:0:9413:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1046 00000100:00100000:1.0:1715330283.184457:0:9413:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d54e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:7121:x1798653942386432:12345-0@lo:105: 00010000:00010000:1.0:1715330283.184467:0:9413:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfed00/0xd895711d66d68c5 lrc: 5/0,1 mode: --/EX res: [0x200000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d68cc expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.184476:0:9413:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfed00/0xd895711d66d68c5 lrc: 5/0,1 mode: --/EX res: [0x200000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d68cc expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.184483:0:9413:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfed00/0xd895711d66d68c5 lrc: 5/0,1 mode: --/EX res: [0x200000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d68cc expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.184490:0:9413:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfed00/0xd895711d66d68c5 lrc: 5/0,1 mode: EX/EX res: [0x200000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d68cc expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.184496:0:9413:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfed00/0xd895711d66d68c5 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d68cc expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.184502:0:9413:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfed00/0xd895711d66d68c5 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d68cc expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.184522:0:9413:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff880093bfed00) 00010000:00010000:0.0:1715330283.184548:0:7134:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfed00/0xd895711d66d68c5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d68cc expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330283.184557:0:9413:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d54e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:7121:x1798653942386432:12345-0@lo:105: Request processed in 100us (421us total) trans 0 rc 0/0 00010000:00010000:0.0:1715330283.184558:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfed00/0xd895711d66d68c5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d68cc expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330283.184563:0:9413:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1046 00000100:00100000:0.0:1715330283.185643:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801345a6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942386496:0@lo:403:mdt00_001.0 00000100:00100000:0.0:1715330283.185690:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.185844:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa540 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.187673:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801345a6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942386496:0@lo:403:mdt00_001.0 00000040:00080000:0.0:1715330283.188552:0:7134:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].349, 664 off529952 00000040:00080000:0.0:1715330283.188695:0:7134:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].350, 744 off578840 00000004:00080000:0.0:1715330283.188699:0:7134:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff880091ffa540 with version 665 00000004:00200000:0.0:1715330283.189238:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x167:0x0]: returning size 4096 00010000:00010000:0.0:1715330283.189259:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe880/0xd895711d66d68be lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.189267:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe880/0xd895711d66d68be lrc: 2/0,0 mode: EX/EX res: [0x240000400:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.189274:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe880/0xd895711d66d68be lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.189280:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfe880 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330283.189283:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe880/0xd895711d66d68be lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.189289:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe880/0xd895711d66d68be lrc: 4/0,0 mode: EX/EX res: [0x240000400:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.189301:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xb7:0x0].0x0 (ffff88009bbf0c00) 00010000:00010000:0.0:1715330283.189305:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715330283.189308:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe880/0xd895711d66d68be lrc: 2/0,0 mode: --/EX res: [0x240000400:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.189313:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe880/0xd895711d66d68be lrc: 0/0,0 mode: --/EX res: [0x240000400:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.189325:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfed00/0xd895711d66d68c5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d68cc expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.189331:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfed00/0xd895711d66d68c5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d68cc expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.189337:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfed00/0xd895711d66d68c5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d68cc expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.189359:0:7134:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1715330283.189365:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000401:0xb7:0x0] 00010000:00010000:0.0:1715330283.189370:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc000/0xd895711d66d68b7 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x167:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.189375:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc000/0xd895711d66d68b7 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x167:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.189380:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc000/0xd895711d66d68b7 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x167:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.189384:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfc000 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330283.189386:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc000/0xd895711d66d68b7 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x167:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.189390:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc000/0xd895711d66d68b7 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x167:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.189400:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x167:0x0].0x0 (ffff88009bbf0d00) 00010000:00010000:0.0:1715330283.189402:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715330283.189405:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc000/0xd895711d66d68b7 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x167:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.189409:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc000/0xd895711d66d68b7 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x167:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.189512:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfef40/0xd895711d66d68a9 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.189517:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfef40/0xd895711d66d68a9 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.189521:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfef40/0xd895711d66d68a9 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.189526:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfef40/0xd895711d66d68a9 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.189529:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfef40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330283.189531:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfef40/0xd895711d66d68a9 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.189536:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfef40/0xd895711d66d68a9 lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.189542:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88009d5fae00) 00010000:00010000:0.0:1715330283.189543:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.189545:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfef40/0xd895711d66d68a9 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.189549:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfef40/0xd895711d66d68a9 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00000004:00010000:0.0:1715330283.189561:0:7134:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012f579180 reply state ffff88012fba7000 transno 4294968283 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc900/0xd895711d66d68b0 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x664526f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.189571:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc900/0xd895711d66d68b0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x664526f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.189577:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x664526f8 (ffff88009bbf0900) 00010000:00010000:0.0:1715330283.189579:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330283.189581:0:7134:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1715330283.189652:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f579180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+10:16740:x1798653937993728:12345-192.168.204.49@tcp:36:rmdir.0 Request processed in 13083us (13329us total) trans 4294968283 rc 0/0 00000100:00100000:0.0:1715330283.189659:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23071 00010000:00010000:1.0:1715330283.189715:0:9415:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715330283.189722:0:9415:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfed00/0xd895711d66d68c5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d68cc expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.189727:0:9415:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfed00 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330283.189745:0:9415:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfed00/0xd895711d66d68c5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d68cc expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330283.189752:0:9415:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfed00/0xd895711d66d68c5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d68cc expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.189773:0:9415:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfed00/0xd895711d66d68c5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d68cc expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.189778:0:9415:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330283.189801:0:9415:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfed00/0xd895711d66d68c5 lrc: 1/0,0 mode: --/EX res: [0x200000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d68cc expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.189807:0:9415:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfed00/0xd895711d66d68c5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d68cc expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.189819:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330283.189820:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330283.189821:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330283.199273:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330283.203878:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937993984 00000100:00100000:0.0:1715330283.203887:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937993984 00000100:00100000:0.0:1715330283.203928:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23073 00000100:00100000:0.0:1715330283.203934:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+10:16741:x1798653937993984:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:0.0:1715330283.203952:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330283.203967:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d68e8 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb0ce expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.204012:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1f80/0xd895711d66d68ef lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.204022:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1f80/0xd895711d66d68ef lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.204030:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1f80/0xd895711d66d68ef lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.204040:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2640/0xd895711d66d68f6 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x6f4526ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.204043:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2640/0xd895711d66d68f6 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.204045:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2640/0xd895711d66d68f6 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.204078:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1f80/0xd895711d66d68ef lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.204081:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1f80/0xd895711d66d68ef lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.204083:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1f80/0xd895711d66d68ef lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.204086:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1f80/0xd895711d66d68ef lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.204090:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f1f80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330283.204093:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1f80/0xd895711d66d68ef lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.204097:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1f80/0xd895711d66d68ef lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.204103:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88009d434800) 00010000:00010000:0.0:1715330283.204105:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.204107:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1f80/0xd895711d66d68ef lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.204110:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1f80/0xd895711d66d68ef lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.204131:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2640/0xd895711d66d68f6 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.204134:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2640/0xd895711d66d68f6 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.204138:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2640/0xd895711d66d68f6 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.204140:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f2640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330283.204141:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2640/0xd895711d66d68f6 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.204143:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2640/0xd895711d66d68f6 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.204146:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x6f4526ef (ffff88009d434000) 00010000:00010000:0.0:1715330283.204147:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.204148:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2640/0xd895711d66d68f6 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x6f4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.204150:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2640/0xd895711d66d68f6 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x6f4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.204167:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d68e8 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb0ce expref: 11 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.204171:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d68e8 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb0ce expref: 11 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.204176:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f1d40, rc 0) 00000100:00100000:0.0:1715330283.204220:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+10:16741:x1798653937993984:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 287us (394us total) trans 0 rc 301/301 00000100:00100000:0.0:1715330283.204226:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23073 00000100:00100000:0.0:1715330283.206274:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937994048 00000100:00100000:0.0:1715330283.206282:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937994048 00000100:00100000:0.0:1715330283.206322:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23074 00000100:00100000:0.0:1715330283.206329:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+10:16741:x1798653937994048:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:0.0:1715330283.206348:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330283.206364:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d68fd lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb0d5 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.206493:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0480/0xd895711d66d6904 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.206505:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0480/0xd895711d66d6904 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.206514:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0480/0xd895711d66d6904 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00000004:00200000:0.0:1715330283.206554:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000401:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1715330283.206558:0:7134:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1715330283.206585:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d68fd lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb0d5 expref: 12 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.206615:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0480/0xd895711d66d6904 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb0d5 expref: 11 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.206623:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88009d434400) 00010000:00010000:0.0:1715330283.206625:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1715330283.206627:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f0480, rc 0) 00000100:00100000:0.0:1715330283.206781:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+11:16741:x1798653937994048:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 451us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.206789:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23074 00000100:00100000:1.0:1715330283.211609:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330283.225069:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc78000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942387264:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330283.225135:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801345a4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942387328:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330283.225162:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.225173:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.225302:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801345a4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942387328:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330283.225339:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801345a4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942387392:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330283.225357:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.225366:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.225438:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801345a4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942387392:0@lo:1000:mdt00_001.0 00000040:00080000:0.0:1715330283.226128:0:7134:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].328, 2168 off505968 00000040:00080000:0.0:1715330283.226202:0:7134:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].327, 2368 off543248 00000004:00080000:0.0:1715330283.226206:0:7134:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880091ffa480 with version 623 00000100:00100000:0.0:1715330283.227136:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942387520 00000100:00100000:0.0:1715330283.227142:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942387520 00000100:00100000:0.0:1715330283.227187:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2114 00000100:00100000:0.0:1715330283.227192:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:8587:x1798653942387520:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330283.227990:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:8587:x1798653942387520:12345-0@lo:1000:osp_up1-0.0 Request processed in 795us (898us total) trans 4294968284 rc 0/0 00000100:00100000:0.0:1715330283.227997:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2114 00010000:00010000:0.0:1715330283.228809:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d6927 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x14f8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.228823:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d6927 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14f8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.228834:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d6927 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14f8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.228848:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d692e lrc: 3/0,1 mode: --/PW res: [0x200000400:0xba:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.228853:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d692e lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.228857:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d692e lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.228882:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f3cc0/0xd895711d66d6935 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xba:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.228888:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f3cc0/0xd895711d66d6935 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.228896:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f3cc0/0xd895711d66d6935 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT0 00000100:00100000:0.0:1715330283.228908:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801345a4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942387584:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1715330283.228938:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.228954:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008b04c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.229044:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942387584 00000100:00100000:1.0:1715330283.229049:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942387584 00000100:00100000:1.0:1715330283.229077:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2115 00000100:00100000:1.0:1715330283.229082:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801345a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7134:x1798653942387584:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330283.229097:0:24873:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330283.229112:0:24873:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d693c lrc: 2/0,0 mode: --/PW res: [0x240000401:0xba:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d6935 expref: -99 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.229129:0:24873:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d693c lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d6935 expref: 11 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.229140:0:24873:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d693c lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6935 expref: 11 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.229148:0:24873:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xba:0x0].0x0 (ffff88009d5fa700) 00010000:00010000:1.0:1715330283.229151:0:24873:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330283.229153:0:24873:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfcb40, rc 0) 00000100:00100000:1.0:1715330283.229177:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801345a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:7134:x1798653942387584:12345-0@lo:101:mdt00_001.0 Request processed in 95us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.229182:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2115 00000100:00100000:0.0:1715330283.229672:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801345a4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942387584:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330283.229695:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f3cc0/0xd895711d66d6935 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d693c expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.229706:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f3cc0/0xd895711d66d6935 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d693c expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330283.229728:0:7134:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008d618700 reply state ffff88009d47d000 transno 4294983334 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d692e lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.229785:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d692e lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.229791:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xba:0x0].0x0 (ffff88009d434a00) 00010000:00010000:0.0:1715330283.229794:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330283.229798:0:7134:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1715330283.229803:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f3cc0/0xd895711d66d6935 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d693c expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.229809:0:7134:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f3cc0/0xd895711d66d6935 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d693c expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1715330283.229820:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0xba:0x0] 00000004:00010000:0.0:1715330283.229826:0:7134:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008d618700 reply state ffff88009d47d000 transno 4294983334 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d6927 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14f8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.229832:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d6927 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x14f8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.229837:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14f8:0x0].0x0 (ffff88009d434700) 00010000:00010000:0.0:1715330283.229839:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330283.229840:0:7134:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1715330283.229844:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x14f8:0x0]: returning size 4096 00000004:00080000:0.0:1715330283.229853:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:0.0:1715330283.229860:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db673c0/0xd895711d66d690b lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6912 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.229865:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db673c0/0xd895711d66d690b lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d6912 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.229870:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db673c0/0xd895711d66d690b lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d6912 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.229895:0:7134:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1715330283.229898:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:0.0:1715330283.229902:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457cd80/0xd895711d66d6919 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6920 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.229907:0:7134:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457cd80/0xd895711d66d6919 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6920 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.230059:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715330283.230067:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db673c0/0xd895711d66d690b lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d6912 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.230075:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db673c0 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330283.230080:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db673c0/0xd895711d66d690b lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d6912 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330283.230087:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db673c0/0xd895711d66d690b lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d6912 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.230110:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db673c0/0xd895711d66d690b lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6912 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.230115:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330283.230134:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db673c0/0xd895711d66d690b lrc: 1/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6912 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.230140:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db673c0/0xd895711d66d690b lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6912 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.230154:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330283.230155:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330283.230156:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330283.230166:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d61bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942387648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330283.230196:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.230222:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942387648 00000100:00100000:1.0:1715330283.230226:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942387648 00000100:00100000:0.0:1715330283.230548:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+16:16741:x1798653937994176:12345-192.168.204.49@tcp:36:lfs.0 Request processed in 18782us (18955us total) trans 4294983334 rc 0/0 00000100:00100000:0.0:1715330283.230556:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23075 00000100:00100000:1.0:1715330283.230628:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1172 00000100:00100000:1.0:1715330283.230638:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+11:3690:x1798653942387648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330283.230650:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330283.230664:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64240/0xd895711d66d6912 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d690b expref: 11 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.230675:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88009d434400) 00010000:00010000:1.0:1715330283.230682:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330283.232865:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+10:3690:x1798653942387648:12345-0@lo:103:ldlm_bl.0 Request processed in 2221us (2663us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.232875:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1172 00000100:00100000:0.0:1715330283.233082:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d61bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942387648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330283.240775:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937994368 00000100:00100000:0.0:1715330283.240784:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937994368 00000100:00100000:0.0:1715330283.240833:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23076 00000100:00100000:0.0:1715330283.240840:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d41b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+10:16742:x1798653937994368:12345-192.168.204.49@tcp:36:mkdir.0 00000100:00100000:0.0:1715330283.240985:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d41b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+10:16742:x1798653937994368:12345-192.168.204.49@tcp:36:mkdir.0 Request processed in 143us (492us total) trans 0 rc -17/-17 00000100:00100000:0.0:1715330283.240990:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23076 00000100:00100000:1.0:1715330283.256445:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937994432 00000100:00100000:1.0:1715330283.256455:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937994432 00000100:00100000:1.0:1715330283.256502:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23077 00000100:00100000:1.0:1715330283.256509:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+10:16743:x1798653937994432:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:1.0:1715330283.256530:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330283.256553:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffcc0/0xd895711d66d6943 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb0dc expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.256633:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d694a lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.256646:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d694a lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.256657:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d694a lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.256666:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d6951 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x6f4526ef bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.256674:0:7134:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d6920 lrc: 2/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526ef bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6919 expref: 9 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.256682:0:7134:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d6951 lrc: 4/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x6f4526ef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.256714:0:7134:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d6920 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526ef bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd895711d66d6919 expref: 9 pid: 24873 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330283.256728:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012faef800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7134:1798653942387712:0@lo:104: 00000100:00100000:1.0:1715330283.256792:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.256810:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435a80 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.256828:0:9413:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942387712 00000100:00100000:1.0:1715330283.256831:0:9413:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942387712 00000100:00100000:1.0:1715330283.256852:0:9413:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1048 00000100:00100000:1.0:1715330283.256855:0:9413:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa87800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:7134:x1798653942387712:12345-0@lo:104: 00010000:00010000:1.0:1715330283.256866:0:9413:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457cd80/0xd895711d66d6919 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d6920 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.256901:0:9413:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1715330283.256906:0:9413:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa87800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:7134:x1798653942387712:12345-0@lo:104: Request processed in 49us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.256912:0:9413:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1048 00000100:00100000:1.0:1715330283.256944:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012faef800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7134:1798653942387712:0@lo:104: 00010000:00010000:1.0:1715330283.256959:0:7134:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d6951 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x6f4526ef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00000100:00100000:0.0:1715330283.257794:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d41b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942387776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330283.257837:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1715330283.260323:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd440/0xd895711d66d684e lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x664526f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.260333:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd440/0xd895711d66d684e lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x664526f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.260344:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd440/0xd895711d66d684e lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x664526f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.260350:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfd440 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330283.260354:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd440/0xd895711d66d684e lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x664526f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.260361:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd440/0xd895711d66d684e lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x664526f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.260376:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x664526f8 (ffff88009bbf0900) 00010000:00010000:0.0:1715330283.260380:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.260383:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd440/0xd895711d66d684e lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x664526f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.260388:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd440/0xd895711d66d684e lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x664526f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.260400:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d6855 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x167:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.260405:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d6855 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x167:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.260409:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d6855 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x167:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.260413:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfc240 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330283.260415:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d6855 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x167:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.260419:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d6855 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x167:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.260425:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x167:0x0].0x0 (ffff88009bbf0d00) 00010000:00010000:0.0:1715330283.260427:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.260429:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d6855 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x167:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.260433:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d6855 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x167:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.260446:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d685c lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xb7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.260450:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d685c lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xb7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.260455:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d685c lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xb7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.260459:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfcfc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330283.260461:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d685c lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xb7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.260464:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d685c lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xb7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.260469:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xb7:0x0].0x0 (ffff88009bbf0c00) 00010000:00010000:0.0:1715330283.260471:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.260473:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d685c lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xb7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.260477:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d685c lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xb7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.260491:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc900/0xd895711d66d68b0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x664526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.260496:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc900/0xd895711d66d68b0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x664526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.260501:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc900/0xd895711d66d68b0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x664526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.260504:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfc900 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330283.260507:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc900/0xd895711d66d68b0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x664526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.260511:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc900/0xd895711d66d68b0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x664526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.260516:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x664526f8 (ffff88009bbf0900) 00010000:00010000:0.0:1715330283.260518:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.260520:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc900/0xd895711d66d68b0 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x664526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.260524:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc900/0xd895711d66d68b0 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x664526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00000100:00100000:0.0:1715330283.261222:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d41b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942387776:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330283.261249:0:7134:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d6951 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.261256:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d6951 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00000100:00100000:0.0:1715330283.261348:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d61bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942387840:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330283.261385:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.261404:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008b04c240 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.261410:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942387840 00000100:00100000:1.0:1715330283.261416:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942387840 00000100:00100000:1.0:1715330283.261445:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2116 00000100:00100000:1.0:1715330283.261450:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:7134:x1798653942387840:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330283.261510:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:7134:x1798653942387840:12345-0@lo:1000:mdt00_001.0 Request processed in 60us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.261516:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2116 00000100:00100000:1.0:1715330283.261524:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942387968 00000100:00100000:1.0:1715330283.261526:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942387968 00000100:00100000:1.0:1715330283.261538:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2117 00000100:00100000:1.0:1715330283.261541:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d41a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:8278:x1798653942387968:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1715330283.261638:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d41a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:8278:x1798653942387968:12345-0@lo:1000:osp_up0-1.0 Request processed in 94us (139us total) trans 4294983335 rc 0/0 00000100:00100000:1.0:1715330283.261643:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2117 00000100:00100000:1.0:1715330283.261722:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942388096 00000100:00100000:1.0:1715330283.261725:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942388096 00000100:00100000:1.0:1715330283.261757:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2118 00000100:00100000:1.0:1715330283.261760:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d419c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:8278:x1798653942388096:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1715330283.261820:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d419c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:8278:x1798653942388096:12345-0@lo:1000:osp_up0-1.0 Request processed in 58us (110us total) trans 4294983336 rc 0/0 00000100:00100000:1.0:1715330283.261825:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2118 00000100:00100000:0.0:1715330283.261965:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d61bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942387840:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1715330283.261999:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2400/0xd895711d66d6958 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x14f8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.262008:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2400/0xd895711d66d6958 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14f8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.262015:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2400/0xd895711d66d6958 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14f8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00000004:00010000:0.0:1715330283.262032:0:7134:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2400/0xd895711d66d6958 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14f8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.262043:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d694a lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.262048:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d694a lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.262052:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d694a lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.262057:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d694a lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.262062:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfdd40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330283.262064:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d694a lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.262069:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d694a lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.262076:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88009d5fa400) 00010000:00010000:0.0:1715330283.262078:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.262081:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d694a lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.262085:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d694a lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.262094:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d6951 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.262098:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d6951 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.262102:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d6951 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.262105:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfc6c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330283.262107:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d6951 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.262111:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d6951 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.262115:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x6f4526ef (ffff88008d699200) 00010000:00010000:0.0:1715330283.262117:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.262119:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d6951 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x6f4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.262123:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d6951 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x6f4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.262151:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffcc0/0xd895711d66d6943 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb0dc expref: 8 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.262165:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2400/0xd895711d66d6958 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x14f8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb0dc expref: 7 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.262170:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14f8:0x0].0x0 (ffff88008b374c00) 00010000:00010000:0.0:1715330283.262172:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1715330283.262174:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f2400, rc 0) 00000100:00100000:0.0:1715330283.262210:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+7:16743:x1798653937994432:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 5701us (6186us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.262217:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23077 00000100:00100000:0.0:1715330283.270099:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937994496 00000100:00100000:0.0:1715330283.270109:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937994496 00000100:00100000:0.0:1715330283.270156:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23078 00000100:00100000:0.0:1715330283.270163:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d41a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+16:16743:x1798653937994496:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:0.0:1715330283.270187:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330283.270209:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66d695f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x14f8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb0e3 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.270265:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d6966 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x14f8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.270277:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d6966 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14f8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.270287:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d6966 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14f8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000004:00200000:0.0:1715330283.270374:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x14f8:0x0]: returning size 4096 00000004:00200000:0.0:1715330283.270378:0:7134:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1715330283.270408:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66d695f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x14f8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb0e3 expref: 18 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.270428:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d6966 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x14f8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb0e3 expref: 17 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.270434:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14f8:0x0].0x0 (ffff88009d434700) 00010000:00010000:0.0:1715330283.270437:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1715330283.270440:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f1680, rc 0) 00000100:00100000:0.0:1715330283.270482:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d41a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+17:16743:x1798653937994496:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 319us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.270488:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23078 00000100:00100000:0.0:1715330283.283162:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937994624 00000100:00100000:0.0:1715330283.283172:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937994624 00000100:00100000:0.0:1715330283.283212:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23080 00000100:00100000:0.0:1715330283.283219:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+7:16743:x1798653937994624:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:0.0:1715330283.283241:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330283.283261:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2880/0xd895711d66d697b lrc: 2/0,0 mode: --/CR res: [0x240000401:0xba:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb0f1 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.283315:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d6982 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xba:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.283327:0:7134:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d693c lrc: 2/0,0 mode: PW/PW res: [0x240000401:0xba:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6935 expref: 5 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.283335:0:7134:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d6982 lrc: 4/1,0 mode: --/PR res: [0x240000401:0xba:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.285026:0:7134:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d693c lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xba:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd895711d66d6935 expref: 5 pid: 24873 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330283.285050:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d798e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7134:1798653942388416:0@lo:104: 00000100:00100000:0.0:1715330283.285101:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.285129:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008b04c240 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.286350:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d798e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7134:1798653942388416:0@lo:104: 00010000:00010000:0.0:1715330283.286365:0:7134:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d6982 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xba:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00000020:00080000:0.0:1715330283.287489:0:8267:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0001: 347 batchid updated 00000004:00080000:0.0:1715330283.287922:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 670 rpc_version 670 00010000:00010000:1.0:1715330283.287938:0:7134:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d6982 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xba:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00000020:00100000:0.0:1715330283.287946:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:1.0:1715330283.287947:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d6982 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xba:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00000100:00100000:0.0:1715330283.287951:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008d798e00 x1798653942388608/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715330283.287967:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d798e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942388608:0@lo:1000:osp_up0-1.0 00000004:00200000:1.0:1715330283.287995:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000401:0xba:0x0]: returning size 4096 00000004:00200000:1.0:1715330283.288000:0:7134:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:0.0:1715330283.288000:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.288013:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008b04c240 going to sleep for 11 seconds 00010000:00010000:1.0:1715330283.288040:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2880/0xd895711d66d697b lrc: 0/0,0 mode: --/CR res: [0x240000401:0xba:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb0f1 expref: 9 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.288060:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d6982 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xba:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb0f1 expref: 8 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.288066:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xba:0x0].0x0 (ffff88009d5fa700) 00010000:00010000:1.0:1715330283.288069:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1715330283.288071:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f1440, rc 0) 00000100:00100000:1.0:1715330283.288116:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+8:16743:x1798653937994624:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 4896us (5040us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.288123:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23080 00000100:00100000:1.0:1715330283.288146:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942388608 00000100:00100000:1.0:1715330283.288151:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942388608 00000100:00100000:1.0:1715330283.288184:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2121 00000100:00100000:1.0:1715330283.288190:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d79ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:8278:x1798653942388608:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1715330283.288304:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d79ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:8278:x1798653942388608:12345-0@lo:1000:osp_up0-1.0 Request processed in 114us (303us total) trans 4294983339 rc 0/0 00000100:00100000:1.0:1715330283.288310:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2121 00000100:00100000:0.0:1715330283.288329:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d798e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942388608:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1715330283.292257:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937994816 00000100:00100000:1.0:1715330283.292267:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937994816 00000100:00100000:1.0:1715330283.292307:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23081 00000100:00100000:1.0:1715330283.292314:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+18:16743:x1798653937994816:12345-192.168.204.49@tcp:36:rmdir.0 00010000:00010000:1.0:1715330283.292364:0:7134:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330283.292396:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d6966 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x14f8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb0e3 expref: 18 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.292411:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14f8:0x0].0x0 (ffff88009d434700) 00010000:00010000:1.0:1715330283.292416:0:7134:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330283.292463:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff180/0xd895711d66d6989 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.292470:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff180/0xd895711d66d6989 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.292478:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff180/0xd895711d66d6989 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT0 00000100:00100000:1.0:1715330283.292496:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa87480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942388672:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1715330283.292541:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.292569:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435300 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.292586:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942388672 00000100:00100000:1.0:1715330283.292589:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942388672 00000100:00100000:1.0:1715330283.292632:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2122 00000100:00100000:1.0:1715330283.292637:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:7134:x1798653942388672:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330283.292646:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330283.292660:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d6990 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d6989 expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.292680:0:9407:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d6990 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d6989 expref: 6 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.292690:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d6990 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6989 expref: 6 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.292696:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88009d5fa600) 00010000:00010000:1.0:1715330283.292698:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330283.292700:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfcd80, rc 0) 00000100:00100000:1.0:1715330283.292723:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7134:x1798653942388672:12345-0@lo:101:mdt00_001.0 Request processed in 86us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.292744:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2122 00000100:00100000:1.0:1715330283.293496:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942388736 00000100:00100000:1.0:1715330283.293499:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942388736 00000100:00100000:1.0:1715330283.293522:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2123 00000100:00100000:1.0:1715330283.293526:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d419f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7134:x1798653942388736:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330283.293534:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330283.293544:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d699e lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x6f4526ef bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d6997 expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.293556:0:9407:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d699e lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d6997 expref: 7 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.293564:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d699e lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6997 expref: 7 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.293570:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x6f4526ef (ffff88009d5fa300) 00010000:00010000:1.0:1715330283.293573:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330283.293579:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bff600, rc 0) 00000100:00100000:1.0:1715330283.293613:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d419f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7134:x1798653942388736:12345-0@lo:101:mdt00_001.0 Request processed in 86us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.293619:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2123 00000100:00100000:1.0:1715330283.296166:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942388800 00000100:00100000:1.0:1715330283.296175:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942388800 00000100:00100000:1.0:1715330283.296210:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2124 00000100:00100000:1.0:1715330283.296330:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d41b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7134:x1798653942388800:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330283.296428:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d41b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7134:x1798653942388800:12345-0@lo:1000:mdt00_001.0 Request processed in 211us (2590us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.296437:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2124 00000100:00100000:1.0:1715330283.297713:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942388928 00000100:00100000:1.0:1715330283.297787:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942388928 00000100:00100000:1.0:1715330283.297819:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2126 00000100:00100000:1.0:1715330283.297825:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7134:x1798653942388928:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330283.297838:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330283.297853:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdf80/0xd895711d66d69ac lrc: 2/0,0 mode: --/EX res: [0x200000402:0x14f8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d69a5 expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.297875:0:9407:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdf80/0xd895711d66d69ac lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14f8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d69a5 expref: 8 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.297887:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdf80/0xd895711d66d69ac lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14f8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d69a5 expref: 8 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.297894:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14f8:0x0].0x0 (ffff88009d5fa400) 00010000:00010000:1.0:1715330283.297897:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1715330283.297900:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfdf80, rc 0) 00000100:00100000:1.0:1715330283.297935:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:7134:x1798653942388928:12345-0@lo:101:mdt00_001.0 Request processed in 110us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.297940:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2126 00000100:00100000:1.0:1715330283.304366:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942389056 00000100:00100000:1.0:1715330283.304369:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942389056 00000100:00100000:1.0:1715330283.304495:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2127 00000100:00100000:1.0:1715330283.304500:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:7134:x1798653942389056:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330283.304514:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330283.304529:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffcc0/0xd895711d66d69c8 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xba:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d69c1 expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.304552:0:9407:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d6982 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0xba:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb0f1 expref: 6 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.304559:0:9407:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffcc0/0xd895711d66d69c8 lrc: 4/0,0 mode: --/EX res: [0x240000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d69c1 expref: 9 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.304578:0:9407:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d6982 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xba:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb0f1 expref: 6 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.304588:0:9407:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d6982 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xba:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb0f1 expref: 6 pid: 7134 timeout: 357 lvb_type: 0 00000100:00100000:1.0:1715330283.304609:0:9407:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa85880 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:9407:1798653942389120:192.168.204.49@tcp:104: 00000100:00100000:1.0:1715330283.305134:0:9407:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435840 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.306679:0:9407:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa85880 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:9407:1798653942389120:192.168.204.49@tcp:104: 00010000:00010000:1.0:1715330283.306704:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffcc0/0xd895711d66d69c8 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d69c1 expref: 9 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.306714:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xba:0x0].0x0 (ffff88009d5fa700) 00010000:00010000:1.0:1715330283.306716:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330283.306719:0:9407:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffcc0/0xd895711d66d69c8 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d69c1 expref: 9 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.306726:0:9407:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffcc0/0xd895711d66d69c8 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d69c1 expref: 9 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.306748:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bffcc0, rc 0) 00000100:00100000:1.0:1715330283.306853:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7134:x1798653942389056:12345-0@lo:101:mdt00_001.0 Request processed in 2351us (2612us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.306861:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2127 00000100:00100000:0.0:1715330283.309203:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942389248 00000100:00100000:0.0:1715330283.309214:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942389248 00000100:00100000:0.0:1715330283.309260:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2128 00000100:00100000:0.0:1715330283.309266:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7134:x1798653942389248:12345-0@lo:403:mdt00_001.0 00000100:00100000:0.0:1715330283.310656:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7134:x1798653942389248:12345-0@lo:403:mdt00_001.0 Request processed in 1388us (1574us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.310663:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2128 00010000:00010000:1.0:1715330283.311893:0:9415:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1715330283.311899:0:9415:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff180/0xd895711d66d6989 lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d6990 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.311906:0:9415:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bff180 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330283.311909:0:9415:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff180/0xd895711d66d6989 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d6990 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330283.311916:0:9415:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff180/0xd895711d66d6989 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d6990 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.311931:0:9415:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff180/0xd895711d66d6989 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6990 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.311936:0:9415:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330283.311952:0:9415:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff180/0xd895711d66d6989 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6990 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.311957:0:9415:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff180/0xd895711d66d6989 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6990 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330283.311958:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d418380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942389312:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330283.311973:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330283.311975:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330283.311977:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330283.311982:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330283.311990:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942389376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330283.311992:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.312015:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.312022:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1715330283.312028:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942389504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330283.312031:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1715330283.312036:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942389440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330283.312050:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.312069:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942389376 00000100:00100000:1.0:1715330283.312074:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942389376 00000100:00100000:1.0:1715330283.312098:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1174 00000100:00100000:1.0:1715330283.312103:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d798700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+11:3689:x1798653942389312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330283.312112:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330283.312134:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffcc0/0xd895711d66d69c8 lrc: 0/0,0 mode: --/EX res: [0x240000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d69c1 expref: 11 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.312143:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xba:0x0].0x0 (ffff88009d5fa700) 00010000:00010000:1.0:1715330283.312151:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330283.312184:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d798700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+8:3689:x1798653942389312:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.312190:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1174 00000100:00100000:1.0:1715330283.312208:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.312231:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942389376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330283.312315:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942389440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330283.312380:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942389504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330283.312388:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d418380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942389312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330283.324169:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330283.330762:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330283.331874:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937995200 00000100:00100000:1.0:1715330283.331881:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937995200 00000100:00100000:1.0:1715330283.331911:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23084 00000100:00100000:1.0:1715330283.331915:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d619880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+7:16745:x1798653937995200:12345-192.168.204.49@tcp:36:lfs.0 00000100:00100000:1.0:1715330283.331987:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa85880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942389568:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330283.332020:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.332032:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435480 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.332042:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942389568 00000100:00100000:1.0:1715330283.332044:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942389568 00000100:00100000:1.0:1715330283.332056:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2129 00000100:00100000:1.0:1715330283.332058:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:7135:x1798653942389568:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330283.332106:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:7135:x1798653942389568:12345-0@lo:1000:mdt00_002.0 Request processed in 47us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.332110:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2129 00000100:00100000:1.0:1715330283.332131:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa85880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942389568:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330283.332156:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa85880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942389632:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330283.332166:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.332171:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435480 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.332176:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942389632 00000100:00100000:1.0:1715330283.332178:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942389632 00000100:00100000:1.0:1715330283.332192:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2130 00000100:00100000:1.0:1715330283.332194:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:7135:x1798653942389632:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330283.332238:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:7135:x1798653942389632:12345-0@lo:1000:mdt00_002.0 Request processed in 43us (70us total) trans 0 rc -2/-2 00000100:00100000:1.0:1715330283.332241:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2130 00000100:00100000:1.0:1715330283.332254:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa85880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942389632:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1715330283.332281:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc6c0/0xd895711d66d69f2 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.332286:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc6c0/0xd895711d66d69f2 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330283.332292:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc6c0/0xd895711d66d69f2 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT1 00000100:00100000:1.0:1715330283.332297:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa85880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942389696:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1715330283.332308:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.332313:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435840 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.332318:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942389696 00000100:00100000:1.0:1715330283.332320:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942389696 00000100:00100000:1.0:1715330283.332338:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2131 00000100:00100000:1.0:1715330283.332341:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:7135:x1798653942389696:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330283.332348:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330283.332359:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d69f9 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d69f2 expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.332383:0:9407:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe400/0xd895711d66d6840 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb0ab expref: 15 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.332390:0:9407:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d69f9 lrc: 4/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d69f2 expref: 12 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.332407:0:9407:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe400/0xd895711d66d6840 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb0ab expref: 15 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.332417:0:9407:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe400/0xd895711d66d6840 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb0ab expref: 15 pid: 7134 timeout: 357 lvb_type: 0 00000100:00100000:1.0:1715330283.332426:0:9407:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa87800 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:9407:1798653942389760:192.168.204.49@tcp:104: 00000100:00100000:1.0:1715330283.332458:0:9407:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435480 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.336692:0:9407:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa87800 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:9407:1798653942389760:192.168.204.49@tcp:104: 00010000:00010000:1.0:1715330283.336717:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d69f9 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d69f2 expref: 12 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.336747:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88009bbf0f00) 00010000:00010000:1.0:1715330283.336749:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330283.336753:0:9407:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d69f9 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d69f2 expref: 12 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.336760:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfdd40, rc 0) 00000100:00100000:1.0:1715330283.336801:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:7135:x1798653942389696:12345-0@lo:101:mdt00_002.0 Request processed in 4458us (4491us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.336808:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2131 00000100:00100000:0.0:1715330283.337164:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa85880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942389696:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330283.337177:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc6c0/0xd895711d66d69f2 lrc: 4/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d69f9 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.337185:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc6c0/0xd895711d66d69f2 lrc: 4/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d69f9 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330283.338030:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942389824 00000100:00100000:0.0:1715330283.338034:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942389824 00000100:00100000:0.0:1715330283.338074:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1051 00000100:00100000:0.0:1715330283.338079:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:7120:x1798653942389824:12345-0@lo:105: 00010000:00010000:0.0:1715330283.338086:0:7118:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc6c0/0xd895711d66d69f2 lrc: 5/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d69f9 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.338093:0:7118:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc6c0/0xd895711d66d69f2 lrc: 5/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d69f9 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.338099:0:7118:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc6c0/0xd895711d66d69f2 lrc: 5/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d69f9 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.338105:0:7118:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc6c0/0xd895711d66d69f2 lrc: 5/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d69f9 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.338110:0:7118:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc6c0/0xd895711d66d69f2 lrc: 6/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d69f9 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.338117:0:7118:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc6c0/0xd895711d66d69f2 lrc: 6/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d69f9 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.338131:0:7118:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff880093bfc6c0) 00000100:00100000:0.0:1715330283.338159:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:7120:x1798653942389824:12345-0@lo:105: Request processed in 79us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.338165:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1051 00010000:00010000:0.0:1715330283.338181:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc6c0/0xd895711d66d69f2 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d69f9 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.338187:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc6c0/0xd895711d66d69f2 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d69f9 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1715330283.338202:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:0.0:1715330283.338226:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1440/0xd895711d66d6a00 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330283.338231:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1440/0xd895711d66d6a00 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330283.338238:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1440/0xd895711d66d6a00 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT1 00000100:00100000:0.0:1715330283.338248:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d61ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942389888:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1715330283.338269:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.338278:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008b04c240 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.338335:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942389888 00000100:00100000:1.0:1715330283.338339:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942389888 00000100:00100000:1.0:1715330283.338357:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2132 00000100:00100000:1.0:1715330283.338361:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d61bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:7135:x1798653942389888:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330283.338373:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330283.338383:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d6a07 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d6a00 expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.338396:0:9407:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d6a07 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d6a00 expref: 13 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.338404:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d6a07 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6a00 expref: 13 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.338409:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x6f4526f0 (ffff88009d5fa500) 00010000:00010000:1.0:1715330283.338411:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330283.338413:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfc900, rc 0) 00000100:00100000:1.0:1715330283.338435:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d61bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+13:7135:x1798653942389888:12345-0@lo:101:mdt00_002.0 Request processed in 74us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.338441:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2132 00000100:00100000:0.0:1715330283.338664:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d61ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942389888:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330283.338673:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1440/0xd895711d66d6a00 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6a07 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.338679:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1440/0xd895711d66d6a00 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6a07 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1715330283.338687:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:0.0:1715330283.338709:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d61ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942389952:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1715330283.338752:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.338771:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008b04ce40 going to sleep for 11 seconds 00000004:00080000:1.0:1715330283.340638:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 671 rpc_version 671 00000020:00100000:1.0:1715330283.340661:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1715330283.340668:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012fa87800 x1798653942390336/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1715330283.340683:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa87800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942390336:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1715330283.340715:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.340760:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435480 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.341330:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa87800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942390336:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1715330283.342015:0:9415:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715330283.342021:0:9415:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc6c0/0xd895711d66d69f2 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d69f9 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.342029:0:9415:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfc6c0 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330283.342033:0:9415:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc6c0/0xd895711d66d69f2 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d69f9 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330283.342040:0:9415:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc6c0/0xd895711d66d69f2 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d69f9 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.342058:0:9415:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc6c0/0xd895711d66d69f2 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d69f9 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.342063:0:9415:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330283.342083:0:9415:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc6c0/0xd895711d66d69f2 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d69f9 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.342088:0:9415:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc6c0/0xd895711d66d69f2 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d69f9 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.342102:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330283.342104:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330283.342105:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330283.371687:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330283.372087:0:9413:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942390528 00000100:00100000:0.0:1715330283.372092:0:9413:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942390528 00000100:00100000:0.0:1715330283.372111:0:9413:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1052 00000100:00100000:0.0:1715330283.372116:0:9413:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d419f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:7135:x1798653942390528:12345-0@lo:104: 00010000:00010000:0.0:1715330283.372126:0:9413:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1440/0xd895711d66d6a00 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d6a07 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.372166:0:9413:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1715330283.372170:0:9413:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d419f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:7135:x1798653942390528:12345-0@lo:104: Request processed in 54us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.372176:0:9413:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1052 00000100:00100000:0.0:1715330283.372583:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d41b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942390592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330283.372626:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:0.0:1715330283.374197:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983340 is committed 00000020:00080000:0.0:1715330283.374205:0:7116:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 341 batchid updated 00000001:00080000:0.0:1715330283.374232:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983334 is committed 00000020:00080000:0.0:1715330283.374236:0:7116:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff880091ffa9c0 refcount 2 committed 0 result 0 batchid 342 00000020:00080000:0.0:1715330283.374239:0:7116:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009d434d00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff880091ffa480 00000020:00080000:0.0:1715330283.374242:0:7116:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].327 00000020:00080000:0.0:1715330283.374244:0:7116:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009d434b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88011dad4800 00000020:00080000:0.0:1715330283.374246:0:7116:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].328 00000020:00080000:0.0:1715330283.374266:0:7116:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 340 batchid updated 00010000:00010000:1.0:1715330283.374951:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d6927 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x14f8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.374959:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d6927 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x14f8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.374965:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d6927 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x14f8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.374970:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f0000 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330283.374973:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d6927 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x14f8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.374979:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d6927 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x14f8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.374986:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14f8:0x0].0x0 (ffff88009d434700) 00010000:00010000:1.0:1715330283.374989:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330283.374991:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d6927 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x14f8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.374995:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d6927 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x14f8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.375008:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d692e lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.375011:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d692e lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.375016:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d692e lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.375019:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f2ac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330283.375020:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d692e lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.375024:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d692e lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.375028:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xba:0x0].0x0 (ffff88009d434a00) 00010000:00010000:1.0:1715330283.375030:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330283.375031:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d692e lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.375035:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d692e lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00000100:00100000:0.0:1715330283.375104:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d41b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942390592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330283.375427:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d418380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942390848:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330283.375532:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942390912 00000100:00100000:0.0:1715330283.375536:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942390912 00000100:00100000:0.0:1715330283.375548:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2142 00000100:00100000:0.0:1715330283.375552:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d79ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7135:x1798653942390912:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1715330283.375587:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d79ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7135:x1798653942390912:12345-0@lo:1000:mdt00_002.0 Request processed in 34us (67us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.375592:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2142 00000100:00100000:0.0:1715330283.377883:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330283.380328:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330283.383990:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937995648 00000100:00100000:0.0:1715330283.383998:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937995648 00000100:00100000:0.0:1715330283.384044:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23089 00000100:00100000:0.0:1715330283.384055:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+14:16755:x1798653937995648:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:0.0:1715330283.384072:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330283.384087:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d6a62 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb11b expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.384130:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0480/0xd895711d66d6a69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.384144:0:7134:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d6a23 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6a1c expref: 5 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.384150:0:7134:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0480/0xd895711d66d6a69 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.384175:0:7134:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d6a23 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd895711d66d6a1c expref: 5 pid: 24873 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330283.384188:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7134:1798653942390976:0@lo:104: 00000100:00100000:0.0:1715330283.384226:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.384252:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008b04cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.384433:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7134:1798653942390976:0@lo:104: 00010000:00010000:0.0:1715330283.384445:0:7134:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0480/0xd895711d66d6a69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.384480:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715330283.384486:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64240/0xd895711d66d6a1c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d6a23 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.384492:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64240 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330283.384496:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64240/0xd895711d66d6a1c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd895711d66d6a23 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330283.384504:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64240/0xd895711d66d6a1c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd895711d66d6a23 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.384523:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64240/0xd895711d66d6a1c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d6a23 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.384532:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330283.384560:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64240/0xd895711d66d6a1c lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d6a23 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.384565:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64240/0xd895711d66d6a1c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d6a23 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330283.384565:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012faed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942391040:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330283.384578:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330283.384579:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330283.384580:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330283.384583:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1715330283.385691:0:7116:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 343 batchid updated 00000004:00080000:0.0:1715330283.385804:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 626 rpc_version 626 00000020:00100000:0.0:1715330283.385822:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1715330283.385830:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008b0c1c00 x1798653942391168/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715330283.385843:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c1c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942391168:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330283.385873:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.385894:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008b04cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.385932:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012faed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942391040:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330283.385970:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942391168 00000100:00100000:1.0:1715330283.385974:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942391168 00000100:00100000:1.0:1715330283.386006:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2143 00000100:00100000:1.0:1715330283.386010:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:8587:x1798653942391168:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330283.386104:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:8587:x1798653942391168:12345-0@lo:1000:osp_up1-0.0 Request processed in 92us (230us total) trans 4294968288 rc 0/0 00000100:00100000:1.0:1715330283.386109:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2143 00010000:00010000:1.0:1715330283.386124:0:7134:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0480/0xd895711d66d6a69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.386130:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0480/0xd895711d66d6a69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000004:00200000:1.0:1715330283.386163:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xb8:0x0]: returning size 4096 00000004:00200000:1.0:1715330283.386166:0:7134:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1715330283.386192:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d6a62 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb11b expref: 16 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.386202:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0480/0xd895711d66d6a69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb11b expref: 15 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.386208:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb8:0x0].0x0 (ffff88008d699900) 00010000:00010000:1.0:1715330283.386210:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1715330283.386212:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f0480, rc 0) 00000100:00100000:0.0:1715330283.386241:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c1c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942391168:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330283.386250:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+15:16755:x1798653937995648:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 2199us (2402us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.386255:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23089 00000100:00100000:0.0:1715330283.389783:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330283.389815:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330283.389867:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937995840 00000100:00100000:1.0:1715330283.389871:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937995840 00000100:00100000:1.0:1715330283.389893:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23090 00000100:00100000:1.0:1715330283.389897:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+11:16755:x1798653937995840:12345-192.168.204.49@tcp:36:rmdir.0 00010000:00010000:1.0:1715330283.389927:0:7134:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330283.389943:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457cfc0/0xd895711d66d6a4d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb10d expref: 11 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.389951:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x16a:0x0].0x0 (ffff88008d699700) 00010000:00010000:1.0:1715330283.389954:0:7134:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330283.389984:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcfc0/0xd895711d66d6a70 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.389995:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcfc0/0xd895711d66d6a70 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.390002:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcfc0/0xd895711d66d6a70 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT1 00000100:00100000:1.0:1715330283.390017:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012faee300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942391232:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1715330283.390046:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.390057:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435480 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.390189:0:7134:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983340 gen 2 00000004:00080000:1.0:1715330283.390194:0:7134:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983333 committed transno 4294983340 00000020:00080000:1.0:1715330283.390198:0:7134:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff880091ffa900 refcount 2 committed 0 result 0 batchid 348 00000020:00080000:1.0:1715330283.390201:0:7134:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009d434300 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880091ffa540 00000020:00080000:1.0:1715330283.390204:0:7134:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].350 00000020:00080000:1.0:1715330283.390206:0:7134:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009d434f00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88011dad4200 00000020:00080000:1.0:1715330283.390208:0:7134:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].349 00000004:00080000:1.0:1715330283.390228:0:7134:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983335 committed transno 4294983340 00000004:00080000:1.0:1715330283.390240:0:7134:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983336 committed transno 4294983340 00000004:00080000:1.0:1715330283.390250:0:7134:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983337 committed transno 4294983340 00000004:00080000:1.0:1715330283.390262:0:7134:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983338 committed transno 4294983340 00000004:00080000:1.0:1715330283.390271:0:7134:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983339 committed transno 4294983340 00000004:00080000:1.0:1715330283.390282:0:7134:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983340 committed transno 4294983340 00000100:00100000:1.0:1715330283.390299:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012faee300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942391232:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330283.390310:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcfc0/0xd895711d66d6a70 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6a77 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.390318:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcfc0/0xd895711d66d6a70 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6a77 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330283.390329:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:1.0:1715330283.390339:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc240/0xd895711d66d6a7e lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.390344:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc240/0xd895711d66d6a7e lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.390349:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc240/0xd895711d66d6a7e lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT1 00000100:00100000:1.0:1715330283.390361:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012faee300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942391296:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1715330283.390429:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.390491:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435480 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.390663:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012faee300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942391296:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330283.390670:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc240/0xd895711d66d6a7e lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6a85 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.390677:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc240/0xd895711d66d6a7e lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6a85 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1715330283.390684:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:0.0:1715330283.390705:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942391360:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330283.390744:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.390763:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008b04c480 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.391020:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942391360:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330283.391049:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942391424:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330283.391066:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.391073:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008b04c480 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.391267:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942391424:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1715330283.391292:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2ac0/0xd895711d66d6a8c lrc: 3/0,1 mode: --/EX res: [0x240000402:0x16a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.391298:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2ac0/0xd895711d66d6a8c lrc: 3/0,1 mode: --/EX res: [0x240000402:0x16a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.391303:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2ac0/0xd895711d66d6a8c lrc: 3/0,1 mode: --/EX res: [0x240000402:0x16a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT1 00000100:00100000:0.0:1715330283.391314:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800877ec700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942391488:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1715330283.391330:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.391337:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008b04cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.391439:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800877ec700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942391488:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330283.391446:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2ac0/0xd895711d66d6a8c lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x16a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6a93 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.391452:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2ac0/0xd895711d66d6a8c lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x16a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6a93 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.391465:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0000/0xd895711d66d6a9a lrc: 3/0,1 mode: --/EX res: [0x240000402:0x16a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.391472:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0000/0xd895711d66d6a9a lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x16a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.391478:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0000/0xd895711d66d6a9a lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x16a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.391487:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d6aa1 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xb8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.391494:0:7134:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457ed00/0xd895711d66d6a5b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb114 expref: 10 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.391500:0:7134:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d6aa1 lrc: 4/0,1 mode: --/EX res: [0x240000400:0xb8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.391514:0:7134:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88013457ed00/0xd895711d66d6a5b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb114 expref: 10 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.391527:0:7134:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457ed00/0xd895711d66d6a5b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb114 expref: 10 pid: 7135 timeout: 357 lvb_type: 0 00000100:00100000:0.0:1715330283.391535:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800877ec700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7134:1798653942391552:192.168.204.49@tcp:104: 00000100:00100000:0.0:1715330283.391707:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008b04cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.395396:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000004:00080000:1.0:1715330283.406148:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 672 rpc_version 672 00000020:00100000:1.0:1715330283.406173:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1715330283.406179:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012faeea00 x1798653942391936/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1808/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1715330283.406198:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012faeea00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942391936:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1715330283.406234:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.406257:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435900 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.406718:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012faeea00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942391936:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1715330283.407629:0:9415:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715330283.407633:0:9415:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2ac0/0xd895711d66d6a8c lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x16a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d6a93 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.407638:0:9415:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f2ac0 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330283.407641:0:9415:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2ac0/0xd895711d66d6a8c lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x16a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d6a93 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330283.407646:0:9415:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2ac0/0xd895711d66d6a8c lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x16a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d6a93 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.407659:0:9415:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2ac0/0xd895711d66d6a8c lrc: 2/0,0 mode: --/EX res: [0x240000402:0x16a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6a93 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.407663:0:9415:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1715330283.407683:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012faef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942392064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330283.407708:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1715330283.407721:0:9415:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2ac0/0xd895711d66d6a8c lrc: 1/0,0 mode: --/EX res: [0x240000402:0x16a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6a93 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.407727:0:9415:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2ac0/0xd895711d66d6a8c lrc: 0/0,0 mode: --/EX res: [0x240000402:0x16a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6a93 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.407750:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330283.407751:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330283.407752:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330283.407838:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012faef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942392064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330283.408062:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1715330283.408070:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d41aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942392128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330283.408089:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.408227:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d41aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942392128:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330283.424594:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330283.429117:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330283.429830:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942392192 00000100:00100000:0.0:1715330283.429834:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942392192 00000100:00100000:0.0:1715330283.429856:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2152 00000100:00100000:0.0:1715330283.429859:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:7134:x1798653942392192:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330283.429916:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:7134:x1798653942392192:12345-0@lo:1000:mdt00_001.0 Request processed in 55us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.429921:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2152 00000100:00100000:0.0:1715330283.434092:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc78000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942392320:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330283.434106:0:7134:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c480/0xd895711d66d6ad9 lrc: 4/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6ae0 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.434114:0:7134:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c480/0xd895711d66d6ad9 lrc: 4/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6ae0 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330283.435938:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00010000:00010000:1.0:1715330283.436592:0:7134:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c480/0xd895711d66d6ad9 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6ae0 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.436618:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c480/0xd895711d66d6ad9 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6ae0 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330283.436636:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:1.0:1715330283.436657:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd440/0xd895711d66d6ae7 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x6f4526f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.436663:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd440/0xd895711d66d6ae7 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x6f4526f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.436670:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd440/0xd895711d66d6ae7 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x6f4526f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT0 00000100:00100000:1.0:1715330283.436681:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012faee300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942392512:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1715330283.436705:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.436715:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435900 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.436887:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012faee300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942392512:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330283.436897:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd440/0xd895711d66d6ae7 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6aee expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.436904:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd440/0xd895711d66d6ae7 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6aee expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1715330283.436915:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:0.0:1715330283.436939:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800877edf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942392576:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330283.436961:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.436970:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008b04cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.436977:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942392576 00000100:00100000:1.0:1715330283.436981:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942392576 00000100:00100000:1.0:1715330283.437004:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2156 00000100:00100000:1.0:1715330283.437008:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7134:x1798653942392576:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330283.437061:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7134:x1798653942392576:12345-0@lo:1000:mdt00_001.0 Request processed in 52us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.437066:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2156 00000100:00100000:0.0:1715330283.437084:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800877edf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942392576:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330283.437113:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800877edf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942392640:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330283.437128:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.437136:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008b04cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.437286:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800877edf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942392640:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330283.437330:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800877edf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942392704:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330283.437347:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.437362:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008b04cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.437464:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800877edf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942392704:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330283.437495:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800877edf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942392768:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330283.437512:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.437531:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008b04cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.437540:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942392768 00000100:00100000:1.0:1715330283.437543:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942392768 00000100:00100000:1.0:1715330283.437563:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2159 00000100:00100000:1.0:1715330283.437566:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7134:x1798653942392768:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330283.437621:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7134:x1798653942392768:12345-0@lo:1000:mdt00_001.0 Request processed in 53us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.437625:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2159 00000100:00100000:0.0:1715330283.437632:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800877edf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942392768:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330283.437660:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800877edf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942392832:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330283.437675:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.437682:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008b04cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.437775:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800877edf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942392832:0@lo:1000:mdt00_001.0 00000040:00080000:0.0:1715330283.439179:0:7134:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].329, 2168 off508136 00000040:00080000:0.0:1715330283.439244:0:7134:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].328, 2368 off545616 00000004:00080000:0.0:1715330283.439248:0:7134:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88008b04c480 with version 627 00000100:00100000:1.0:1715330283.440263:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942392960 00000100:00100000:1.0:1715330283.440269:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942392960 00000100:00100000:1.0:1715330283.440771:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2161 00000100:00100000:1.0:1715330283.440777:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:8587:x1798653942392960:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330283.441396:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:8587:x1798653942392960:12345-0@lo:1000:osp_up1-0.0 Request processed in 618us (1943us total) trans 4294968290 rc 0/0 00000100:00100000:1.0:1715330283.441403:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2161 00010000:00010000:0.0:1715330283.441694:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d6af5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x14fa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.441706:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d6af5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14fa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.441715:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d6af5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14fa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.441727:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d6afc lrc: 3/0,1 mode: --/PW res: [0x200000400:0xbb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.441889:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d6afc lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xbb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.441896:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d6afc lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xbb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.441920:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f2640/0xd895711d66d6b03 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xbb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.441926:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f2640/0xd895711d66d6b03 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xbb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.441937:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f2640/0xd895711d66d6b03 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xbb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT0 00000100:00100000:0.0:1715330283.441949:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800877edf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942393024:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1715330283.441973:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.442156:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008b04c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.442222:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942393024 00000100:00100000:1.0:1715330283.442226:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942393024 00000100:00100000:1.0:1715330283.442278:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2162 00000100:00100000:1.0:1715330283.442283:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:7134:x1798653942393024:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330283.442294:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330283.442306:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d6b0a lrc: 2/0,0 mode: --/PW res: [0x240000401:0xbb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d6b03 expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.442325:0:23404:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d6b0a lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xbb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d6b03 expref: 12 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.442333:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d6b0a lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xbb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6b03 expref: 12 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.442340:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xbb:0x0].0x0 (ffff88009d5fa200) 00010000:00010000:1.0:1715330283.442342:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330283.442344:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfed00, rc 0) 00000100:00100000:1.0:1715330283.442374:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:7134:x1798653942393024:12345-0@lo:101:mdt00_001.0 Request processed in 91us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.442379:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2162 00000100:00100000:0.0:1715330283.442437:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800877edf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942393024:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330283.442446:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f2640/0xd895711d66d6b03 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xbb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6b0a expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.442453:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f2640/0xd895711d66d6b03 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xbb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6b0a expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330283.442467:0:7134:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800877ec000 reply state ffff88012fbd9000 transno 4294983342 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d6afc lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xbb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.442474:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d6afc lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xbb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.442479:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xbb:0x0].0x0 (ffff88008d5ee200) 00010000:00010000:0.0:1715330283.442481:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330283.442483:0:7134:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1715330283.442487:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f2640/0xd895711d66d6b03 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xbb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6b0a expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.442493:0:7134:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f2640/0xd895711d66d6b03 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xbb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6b0a expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1715330283.442499:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0xbb:0x0] 00000004:00010000:0.0:1715330283.442503:0:7134:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800877ec000 reply state ffff88012fbd9000 transno 4294983342 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d6af5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14fa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.442509:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d6af5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x14fa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.442513:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14fa:0x0].0x0 (ffff88008d5eea00) 00010000:00010000:0.0:1715330283.442516:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330283.442517:0:7134:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1715330283.442520:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x14fa:0x0]: returning size 4096 00000004:00080000:0.0:1715330283.442526:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:0.0:1715330283.442531:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c480/0xd895711d66d6ad9 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6ae0 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.442537:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c480/0xd895711d66d6ad9 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d6ae0 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.442542:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c480/0xd895711d66d6ad9 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d6ae0 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.442553:0:7134:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1715330283.442556:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:0.0:1715330283.442559:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd440/0xd895711d66d6ae7 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6aee expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.442565:0:7134:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd440/0xd895711d66d6ae7 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6aee expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.442833:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715330283.442839:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c480/0xd895711d66d6ad9 lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d6ae0 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.442846:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457c480 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330283.442850:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c480/0xd895711d66d6ad9 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d6ae0 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330283.442856:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c480/0xd895711d66d6ad9 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d6ae0 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.442874:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c480/0xd895711d66d6ad9 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6ae0 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.442878:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330283.443038:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c480/0xd895711d66d6ad9 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6ae0 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.443049:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c480/0xd895711d66d6ad9 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6ae0 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.443062:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330283.443064:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330283.443065:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330283.443192:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+16:16756:x1798653937996224:12345-192.168.204.49@tcp:36:lfs.0 Request processed in 13884us (14080us total) trans 4294983342 rc 0/0 00000100:00100000:0.0:1715330283.443199:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23093 00000100:00100000:0.0:1715330283.453260:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330283.461681:0:9413:0:(service.c:168:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1715330283.461704:0:9413:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942393152 00000100:00100000:0.0:1715330283.461711:0:9413:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942393152 00000100:00100000:0.0:1715330283.461783:0:9413:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1056 00000100:00100000:0.0:1715330283.461790:0:9413:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b3a6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:7134:x1798653942393152:12345-0@lo:104: 00010000:00010000:0.0:1715330283.461803:0:9413:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd440/0xd895711d66d6ae7 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d6aee expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.461874:0:9413:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1715330283.461880:0:9413:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b3a6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:7134:x1798653942393152:12345-0@lo:104: Request processed in 90us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.461886:0:9413:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1056 00010000:00010000:0.0:1715330283.464856:0:8267:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc240/0xd895711d66d6a7e lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d6a85 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330283.464870:0:8267:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc240/0xd895711d66d6a7e lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d6a85 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.464901:0:8267:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc240/0xd895711d66d6a7e lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6a85 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.464905:0:8267:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330283.464925:0:8267:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc240/0xd895711d66d6a7e lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6a85 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1715330283.464946:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968290 is committed 00000001:00080000:0.0:1715330283.464970:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968289 is committed 00000020:00080000:0.0:1715330283.464977:0:8267:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0001: 348 batchid updated 00000020:00080000:0.0:1715330283.464990:0:8267:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff88011db63600 refcount 2 committed 0 result 0 batchid 349 00000020:00080000:0.0:1715330283.464994:0:8267:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008d699f00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff88011db639c0 00000020:00080000:0.0:1715330283.464998:0:8267:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].351 00000020:00080000:0.0:1715330283.465000:0:8267:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008d699400 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88006eff7e00 00000020:00080000:0.0:1715330283.465002:0:8267:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].350 00010000:00010000:0.0:1715330283.465020:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67840/0xd895711d66d6a0e lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x16a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330283.465026:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67840/0xd895711d66d6a0e lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x16a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330283.465031:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67840/0xd895711d66d6a0e lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x16a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330283.465037:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db67840 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330283.465040:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67840/0xd895711d66d6a0e lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x16a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330283.465046:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67840/0xd895711d66d6a0e lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x16a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330283.465058:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x16a:0x0].0x0 (ffff88008d699700) 00010000:00010000:0.0:1715330283.465061:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.465064:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67840/0xd895711d66d6a0e lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x16a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330283.465069:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67840/0xd895711d66d6a0e lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x16a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330283.465081:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d6a15 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xb8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330283.465085:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d6a15 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xb8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330283.465090:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d6a15 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xb8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330283.465094:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db65d40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330283.465096:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d6a15 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xb8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330283.465101:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d6a15 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xb8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330283.465106:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xb8:0x0].0x0 (ffff88008d699c00) 00010000:00010000:0.0:1715330283.465107:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.465109:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d6a15 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xb8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330283.465113:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d6a15 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xb8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00000100:00100000:1.0:1715330283.465358:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800877ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942393280:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1715330283.465413:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.465711:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800877ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942393280:0@lo:103:jbd2/dm-1-8.0 00000004:00080000:0.0:1715330283.465764:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 673 rpc_version 673 00000020:00100000:0.0:1715330283.465783:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1715330283.465789:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800877ef100 x1798653942393408/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715330283.465803:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800877ef100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942393408:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330283.465834:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.465852:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008b04cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.467074:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800877ef100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942393408:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1715330283.477843:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937996608 00000100:00100000:1.0:1715330283.477853:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937996608 00000100:00100000:1.0:1715330283.477904:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23097 00000100:00100000:1.0:1715330283.477911:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801345a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:16758:x1798653937996608:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:1.0:1715330283.477929:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330283.477950:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d6b3b lrc: 2/0,0 mode: --/CR res: [0x200000400:0xbb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb13e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.478001:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d6b42 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xbb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.478012:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d6b42 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xbb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.478022:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d6b42 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xbb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00200000:1.0:1715330283.478061:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0xbb:0x0]: returning size 4096 00000004:00200000:1.0:1715330283.478065:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1715330283.478092:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d6b3b lrc: 0/0,0 mode: --/CR res: [0x200000400:0xbb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb13e expref: 19 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.478108:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d6b42 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xbb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb13e expref: 18 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.478115:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xbb:0x0].0x0 (ffff88008d5ee200) 00010000:00010000:1.0:1715330283.478118:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1715330283.478120:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfef40, rc 0) 00000100:00100000:1.0:1715330283.478166:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801345a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+18:16758:x1798653937996608:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 255us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.478171:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23097 00000100:00100000:1.0:1715330283.480455:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937996672 00000100:00100000:1.0:1715330283.480463:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937996672 00000100:00100000:1.0:1715330283.480505:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23098 00000100:00100000:1.0:1715330283.480511:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801345a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+7:16758:x1798653937996672:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:1.0:1715330283.480525:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330283.480540:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc000/0xd895711d66d6b49 lrc: 2/0,0 mode: --/CR res: [0x240000401:0xbb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb145 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.480584:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe880/0xd895711d66d6b50 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xbb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.480608:0:7135:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d6b0a lrc: 2/0,0 mode: PW/PW res: [0x240000401:0xbb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6b03 expref: 5 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.480615:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe880/0xd895711d66d6b50 lrc: 4/1,0 mode: --/PR res: [0x240000401:0xbb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330283.480639:0:7135:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d6b0a lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xbb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd895711d66d6b03 expref: 5 pid: 23404 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330283.480653:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012faee300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7135:1798653942393536:0@lo:104: 00000100:00100000:1.0:1715330283.480689:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.480717:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435600 going to sleep for 11 seconds 00010000:00010000:1.0:1715330283.480901:0:9415:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715330283.480907:0:9415:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f2640/0xd895711d66d6b03 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xbb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d6b0a expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.480914:0:9415:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f2640 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330283.480919:0:9415:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f2640/0xd895711d66d6b03 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0xbb:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd895711d66d6b0a expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330283.480927:0:9415:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f2640/0xd895711d66d6b03 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0xbb:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd895711d66d6b0a expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.480946:0:9415:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f2640/0xd895711d66d6b03 lrc: 2/0,0 mode: --/PW res: [0x240000401:0xbb:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d6b0a expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.480952:0:9415:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330283.480981:0:9415:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f2640/0xd895711d66d6b03 lrc: 1/0,0 mode: --/PW res: [0x240000401:0xbb:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d6b0a expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.480987:0:9415:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f2640/0xd895711d66d6b03 lrc: 0/0,0 mode: --/PW res: [0x240000401:0xbb:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d6b0a expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.481000:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330283.481001:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330283.481003:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330283.481023:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012faee300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7135:1798653942393536:0@lo:104: 00010000:00010000:1.0:1715330283.481037:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe880/0xd895711d66d6b50 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xbb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000100:00100000:0.0:1715330283.481087:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1715330283.481096:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942393600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330283.481119:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1715330283.483670:0:8267:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0001: 349 batchid updated 00010000:00010000:0.0:1715330283.483849:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d6b0a lrc: 0/0,0 mode: --/PW res: [0x240000401:0xbb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd895711d66d6b03 expref: 6 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.483865:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xbb:0x0].0x0 (ffff88009d5fa200) 00010000:00010000:0.0:1715330283.483869:0:7120:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe880/0xd895711d66d6b50 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xbb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330283.483876:0:7120:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe880/0xd895711d66d6b50 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xbb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330283.483881:0:7120:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe880/0xd895711d66d6b50 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0xbb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330283.483896:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330283.483934:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942393600:12345-0@lo:103:ldlm_bl.0 Request processed in 2726us (2814us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.483942:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1390 00000100:00100000:0.0:1715330283.483976:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942393600:0@lo:103:ldlm_bl.0 00000004:00080000:1.0:1715330283.484149:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 674 rpc_version 674 00000020:00100000:1.0:1715330283.484170:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1715330283.484176:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012cc79500 x1798653942393728/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1715330283.484189:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc79500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942393728:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1715330283.484219:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.484344:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435600 going to sleep for 11 seconds 00010000:00010000:1.0:1715330283.484358:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe880/0xd895711d66d6b50 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xbb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330283.484364:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe880/0xd895711d66d6b50 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xbb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000004:00200000:1.0:1715330283.484400:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000401:0xbb:0x0]: returning size 4096 00000004:00200000:1.0:1715330283.484404:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1715330283.484442:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc000/0xd895711d66d6b49 lrc: 0/0,0 mode: --/CR res: [0x240000401:0xbb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb145 expref: 9 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.484454:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe880/0xd895711d66d6b50 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xbb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb145 expref: 8 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.484461:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xbb:0x0].0x0 (ffff88009d5fa200) 00010000:00010000:1.0:1715330283.484463:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1715330283.484465:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfe880, rc 0) 00000100:00100000:1.0:1715330283.484504:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801345a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+8:16758:x1798653937996672:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 3993us (4102us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.484510:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23098 00000100:00100000:0.0:1715330283.484747:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942393728 00000100:00100000:0.0:1715330283.484752:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942393728 00000100:00100000:0.0:1715330283.484775:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2165 00000100:00100000:0.0:1715330283.484780:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:8278:x1798653942393728:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330283.484877:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:8278:x1798653942393728:12345-0@lo:1000:osp_up0-1.0 Request processed in 96us (657us total) trans 4294983344 rc 0/0 00000100:00100000:0.0:1715330283.484884:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2165 00000100:00100000:1.0:1715330283.485043:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc79500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942393728:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330283.487125:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330283.487671:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330283.487698:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937996736 00000100:00100000:0.0:1715330283.487706:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937996736 00000100:00100000:1.0:1715330283.490168:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937996864 00000100:00100000:1.0:1715330283.490177:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937996864 00000100:00100000:1.0:1715330283.490224:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23099 00000100:00100000:1.0:1715330283.490232:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+18:16758:x1798653937996864:12345-192.168.204.49@tcp:36:rmdir.0 00010000:00010000:1.0:1715330283.490278:0:7135:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330283.490301:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f600/0xd895711d66d6b34 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x14fa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb137 expref: 18 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.490314:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14fa:0x0].0x0 (ffff88008d5eea00) 00010000:00010000:1.0:1715330283.490318:0:7135:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330283.490353:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc480/0xd895711d66d6b57 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.490360:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc480/0xd895711d66d6b57 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.490368:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc480/0xd895711d66d6b57 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT0 00000100:00100000:1.0:1715330283.490385:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc79880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942393792:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1715330283.490428:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.490445:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435600 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.490543:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1185 00000100:00100000:0.0:1715330283.490550:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5225450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72de1896-1df4-4b3a-930a-9116d2c66168+8:2011:x1798653937996736:12345-192.168.204.49@tcp:103:rmdir.0 00010000:00010000:0.0:1715330283.490560:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330283.490572:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64000/0xd895711d66d6b26 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x14fa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb130 expref: 8 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.490582:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14fa:0x0].0x0 (ffff88008d699900) 00010000:00010000:0.0:1715330283.490588:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330283.490639:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5225450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72de1896-1df4-4b3a-930a-9116d2c66168+7:2011:x1798653937996736:12345-192.168.204.49@tcp:103:rmdir.0 Request processed in 89us (2968us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.490646:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1185 00000100:00100000:0.0:1715330283.490686:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942393792 00000100:00100000:0.0:1715330283.490689:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942393792 00000100:00100000:0.0:1715330283.490703:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2166 00000100:00100000:0.0:1715330283.490707:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:7135:x1798653942393792:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330283.490715:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330283.490724:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1f80/0xd895711d66d6b5e lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d6b57 expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.490760:0:23404:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1f80/0xd895711d66d6b5e lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d6b57 expref: 6 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.490770:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1f80/0xd895711d66d6b5e lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6b57 expref: 6 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.490776:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88009d434900) 00010000:00010000:0.0:1715330283.490778:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.490780:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f1f80, rc 0) 00000100:00100000:0.0:1715330283.490813:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7135:x1798653942393792:12345-0@lo:101:mdt00_002.0 Request processed in 101us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.490820:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2166 00000100:00100000:1.0:1715330283.490882:0:7135:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968290 gen 2 00000004:00080000:1.0:1715330283.490887:0:7135:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968286 committed transno 4294968290 00000004:00080000:1.0:1715330283.490905:0:7135:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968287 committed transno 4294968290 00000004:00080000:1.0:1715330283.490915:0:7135:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968288 committed transno 4294968290 00000004:00080000:1.0:1715330283.490925:0:7135:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968290 committed transno 4294968290 00000100:00100000:1.0:1715330283.490946:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc79880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942393792:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330283.490957:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc480/0xd895711d66d6b57 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6b5e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.490965:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc480/0xd895711d66d6b57 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6b5e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330283.490976:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:1.0:1715330283.490988:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe640/0xd895711d66d6b65 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x6f4526f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.490993:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe640/0xd895711d66d6b65 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x6f4526f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.491000:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe640/0xd895711d66d6b65 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x6f4526f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT0 00000100:00100000:1.0:1715330283.491008:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012faed880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942393856:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1715330283.491024:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.491033:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435600 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.491084:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942393856 00000100:00100000:0.0:1715330283.491087:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942393856 00000100:00100000:0.0:1715330283.491113:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2167 00000100:00100000:0.0:1715330283.491116:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7135:x1798653942393856:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330283.491123:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330283.491130:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f21c0/0xd895711d66d6b6c lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x6f4526f1 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d6b65 expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.491141:0:23404:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f21c0/0xd895711d66d6b6c lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d6b65 expref: 7 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.491148:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f21c0/0xd895711d66d6b6c lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6b65 expref: 7 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.491152:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x6f4526f1 (ffff88009d434500) 00010000:00010000:0.0:1715330283.491154:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.491156:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f21c0, rc 0) 00000100:00100000:0.0:1715330283.491174:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7135:x1798653942393856:12345-0@lo:101:mdt00_002.0 Request processed in 57us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.491178:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2167 00000100:00100000:1.0:1715330283.491230:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012faed880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942393856:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330283.491238:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe640/0xd895711d66d6b65 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6b6c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.491245:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe640/0xd895711d66d6b65 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6b6c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330283.491253:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:1.0:1715330283.491273:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012faed880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942393920:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330283.491291:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.491299:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.491504:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012faed880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942393920:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330283.491535:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b162a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942393984:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330283.491551:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.491568:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.491689:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b162a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942393984:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1715330283.491821:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd680/0xd895711d66d6b73 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14fa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.491827:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd680/0xd895711d66d6b73 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14fa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.491832:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd680/0xd895711d66d6b73 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14fa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT0 00000100:00100000:1.0:1715330283.491841:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b162a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942394048:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1715330283.491858:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.491874:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435600 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.491983:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b162a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942394048:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330283.491990:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd680/0xd895711d66d6b73 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x14fa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6b7a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.491997:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd680/0xd895711d66d6b73 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x14fa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6b7a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.492010:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66d6b81 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14fa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.492017:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66d6b81 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14fa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.492023:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66d6b81 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14fa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.492034:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d6b88 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xbb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.492041:0:7135:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d6b42 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xbb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb13e expref: 17 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.492047:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d6b88 lrc: 4/0,1 mode: --/EX res: [0x200000400:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.492062:0:7135:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d6b42 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xbb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb13e expref: 17 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.492072:0:7135:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d6b42 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xbb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb13e expref: 17 pid: 7135 timeout: 357 lvb_type: 0 00000100:00100000:1.0:1715330283.492080:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b162a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7135:1798653942394112:192.168.204.49@tcp:104: 00000100:00100000:1.0:1715330283.492112:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435600 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.495478:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330283.496120:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b162a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7135:1798653942394112:192.168.204.49@tcp:104: 00010000:00010000:1.0:1715330283.496140:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d6b88 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000100:00100000:1.0:1715330283.496161:0:10673:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937996928 00000100:00100000:1.0:1715330283.496165:0:10673:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937996928 00010000:00010000:1.0:1715330283.496190:0:10673:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d6b42 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xbb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb13e expref: 18 pid: 7135 timeout: 357 lvb_type: 0 00000100:00100000:1.0:1715330283.496211:0:10673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1391 00000100:00100000:1.0:1715330283.496217:0:10673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d41aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:72de1896-1df4-4b3a-930a-9116d2c66168+18:2011:x1798653937996928:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1715330283.496230:0:10673:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330283.496235:0:10673:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d6b42 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xbb:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb13e expref: 18 pid: 7135 timeout: 357 lvb_type: 0 00010000:00010000:1.0:1715330283.496244:0:10673:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d6b42 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xbb:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb13e expref: 18 pid: 7135 timeout: 357 lvb_type: 0 00010000:00010000:1.0:1715330283.496261:0:10673:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d6b42 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xbb:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb13e expref: 18 pid: 7135 timeout: 357 lvb_type: 0 00010000:00010000:1.0:1715330283.496273:0:10673:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xbb:0x0].0x0 (ffff88008d5ee200) 00010000:00010000:1.0:1715330283.496277:0:10673:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d6b88 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.496284:0:10673:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d6b88 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.496291:0:10673:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d6b88 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.496303:0:10673:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330283.496335:0:10673:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d41aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:72de1896-1df4-4b3a-930a-9116d2c66168+17:2011:x1798653937996928:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 117us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.496341:0:10673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1391 00010000:00010000:1.0:1715330283.496357:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d6b88 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.496363:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d6b88 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.496389:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe1c0/0xd895711d66d6b8f lrc: 3/0,1 mode: --/EX res: [0x240000401:0xbb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.496395:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe1c0/0xd895711d66d6b8f lrc: 3/0,1 mode: --/EX res: [0x240000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.496403:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe1c0/0xd895711d66d6b8f lrc: 3/0,1 mode: --/EX res: [0x240000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT0 00000100:00100000:1.0:1715330283.496418:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b162a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942394176:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1715330283.496447:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.496466:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435600 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.502184:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b162a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942394176:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330283.502198:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe1c0/0xd895711d66d6b8f lrc: 4/0,1 mode: --/EX res: [0x240000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6b96 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.502208:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe1c0/0xd895711d66d6b8f lrc: 4/0,1 mode: --/EX res: [0x240000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6b96 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330283.502247:0:10673:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937996992 00000100:00100000:1.0:1715330283.502251:0:10673:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937996992 00010000:00010000:1.0:1715330283.502267:0:10673:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe880/0xd895711d66d6b50 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xbb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb145 expref: 7 pid: 7135 timeout: 357 lvb_type: 0 00000100:00100000:1.0:1715330283.502283:0:10673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1392 00000100:00100000:1.0:1715330283.502288:0:10673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801345a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:72de1896-1df4-4b3a-930a-9116d2c66168+7:2012:x1798653937996992:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1715330283.502297:0:10673:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330283.502302:0:10673:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe880/0xd895711d66d6b50 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xbb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb145 expref: 7 pid: 7135 timeout: 357 lvb_type: 0 00010000:00010000:1.0:1715330283.502310:0:10673:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe880/0xd895711d66d6b50 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xbb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb145 expref: 7 pid: 7135 timeout: 357 lvb_type: 0 00010000:00010000:1.0:1715330283.502326:0:10673:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe880/0xd895711d66d6b50 lrc: 0/0,0 mode: --/PR res: [0x240000401:0xbb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb145 expref: 7 pid: 7135 timeout: 357 lvb_type: 0 00010000:00010000:1.0:1715330283.502335:0:10673:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xbb:0x0].0x0 (ffff88009d5fa200) 00010000:00010000:1.0:1715330283.502339:0:10673:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67180/0xd895711d66d6b96 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6b8f expref: 8 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.502346:0:10673:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67180/0xd895711d66d6b96 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d6b8f expref: 8 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.502354:0:10673:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67180/0xd895711d66d6b96 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d6b8f expref: 8 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.502375:0:10673:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67180/0xd895711d66d6b96 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6b8f expref: 8 pid: 24873 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330283.502386:0:10673:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5ed180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001_UUID:10673:1798653942394304:0@lo:105: 00000100:00100000:1.0:1715330283.502409:0:10673:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.502431:0:10673:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435600 going to sleep for 11 seconds 00010000:00010000:1.0:1715330283.502589:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe1c0/0xd895711d66d6b8f lrc: 5/0,1 mode: EX/EX res: [0x240000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6b96 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.502614:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe1c0/0xd895711d66d6b8f lrc: 5/0,1 mode: EX/EX res: [0x240000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6b96 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330283.503135:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5ec380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942394368:0@lo:403:mdt00_002.0 00000100:00100000:1.0:1715330283.503162:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.503171:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.505040:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5ec380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942394368:0@lo:403:mdt00_002.0 00000040:00080000:0.0:1715330283.505915:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].330, 664 off508800 00000040:00080000:0.0:1715330283.506025:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].329, 744 off546360 00000004:00080000:0.0:1715330283.506029:0:7135:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88009396c6c0 with version 628 00000100:00100000:0.0:1715330283.506770:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942394496 00000100:00100000:0.0:1715330283.506775:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942394496 00000100:00100000:0.0:1715330283.506836:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2173 00000100:00100000:0.0:1715330283.506841:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:8587:x1798653942394496:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330283.507172:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:8587:x1798653942394496:12345-0@lo:1000:osp_up1-0.0 Request processed in 330us (514us total) trans 4294968291 rc 0/0 00000100:00100000:0.0:1715330283.507178:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2173 00000004:00200000:1.0:1715330283.507214:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x14fa:0x0]: returning size 4096 00010000:00010000:1.0:1715330283.507234:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d6b88 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.507242:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d6b88 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.507248:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d6b88 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.507253:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfdb00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330283.507256:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d6b88 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.507262:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d6b88 lrc: 4/0,0 mode: EX/EX res: [0x200000400:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.507272:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xbb:0x0].0x0 (ffff88008d5ee200) 00010000:00010000:1.0:1715330283.507274:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330283.507276:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d6b88 lrc: 2/0,0 mode: --/EX res: [0x200000400:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.507281:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d6b88 lrc: 0/0,0 mode: --/EX res: [0x200000400:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.507289:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe1c0/0xd895711d66d6b8f lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6b96 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.507295:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe1c0/0xd895711d66d6b8f lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d6b96 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.507300:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe1c0/0xd895711d66d6b8f lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d6b96 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.507315:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1715330283.507320:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0xbb:0x0] 00010000:00010000:1.0:1715330283.507324:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66d6b81 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14fa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.507328:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66d6b81 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x14fa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.507332:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66d6b81 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14fa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.507335:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfeac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330283.507337:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66d6b81 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14fa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.507341:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66d6b81 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x14fa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.507345:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14fa:0x0].0x0 (ffff88008d5eea00) 00010000:00010000:1.0:1715330283.507347:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330283.507348:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66d6b81 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x14fa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.507352:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66d6b81 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x14fa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.507358:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd680/0xd895711d66d6b73 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x14fa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6b7a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.507362:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd680/0xd895711d66d6b73 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x14fa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d6b7a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.507371:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd680/0xd895711d66d6b73 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14fa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d6b7a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.507378:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:1.0:1715330283.507460:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:1.0:1715330283.507464:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc480/0xd895711d66d6b57 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6b5e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.507469:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc480/0xd895711d66d6b57 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d6b5e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.507473:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc480/0xd895711d66d6b57 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d6b5e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.507480:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000004:00080000:1.0:1715330283.507482:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:1.0:1715330283.507485:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe640/0xd895711d66d6b65 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6b6c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.507489:0:7135:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe640/0xd895711d66d6b65 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6b6c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330283.507618:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:16758:x1798653937996864:12345-192.168.204.49@tcp:36:rmdir.0 Request processed in 17303us (20411us total) trans 4294983345 rc 0/0 00000100:00100000:1.0:1715330283.507625:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23099 00010000:00010000:1.0:1715330283.507640:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1715330283.507643:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd680/0xd895711d66d6b73 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x14fa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d6b7a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.507652:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfd680 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330283.507654:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd680/0xd895711d66d6b73 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14fa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d6b7a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330283.507659:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd680/0xd895711d66d6b73 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14fa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d6b7a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330283.507722:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942394560 00000100:00100000:0.0:1715330283.507725:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942394560 00000100:00100000:0.0:1715330283.507754:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1186 00000100:00100000:0.0:1715330283.507758:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801345a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+10:3690:x1798653942394560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330283.507766:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330283.507777:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67180/0xd895711d66d6b96 lrc: 0/0,0 mode: --/EX res: [0x240000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d6b8f expref: 10 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.507820:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd680/0xd895711d66d6b73 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x14fa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6b7a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.507824:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330283.507831:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd680/0xd895711d66d6b73 lrc: 1/0,0 mode: --/EX res: [0x200000402:0x14fa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6b7a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.507837:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd680/0xd895711d66d6b73 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x14fa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6b7a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.507846:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330283.507848:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330283.507849:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330283.507878:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xbb:0x0].0x0 (ffff88009d5fa200) 00010000:00010000:0.0:1715330283.507885:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330283.507907:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801345a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+11:3690:x1798653942394560:12345-0@lo:103:ldlm_bl.0 Request processed in 148us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.507913:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1186 00000100:00100000:0.0:1715330283.507924:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1188 00000100:00100000:0.0:1715330283.507928:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801345a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+10:3688:x1798653942394688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330283.507934:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330283.507943:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64480/0xd895711d66d6b7a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x14fa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d6b73 expref: 9 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.507950:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14fa:0x0].0x0 (ffff88008d699a00) 00010000:00010000:0.0:1715330283.507955:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330283.507971:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801345a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+7:3688:x1798653942394688:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.507976:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1188 00000100:00100000:0.0:1715330283.516498:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330283.516567:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937997056 00000100:00100000:1.0:1715330283.516576:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937997056 00000100:00100000:1.0:1715330283.516637:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23100 00000100:00100000:1.0:1715330283.516644:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d418380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:16759:x1798653937997056:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:1.0:1715330283.516662:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330283.516677:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d6b9d lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb14c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.516858:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d6ba4 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.516869:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d6ba4 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.516878:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d6ba4 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.516889:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66d6bab lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x6f4526f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.516894:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66d6bab lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.516898:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66d6bab lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.516932:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d6ba4 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.516938:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d6ba4 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.516943:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d6ba4 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.516947:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d6ba4 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.516951:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bffa80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330283.516954:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d6ba4 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.516960:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d6ba4 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.516968:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88008b122700) 00010000:00010000:1.0:1715330283.516971:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330283.516974:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d6ba4 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.516978:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d6ba4 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.516986:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66d6bab lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.516991:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66d6bab lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.516995:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66d6bab lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.516999:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bff3c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330283.517001:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66d6bab lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.517005:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66d6bab lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.517009:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x6f4526f2 (ffff88009d5fa500) 00010000:00010000:1.0:1715330283.517012:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330283.517013:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66d6bab lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x6f4526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.517017:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66d6bab lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x6f4526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.517038:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d6b9d lrc: 1/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb14c expref: 18 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.517049:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d6b9d lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb14c expref: 18 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.517058:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfd200, rc 0) 00000100:00100000:1.0:1715330283.517108:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d418380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:16759:x1798653937997056:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 464us (615us total) trans 0 rc 301/301 00000100:00100000:1.0:1715330283.517114:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23100 00000100:00100000:0.0:1715330283.520064:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330283.520339:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937997120 00000100:00100000:1.0:1715330283.520345:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937997120 00000100:00100000:1.0:1715330283.520370:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23101 00000100:00100000:1.0:1715330283.520376:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+6:16759:x1798653937997120:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:1.0:1715330283.520388:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330283.520402:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff840/0xd895711d66d6bb2 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb153 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.520439:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe880/0xd895711d66d6bb9 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.520448:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe880/0xd895711d66d6bb9 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330283.520456:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe880/0xd895711d66d6bb9 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000004:00200000:1.0:1715330283.520488:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000401:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1715330283.520491:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1715330283.520513:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff840/0xd895711d66d6bb2 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb153 expref: 8 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.520530:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe880/0xd895711d66d6bb9 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb153 expref: 7 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.520536:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88009d5fab00) 00010000:00010000:1.0:1715330283.520539:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1715330283.520541:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfe880, rc 0) 00000100:00100000:1.0:1715330283.520580:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+7:16759:x1798653937997120:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 204us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.520585:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23101 00000100:00100000:0.0:1715330283.524743:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937997248 00000100:00100000:0.0:1715330283.524750:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937997248 00000100:00100000:0.0:1715330283.524793:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23102 00000100:00100000:0.0:1715330283.524799:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+7:16759:x1798653937997248:12345-192.168.204.49@tcp:36:lfs.0 00000100:00100000:0.0:1715330283.524948:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d61ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942394752:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330283.524988:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.525037:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009396c180 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.525088:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942394752 00000100:00100000:1.0:1715330283.525092:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942394752 00000100:00100000:1.0:1715330283.525112:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2174 00000100:00100000:1.0:1715330283.525116:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:7134:x1798653942394752:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330283.525169:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:7134:x1798653942394752:12345-0@lo:1000:mdt00_001.0 Request processed in 51us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.525174:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2174 00000100:00100000:0.0:1715330283.525236:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d61ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942394752:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330283.525275:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800877ee680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942394816:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330283.525291:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.525298:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008b04c000 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.525307:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942394816 00000100:00100000:0.0:1715330283.525309:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942394816 00000100:00100000:0.0:1715330283.525322:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2175 00000100:00100000:0.0:1715330283.525325:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:7134:x1798653942394816:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330283.525536:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:7134:x1798653942394816:12345-0@lo:1000:mdt00_001.0 Request processed in 209us (242us total) trans 0 rc -2/-2 00000100:00100000:0.0:1715330283.525541:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2175 00000100:00100000:1.0:1715330283.525606:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800877ee680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942394816:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1715330283.525640:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfef40/0xd895711d66d6bc0 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.525649:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfef40/0xd895711d66d6bc0 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.525657:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfef40/0xd895711d66d6bc0 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT1 00000100:00100000:1.0:1715330283.525665:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942394880:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1715330283.525686:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.525694:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435480 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.525746:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942394880 00000100:00100000:0.0:1715330283.525749:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942394880 00000100:00100000:0.0:1715330283.525763:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2176 00000100:00100000:0.0:1715330283.525766:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:7134:x1798653942394880:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330283.525775:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330283.525786:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d6bc7 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d6bc0 expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.525803:0:9407:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f180/0xd895711d66d6ad2 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb129 expref: 16 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.525810:0:9407:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d6bc7 lrc: 4/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d6bc0 expref: 9 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.525827:0:9407:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f180/0xd895711d66d6ad2 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb129 expref: 16 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.525836:0:9407:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f180/0xd895711d66d6ad2 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb129 expref: 16 pid: 7134 timeout: 358 lvb_type: 0 00000100:00100000:0.0:1715330283.525843:0:9407:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800877ee680 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:9407:1798653942394944:192.168.204.49@tcp:104: 00000100:00100000:0.0:1715330283.525872:0:9407:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008b04c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.529158:0:9407:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800877ee680 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:9407:1798653942394944:192.168.204.49@tcp:104: 00010000:00010000:1.0:1715330283.529180:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d6bc7 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6bc0 expref: 9 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.529189:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88008b122700) 00010000:00010000:1.0:1715330283.529191:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330283.529194:0:9407:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d6bc7 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6bc0 expref: 9 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.529201:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f3a80, rc 0) 00000100:00100000:1.0:1715330283.529378:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7134:x1798653942394880:12345-0@lo:101:mdt00_001.0 Request processed in 3610us (3690us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.529385:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2176 00000100:00100000:1.0:1715330283.529418:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942394880:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330283.529430:0:7134:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfef40/0xd895711d66d6bc0 lrc: 4/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6bc7 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.529438:0:7134:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfef40/0xd895711d66d6bc0 lrc: 4/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6bc7 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.532833:0:7134:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfef40/0xd895711d66d6bc0 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6bc7 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.532842:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfef40/0xd895711d66d6bc0 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6bc7 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330283.532864:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:1.0:1715330283.532883:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc480/0xd895711d66d6bce lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.532889:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc480/0xd895711d66d6bce lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.532897:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc480/0xd895711d66d6bce lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT1 00000100:00100000:1.0:1715330283.532908:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942395072:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1715330283.532938:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.532953:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435480 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.534870:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942395072:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330283.534884:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc480/0xd895711d66d6bce lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6bd5 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.534893:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc480/0xd895711d66d6bce lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6bd5 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330283.534905:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:1.0:1715330283.534931:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942395136:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330283.534955:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.534977:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435b40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.535203:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942395136:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330283.535228:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942395200:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330283.535242:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.535260:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435b40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.536418:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942395200:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330283.536473:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942395264:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330283.536493:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.536514:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435b40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.536633:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942395264:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330283.536665:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942395328:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330283.536684:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.536705:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435b40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.536793:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942395328:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330283.536822:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942395392:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330283.536839:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.536860:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435b40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.537182:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942395392:0@lo:1000:mdt00_001.0 00000040:00080000:1.0:1715330283.537721:0:7134:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].352, 2168 off534952 00000040:00080000:1.0:1715330283.537830:0:7134:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].353, 2368 off584320 00000004:00080000:1.0:1715330283.537834:0:7134:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff880134435480 with version 675 00010000:00010000:1.0:1715330283.538656:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d6bdc lrc: 3/0,1 mode: --/PW res: [0x240000402:0x16c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.538667:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d6bdc lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.538679:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d6bdc lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.538691:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d6be3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.538701:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d6be3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.538706:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d6be3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.538723:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc000/0xd895711d66d6bea lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.538728:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc000/0xd895711d66d6bea lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.538765:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc000/0xd895711d66d6bea lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT1 00000100:00100000:1.0:1715330283.538775:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942395584:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1715330283.538794:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.538810:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435f00 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.539019:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942395584:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330283.539028:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc000/0xd895711d66d6bea lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6bf1 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.539035:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc000/0xd895711d66d6bea lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6bf1 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330283.539045:0:7134:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007d636300 reply state ffff880093aa9000 transno 4294968292 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d6be3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.539051:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d6be3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xb9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.539055:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xb9:0x0].0x0 (ffff88009d5fa100) 00010000:00010000:1.0:1715330283.539057:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330283.539058:0:7134:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1715330283.539061:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc000/0xd895711d66d6bea lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6bf1 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.539065:0:7134:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc000/0xd895711d66d6bea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6bf1 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330283.539069:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000401:0xb9:0x0] 00000004:00010000:1.0:1715330283.539072:0:7134:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007d636300 reply state ffff880093aa9000 transno 4294968292 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d6bdc lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.539075:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d6bdc lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.539078:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x16c:0x0].0x0 (ffff88009d5fa500) 00010000:00010000:1.0:1715330283.539079:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330283.539080:0:7134:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1715330283.539083:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x16c:0x0]: returning size 4096 00000004:00080000:1.0:1715330283.539086:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:1.0:1715330283.539089:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfef40/0xd895711d66d6bc0 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6bc7 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.539093:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfef40/0xd895711d66d6bc0 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d6bc7 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.539096:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfef40/0xd895711d66d6bc0 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d6bc7 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.539104:0:7134:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1715330283.539105:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:1.0:1715330283.539107:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc480/0xd895711d66d6bce lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6bd5 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.539111:0:7134:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc480/0xd895711d66d6bce lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6bd5 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330283.539162:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+9:16759:x1798653937997248:12345-192.168.204.49@tcp:36:lfs.0 Request processed in 14363us (14476us total) trans 4294968292 rc 0/0 00000100:00100000:1.0:1715330283.539167:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23102 00000100:00100000:0.0:1715330283.539697:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942395648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330283.551070:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937997440 00000100:00100000:1.0:1715330283.551080:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937997440 00000100:00100000:1.0:1715330283.551124:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23103 00000100:00100000:1.0:1715330283.551130:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+16:16760:x1798653937997440:12345-192.168.204.49@tcp:36:mkdir.0 00000100:00100000:1.0:1715330283.551262:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+16:16760:x1798653937997440:12345-192.168.204.49@tcp:36:mkdir.0 Request processed in 131us (267us total) trans 0 rc -17/-17 00000100:00100000:1.0:1715330283.551268:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23103 00000100:00100000:0.0:1715330283.562959:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330283.562989:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937997504 00000100:00100000:1.0:1715330283.562998:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937997504 00000100:00100000:1.0:1715330283.563047:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23104 00000100:00100000:1.0:1715330283.563055:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+16:16761:x1798653937997504:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:1.0:1715330283.563073:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330283.563091:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d6bf8 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb15a expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.563139:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d6bff lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.563149:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d6bff lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.563160:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d6bff lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.563167:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d6c06 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x6f4526f2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.563173:0:7134:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d6bd5 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f2 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6bce expref: 10 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.563178:0:7134:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d6c06 lrc: 4/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x6f4526f2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.563202:0:7134:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d6bd5 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f2 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd895711d66d6bce expref: 10 pid: 9407 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330283.563214:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7134:1798653942395712:0@lo:104: 00000100:00100000:1.0:1715330283.563254:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.563284:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435180 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.563487:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7134:1798653942395712:0@lo:104: 00010000:00010000:1.0:1715330283.563501:0:7134:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d6c06 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x6f4526f2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000100:00100000:0.0:1715330283.563520:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942395776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330283.563545:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1715330283.568002:0:7116:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe640/0xd895711d66d6b65 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d6b6c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330283.568018:0:7116:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe640/0xd895711d66d6b65 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d6b6c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.568060:0:7116:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe640/0xd895711d66d6b65 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x6f4526f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6b6c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.568066:0:7116:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330283.568104:0:7116:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe640/0xd895711d66d6b65 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x6f4526f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6b6c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1715330283.568122:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983346 is committed 00000100:00100000:1.0:1715330283.568127:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000001:00080000:0.0:1715330283.568143:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983345 is committed 00000100:00100000:1.0:1715330283.568144:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942395840:0@lo:103:jbd2/dm-0-8.0 00000020:00080000:0.0:1715330283.568153:0:7116:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88008b04cb40 refcount 2 committed 0 result 0 batchid 344 00000020:00080000:0.0:1715330283.568157:0:7116:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008d5ee800 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88008b04c480 00000020:00080000:0.0:1715330283.568160:0:7116:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].328 00000020:00080000:0.0:1715330283.568162:0:7116:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008d5ee900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88011dad4800 00000020:00080000:0.0:1715330283.568164:0:7116:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].329 00000100:00100000:1.0:1715330283.568196:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1715330283.568226:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d6af5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x14fa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.568239:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d6af5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x14fa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.568249:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d6af5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x14fa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.568253:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f3cc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330283.568257:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d6af5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x14fa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.568262:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d6af5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x14fa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.568271:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14fa:0x0].0x0 (ffff88008d5eea00) 00010000:00010000:1.0:1715330283.568274:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330283.568277:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d6af5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x14fa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.568281:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d6af5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x14fa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.568298:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d6afc lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xbb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.568303:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d6afc lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xbb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.568307:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d6afc lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xbb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.568310:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f1d40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330283.568312:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d6afc lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xbb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.568316:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d6afc lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xbb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.568324:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xbb:0x0].0x0 (ffff88008d5ee200) 00010000:00010000:1.0:1715330283.568326:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330283.568328:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d6afc lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xbb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.568332:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d6afc lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xbb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.568371:0:7134:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d6c06 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.568377:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d6c06 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000100:00100000:1.0:1715330283.568408:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942395840:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1715330283.568433:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942395776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330283.568450:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942395904:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330283.568477:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.568501:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008b04c300 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.568889:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942395904:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1715330283.568917:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1b00/0xd895711d66d6c0d lrc: 3/1,0 mode: --/PR res: [0x240000402:0x16c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.568926:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1b00/0xd895711d66d6c0d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x16c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.568933:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1b00/0xd895711d66d6c0d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x16c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000004:00010000:0.0:1715330283.568949:0:7134:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1b00/0xd895711d66d6c0d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x16c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.568958:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d6bff lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.568963:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d6bff lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.568967:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d6bff lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.568972:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d6bff lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.568976:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfc240 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330283.568979:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d6bff lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.568983:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d6bff lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.568990:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88009d5fa200) 00010000:00010000:0.0:1715330283.568992:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.568994:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d6bff lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.568999:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d6bff lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.569006:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d6c06 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.569011:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d6c06 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.569015:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d6c06 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.569018:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfcfc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330283.569020:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d6c06 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.569024:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d6c06 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.569029:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x6f4526f2 (ffff88008d699f00) 00010000:00010000:0.0:1715330283.569031:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.569032:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d6c06 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x6f4526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.569036:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d6c06 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x6f4526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.569061:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d6bf8 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb15a expref: 15 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.569075:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1b00/0xd895711d66d6c0d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x16c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb15a expref: 14 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.569081:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x16c:0x0].0x0 (ffff8800b5276a00) 00010000:00010000:0.0:1715330283.569082:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1715330283.569084:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f1b00, rc 0) 00000100:00100000:0.0:1715330283.569129:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+14:16761:x1798653937997504:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 6074us (6178us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.569136:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23104 00000100:00100000:0.0:1715330283.574706:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330283.574798:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937997568 00000100:00100000:1.0:1715330283.574806:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937997568 00000100:00100000:1.0:1715330283.574843:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23105 00000100:00100000:1.0:1715330283.574850:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+9:16761:x1798653937997568:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:1.0:1715330283.574869:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330283.574884:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc480/0xd895711d66d6c14 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x16c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb161 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.574928:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc900/0xd895711d66d6c1b lrc: 3/1,0 mode: --/PR res: [0x240000402:0x16c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.574939:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc900/0xd895711d66d6c1b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x16c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.574947:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc900/0xd895711d66d6c1b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x16c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00000004:00200000:1.0:1715330283.575048:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x16c:0x0]: returning size 4096 00000004:00200000:1.0:1715330283.575051:0:7134:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1715330283.575076:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc480/0xd895711d66d6c14 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb161 expref: 11 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.575090:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc900/0xd895711d66d6c1b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x16c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb161 expref: 10 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.575096:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x16c:0x0].0x0 (ffff88009d5fa500) 00010000:00010000:1.0:1715330283.575099:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1715330283.575101:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfc900, rc 0) 00000100:00100000:1.0:1715330283.575138:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+10:16761:x1798653937997568:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 289us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.575144:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23105 00000100:00100000:1.0:1715330283.577437:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937997632 00000100:00100000:1.0:1715330283.577444:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937997632 00000100:00100000:1.0:1715330283.577479:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23106 00000100:00100000:1.0:1715330283.577485:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+10:16761:x1798653937997632:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:1.0:1715330283.577498:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330283.577511:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d6c22 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xb9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb168 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.577547:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe400/0xd895711d66d6c29 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.577557:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe400/0xd895711d66d6c29 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.577565:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe400/0xd895711d66d6c29 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xb9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00000004:00200000:1.0:1715330283.577629:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000400:0xb9:0x0]: returning size 4096 00000004:00200000:1.0:1715330283.577633:0:7134:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1715330283.577657:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d6c22 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xb9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb168 expref: 12 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.577670:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe400/0xd895711d66d6c29 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb168 expref: 11 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.577677:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xb9:0x0].0x0 (ffff88009d5fa100) 00010000:00010000:1.0:1715330283.577680:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1715330283.577683:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfe400, rc 0) 00000100:00100000:1.0:1715330283.578343:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+11:16761:x1798653937997632:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 856us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.578350:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23106 00000100:00100000:0.0:1715330283.580822:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330283.581107:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937997696 00000100:00100000:1.0:1715330283.581114:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937997696 00000100:00100000:1.0:1715330283.581153:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23107 00000100:00100000:1.0:1715330283.581159:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+14:16761:x1798653937997696:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:1.0:1715330283.581173:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330283.581188:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d6c30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb16f expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.581227:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d6c37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.581238:0:7134:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f600/0xd895711d66d6bf1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6bea expref: 5 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.581244:0:7134:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d6c37 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.581269:0:7134:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f600/0xd895711d66d6bf1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd895711d66d6bea expref: 5 pid: 24873 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330283.581282:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013027aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7134:1798653942395968:0@lo:104: 00000100:00100000:1.0:1715330283.581314:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.581338:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435180 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.581837:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88013027aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7134:1798653942395968:0@lo:104: 00010000:00010000:1.0:1715330283.581849:0:7134:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d6c37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000100:00100000:1.0:1715330283.582037:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942396032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330283.582058:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1715330283.585935:0:7116:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 344 batchid updated 00000100:00100000:0.0:1715330283.586180:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942396032:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330283.586369:0:7134:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d6c37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.586376:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d6c37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000004:00200000:1.0:1715330283.586414:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xb9:0x0]: returning size 4096 00000004:00200000:1.0:1715330283.586418:0:7134:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1715330283.586449:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d6c30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb16f expref: 16 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.586462:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d6c37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb16f expref: 15 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.586468:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb9:0x0].0x0 (ffff88008b122a00) 00010000:00010000:1.0:1715330283.586471:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1715330283.586473:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bffcc0, rc 0) 00000100:00100000:1.0:1715330283.586506:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+15:16761:x1798653937997696:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 5347us (5689us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.586513:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23107 00000100:00100000:0.0:1715330283.593800:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330283.600339:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937997888 00000100:00100000:1.0:1715330283.600348:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937997888 00000100:00100000:1.0:1715330283.600397:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23108 00000100:00100000:1.0:1715330283.600405:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+11:16761:x1798653937997888:12345-192.168.204.49@tcp:36:rmdir.0 00010000:00010000:1.0:1715330283.600445:0:7134:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330283.600465:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc900/0xd895711d66d6c1b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x16c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb161 expref: 11 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.600479:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x16c:0x0].0x0 (ffff88009d5fa500) 00010000:00010000:1.0:1715330283.600487:0:7134:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330283.600521:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff180/0xd895711d66d6c3e lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.600528:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff180/0xd895711d66d6c3e lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.600537:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff180/0xd895711d66d6c3e lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT1 00000100:00100000:1.0:1715330283.600554:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130279f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942396224:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1715330283.600610:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.600633:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435a80 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.600686:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942396224 00000100:00100000:0.0:1715330283.600690:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942396224 00000100:00100000:0.0:1715330283.600719:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2187 00000100:00100000:0.0:1715330283.600723:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ba3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:7134:x1798653942396224:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330283.600745:0:24873:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330283.600758:0:24873:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d6c45 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d6c3e expref: -99 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.600776:0:24873:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d6c45 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d6c3e expref: 6 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.600786:0:24873:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d6c45 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6c3e expref: 6 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.600791:0:24873:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff8800b5206900) 00010000:00010000:0.0:1715330283.600793:0:24873:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.600795:0:24873:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f3840, rc 0) 00000100:00100000:0.0:1715330283.600824:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ba3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:7134:x1798653942396224:12345-0@lo:101:mdt00_001.0 Request processed in 99us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.600829:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2187 00000100:00100000:1.0:1715330283.601066:0:7134:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983346 gen 2 00000004:00080000:1.0:1715330283.601071:0:7134:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983341 committed transno 4294983346 00000020:00080000:1.0:1715330283.601075:0:7134:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff880091cb2480 refcount 2 committed 0 result 0 batchid 350 00000020:00080000:1.0:1715330283.601079:0:7134:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008b122600 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880091cb2e40 00000020:00080000:1.0:1715330283.601082:0:7134:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].352 00000020:00080000:1.0:1715330283.601084:0:7134:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008b122e00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88009d6a9600 00000020:00080000:1.0:1715330283.601086:0:7134:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].351 00000004:00080000:1.0:1715330283.601105:0:7134:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983343 committed transno 4294983346 00000004:00080000:1.0:1715330283.601116:0:7134:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983344 committed transno 4294983346 00000004:00080000:1.0:1715330283.601127:0:7134:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983346 committed transno 4294983346 00000100:00100000:1.0:1715330283.601145:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880130279f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942396224:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330283.601156:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff180/0xd895711d66d6c3e lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6c45 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.601164:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff180/0xd895711d66d6c3e lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6c45 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330283.601174:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:1.0:1715330283.601187:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcd80/0xd895711d66d6c4c lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.601192:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcd80/0xd895711d66d6c4c lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.601197:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcd80/0xd895711d66d6c4c lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT1 00000100:00100000:1.0:1715330283.601205:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130279f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942396288:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1715330283.601223:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.601231:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435a80 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.601279:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942396288 00000100:00100000:0.0:1715330283.601283:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942396288 00000100:00100000:0.0:1715330283.601296:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2188 00000100:00100000:0.0:1715330283.601299:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130278000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:7134:x1798653942396288:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330283.601306:0:24873:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330283.601314:0:24873:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d6c53 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f2 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d6c4c expref: -99 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.601324:0:24873:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d6c53 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d6c4c expref: 7 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.601332:0:24873:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d6c53 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6c4c expref: 7 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.601337:0:24873:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x6f4526f2 (ffff8800b5206800) 00010000:00010000:0.0:1715330283.601339:0:24873:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.601341:0:24873:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f06c0, rc 0) 00000100:00100000:0.0:1715330283.601545:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130278000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7134:x1798653942396288:12345-0@lo:101:mdt00_001.0 Request processed in 243us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.601550:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2188 00000100:00100000:1.0:1715330283.601615:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880130279f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942396288:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330283.601623:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcd80/0xd895711d66d6c4c lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6c53 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.601633:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcd80/0xd895711d66d6c4c lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6c53 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330283.601640:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:1.0:1715330283.601661:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130279f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942396352:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330283.601680:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.601699:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435480 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.601748:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942396352 00000100:00100000:0.0:1715330283.601752:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942396352 00000100:00100000:0.0:1715330283.601828:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2189 00000100:00100000:0.0:1715330283.601833:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130278380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7134:x1798653942396352:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330283.601960:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130278380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7134:x1798653942396352:12345-0@lo:1000:mdt00_001.0 Request processed in 126us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.601966:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2189 00000100:00100000:1.0:1715330283.602067:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880130279f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942396352:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330283.602095:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130279f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942396416:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330283.602111:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.602129:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435480 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.602271:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942396416 00000100:00100000:0.0:1715330283.602274:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942396416 00000100:00100000:0.0:1715330283.602326:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2190 00000100:00100000:0.0:1715330283.602330:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013027a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7134:x1798653942396416:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330283.602391:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013027a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7134:x1798653942396416:12345-0@lo:1000:mdt00_001.0 Request processed in 60us (278us total) trans 0 rc 1/1 00000100:00100000:0.0:1715330283.602396:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2190 00000100:00100000:1.0:1715330283.602462:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880130279f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942396416:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1715330283.602488:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfdf80/0xd895711d66d6c5a lrc: 3/0,1 mode: --/EX res: [0x240000402:0x16c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.602494:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfdf80/0xd895711d66d6c5a lrc: 3/0,1 mode: --/EX res: [0x240000402:0x16c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.602499:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfdf80/0xd895711d66d6c5a lrc: 3/0,1 mode: --/EX res: [0x240000402:0x16c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT1 00000100:00100000:1.0:1715330283.602507:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130279f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942396480:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1715330283.602523:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.602530:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435a80 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.602841:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880130279f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942396480:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330283.602848:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfdf80/0xd895711d66d6c5a lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x16c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6c61 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.602858:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfdf80/0xd895711d66d6c5a lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x16c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6c61 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.602871:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d6c68 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x16c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.602877:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d6c68 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.602882:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d6c68 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.602893:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d6c6f lrc: 3/0,1 mode: --/EX res: [0x240000400:0xb9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.602899:0:7134:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe400/0xd895711d66d6c29 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb168 expref: 10 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.602905:0:7134:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d6c6f lrc: 4/0,1 mode: --/EX res: [0x240000400:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.602920:0:7134:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe400/0xd895711d66d6c29 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb168 expref: 10 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.602930:0:7134:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe400/0xd895711d66d6c29 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb168 expref: 10 pid: 7134 timeout: 358 lvb_type: 0 00000100:00100000:1.0:1715330283.602944:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130279f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7134:1798653942396544:192.168.204.49@tcp:104: 00000100:00100000:1.0:1715330283.602977:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435a80 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.612312:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880130279f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7134:1798653942396544:192.168.204.49@tcp:104: 00010000:00010000:1.0:1715330283.612334:0:7134:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d6c6f lrc: 3/0,1 mode: --/EX res: [0x240000400:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00000100:00100000:0.0:1715330283.614456:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937997952 00000100:00100000:0.0:1715330283.614462:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937997952 00010000:00010000:0.0:1715330283.614485:0:9416:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe400/0xd895711d66d6c29 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb168 expref: 11 pid: 7134 timeout: 358 lvb_type: 0 00000100:00100000:0.0:1715330283.614505:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1396 00000100:00100000:0.0:1715330283.614511:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+11:2012:x1798653937997952:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1715330283.614521:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330283.614525:0:9416:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe400/0xd895711d66d6c29 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb168 expref: 11 pid: 7134 timeout: 358 lvb_type: 0 00010000:00010000:0.0:1715330283.614535:0:9416:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe400/0xd895711d66d6c29 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb168 expref: 11 pid: 7134 timeout: 358 lvb_type: 0 00010000:00010000:0.0:1715330283.614550:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe400/0xd895711d66d6c29 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb168 expref: 11 pid: 7134 timeout: 358 lvb_type: 0 00010000:00010000:0.0:1715330283.614561:0:9416:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xb9:0x0].0x0 (ffff88009d5fa100) 00010000:00010000:0.0:1715330283.614565:0:9416:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d6c6f lrc: 3/0,1 mode: --/EX res: [0x240000400:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.614572:0:9416:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d6c6f lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.614582:0:9416:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d6c6f lrc: 4/0,1 mode: EX/EX res: [0x240000400:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.614606:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330283.614637:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+10:2012:x1798653937997952:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 125us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.614642:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1396 00010000:00010000:1.0:1715330283.614754:0:7134:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d6c6f lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.614761:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d6c6f lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.614791:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfdd40/0xd895711d66d6c76 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.614797:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfdd40/0xd895711d66d6c76 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.614805:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfdd40/0xd895711d66d6c76 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT1 00000100:00100000:1.0:1715330283.614820:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130279f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942396608:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1715330283.614847:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.614858:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435a80 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.614896:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942396608 00000100:00100000:0.0:1715330283.614899:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942396608 00000100:00100000:0.0:1715330283.615089:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2192 00000100:00100000:0.0:1715330283.615093:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130279500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:7134:x1798653942396608:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330283.615105:0:24873:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330283.615117:0:24873:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1b00/0xd895711d66d6c7d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d6c76 expref: -99 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.615131:0:24873:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d6c37 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb16f expref: 13 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.615139:0:24873:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1b00/0xd895711d66d6c7d lrc: 4/0,0 mode: --/EX res: [0x200000401:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d6c76 expref: 9 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.615154:0:24873:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d6c37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb16f expref: 13 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.615164:0:24873:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d6c37 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb16f expref: 13 pid: 7134 timeout: 358 lvb_type: 0 00000100:00100000:0.0:1715330283.615172:0:24873:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c1180 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:24873:1798653942396672:192.168.204.49@tcp:104: 00000100:00100000:0.0:1715330283.615205:0:24873:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008b04c240 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.619283:0:24873:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c1180 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:24873:1798653942396672:192.168.204.49@tcp:104: 00010000:00010000:0.0:1715330283.619306:0:24873:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1b00/0xd895711d66d6c7d lrc: 3/0,0 mode: --/EX res: [0x200000401:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6c76 expref: 9 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.619316:0:24873:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb9:0x0].0x0 (ffff88008b122a00) 00010000:00010000:0.0:1715330283.619319:0:24873:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715330283.619322:0:24873:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1b00/0xd895711d66d6c7d lrc: 3/0,0 mode: --/EX res: [0x200000401:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6c76 expref: 9 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.619330:0:24873:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1b00/0xd895711d66d6c7d lrc: 3/0,0 mode: --/EX res: [0x200000401:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6c76 expref: 9 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.619336:0:24873:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f1b00, rc 0) 00000100:00100000:0.0:1715330283.619368:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130279500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7134:x1798653942396608:12345-0@lo:101:mdt00_001.0 Request processed in 4275us (4520us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.619376:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2192 00000100:00100000:0.0:1715330283.619494:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330283.619552:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880130279f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942396608:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330283.619565:0:7134:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfdd40/0xd895711d66d6c76 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6c7d expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.619573:0:7134:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfdd40/0xd895711d66d6c76 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6c7d expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.621222:0:7134:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfdd40/0xd895711d66d6c76 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6c7d expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.621231:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfdd40/0xd895711d66d6c76 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6c7d expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330283.622176:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130279f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942396800:0@lo:403:mdt00_001.0 00000100:00100000:1.0:1715330283.622210:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.622230:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435a80 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.622278:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942396800 00000100:00100000:0.0:1715330283.622283:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942396800 00000100:00100000:0.0:1715330283.622312:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2193 00000100:00100000:0.0:1715330283.622317:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013027b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7134:x1798653942396800:12345-0@lo:403:mdt00_001.0 00000100:00100000:0.0:1715330283.624880:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013027b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7134:x1798653942396800:12345-0@lo:403:mdt00_001.0 Request processed in 2558us (2666us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.624888:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2193 00000100:00100000:1.0:1715330283.624980:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880130279f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942396800:0@lo:403:mdt00_001.0 00000040:00080000:1.0:1715330283.626376:0:7134:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].353, 664 off535616 00000040:00080000:1.0:1715330283.626496:0:7134:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].354, 744 off585064 00000004:00080000:1.0:1715330283.626501:0:7134:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff880134435a80 with version 676 00000100:00100000:0.0:1715330283.626716:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942396928 00000100:00100000:0.0:1715330283.626722:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942396928 00000100:00100000:0.0:1715330283.626763:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2194 00000100:00100000:0.0:1715330283.626768:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d41b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:8278:x1798653942396928:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330283.627032:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d41b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:8278:x1798653942396928:12345-0@lo:1000:osp_up0-1.0 Request processed in 262us (387us total) trans 4294983347 rc 0/0 00000100:00100000:0.0:1715330283.627039:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2194 00000004:00200000:1.0:1715330283.628193:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x16c:0x0]: returning size 4096 00010000:00010000:1.0:1715330283.628213:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d6c6f lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.628220:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d6c6f lrc: 2/0,0 mode: EX/EX res: [0x240000400:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.628226:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d6c6f lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.628231:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfcb40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330283.628234:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d6c6f lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.628240:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d6c6f lrc: 4/0,0 mode: EX/EX res: [0x240000400:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.628252:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xb9:0x0].0x0 (ffff88009d5fa100) 00010000:00010000:1.0:1715330283.628255:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330283.628306:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d6c6f lrc: 2/0,0 mode: --/EX res: [0x240000400:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.628312:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d6c6f lrc: 0/0,0 mode: --/EX res: [0x240000400:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.628322:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfdd40/0xd895711d66d6c76 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6c7d expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.628328:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfdd40/0xd895711d66d6c76 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d6c7d expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.628333:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfdd40/0xd895711d66d6c76 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d6c7d expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.628344:0:7134:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1715330283.628350:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000401:0xb9:0x0] 00010000:00010000:1.0:1715330283.628354:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d6c68 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.628358:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d6c68 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.628362:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d6c68 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.628366:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bff600 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330283.628368:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d6c68 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.628372:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d6c68 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.628382:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x16c:0x0].0x0 (ffff88009d5fa500) 00010000:00010000:1.0:1715330283.628384:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330283.628386:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d6c68 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.628394:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d6c68 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.628402:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfdf80/0xd895711d66d6c5a lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x16c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6c61 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.628407:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfdf80/0xd895711d66d6c5a lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x16c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d6c61 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.628412:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfdf80/0xd895711d66d6c5a lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x16c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d6c61 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.628432:0:7134:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:1.0:1715330283.628546:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:1.0:1715330283.628550:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff180/0xd895711d66d6c3e lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6c45 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.628556:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff180/0xd895711d66d6c3e lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d6c45 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.628561:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff180/0xd895711d66d6c3e lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d6c45 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.628575:0:7134:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1715330283.628578:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:1.0:1715330283.628582:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcd80/0xd895711d66d6c4c lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6c53 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.628587:0:7134:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcd80/0xd895711d66d6c4c lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6c53 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330283.628617:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d418e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942396992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330283.628650:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.628652:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+10:16761:x1798653937997888:12345-192.168.204.49@tcp:36:rmdir.0 Request processed in 28246us (28376us total) trans 4294968294 rc 0/0 00000100:00100000:1.0:1715330283.628658:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23108 00010000:00010000:1.0:1715330283.628674:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330283.628675:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1715330283.628681:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d41a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942397120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330283.628699:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942396992 00000100:00100000:0.0:1715330283.628699:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.628703:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942396992 00000100:00100000:0.0:1715330283.628717:0:10673:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942397056 00000100:00100000:0.0:1715330283.628720:0:10673:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942397056 00000100:00100000:1.0:1715330283.628723:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942397120 00000100:00100000:1.0:1715330283.628725:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942397120 00000100:00100000:1.0:1715330283.628754:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1192 00000100:00100000:1.0:1715330283.628758:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5225050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942396992:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330283.628762:0:10673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1193 00000100:00100000:0.0:1715330283.628766:0:10673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+12:3689:x1798653942397120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330283.628767:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330283.628774:0:10673:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330283.628778:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1b00/0xd895711d66d6c7d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d6c76 expref: 12 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.628784:0:10673:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d6c45 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d6c3e expref: 12 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.628787:0:9416:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb9:0x0].0x0 (ffff88008b122a00) 00010000:00010000:1.0:1715330283.628794:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715330283.628794:0:10673:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff8800b5206900) 00010000:00010000:0.0:1715330283.628799:0:10673:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330283.628818:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5225050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+10:3690:x1798653942396992:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.628819:0:10673:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+10:3689:x1798653942397120:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.628823:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1192 00000100:00100000:0.0:1715330283.628826:0:10673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1193 00000100:00100000:0.0:1715330283.628848:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d41a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942397120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330283.628880:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d418e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942396992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330283.640076:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330283.640182:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937998080 00000100:00100000:0.0:1715330283.640190:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937998080 00000100:00100000:0.0:1715330283.640231:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23109 00000100:00100000:0.0:1715330283.640238:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013027ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+10:16762:x1798653937998080:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:0.0:1715330283.640257:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330283.640272:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d6c84 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb176 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.640321:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3840/0xd895711d66d6c8b lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.640331:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3840/0xd895711d66d6c8b lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.640340:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3840/0xd895711d66d6c8b lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.640350:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1b00/0xd895711d66d6c92 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x6f4526f3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.640356:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1b00/0xd895711d66d6c92 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.640360:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1b00/0xd895711d66d6c92 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.640396:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3840/0xd895711d66d6c8b lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.640401:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3840/0xd895711d66d6c8b lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.640406:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3840/0xd895711d66d6c8b lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.640410:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3840/0xd895711d66d6c8b lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.640415:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f3840 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330283.640419:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3840/0xd895711d66d6c8b lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.640424:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3840/0xd895711d66d6c8b lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.640433:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88009d5fab00) 00010000:00010000:0.0:1715330283.640436:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.640439:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3840/0xd895711d66d6c8b lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.640444:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3840/0xd895711d66d6c8b lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.640452:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1b00/0xd895711d66d6c92 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.640456:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1b00/0xd895711d66d6c92 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.640460:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1b00/0xd895711d66d6c92 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.640465:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f1b00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330283.640467:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1b00/0xd895711d66d6c92 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.640471:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1b00/0xd895711d66d6c92 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.640476:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x6f4526f3 (ffff8800b5276a00) 00010000:00010000:0.0:1715330283.640478:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.640480:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1b00/0xd895711d66d6c92 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x6f4526f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.640484:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1b00/0xd895711d66d6c92 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x6f4526f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.640506:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d6c84 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb176 expref: 11 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.640513:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d6c84 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb176 expref: 11 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.640520:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f2d00, rc 0) 00000100:00100000:0.0:1715330283.640679:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013027ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+10:16762:x1798653937998080:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 439us (606us total) trans 0 rc 301/301 00000100:00100000:0.0:1715330283.640685:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23109 00000100:00100000:0.0:1715330283.646109:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937998144 00000100:00100000:0.0:1715330283.646117:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937998144 00000100:00100000:0.0:1715330283.646151:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23110 00000100:00100000:0.0:1715330283.646158:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d418a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+13:16762:x1798653937998144:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:0.0:1715330283.646174:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330283.646190:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d6c99 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb17d expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.646235:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d6ca0 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.646246:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d6ca0 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.646255:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d6ca0 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000004:00200000:0.0:1715330283.646293:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1715330283.646298:0:7134:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1715330283.646323:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d6c99 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb17d expref: 15 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.646336:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d6ca0 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb17d expref: 14 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.646342:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff8800b5276f00) 00010000:00010000:0.0:1715330283.646345:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1715330283.646348:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f1d40, rc 0) 00000100:00100000:0.0:1715330283.646947:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d418a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+14:16762:x1798653937998144:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 788us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.646954:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23110 00000100:00100000:1.0:1715330283.652337:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330283.652373:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937998272 00000100:00100000:0.0:1715330283.652381:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937998272 00000100:00100000:0.0:1715330283.652419:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23111 00000100:00100000:0.0:1715330283.652426:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013027aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+14:16762:x1798653937998272:12345-192.168.204.49@tcp:36:lfs.0 00000100:00100000:0.0:1715330283.652504:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942397184:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330283.652539:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.652558:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008b04cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.652678:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942397184:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330283.652711:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942397248:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330283.652728:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.652757:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008b04cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.652867:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942397248:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1715330283.652900:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f3cc0/0xd895711d66d6ca7 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.652907:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f3cc0/0xd895711d66d6ca7 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.652914:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f3cc0/0xd895711d66d6ca7 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT0 00000100:00100000:0.0:1715330283.652922:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942397312:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1715330283.652939:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.652955:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008b04c240 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.654959:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942397312:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330283.654970:0:7134:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f3cc0/0xd895711d66d6ca7 lrc: 4/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6cae expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.654978:0:7134:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f3cc0/0xd895711d66d6ca7 lrc: 4/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6cae expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330283.655570:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00010000:00010000:1.0:1715330283.656212:0:7134:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f3cc0/0xd895711d66d6ca7 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6cae expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.656219:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f3cc0/0xd895711d66d6ca7 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6cae expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330283.656245:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:1.0:1715330283.656262:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff600/0xd895711d66d6cb5 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x6f4526f3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.656268:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff600/0xd895711d66d6cb5 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x6f4526f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.656275:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff600/0xd895711d66d6cb5 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x6f4526f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT0 00000100:00100000:1.0:1715330283.656289:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130278a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942397504:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1715330283.656309:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.656330:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435f00 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.656485:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880130278a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942397504:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330283.656493:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff600/0xd895711d66d6cb5 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526f3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6cbc expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.656500:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff600/0xd895711d66d6cb5 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526f3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6cbc expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330283.656508:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:1.0:1715330283.656527:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130278a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942397568:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330283.656544:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.656550:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435e40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.656640:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880130278a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942397568:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330283.656666:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d57100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942397632:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330283.656680:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.656686:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435e40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.656775:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d57100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942397632:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330283.656815:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d57100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942397696:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330283.656829:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.656835:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435e40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.656899:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d57100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942397696:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330283.656927:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942397760:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330283.656940:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.656946:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435e40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.657008:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942397760:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330283.657036:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942397824:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330283.657051:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.657058:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435e40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.657290:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942397824:0@lo:1000:mdt00_001.0 00080000:02000000:1.0:1715330283.657400:0:7134:0:(osd_handler.c:2105:osd_trans_start()) *** cfs_fail_loc=19a, val=0*** 00000004:00080000:1.0:1715330283.657412:0:7134:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880134435f00 with version 0 00000020:00080000:1.0:1715330283.657416:0:7134:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff880134435e40 refcount 3 committed 0 result -5 batchid 346 00000020:00080000:1.0:1715330283.657418:0:7134:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009d5fa000 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result -5 sub_th ffff880134435f00 00000020:00080000:1.0:1715330283.657421:0:7134:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009d5fa600 obd lustre-MDT0000-osd committed 1 started 0 stopped 1 result 0 sub_th ffff88008d40ba00 00000004:00080000:1.0:1715330283.657448:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:1.0:1715330283.657454:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f3cc0/0xd895711d66d6ca7 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6cae expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.657460:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f3cc0/0xd895711d66d6ca7 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d6cae expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.657470:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f3cc0/0xd895711d66d6ca7 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d6cae expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.657492:0:7134:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1715330283.657496:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:1.0:1715330283.657499:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff600/0xd895711d66d6cb5 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526f3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6cbc expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.657504:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff600/0xd895711d66d6cb5 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526f3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d6cbc expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.657508:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff600/0xd895711d66d6cb5 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526f3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d6cbc expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.657516:0:7134:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1715330283.657546:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013027aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+14:16762:x1798653937998272:12345-192.168.204.49@tcp:36:lfs.0 Request processed in 5121us (5213us total) trans 0 rc -5/-5 00000100:00100000:1.0:1715330283.657552:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23111 00000100:00100000:0.0:1715330283.657588:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942397888:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330283.657631:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.657758:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942397888:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330283.671316:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937998464 00000100:00100000:1.0:1715330283.671323:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937998464 00000100:00100000:1.0:1715330283.671366:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23112 00000100:00100000:1.0:1715330283.671373:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d419500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+9:16766:x1798653937998464:12345-192.168.204.49@tcp:36:mkdir.0 00010000:00010000:1.0:1715330283.671474:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d6cc3 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.671485:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d6cc3 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.671494:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d6cc3 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.671503:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d6cca lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x6f4526f3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.671508:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d6cca lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.671513:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d6cca lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.671842:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdf80/0xd895711d66d6cd1 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x16d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.671850:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdf80/0xd895711d66d6cd1 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x16d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.671855:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdf80/0xd895711d66d6cd1 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x16d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00000004:00010000:1.0:1715330283.671866:0:7134:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009d419500 reply state ffff88009d7c1000 transno 4294968295 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdf80/0xd895711d66d6cd1 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x16d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.671873:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdf80/0xd895711d66d6cd1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x16d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.671878:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x16d:0x0].0x0 (ffff88009d5fa900) 00010000:00010000:1.0:1715330283.671881:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330283.671883:0:7134:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1715330283.671886:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x16d:0x0]: returning size 4096 00010000:00010000:1.0:1715330283.671891:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d6cc3 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.671895:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d6cc3 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.671903:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d6cc3 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.671909:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d6cc3 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.671913:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfcb40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330283.671916:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d6cc3 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.671921:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d6cc3 lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.671927:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88009d5faa00) 00010000:00010000:1.0:1715330283.671930:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330283.671932:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d6cc3 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.671937:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d6cc3 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00000004:00010000:1.0:1715330283.671949:0:7134:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009d419500 reply state ffff88009d7c1000 transno 4294968295 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d6cca lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.671954:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d6cca lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x6f4526f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.671959:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x6f4526f3 (ffff88009d5fae00) 00010000:00010000:1.0:1715330283.671961:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330283.671962:0:7134:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1715330283.672021:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d419500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+11:16766:x1798653937998464:12345-192.168.204.49@tcp:36:mkdir.0 Request processed in 647us (785us total) trans 4294968295 rc 0/0 00000100:00100000:1.0:1715330283.672031:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23112 00000100:00100000:0.0:1715330283.679918:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937998528 00000100:00100000:0.0:1715330283.679926:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937998528 00000100:00100000:0.0:1715330283.679960:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23113 00000100:00100000:0.0:1715330283.679967:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d418700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+11:16773:x1798653937998528:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:0.0:1715330283.679985:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330283.680001:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d6cd8 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb184 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.680056:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d6cdf lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.680065:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d6cdf lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.680074:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d6cdf lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.680082:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1f80/0xd895711d66d6ce6 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x6f4526f3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.680088:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1f80/0xd895711d66d6ce6 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.680092:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1f80/0xd895711d66d6ce6 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.680240:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2640/0xd895711d66d6ced lrc: 3/1,0 mode: --/PR res: [0x240000402:0x16d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.680247:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2640/0xd895711d66d6ced lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x16d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.680253:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2640/0xd895711d66d6ced lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x16d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00000004:00200000:0.0:1715330283.680285:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x16d:0x0]: returning size 4096 00000004:00200000:0.0:1715330283.680288:0:7134:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1715330283.680436:0:7134:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2640/0xd895711d66d6ced lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x16d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.680446:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d6cdf lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.680451:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d6cdf lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.680456:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d6cdf lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.680461:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d6cdf lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.680465:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f3a80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330283.680468:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d6cdf lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.680473:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d6cdf lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.680482:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88011d537500) 00010000:00010000:0.0:1715330283.680485:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.680488:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d6cdf lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.680492:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d6cdf lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.680501:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1f80/0xd895711d66d6ce6 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.680505:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1f80/0xd895711d66d6ce6 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.680509:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1f80/0xd895711d66d6ce6 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.680513:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f1f80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330283.680515:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1f80/0xd895711d66d6ce6 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.680519:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1f80/0xd895711d66d6ce6 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.680524:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x6f4526f3 (ffff88009d5fae00) 00010000:00010000:0.0:1715330283.680526:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.680528:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1f80/0xd895711d66d6ce6 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x6f4526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.680532:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1f80/0xd895711d66d6ce6 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x6f4526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.680549:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d6cd8 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb184 expref: 13 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.680560:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2640/0xd895711d66d6ced lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x16d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb184 expref: 12 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.680565:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x16d:0x0].0x0 (ffff88009d5fa900) 00010000:00010000:0.0:1715330283.680567:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1715330283.680568:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f2640, rc 0) 00000100:00100000:0.0:1715330283.680659:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d418700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+12:16773:x1798653937998528:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 692us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.680665:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23113 00000100:00100000:0.0:1715330283.682967:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937998656 00000100:00100000:0.0:1715330283.682974:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937998656 00000100:00100000:0.0:1715330283.683001:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23114 00000100:00100000:0.0:1715330283.683499:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d41ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+12:16773:x1798653937998656:12345-192.168.204.49@tcp:36:rmdir.0 00010000:00010000:0.0:1715330283.683540:0:7134:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330283.683557:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2640/0xd895711d66d6ced lrc: 0/0,0 mode: --/PR res: [0x240000402:0x16d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb184 expref: 12 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.683569:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x16d:0x0].0x0 (ffff88009d5fa900) 00010000:00010000:0.0:1715330283.683572:0:7134:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715330283.683599:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d6cf4 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.683609:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d6cf4 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.683615:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d6cf4 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.683622:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d6cfb lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x6f4526f3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.683627:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d6cfb lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.683632:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d6cfb lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.683676:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0000/0xd895711d66d6d02 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x16d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.683681:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0000/0xd895711d66d6d02 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x16d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.683686:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0000/0xd895711d66d6d02 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x16d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00000004:00200000:0.0:1715330283.683860:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x16d:0x0]: returning size 4096 00010000:00010000:0.0:1715330283.684781:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0000/0xd895711d66d6d02 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x16d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.684788:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0000/0xd895711d66d6d02 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x16d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.684793:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0000/0xd895711d66d6d02 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x16d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.684797:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f0000 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330283.684800:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0000/0xd895711d66d6d02 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x16d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.684805:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0000/0xd895711d66d6d02 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x16d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.684813:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x16d:0x0].0x0 (ffff88009d5fa900) 00010000:00010000:0.0:1715330283.684815:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715330283.684817:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0000/0xd895711d66d6d02 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x16d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.684879:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0000/0xd895711d66d6d02 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x16d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.684902:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d6cf4 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.684907:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d6cf4 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.684911:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d6cf4 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.684915:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d6cf4 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.684923:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f2ac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330283.684925:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d6cf4 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.684929:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d6cf4 lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.684934:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88011d537800) 00010000:00010000:0.0:1715330283.684936:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.684938:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d6cf4 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.684942:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d6cf4 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00000004:00010000:0.0:1715330283.684952:0:7134:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009d41ad80 reply state ffff88012fbbc000 transno 4294968296 ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d6cfb lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.684959:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d6cfb lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x6f4526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.684964:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x6f4526f3 (ffff88009d5fae00) 00010000:00010000:0.0:1715330283.684966:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330283.684968:0:7134:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1715330283.685100:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d41ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+13:16773:x1798653937998656:12345-192.168.204.49@tcp:36:rmdir.0 Request processed in 2091us (2201us total) trans 4294968296 rc 0/0 00000100:00100000:0.0:1715330283.685107:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23114 00000100:00100000:0.0:1715330283.694094:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330283.694133:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937998720 00000100:00100000:1.0:1715330283.694140:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937998720 00000100:00100000:1.0:1715330283.694174:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23115 00000100:00100000:1.0:1715330283.694180:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+14:16774:x1798653937998720:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:1.0:1715330283.694194:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330283.694209:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe880/0xd895711d66d6d09 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb18b expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.694266:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d6d10 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.694276:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d6d10 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.694285:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d6d10 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.694294:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d6d17 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x6f4526f4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.694303:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d6d17 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.694308:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d6d17 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.694339:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d6d10 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.694344:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d6d10 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.694349:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d6d10 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.694355:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d6d10 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.694359:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfdd40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330283.694362:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d6d10 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.694367:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d6d10 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.694375:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff8800b5276f00) 00010000:00010000:1.0:1715330283.694377:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330283.694380:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d6d10 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.694384:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d6d10 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.694392:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d6d17 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.694396:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d6d17 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.694401:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d6d17 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.694405:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bffcc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330283.694407:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d6d17 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.694415:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d6d17 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.694419:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x6f4526f4 (ffff8800b5276a00) 00010000:00010000:1.0:1715330283.694421:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330283.694423:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d6d17 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x6f4526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.694427:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d6d17 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x6f4526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.694445:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe880/0xd895711d66d6d09 lrc: 1/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb18b expref: 15 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.694451:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe880/0xd895711d66d6d09 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb18b expref: 15 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.694457:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfe880, rc 0) 00000100:00100000:1.0:1715330283.694490:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+14:16774:x1798653937998720:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 309us (404us total) trans 0 rc 301/301 00000100:00100000:1.0:1715330283.694495:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23115 00000100:00100000:1.0:1715330283.699030:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937998784 00000100:00100000:1.0:1715330283.699039:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937998784 00000100:00100000:1.0:1715330283.699074:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23116 00000100:00100000:1.0:1715330283.699321:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d41aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+13:16774:x1798653937998784:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:1.0:1715330283.699340:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330283.699357:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc900/0xd895711d66d6d1e lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb192 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.699406:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc000/0xd895711d66d6d25 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.699415:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc000/0xd895711d66d6d25 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.699424:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc000/0xd895711d66d6d25 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00000004:00200000:1.0:1715330283.699458:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000401:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1715330283.699461:0:7134:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1715330283.699485:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc900/0xd895711d66d6d1e lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb192 expref: 15 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.699497:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc000/0xd895711d66d6d25 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb192 expref: 14 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.699504:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff8800b5276c00) 00010000:00010000:1.0:1715330283.699506:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1715330283.699508:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfc000, rc 0) 00000100:00100000:1.0:1715330283.699547:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d41aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+14:16774:x1798653937998784:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 229us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.699658:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23116 00000100:00100000:1.0:1715330283.705589:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937998912 00000100:00100000:1.0:1715330283.705605:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937998912 00000100:00100000:1.0:1715330283.705650:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23117 00000100:00100000:1.0:1715330283.705657:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d418e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+14:16774:x1798653937998912:12345-192.168.204.49@tcp:36:lfs.0 00000100:00100000:1.0:1715330283.705849:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942398016:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330283.705894:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.705917:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435480 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.705935:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942398016 00000100:00100000:0.0:1715330283.705939:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942398016 00000100:00100000:0.0:1715330283.705959:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2204 00000100:00100000:0.0:1715330283.705964:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7134:x1798653942398016:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330283.706024:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7134:x1798653942398016:12345-0@lo:1000:mdt00_001.0 Request processed in 58us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.706034:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2204 00000100:00100000:1.0:1715330283.706253:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942398016:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330283.706286:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942398080:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330283.706302:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.706475:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435480 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.706676:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942398080:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1715330283.706901:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc6c0/0xd895711d66d6d2c lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.706909:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc6c0/0xd895711d66d6d2c lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.706917:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc6c0/0xd895711d66d6d2c lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT1 00000100:00100000:1.0:1715330283.706925:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942398144:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1715330283.706941:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.707299:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435f00 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.711313:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937998976 00000100:00100000:0.0:1715330283.711318:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937998976 00010000:00010000:0.0:1715330283.711338:0:7121:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d6ca0 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb17d expref: 14 pid: 7134 timeout: 358 lvb_type: 0 00000100:00100000:0.0:1715330283.711359:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1399 00000100:00100000:0.0:1715330283.711365:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d634a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+14:2012:x1798653937998976:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1715330283.711375:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330283.711379:0:7121:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d6ca0 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb17d expref: 14 pid: 7134 timeout: 358 lvb_type: 0 00010000:00010000:0.0:1715330283.711387:0:7121:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d6ca0 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb17d expref: 14 pid: 7134 timeout: 358 lvb_type: 0 00010000:00010000:0.0:1715330283.711404:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d6ca0 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb17d expref: 14 pid: 7134 timeout: 358 lvb_type: 0 00010000:00010000:0.0:1715330283.711413:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff8800b5276f00) 00010000:00010000:0.0:1715330283.711417:0:7121:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d6d33 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6d2c expref: 7 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.711423:0:7121:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d6d33 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d6d2c expref: 7 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.711506:0:7121:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d6d33 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d6d2c expref: 7 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.711528:0:7121:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d6d33 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6d2c expref: 7 pid: 9407 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330283.711538:0:7121:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:7121:1798653942398272:0@lo:105: 00000100:00100000:0.0:1715330283.711562:0:7121:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.712189:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942398144:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330283.712201:0:7134:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc6c0/0xd895711d66d6d2c lrc: 4/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6d33 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.712208:0:7134:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc6c0/0xd895711d66d6d2c lrc: 4/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6d33 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330283.712830:0:7121:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008b04c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.713100:0:7121:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:7121:1798653942398272:0@lo:105: 00010000:00010000:0.0:1715330283.713111:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330283.713139:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d634a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+13:2012:x1798653937998976:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 1774us (1917us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.713146:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1399 00010000:00010000:1.0:1715330283.713456:0:7134:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc6c0/0xd895711d66d6d2c lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6d33 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.713466:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc6c0/0xd895711d66d6d2c lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6d33 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330283.713481:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:1.0:1715330283.713501:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc480/0xd895711d66d6d3a lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.713506:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc480/0xd895711d66d6d3a lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.713513:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc480/0xd895711d66d6d3a lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT1 00000100:00100000:1.0:1715330283.713524:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942398336:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1715330283.713543:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.713991:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435f00 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.714211:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942398336:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330283.714218:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc480/0xd895711d66d6d3a lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6d41 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.714223:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc480/0xd895711d66d6d3a lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6d41 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330283.714231:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:1.0:1715330283.714252:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942398400:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330283.714271:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.714278:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435480 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.714316:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942398400 00000100:00100000:0.0:1715330283.714319:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942398400 00000100:00100000:0.0:1715330283.714333:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2208 00000100:00100000:0.0:1715330283.714337:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7134:x1798653942398400:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330283.714382:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7134:x1798653942398400:12345-0@lo:1000:mdt00_001.0 Request processed in 44us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.714386:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2208 00000100:00100000:1.0:1715330283.714543:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942398400:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330283.714572:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942398464:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330283.714587:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.714607:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435480 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.714644:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942398464 00000100:00100000:0.0:1715330283.714647:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942398464 00000100:00100000:0.0:1715330283.714659:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2209 00000100:00100000:0.0:1715330283.714662:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7134:x1798653942398464:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330283.714713:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7134:x1798653942398464:12345-0@lo:1000:mdt00_001.0 Request processed in 49us (124us total) trans 0 rc -2/-2 00000100:00100000:0.0:1715330283.714718:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2209 00000100:00100000:1.0:1715330283.715219:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942398464:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330283.715265:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942398528:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330283.715281:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.715289:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435480 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.715955:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942398528:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330283.715989:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942398592:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330283.716007:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.716028:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435480 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.716176:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942398592:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330283.716211:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942398656:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330283.716227:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.716236:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435480 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.717070:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942398656:0@lo:1000:mdt00_001.0 00000040:00080000:1.0:1715330283.717671:0:7134:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].354, 2168 off537784 00000040:00080000:1.0:1715330283.717749:0:7134:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].355, 2368 off587432 00000004:00080000:1.0:1715330283.717753:0:7134:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff880134435f00 with version 677 00010000:00010000:0.0:1715330283.718558:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0480/0xd895711d66d6d48 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x16e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.718570:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0480/0xd895711d66d6d48 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x16e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.718578:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0480/0xd895711d66d6d48 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x16e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.718598:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d6d4f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xba:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.718603:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d6d4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.718607:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d6d4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.718622:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1680/0xd895711d66d6d56 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xba:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.718627:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1680/0xd895711d66d6d56 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.718633:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1680/0xd895711d66d6d56 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT1 00000100:00100000:0.0:1715330283.718642:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d61bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942398848:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1715330283.718663:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.718671:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008b04c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.719061:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d61bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942398848:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330283.719069:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1680/0xd895711d66d6d56 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6d5d expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.719076:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1680/0xd895711d66d6d56 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6d5d expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330283.719088:0:7134:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009d418e00 reply state ffff88008b189000 transno 4294968297 ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d6d4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.719095:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d6d4f lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.719099:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xba:0x0].0x0 (ffff88011d537200) 00010000:00010000:1.0:1715330283.719101:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330283.719103:0:7134:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1715330283.719108:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1680/0xd895711d66d6d56 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6d5d expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.719113:0:7134:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1680/0xd895711d66d6d56 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6d5d expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330283.719120:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000401:0xba:0x0] 00000004:00010000:1.0:1715330283.719123:0:7134:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009d418e00 reply state ffff88008b189000 transno 4294968297 ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0480/0xd895711d66d6d48 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x16e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.719129:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0480/0xd895711d66d6d48 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x16e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.719133:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x16e:0x0].0x0 (ffff88011d537000) 00010000:00010000:1.0:1715330283.719135:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330283.719136:0:7134:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1715330283.719139:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x16e:0x0]: returning size 4096 00000004:00080000:1.0:1715330283.719143:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:1.0:1715330283.719148:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc6c0/0xd895711d66d6d2c lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6d33 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.719153:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc6c0/0xd895711d66d6d2c lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d6d33 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.719159:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc6c0/0xd895711d66d6d2c lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d6d33 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.719179:0:7134:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1715330283.719183:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:1.0:1715330283.719186:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc480/0xd895711d66d6d3a lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6d41 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.719192:0:7134:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc480/0xd895711d66d6d3a lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6d41 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330283.719242:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d418e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+16:16774:x1798653937998912:12345-192.168.204.49@tcp:36:lfs.0 Request processed in 13584us (15400us total) trans 4294968297 rc 0/0 00000100:00100000:1.0:1715330283.719247:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23117 00010000:00010000:0.0:1715330283.719288:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715330283.719292:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc6c0/0xd895711d66d6d2c lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d6d33 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.719298:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfc6c0 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330283.719302:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc6c0/0xd895711d66d6d2c lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d6d33 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330283.719308:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc6c0/0xd895711d66d6d2c lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d6d33 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.719323:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc6c0/0xd895711d66d6d2c lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6d33 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.719327:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330283.719340:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc6c0/0xd895711d66d6d2c lrc: 1/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6d33 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.719345:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc6c0/0xd895711d66d6d2c lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6d33 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.719355:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330283.719356:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330283.719357:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330283.719710:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942398912 00000100:00100000:0.0:1715330283.719714:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942398912 00000100:00100000:0.0:1715330283.719766:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1197 00000100:00100000:0.0:1715330283.719769:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5227050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+11:3691:x1798653942398912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330283.719776:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330283.719784:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d6d33 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d6d2c expref: 11 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.719792:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff8800b5276f00) 00010000:00010000:0.0:1715330283.719798:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330283.720009:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5227050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+10:3691:x1798653942398912:12345-0@lo:103:ldlm_bl.0 Request processed in 238us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.720013:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1197 00000100:00100000:0.0:1715330283.733553:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937999104 00000100:00100000:0.0:1715330283.733562:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937999104 00000100:00100000:0.0:1715330283.733665:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23118 00000100:00100000:0.0:1715330283.733672:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+13:16775:x1798653937999104:12345-192.168.204.49@tcp:36:mkdir.0 00000100:00100000:0.0:1715330283.733812:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+13:16775:x1798653937999104:12345-192.168.204.49@tcp:36:mkdir.0 Request processed in 139us (354us total) trans 0 rc -17/-17 00000100:00100000:0.0:1715330283.733818:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23118 00000100:00100000:0.0:1715330283.747942:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330283.750017:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942399040 00000100:00100000:0.0:1715330283.750020:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942399040 00010000:00010000:0.0:1715330283.750034:0:7121:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d6d41 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f4 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd895711d66d6d3a expref: 10 pid: 9407 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330283.750048:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1400 00000100:00100000:0.0:1715330283.750052:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d634e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+10:3688:x1798653942399040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330283.750059:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330283.752686:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d6d41 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f4 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd895711d66d6d3a expref: 8 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.752699:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x6f4526f4 (ffff88008b122500) 00010000:00010000:0.0:1715330283.752703:0:7121:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d6d72 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x6f4526f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.752710:0:7121:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d6d72 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.752716:0:7121:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d6d72 lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.752743:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330283.752791:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d634e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+7:3688:x1798653942399040:12345-0@lo:103:ldlm_bl.0 Request processed in 2737us (2844us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.752798:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1400 00000100:00100000:1.0:1715330283.754355:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942399104 00000100:00100000:1.0:1715330283.754361:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942399104 00000100:00100000:1.0:1715330283.754399:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2215 00000100:00100000:1.0:1715330283.754405:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801345a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7134:x1798653942399104:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330283.754474:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801345a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7134:x1798653942399104:12345-0@lo:1000:mdt00_001.0 Request processed in 68us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.754479:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2215 00000100:00100000:0.0:1715330283.762497:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937999296 00000100:00100000:0.0:1715330283.762503:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937999296 00000100:00100000:0.0:1715330283.764768:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330283.765390:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801345a4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7134:1798653942399168:0@lo:104: 00010000:00010000:0.0:1715330283.765407:0:7134:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d6da3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xba:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000100:00100000:1.0:1715330283.765448:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801345a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942399232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330283.765472:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.765587:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942399232 00000100:00100000:0.0:1715330283.765713:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942399232 00010000:00010000:0.0:1715330283.765727:0:7121:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d200/0xd895711d66d6d5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xba:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd895711d66d6d56 expref: 7 pid: 24873 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330283.765766:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1401 00000100:00100000:0.0:1715330283.765770:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+7:3689:x1798653942399232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330283.765777:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330283.766050:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d200/0xd895711d66d6d5d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xba:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd895711d66d6d56 expref: 7 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.766072:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xba:0x0].0x0 (ffff88008b122800) 00010000:00010000:0.0:1715330283.766076:0:7121:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d6da3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xba:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.766085:0:7121:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d6da3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xba:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.766090:0:7121:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d6da3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xba:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.766338:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330283.766346:0:7134:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d6da3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xba:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.766351:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d6da3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xba:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000100:00100000:0.0:1715330283.766366:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+6:3689:x1798653942399232:12345-0@lo:103:ldlm_bl.0 Request processed in 595us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.766371:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1401 00000100:00100000:1.0:1715330283.766379:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801345a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942399232:0@lo:103:ldlm_bl.0 00000004:00200000:1.0:1715330283.766455:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xba:0x0]: returning size 4096 00000004:00200000:1.0:1715330283.766459:0:7134:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1715330283.766485:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db661c0/0xd895711d66d6d9c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xba:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb1ae expref: 16 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.766507:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d6da3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xba:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb1ae expref: 15 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.766512:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xba:0x0].0x0 (ffff88008b122800) 00010000:00010000:1.0:1715330283.766514:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1715330283.766516:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db65200, rc 0) 00000100:00100000:1.0:1715330283.766580:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d79ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+15:16776:x1798653937999360:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 1723us (1814us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.766585:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23122 00000100:00100000:1.0:1715330283.769628:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937999552 00000100:00100000:1.0:1715330283.769635:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937999552 00000100:00100000:0.0:1715330283.769831:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937999424 00000100:00100000:0.0:1715330283.769835:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937999424 00000100:00100000:0.0:1715330283.769861:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1198 00000100:00100000:0.0:1715330283.769866:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d637800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+15:2014:x1798653937999424:12345-192.168.204.49@tcp:103:rmdir.0 00010000:00010000:0.0:1715330283.769876:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330283.769892:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d6d79 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x16e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb199 expref: 15 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.769906:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x16e:0x0].0x0 (ffff88008d699e00) 00010000:00010000:0.0:1715330283.769914:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330283.769953:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d637800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+14:2014:x1798653937999424:12345-192.168.204.49@tcp:103:rmdir.0 Request processed in 85us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.769958:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1198 00000100:00100000:1.0:1715330283.770060:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23123 00000100:00100000:1.0:1715330283.770064:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+18:16776:x1798653937999552:12345-192.168.204.49@tcp:36:rmdir.0 00010000:00010000:1.0:1715330283.770097:0:7134:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330283.770107:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d6d87 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x16e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb1a0 expref: 18 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.770117:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x16e:0x0].0x0 (ffff88011d537000) 00010000:00010000:1.0:1715330283.770120:0:7134:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330283.770152:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd440/0xd895711d66d6daa lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.770159:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd440/0xd895711d66d6daa lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.770166:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd440/0xd895711d66d6daa lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT1 00000100:00100000:1.0:1715330283.770182:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942399296:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1715330283.770210:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.770221:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.770466:0:7134:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983348 gen 2 00000004:00080000:0.0:1715330283.770470:0:7134:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983347 committed transno 4294983348 00000004:00080000:0.0:1715330283.770488:0:7134:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983348 committed transno 4294983348 00000100:00100000:0.0:1715330283.770504:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942399296:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330283.770516:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd440/0xd895711d66d6daa lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6db1 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.770523:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd440/0xd895711d66d6daa lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6db1 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1715330283.770534:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:0.0:1715330283.770546:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2400/0xd895711d66d6db8 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.770551:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2400/0xd895711d66d6db8 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.770556:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2400/0xd895711d66d6db8 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT1 00000100:00100000:0.0:1715330283.770565:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d54e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942399360:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1715330283.770581:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.770604:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008b04c780 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.771053:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d54e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942399360:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330283.771060:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2400/0xd895711d66d6db8 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6dbf expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.771065:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2400/0xd895711d66d6db8 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6dbf expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1715330283.771073:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:0.0:1715330283.771091:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d419c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942399424:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330283.771107:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.771378:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008b04c000 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.771797:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942399424 00000100:00100000:1.0:1715330283.771800:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942399424 00000100:00100000:1.0:1715330283.771814:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2218 00000100:00100000:1.0:1715330283.771817:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:7134:x1798653942399424:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330283.771859:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:7134:x1798653942399424:12345-0@lo:1000:mdt00_001.0 Request processed in 41us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.771863:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2218 00000100:00100000:0.0:1715330283.771907:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d419c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942399424:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330283.771932:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d419c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942399488:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330283.771945:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.771951:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008b04c000 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.772112:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d419c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942399488:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1715330283.772138:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2880/0xd895711d66d6dc6 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x16e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.772144:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2880/0xd895711d66d6dc6 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x16e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.772150:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2880/0xd895711d66d6dc6 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x16e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT1 00000100:00100000:0.0:1715330283.772158:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d419c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942399552:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1715330283.772174:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.772501:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008b04c780 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.772546:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942399552 00000100:00100000:1.0:1715330283.772549:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942399552 00000100:00100000:1.0:1715330283.772641:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2220 00000100:00100000:1.0:1715330283.772646:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:7134:x1798653942399552:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330283.772652:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330283.772661:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d6dcd lrc: 2/0,0 mode: --/EX res: [0x240000402:0x16e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d6dc6 expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.772673:0:23404:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d6dcd lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x16e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d6dc6 expref: 9 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.772680:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d6dcd lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x16e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6dc6 expref: 9 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.772685:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x16e:0x0].0x0 (ffff880091c70900) 00010000:00010000:1.0:1715330283.772687:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1715330283.772688:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfcfc0, rc 0) 00000100:00100000:1.0:1715330283.772716:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7134:x1798653942399552:12345-0@lo:101:mdt00_001.0 Request processed in 70us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.772721:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2220 00000100:00100000:0.0:1715330283.772765:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d419c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942399552:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330283.772772:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2880/0xd895711d66d6dc6 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x16e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6dcd expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.772778:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2880/0xd895711d66d6dc6 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x16e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6dcd expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.772791:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d6dd4 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x16e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.772797:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d6dd4 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x16e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.772803:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d6dd4 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x16e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.772815:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d6ddb lrc: 3/0,1 mode: --/EX res: [0x240000400:0xba:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.772823:0:7134:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d6d95 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xba:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb1a7 expref: 17 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.772829:0:7134:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d6ddb lrc: 4/0,1 mode: --/EX res: [0x240000400:0xba:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.772844:0:7134:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d6d95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xba:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb1a7 expref: 17 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.772853:0:7134:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d6d95 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xba:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb1a7 expref: 17 pid: 7134 timeout: 358 lvb_type: 0 00000100:00100000:0.0:1715330283.772862:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7134:1798653942399616:192.168.204.49@tcp:104: 00000100:00100000:0.0:1715330283.773365:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008b04c780 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.777939:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7134:1798653942399616:192.168.204.49@tcp:104: 00010000:00010000:0.0:1715330283.777961:0:7134:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d6ddb lrc: 3/0,1 mode: --/EX res: [0x240000400:0xba:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00000100:00100000:1.0:1715330283.778851:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00010000:00010000:1.0:1715330283.779279:0:7134:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d6ddb lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.779285:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d6ddb lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.779314:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc240/0xd895711d66d6de2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xba:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.779320:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc240/0xd895711d66d6de2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.779328:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc240/0xd895711d66d6de2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT1 00000100:00100000:1.0:1715330283.779342:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942399680:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1715330283.779371:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.779381:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47e180 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.782163:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942399680:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330283.782176:0:7134:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc240/0xd895711d66d6de2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6de9 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.782183:0:7134:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc240/0xd895711d66d6de2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6de9 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.782982:0:7134:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc240/0xd895711d66d6de2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6de9 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.782990:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc240/0xd895711d66d6de2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6de9 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330283.783484:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942399872:0@lo:403:mdt00_001.0 00000100:00100000:0.0:1715330283.783521:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.783530:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008b04c780 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.785106:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942399872:0@lo:403:mdt00_001.0 00000040:00080000:0.0:1715330283.785824:0:7134:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].355, 664 off538448 00000040:00080000:0.0:1715330283.785953:0:7134:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].356, 744 off588176 00000004:00080000:0.0:1715330283.785957:0:7134:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88008b04c780 with version 678 00000004:00200000:0.0:1715330283.786952:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x16e:0x0]: returning size 4096 00010000:00010000:0.0:1715330283.786968:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d6ddb lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.786976:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d6ddb lrc: 2/0,0 mode: EX/EX res: [0x240000400:0xba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.786982:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d6ddb lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.786986:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f2ac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330283.786990:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d6ddb lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.786996:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d6ddb lrc: 4/0,0 mode: EX/EX res: [0x240000400:0xba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.787007:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xba:0x0].0x0 (ffff88011d537200) 00010000:00010000:0.0:1715330283.787010:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715330283.787013:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d6ddb lrc: 2/0,0 mode: --/EX res: [0x240000400:0xba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.787017:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d6ddb lrc: 0/0,0 mode: --/EX res: [0x240000400:0xba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.787027:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc240/0xd895711d66d6de2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6de9 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.787033:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc240/0xd895711d66d6de2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d6de9 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.787038:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc240/0xd895711d66d6de2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d6de9 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.787054:0:7134:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1715330283.787059:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000401:0xba:0x0] 00010000:00010000:0.0:1715330283.787062:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d6dd4 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x16e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.787065:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d6dd4 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x16e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.787068:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d6dd4 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x16e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.787070:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f1d40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330283.787071:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d6dd4 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x16e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.787074:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d6dd4 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x16e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.787078:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x16e:0x0].0x0 (ffff88011d537000) 00010000:00010000:0.0:1715330283.787079:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.787080:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d6dd4 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x16e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.787082:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d6dd4 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x16e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.787088:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2880/0xd895711d66d6dc6 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x16e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6dcd expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.787092:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2880/0xd895711d66d6dc6 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x16e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d6dcd expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.787095:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2880/0xd895711d66d6dc6 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x16e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d6dcd expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.787104:0:7134:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1715330283.787130:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1715330283.787135:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc240/0xd895711d66d6de2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d6de9 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.787141:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfc240 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330283.787145:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc240/0xd895711d66d6de2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d6de9 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330283.787150:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc240/0xd895711d66d6de2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d6de9 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.787167:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc240/0xd895711d66d6de2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6de9 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.787172:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330283.787194:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc240/0xd895711d66d6de2 lrc: 1/0,0 mode: --/EX res: [0x200000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6de9 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.787199:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc240/0xd895711d66d6de2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6de9 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1715330283.787201:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:0.0:1715330283.787204:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd440/0xd895711d66d6daa lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6db1 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.787208:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd440/0xd895711d66d6daa lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d6db1 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.787212:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715330283.787213:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd440/0xd895711d66d6daa lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d6db1 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.787215:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2880/0xd895711d66d6dc6 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x16e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d6dcd expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.787219:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f2880 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330283.787221:0:7134:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1715330283.787222:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2880/0xd895711d66d6dc6 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x16e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d6dcd expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1715330283.787223:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:0.0:1715330283.787227:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2400/0xd895711d66d6db8 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6dbf expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330283.787231:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2880/0xd895711d66d6dc6 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x16e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d6dcd expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.787232:0:7134:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2400/0xd895711d66d6db8 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6dbf expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.787242:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2880/0xd895711d66d6dc6 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x16e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6dcd expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.787246:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330283.787250:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2880/0xd895711d66d6dc6 lrc: 1/0,0 mode: --/EX res: [0x240000402:0x16e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6dcd expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.787255:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2880/0xd895711d66d6dc6 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x16e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6dcd expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.787262:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715330283.787264:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd440/0xd895711d66d6daa lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d6db1 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.787268:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfd440 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330283.787271:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd440/0xd895711d66d6daa lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d6db1 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330283.787271:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+17:16776:x1798653937999552:12345-192.168.204.49@tcp:36:rmdir.0 Request processed in 17206us (17722us total) trans 4294968298 rc 0/0 00000004:00010000:1.0:1715330283.787276:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd440/0xd895711d66d6daa lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d6db1 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330283.787278:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23123 00010000:00010000:1.0:1715330283.787285:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd440/0xd895711d66d6daa lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6db1 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.787289:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330283.787297:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd440/0xd895711d66d6daa lrc: 1/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6db1 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.787306:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd440/0xd895711d66d6daa lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6db1 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.787314:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330283.787315:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330283.787317:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330283.787323:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942400064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330283.787479:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.788197:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942400064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330283.788309:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942400192 00000100:00100000:0.0:1715330283.788312:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942400192 00000100:00100000:0.0:1715330283.788326:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1201 00000100:00100000:0.0:1715330283.788330:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5224450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+11:3688:x1798653942400192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330283.788336:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330283.788344:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d6db1 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d6daa expref: 11 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.788476:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88008b122200) 00010000:00010000:0.0:1715330283.788481:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330283.788498:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5224450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+8:3688:x1798653942400192:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.788503:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1201 00000100:00100000:0.0:1715330283.797071:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653937999744 00000100:00100000:0.0:1715330283.797079:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653937999744 00000100:00100000:0.0:1715330283.797127:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23124 00000100:00100000:0.0:1715330283.797134:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+17:16777:x1798653937999744:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:0.0:1715330283.797156:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330283.797171:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0000/0xd895711d66d6df0 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb1b5 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.797270:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2640/0xd895711d66d6df7 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.797281:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2640/0xd895711d66d6df7 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.797294:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2640/0xd895711d66d6df7 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.797305:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d6dfe lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x6f4526f5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.797309:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d6dfe lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.797314:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d6dfe lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.797350:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2640/0xd895711d66d6df7 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.797356:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2640/0xd895711d66d6df7 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.797361:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2640/0xd895711d66d6df7 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.797366:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2640/0xd895711d66d6df7 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.797370:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f2640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330283.797374:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2640/0xd895711d66d6df7 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.797379:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2640/0xd895711d66d6df7 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.797388:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff8800b5276c00) 00010000:00010000:0.0:1715330283.797391:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.797395:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2640/0xd895711d66d6df7 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.797400:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2640/0xd895711d66d6df7 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.797411:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d6dfe lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.797416:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d6dfe lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.797420:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d6dfe lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.797423:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f3cc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330283.797425:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d6dfe lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.797429:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d6dfe lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.797434:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x6f4526f5 (ffff88009d434200) 00010000:00010000:0.0:1715330283.797436:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.797438:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d6dfe lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x6f4526f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.797443:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d6dfe lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x6f4526f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.797464:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0000/0xd895711d66d6df0 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb1b5 expref: 18 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.797471:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0000/0xd895711d66d6df0 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb1b5 expref: 18 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.797479:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f0000, rc 0) 00000100:00100000:0.0:1715330283.797528:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+17:16777:x1798653937999744:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 394us (511us total) trans 0 rc 301/301 00000100:00100000:0.0:1715330283.797534:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23124 00000100:00100000:0.0:1715330283.802433:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330283.808229:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942400384 00000100:00100000:1.0:1715330283.808233:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942400384 00000100:00100000:1.0:1715330283.808260:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2226 00000100:00100000:1.0:1715330283.808264:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134567b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7134:x1798653942400384:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330283.808272:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330283.808284:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d6e1a lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d6e13 expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.808302:0:23404:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc000/0xd895711d66d6d25 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb192 expref: 16 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.808309:0:23404:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d6e1a lrc: 4/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d6e13 expref: 8 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.808329:0:23404:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc000/0xd895711d66d6d25 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb192 expref: 16 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.808339:0:23404:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc000/0xd895711d66d6d25 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb192 expref: 16 pid: 7134 timeout: 358 lvb_type: 0 00000100:00100000:1.0:1715330283.808350:0:23404:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:23404:1798653942400448:192.168.204.49@tcp:104: 00000100:00100000:1.0:1715330283.808385:0:23404:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47e180 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.811517:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938000000 00000100:00100000:1.0:1715330283.811599:0:23404:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:23404:1798653942400448:192.168.204.49@tcp:104: 00010000:00010000:1.0:1715330283.811627:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d6e1a lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6e13 expref: 8 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.811639:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff8800b5276c00) 00010000:00010000:1.0:1715330283.811641:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330283.811645:0:23404:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d6e1a lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6e13 expref: 8 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.811654:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfcfc0, rc 0) 00000100:00100000:1.0:1715330283.811814:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134567b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:7134:x1798653942400384:12345-0@lo:101:mdt00_001.0 Request processed in 3548us (3681us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.811816:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938000000 00000100:00100000:1.0:1715330283.811824:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2226 00010000:00010000:0.0:1715330283.811843:0:7120:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc000/0xd895711d66d6d25 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb192 expref: 17 pid: 7134 timeout: 358 lvb_type: 0 00000100:00100000:0.0:1715330283.811878:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1404 00000100:00100000:0.0:1715330283.811885:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72de1896-1df4-4b3a-930a-9116d2c66168+17:2012:x1798653938000000:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1715330283.811898:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330283.811902:0:7120:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc000/0xd895711d66d6d25 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb192 expref: 17 pid: 7134 timeout: 358 lvb_type: 0 00010000:00010000:0.0:1715330283.811912:0:7120:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc000/0xd895711d66d6d25 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb192 expref: 17 pid: 7134 timeout: 358 lvb_type: 0 00010000:00010000:0.0:1715330283.811928:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc000/0xd895711d66d6d25 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb192 expref: 17 pid: 7134 timeout: 358 lvb_type: 0 00010000:00010000:0.0:1715330283.811943:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff8800b5276c00) 00010000:00010000:0.0:1715330283.811947:0:7120:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d6e1a lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6e13 expref: 7 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.811955:0:7120:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d6e1a lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d6e13 expref: 7 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.811961:0:7120:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d6e1a lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d6e13 expref: 7 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.811985:0:7120:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d6e1a lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6e13 expref: 7 pid: 23404 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330283.811995:0:7120:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7b5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001_UUID:7120:1798653942400512:0@lo:105: 00000100:00100000:0.0:1715330283.812026:0:7120:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.812038:0:7120:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008b04c480 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.812470:0:7120:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7b5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001_UUID:7120:1798653942400512:0@lo:105: 00010000:00010000:1.0:1715330283.812491:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330283.812564:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72de1896-1df4-4b3a-930a-9116d2c66168+16:2012:x1798653938000000:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 678us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.812570:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1404 00000100:00100000:1.0:1715330283.812602:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942400576 00000100:00100000:1.0:1715330283.812605:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942400576 00000100:00100000:1.0:1715330283.812632:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2227 00000100:00100000:1.0:1715330283.812637:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134564380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:7134:x1798653942400576:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330283.812662:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330283.812678:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d6e28 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x6f4526f5 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d6e21 expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.812724:0:23404:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d6e28 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526f5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d6e21 expref: 9 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.812773:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d6e28 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526f5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6e21 expref: 9 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.812779:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x6f4526f5 (ffff88008b0d2300) 00010000:00010000:1.0:1715330283.812781:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330283.812790:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfe640, rc 0) 00000100:00100000:1.0:1715330283.812812:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134564380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7134:x1798653942400576:12345-0@lo:101:mdt00_001.0 Request processed in 175us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.812831:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2227 00000100:00100000:0.0:1715330283.817601:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942401024 00000100:00100000:0.0:1715330283.817607:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942401024 00000100:00100000:0.0:1715330283.817657:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2233 00000100:00100000:0.0:1715330283.817663:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:8587:x1798653942401024:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330283.818780:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:8587:x1798653942401024:12345-0@lo:1000:osp_up1-0.0 Request processed in 1116us (1418us total) trans 4294968299 rc 0/0 00000100:00100000:0.0:1715330283.818787:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2233 00000100:00100000:0.0:1715330283.819198:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942401088 00000100:00100000:0.0:1715330283.819202:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942401088 00000100:00100000:0.0:1715330283.819311:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2234 00000100:00100000:0.0:1715330283.819317:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134565180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7134:x1798653942401088:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330283.819349:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330283.819378:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1f80/0xd895711d66d6e44 lrc: 2/0,0 mode: --/PW res: [0x240000401:0xbd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d6e3d expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.819393:0:9408:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1f80/0xd895711d66d6e44 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xbd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d6e3d expref: 11 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.819419:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1f80/0xd895711d66d6e44 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xbd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6e3d expref: 11 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.819438:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xbd:0x0].0x0 (ffff88009d434800) 00010000:00010000:0.0:1715330283.819440:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.819460:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f1f80, rc 0) 00000100:00100000:0.0:1715330283.819516:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134565180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:7134:x1798653942401088:12345-0@lo:101:mdt00_001.0 Request processed in 199us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.819521:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2234 00000100:00100000:1.0:1715330283.820637:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942401152 00000100:00100000:1.0:1715330283.820642:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942401152 00000100:00100000:1.0:1715330283.820667:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1202 00000100:00100000:1.0:1715330283.820671:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134564a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+11:3688:x1798653942401152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330283.820679:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330283.820690:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d6e1a lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d6e13 expref: 11 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.820704:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff8800b5276c00) 00010000:00010000:1.0:1715330283.820711:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330283.820757:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134564a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+10:3688:x1798653942401152:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.820763:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1202 00000100:00100000:1.0:1715330283.841147:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00010000:00010000:1.0:1715330283.841681:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715330283.841686:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66400/0xd895711d66d6e21 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526f5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d6e28 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.841692:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66400 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330283.841696:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66400/0xd895711d66d6e21 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526f5 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd895711d66d6e28 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330283.841703:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66400/0xd895711d66d6e21 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526f5 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd895711d66d6e28 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.841723:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66400/0xd895711d66d6e21 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x6f4526f5 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d6e28 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.841728:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330283.841768:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66400/0xd895711d66d6e21 lrc: 1/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x6f4526f5 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d6e28 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.841773:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66400/0xd895711d66d6e21 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x6f4526f5 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d6e28 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.841786:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330283.841787:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330283.841788:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330283.841798:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942401280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330283.841821:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.845553:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942401344:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1715330283.845613:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.845629:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942401344 00000100:00100000:1.0:1715330283.845635:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942401344 00000100:00100000:1.0:1715330283.845662:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1203 00000100:00100000:1.0:1715330283.845669:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+9:3691:x1798653942401344:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1715330283.845679:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330283.845694:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f600/0xd895711d66d6dbf lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f4 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d6db8 expref: 9 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.845704:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x6f4526f4 (ffff88008b122a00) 00010000:00010000:1.0:1715330283.845711:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330283.845751:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+7:3691:x1798653942401344:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 82us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.845757:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1203 00000100:00100000:0.0:1715330283.845988:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942401344:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1715330283.846095:0:7134:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64000/0xd895711d66d6e59 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.846101:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64000/0xd895711d66d6e59 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00000100:00100000:0.0:1715330283.846160:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7b6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942401600:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330283.846184:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.846203:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435f00 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.846217:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942401600 00000100:00100000:0.0:1715330283.846220:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942401600 00000100:00100000:0.0:1715330283.846235:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942401536 00000100:00100000:0.0:1715330283.846237:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942401536 00000100:00100000:0.0:1715330283.846246:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2236 00000100:00100000:0.0:1715330283.846250:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091eaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:8278:x1798653942401536:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330283.846333:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091eaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:8278:x1798653942401536:12345-0@lo:1000:osp_up0-1.0 Request processed in 82us (127us total) trans 4294983351 rc 0/0 00000100:00100000:0.0:1715330283.846338:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2236 00000100:00100000:0.0:1715330283.846353:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7b6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942401600:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1715330283.846378:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d6e60 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x14fe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.846385:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d6e60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14fe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.846391:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d6e60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14fe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00000100:00100000:1.0:1715330283.846402:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942401280:0@lo:103:ldlm_bl.0 00000004:00010000:0.0:1715330283.846406:0:7134:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d6e60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14fe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.846414:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67180/0xd895711d66d6e52 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.846419:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67180/0xd895711d66d6e52 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.846424:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67180/0xd895711d66d6e52 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.846428:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67180/0xd895711d66d6e52 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.846432:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db67180 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330283.846434:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67180/0xd895711d66d6e52 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.846438:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67180/0xd895711d66d6e52 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.846445:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88008d699c00) 00010000:00010000:0.0:1715330283.846447:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.846449:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67180/0xd895711d66d6e52 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.846453:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67180/0xd895711d66d6e52 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.846462:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64000/0xd895711d66d6e59 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.846467:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64000/0xd895711d66d6e59 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.846471:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64000/0xd895711d66d6e59 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.846475:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64000 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330283.846477:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64000/0xd895711d66d6e59 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.846480:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64000/0xd895711d66d6e59 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.846485:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x6f4526f5 (ffff88008b0d2300) 00010000:00010000:0.0:1715330283.846487:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.846489:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64000/0xd895711d66d6e59 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x6f4526f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.846493:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64000/0xd895711d66d6e59 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x6f4526f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.846519:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64900/0xd895711d66d6e4b lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb1c3 expref: 8 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.846532:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d6e60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x14fe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb1c3 expref: 7 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.846538:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14fe:0x0].0x0 (ffff88009d434300) 00010000:00010000:0.0:1715330283.846540:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1715330283.846542:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f3a80, rc 0) 00000100:00100000:0.0:1715330283.846595:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+7:16779:x1798653938000192:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 5345us (5443us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.846602:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23128 00000100:00100000:0.0:1715330283.850233:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938000256 00000100:00100000:0.0:1715330283.850239:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938000256 00000100:00100000:0.0:1715330283.850262:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23129 00000100:00100000:0.0:1715330283.850266:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+16:16779:x1798653938000256:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:0.0:1715330283.850280:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330283.850291:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d6e67 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x14fe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb1ca expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.850323:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d6e6e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x14fe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.850331:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d6e6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14fe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.850337:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d6e6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14fe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000004:00200000:0.0:1715330283.850399:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x14fe:0x0]: returning size 4096 00000004:00200000:0.0:1715330283.850402:0:7134:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1715330283.850420:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d6e67 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x14fe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb1ca expref: 18 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.850429:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d6e6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x14fe:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb1ca expref: 17 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.850433:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14fe:0x0].0x0 (ffff88008d699200) 00010000:00010000:0.0:1715330283.850434:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1715330283.850436:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f2d00, rc 0) 00000100:00100000:0.0:1715330283.850468:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+17:16779:x1798653938000256:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 201us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.850472:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23129 00000100:00100000:0.0:1715330283.854888:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330283.855919:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091eaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942401728:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330283.855946:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.857840:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091eaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942401728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330283.858022:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942401856 00000100:00100000:1.0:1715330283.858026:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942401856 00000100:00100000:1.0:1715330283.858054:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2237 00000100:00100000:1.0:1715330283.858060:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:8278:x1798653942401856:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1715330283.858134:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:8278:x1798653942401856:12345-0@lo:1000:osp_up0-1.0 Request processed in 74us (149us total) trans 4294983352 rc 0/0 00000100:00100000:1.0:1715330283.858139:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2237 00000100:00100000:1.0:1715330283.858304:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942401984 00000100:00100000:1.0:1715330283.858307:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942401984 00000100:00100000:1.0:1715330283.858321:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2238 00000100:00100000:1.0:1715330283.858324:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:8278:x1798653942401984:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1715330283.858376:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:8278:x1798653942401984:12345-0@lo:1000:osp_up0-1.0 Request processed in 50us (115us total) trans 4294983353 rc 0/0 00000100:00100000:1.0:1715330283.858381:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2238 00000100:00100000:0.0:1715330283.858765:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942402112 00000100:00100000:0.0:1715330283.858768:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942402112 00000100:00100000:0.0:1715330283.858783:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2239 00000100:00100000:0.0:1715330283.858787:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:8278:x1798653942402112:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330283.858910:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:8278:x1798653942402112:12345-0@lo:1000:osp_up0-1.0 Request processed in 121us (221us total) trans 4294983354 rc 0/0 00000100:00100000:0.0:1715330283.858915:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2239 00000100:00100000:0.0:1715330283.861454:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330283.861672:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330283.863284:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942402176 00000100:00100000:1.0:1715330283.863288:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942402176 00000100:00100000:1.0:1715330283.863306:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2240 00000100:00100000:1.0:1715330283.863310:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:7135:x1798653942402176:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330283.863317:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330283.863327:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfef40/0xd895711d66d6e98 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d6e91 expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.863342:0:9408:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfef40/0xd895711d66d6e98 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d6e91 expref: 6 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.863351:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfef40/0xd895711d66d6e98 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6e91 expref: 6 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.863357:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88008b0d2400) 00010000:00010000:1.0:1715330283.863359:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330283.863361:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfef40, rc 0) 00000100:00100000:1.0:1715330283.863384:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7135:x1798653942402176:12345-0@lo:101:mdt00_002.0 Request processed in 73us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.863390:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2240 00000100:00100000:0.0:1715330283.864440:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942402240 00000100:00100000:0.0:1715330283.864444:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942402240 00000100:00100000:0.0:1715330283.864459:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2241 00000100:00100000:0.0:1715330283.864463:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7135:x1798653942402240:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330283.864469:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330283.864477:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d6ea6 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x6f4526f5 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d6e9f expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.864489:0:23404:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d6ea6 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526f5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d6e9f expref: 7 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.864497:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d6ea6 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526f5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6e9f expref: 7 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.864502:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x6f4526f5 (ffff88009d434900) 00010000:00010000:0.0:1715330283.864504:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.864505:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f1440, rc 0) 00000100:00100000:0.0:1715330283.864525:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7135:x1798653942402240:12345-0@lo:101:mdt00_002.0 Request processed in 61us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.864529:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2241 00000100:00100000:1.0:1715330283.865320:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942402304 00000100:00100000:1.0:1715330283.865324:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942402304 00000100:00100000:1.0:1715330283.865349:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2242 00000100:00100000:1.0:1715330283.865353:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7135:x1798653942402304:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330283.865407:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7135:x1798653942402304:12345-0@lo:1000:mdt00_002.0 Request processed in 52us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.865412:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2242 00000100:00100000:1.0:1715330283.865556:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942402368 00000100:00100000:1.0:1715330283.865559:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942402368 00000100:00100000:1.0:1715330283.865570:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2243 00000100:00100000:1.0:1715330283.865573:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091ead880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7135:x1798653942402368:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330283.865643:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091ead880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7135:x1798653942402368:12345-0@lo:1000:mdt00_002.0 Request processed in 68us (127us total) trans 0 rc 1/1 00000100:00100000:1.0:1715330283.865649:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2243 00000100:00100000:1.0:1715330283.865853:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942402432 00000100:00100000:1.0:1715330283.865857:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942402432 00000100:00100000:1.0:1715330283.865876:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2244 00000100:00100000:1.0:1715330283.865879:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7135:x1798653942402432:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330283.865887:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330283.865896:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d6eb4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x14fe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d6ead expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.865908:0:9408:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d6eb4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14fe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d6ead expref: 8 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.865916:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d6eb4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14fe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6ead expref: 8 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.865922:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14fe:0x0].0x0 (ffff88008b0d2e00) 00010000:00010000:1.0:1715330283.865924:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1715330283.865926:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfe640, rc 0) 00000100:00100000:1.0:1715330283.865945:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:7135:x1798653942402432:12345-0@lo:101:mdt00_002.0 Request processed in 64us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.866152:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2244 00000100:00100000:0.0:1715330283.873976:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330283.874814:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942402560 00000100:00100000:1.0:1715330283.874818:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942402560 00000100:00100000:1.0:1715330283.875152:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2245 00000100:00100000:1.0:1715330283.875158:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:7135:x1798653942402560:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330283.875170:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330283.875186:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff840/0xd895711d66d6ed0 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xbd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d6ec9 expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.875202:0:9408:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e1c0/0xd895711d66d6e8a lrc: 2/0,0 mode: PR/PR res: [0x240000401:0xbd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb1d8 expref: 6 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.875209:0:9408:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff840/0xd895711d66d6ed0 lrc: 4/0,0 mode: --/EX res: [0x240000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d6ec9 expref: 9 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.875225:0:9408:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e1c0/0xd895711d66d6e8a lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xbd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb1d8 expref: 6 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.875233:0:9408:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e1c0/0xd895711d66d6e8a lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xbd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb1d8 expref: 6 pid: 7135 timeout: 358 lvb_type: 0 00000100:00100000:1.0:1715330283.875246:0:9408:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:9408:1798653942402624:192.168.204.49@tcp:104: 00000100:00100000:1.0:1715330283.875631:0:9408:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.878614:0:9408:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:9408:1798653942402624:192.168.204.49@tcp:104: 00010000:00010000:1.0:1715330283.878633:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff840/0xd895711d66d6ed0 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6ec9 expref: 9 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.878641:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xbd:0x0].0x0 (ffff88009d434800) 00010000:00010000:1.0:1715330283.878644:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330283.878646:0:9408:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff840/0xd895711d66d6ed0 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6ec9 expref: 9 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.878653:0:9408:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff840/0xd895711d66d6ed0 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6ec9 expref: 9 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.878662:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bff840, rc 0) 00000100:00100000:1.0:1715330283.878692:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7135:x1798653942402560:12345-0@lo:101:mdt00_002.0 Request processed in 3535us (3982us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.878698:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2245 00000100:00100000:0.0:1715330283.879240:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942402688 00000100:00100000:0.0:1715330283.879244:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942402688 00000100:00100000:0.0:1715330283.879274:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1071 00000100:00100000:0.0:1715330283.879279:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091eac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7122:x1798653942402688:12345-0@lo:105: 00010000:00010000:0.0:1715330283.879286:0:7118:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f3c0/0xd895711d66d6ec9 lrc: 5/0,1 mode: --/EX res: [0x240000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6ed0 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.879292:0:7118:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f3c0/0xd895711d66d6ec9 lrc: 5/0,1 mode: --/EX res: [0x240000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6ed0 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.879303:0:7118:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f3c0/0xd895711d66d6ec9 lrc: 5/0,1 mode: --/EX res: [0x240000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6ed0 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.879308:0:7118:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f3c0/0xd895711d66d6ec9 lrc: 5/0,1 mode: EX/EX res: [0x240000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d6ed0 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.879313:0:7118:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f3c0/0xd895711d66d6ec9 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d6ed0 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.879319:0:7118:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f3c0/0xd895711d66d6ec9 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d6ed0 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.879337:0:7118:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88013457f3c0) 00000100:00100000:0.0:1715330283.879365:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091eac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7122:x1798653942402688:12345-0@lo:105: Request processed in 87us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.879369:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1071 00000100:00100000:1.0:1715330283.881509:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942402752 00000100:00100000:1.0:1715330283.881515:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942402752 00000100:00100000:1.0:1715330283.881535:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2246 00000100:00100000:1.0:1715330283.881540:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7135:x1798653942402752:12345-0@lo:403:mdt00_002.0 00000100:00100000:1.0:1715330283.883900:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7135:x1798653942402752:12345-0@lo:403:mdt00_002.0 Request processed in 2356us (3972us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.883909:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2246 00000004:00080000:0.0:1715330283.884920:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 631 rpc_version 631 00000020:00100000:0.0:1715330283.884942:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1715330283.884948:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008d7b6300 x1798653942402880/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 2352/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715330283.884967:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7b6300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942402880:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330283.885001:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.885120:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff8801344356c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.885155:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942402880 00000100:00100000:1.0:1715330283.885160:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942402880 00000100:00100000:1.0:1715330283.885182:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2247 00000100:00100000:1.0:1715330283.885187:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:8587:x1798653942402880:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330283.886164:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:8587:x1798653942402880:12345-0@lo:1000:osp_up1-0.0 Request processed in 975us (1161us total) trans 4294968300 rc 0/0 00000100:00100000:1.0:1715330283.886170:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2247 00010000:00010000:0.0:1715330283.886900:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330283.886976:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091eae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942403008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330283.886999:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.887019:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1715330283.887024:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091eafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942402944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330283.887037:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.887076:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1207 00000100:00100000:0.0:1715330283.887081:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+11:3691:x1798653942402944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330283.887088:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330283.887097:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff840/0xd895711d66d6ed0 lrc: 0/0,0 mode: --/EX res: [0x240000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d6ec9 expref: 10 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.887107:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xbd:0x0].0x0 (ffff88009d434800) 00010000:00010000:0.0:1715330283.887114:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330283.887129:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+9:3691:x1798653942402944:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.887134:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1207 00000100:00100000:0.0:1715330283.887155:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091eafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942402944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330283.887162:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091eae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942403008:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330283.887201:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330283.898158:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938000768 00000100:00100000:0.0:1715330283.898167:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938000768 00000100:00100000:0.0:1715330283.898224:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23133 00000100:00100000:0.0:1715330283.898231:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:16780:x1798653938000768:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:0.0:1715330283.898250:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330283.898266:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d6ed7 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb1df expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.898317:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d6ede lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330283.898328:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d6ede lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330283.898337:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d6ede lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330283.898348:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d6ee5 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330283.898353:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d6ee5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330283.898358:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d6ee5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330283.898394:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d6ede lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330283.898399:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d6ede lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330283.898403:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d6ede lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330283.898409:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d6ede lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330283.898414:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f3a80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330283.898417:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d6ede lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330283.898423:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d6ede lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330283.898431:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88008d699e00) 00010000:00010000:0.0:1715330283.898433:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.898438:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d6ede lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330283.898448:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d6ede lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330283.898459:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d6ee5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330283.898464:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d6ee5 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330283.898469:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d6ee5 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330283.898473:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f1f80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330283.898476:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d6ee5 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330283.898480:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d6ee5 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330283.898485:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x6f4526f6 (ffff88009d434400) 00010000:00010000:0.0:1715330283.898487:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.898489:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d6ee5 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330283.898493:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d6ee5 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330283.898517:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d6ed7 lrc: 1/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb1df expref: 18 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.898523:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d6ed7 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb1df expref: 18 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.898529:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f2d00, rc 0) 00000100:00100000:0.0:1715330283.898583:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:16780:x1798653938000768:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 351us (738us total) trans 0 rc 301/301 00000100:00100000:0.0:1715330283.898602:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23133 00000100:00100000:0.0:1715330283.901040:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330283.901204:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23134 00000100:00100000:0.0:1715330283.901210:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+6:16780:x1798653938000832:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:0.0:1715330283.901222:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330283.901238:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0480/0xd895711d66d6eec lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb1e6 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.901276:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d6ef3 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330283.901286:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d6ef3 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330283.901292:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d6ef3 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000004:00200000:0.0:1715330283.901325:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000401:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1715330283.901328:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1715330283.901348:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0480/0xd895711d66d6eec lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb1e6 expref: 8 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.901361:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d6ef3 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb1e6 expref: 7 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.901372:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88009d434b00) 00010000:00010000:0.0:1715330283.901374:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1715330283.901376:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f18c0, rc 0) 00000100:00100000:0.0:1715330283.901446:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+7:16780:x1798653938000832:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 236us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.901452:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23134 00000100:00100000:1.0:1715330283.904958:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330283.906551:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942403136 00000100:00100000:1.0:1715330283.906555:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942403136 00000100:00100000:1.0:1715330283.906745:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2248 00000100:00100000:1.0:1715330283.906751:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:7134:x1798653942403136:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330283.906805:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:7134:x1798653942403136:12345-0@lo:1000:mdt00_001.0 Request processed in 54us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.906810:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2248 00000100:00100000:1.0:1715330283.908301:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942403200 00000100:00100000:1.0:1715330283.908306:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942403200 00000100:00100000:1.0:1715330283.908357:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2249 00000100:00100000:1.0:1715330283.908362:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091ead180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:7134:x1798653942403200:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330283.908432:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091ead180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:7134:x1798653942403200:12345-0@lo:1000:mdt00_001.0 Request processed in 69us (1187us total) trans 0 rc -2/-2 00000100:00100000:1.0:1715330283.908437:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2249 00000100:00100000:1.0:1715330283.908644:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942403264 00000100:00100000:1.0:1715330283.908647:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942403264 00000100:00100000:1.0:1715330283.908778:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2250 00000100:00100000:1.0:1715330283.908782:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091eaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:7134:x1798653942403264:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330283.908790:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330283.908802:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d6f01 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d6efa expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.908819:0:9408:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66d6e0c lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb1bc expref: 16 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.908827:0:9408:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d6f01 lrc: 4/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d6efa expref: 11 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.908843:0:9408:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66d6e0c lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb1bc expref: 16 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.908853:0:9408:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66d6e0c lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb1bc expref: 16 pid: 7134 timeout: 358 lvb_type: 0 00000100:00100000:1.0:1715330283.908866:0:9408:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4f480 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:9408:1798653942403328:192.168.204.49@tcp:104: 00000100:00100000:1.0:1715330283.908899:0:9408:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330283.911231:0:9408:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4f480 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:9408:1798653942403328:192.168.204.49@tcp:104: 00010000:00010000:1.0:1715330283.911250:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d6f01 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6efa expref: 11 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.911260:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88008d699e00) 00010000:00010000:1.0:1715330283.911263:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330283.911266:0:9408:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d6f01 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6efa expref: 11 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.911273:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfef40, rc 0) 00000100:00100000:1.0:1715330283.911310:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091eaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:7134:x1798653942403264:12345-0@lo:101:mdt00_001.0 Request processed in 2527us (2736us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.911317:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2250 00000100:00100000:1.0:1715330283.912172:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330283.912637:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942403392 00000100:00100000:0.0:1715330283.912641:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942403392 00000100:00100000:0.0:1715330283.912670:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1072 00000100:00100000:0.0:1715330283.912675:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091eaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:7120:x1798653942403392:12345-0@lo:105: 00010000:00010000:0.0:1715330283.912682:0:7118:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db67840/0xd895711d66d6efa lrc: 5/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6f01 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.912691:0:7118:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db67840/0xd895711d66d6efa lrc: 5/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6f01 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.912698:0:7118:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db67840/0xd895711d66d6efa lrc: 5/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6f01 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.912704:0:7118:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db67840/0xd895711d66d6efa lrc: 5/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d6f01 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.912713:0:7118:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db67840/0xd895711d66d6efa lrc: 6/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d6f01 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.912719:0:7118:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db67840/0xd895711d66d6efa lrc: 6/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d6f01 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.912765:0:7118:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88011db67840) 00000100:00100000:0.0:1715330283.912796:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091eaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:7120:x1798653942403392:12345-0@lo:105: Request processed in 121us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.912802:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1072 00000100:00100000:1.0:1715330283.913165:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942403456 00000100:00100000:1.0:1715330283.913168:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942403456 00000100:00100000:1.0:1715330283.913322:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2251 00000100:00100000:1.0:1715330283.913326:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091eae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:7134:x1798653942403456:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330283.913337:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330283.913347:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d6f0f lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d6f08 expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.913359:0:9408:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d6f0f lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d6f08 expref: 12 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.913371:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d6f0f lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6f08 expref: 12 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.913377:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x6f4526f6 (ffff88008b0d2800) 00010000:00010000:1.0:1715330283.913379:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330283.913380:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfd200, rc 0) 00000100:00100000:1.0:1715330283.913407:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091eae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:7134:x1798653942403456:12345-0@lo:101:mdt00_001.0 Request processed in 80us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.913412:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2251 00000100:00100000:0.0:1715330283.915904:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942403520 00000100:00100000:0.0:1715330283.915911:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942403520 00000100:00100000:0.0:1715330283.915936:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2252 00000100:00100000:0.0:1715330283.915942:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:7134:x1798653942403520:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330283.917235:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:7134:x1798653942403520:12345-0@lo:1000:mdt00_001.0 Request processed in 1291us (1389us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.917243:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2252 00000100:00100000:0.0:1715330283.918228:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942403584 00000100:00100000:0.0:1715330283.918234:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942403584 00000100:00100000:0.0:1715330283.918265:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2253 00000100:00100000:0.0:1715330283.918270:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091ead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:7134:x1798653942403584:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330283.918502:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091ead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:7134:x1798653942403584:12345-0@lo:1000:mdt00_001.0 Request processed in 230us (1093us total) trans 0 rc -2/-2 00000100:00100000:0.0:1715330283.918508:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2253 00000100:00100000:0.0:1715330283.918845:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942403648 00000100:00100000:0.0:1715330283.918850:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942403648 00000100:00100000:0.0:1715330283.919378:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2254 00000100:00100000:0.0:1715330283.919383:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801345a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:7134:x1798653942403648:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330283.919435:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801345a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:7134:x1798653942403648:12345-0@lo:1000:mdt00_001.0 Request processed in 50us (760us total) trans 0 rc -2/-2 00000100:00100000:0.0:1715330283.919440:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2254 00000100:00100000:1.0:1715330283.919950:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942403712 00000100:00100000:1.0:1715330283.919954:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942403712 00000100:00100000:1.0:1715330283.919985:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2255 00000100:00100000:1.0:1715330283.919990:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801345a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:7134:x1798653942403712:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330283.920035:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801345a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:7134:x1798653942403712:12345-0@lo:1000:mdt00_001.0 Request processed in 44us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.920041:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2255 00000100:00100000:1.0:1715330283.920126:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942403776 00000100:00100000:1.0:1715330283.920128:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942403776 00000100:00100000:1.0:1715330283.920151:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2256 00000100:00100000:1.0:1715330283.920155:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801345a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:7134:x1798653942403776:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330283.920189:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801345a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:7134:x1798653942403776:12345-0@lo:1000:mdt00_001.0 Request processed in 34us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.920194:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2256 00000100:00100000:0.0:1715330283.921240:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942403904 00000100:00100000:0.0:1715330283.921243:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942403904 00000100:00100000:0.0:1715330283.921821:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2257 00000100:00100000:0.0:1715330283.921827:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:8278:x1798653942403904:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330283.922239:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+13:8278:x1798653942403904:12345-0@lo:1000:osp_up0-1.0 Request processed in 411us (1066us total) trans 4294983356 rc 0/0 00000100:00100000:0.0:1715330283.922246:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2257 00000100:00100000:0.0:1715330283.922756:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942403968 00000100:00100000:0.0:1715330283.922760:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942403968 00000100:00100000:0.0:1715330283.922774:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2258 00000100:00100000:0.0:1715330283.922778:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801345a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+13:7134:x1798653942403968:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330283.922787:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330283.922798:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d6f2b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xbb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d6f24 expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.922810:0:9408:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d6f2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xbb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d6f24 expref: 14 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.922819:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d6f2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xbb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6f24 expref: 14 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.922825:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xbb:0x0].0x0 (ffff88009d434300) 00010000:00010000:0.0:1715330283.922827:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.922829:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f2400, rc 0) 00000100:00100000:0.0:1715330283.923095:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801345a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:7134:x1798653942403968:12345-0@lo:101:mdt00_001.0 Request processed in 315us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.923100:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2258 00000100:00100000:1.0:1715330283.924001:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801345a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942404032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330283.924028:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.924301:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801345a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942404032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330283.947921:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938001216 00000100:00100000:1.0:1715330283.947930:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938001216 00000100:00100000:1.0:1715330283.947965:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23137 00000100:00100000:1.0:1715330283.947972:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091ead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+16:16783:x1798653938001216:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:1.0:1715330283.947988:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330283.948007:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66d6f32 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb1ed expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.948056:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d6f39 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.948066:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d6f39 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.948075:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d6f39 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.948083:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66d6f40 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.948089:0:7135:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d6f0f lrc: 2/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6f08 expref: 12 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.948096:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66d6f40 lrc: 4/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.948117:0:7135:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d6f0f lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd895711d66d6f08 expref: 12 pid: 9408 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330283.948130:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7135:1798653942404096:0@lo:104: 00000100:00100000:1.0:1715330283.948168:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.948192:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.948200:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942404096 00000100:00100000:0.0:1715330283.948205:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942404096 00000100:00100000:0.0:1715330283.948245:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1073 00000100:00100000:0.0:1715330283.948250:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:7135:x1798653942404096:12345-0@lo:104: 00010000:00010000:0.0:1715330283.948259:0:7118:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db67cc0/0xd895711d66d6f08 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d6f0f expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.948311:0:7118:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1715330283.948316:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:7135:x1798653942404096:12345-0@lo:104: Request processed in 66us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.948322:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1073 00000100:00100000:1.0:1715330283.948335:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7135:1798653942404096:0@lo:104: 00010000:00010000:0.0:1715330283.948339:0:7124:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715330283.948344:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db67cc0/0xd895711d66d6f08 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d6f0f expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.948348:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66d6f40 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330283.948351:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db67cc0 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330283.948356:0:7124:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db67cc0/0xd895711d66d6f08 lrc: 4/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd895711d66d6f0f expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330283.948363:0:7124:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db67cc0/0xd895711d66d6f08 lrc: 4/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd895711d66d6f0f expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.948493:0:7124:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db67cc0/0xd895711d66d6f08 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d6f0f expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.948498:0:7124:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1715330283.948577:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942404160:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330283.948593:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db67cc0/0xd895711d66d6f08 lrc: 1/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d6f0f expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.948600:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db67cc0/0xd895711d66d6f08 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d6f0f expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330283.948609:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1715330283.948617:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330283.948618:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330283.948620:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330283.948635:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942404160 00000100:00100000:1.0:1715330283.948638:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942404160 00010000:00010000:1.0:1715330283.948651:0:10674:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d6f0f lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd895711d66d6f08 expref: 13 pid: 9408 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330283.948683:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1410 00000100:00100000:1.0:1715330283.948688:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+13:3690:x1798653942404160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330283.948696:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1715330283.952915:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1715330283.952930:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942404224:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1715330283.952977:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1715330283.953006:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d6e2f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x14fe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.953014:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d6e2f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x14fe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.953019:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d6e2f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x14fe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.953024:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64b40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330283.953028:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d6e2f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x14fe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.953033:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d6e2f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x14fe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.953042:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14fe:0x0].0x0 (ffff88008d699200) 00010000:00010000:1.0:1715330283.953044:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330283.953047:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d6e2f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x14fe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.953051:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d6e2f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x14fe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.953065:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d6e36 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xbd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.953069:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d6e36 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xbd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.953073:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d6e36 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xbd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.953076:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64fc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330283.953078:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d6e36 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xbd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.953082:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d6e36 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xbd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.953087:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xbd:0x0].0x0 (ffff88008d699a00) 00010000:00010000:1.0:1715330283.953089:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330283.953091:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d6e36 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xbd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.953094:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d6e36 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xbd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.953141:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d6f0f lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd895711d66d6f08 expref: 7 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.953150:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x6f4526f6 (ffff88008b0d2800) 00010000:00010000:1.0:1715330283.953153:0:10674:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66d6f40 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.953159:0:10674:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66d6f40 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.953164:0:10674:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66d6f40 lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.953179:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330283.953194:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942404352 00000100:00100000:0.0:1715330283.953199:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942404352 00000100:00100000:1.0:1715330283.953205:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+6:3690:x1798653942404160:12345-0@lo:103:ldlm_bl.0 Request processed in 4516us (4596us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.953213:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1410 00000100:00100000:1.0:1715330283.953226:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942404224 00000100:00100000:1.0:1715330283.953228:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942404224 00000100:00100000:0.0:1715330283.953234:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2259 00000100:00100000:0.0:1715330283.953240:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:8587:x1798653942404352:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330283.953244:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1210 00000100:00100000:1.0:1715330283.953247:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+8:3690:x1798653942404224:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:1.0:1715330283.953255:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330283.953265:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d6ea6 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x6f4526f5 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d6e9f expref: 8 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.953274:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x6f4526f5 (ffff88009d434900) 00010000:00010000:1.0:1715330283.953291:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330283.953306:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+8:3690:x1798653942404224:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 58us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.953314:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1210 00000100:00100000:0.0:1715330283.953325:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:8587:x1798653942404352:12345-0@lo:1000:osp_up1-0.0 Request processed in 85us (194us total) trans 4294968302 rc 0/0 00000100:00100000:0.0:1715330283.953330:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2259 00000100:00100000:1.0:1715330283.953335:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942404224:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1715330283.953342:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942404160:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330283.953360:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66d6f40 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.953365:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66d6f40 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000100:00100000:1.0:1715330283.953418:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942404416:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330283.953434:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.953441:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.953445:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942404416 00000100:00100000:0.0:1715330283.953448:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942404416 00000100:00100000:0.0:1715330283.953466:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2260 00000100:00100000:0.0:1715330283.953470:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7135:x1798653942404416:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1715330283.953511:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7135:x1798653942404416:12345-0@lo:1000:mdt00_002.0 Request processed in 40us (76us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.953517:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942404416:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1715330283.953517:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2260 00010000:00010000:1.0:1715330283.953541:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66d6f47 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x170:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.953548:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66d6f47 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x170:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.953554:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66d6f47 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x170:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00010000:1.0:1715330283.953568:0:7135:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66d6f47 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x170:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.953576:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d6f39 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.953580:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d6f39 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.953599:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d6f39 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.953603:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d6f39 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.953606:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bffa80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330283.953608:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d6f39 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.953612:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d6f39 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.953618:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88008b0d2200) 00010000:00010000:1.0:1715330283.953620:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330283.953622:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d6f39 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.953626:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d6f39 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.953634:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66d6f40 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.953638:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66d6f40 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.953642:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66d6f40 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.953645:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfd680 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330283.953647:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66d6f40 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.953654:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66d6f40 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.953658:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x6f4526f6 (ffff88008b0d2800) 00010000:00010000:1.0:1715330283.953660:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330283.953661:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66d6f40 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.953665:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66d6f40 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330283.953689:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66d6f32 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb1ed expref: 15 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.953701:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66d6f47 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x170:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb1ed expref: 14 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.953706:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x170:0x0].0x0 (ffff88008b0d2900) 00010000:00010000:1.0:1715330283.953708:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1715330283.953709:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfeac0, rc 0) 00000100:00100000:1.0:1715330283.953769:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091ead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+14:16783:x1798653938001216:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 5796us (5899us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330283.953774:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23137 00000100:00100000:0.0:1715330283.958708:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00010000:00010000:0.0:1715330283.965655:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715330283.965661:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66880/0xd895711d66d6f24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xbb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d6f2b expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.965667:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66880 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330283.965672:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66880/0xd895711d66d6f24 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xbb:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd895711d66d6f2b expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330283.965682:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66880/0xd895711d66d6f24 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xbb:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd895711d66d6f2b expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.965701:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66880/0xd895711d66d6f24 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xbb:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d6f2b expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.965705:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330283.965723:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66880/0xd895711d66d6f24 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xbb:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d6f2b expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.965742:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66880/0xd895711d66d6f24 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xbb:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d6f2b expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.965757:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330283.965758:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330283.965759:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330283.967906:0:7134:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d6f71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xbb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.967912:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d6f71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xbb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000004:00200000:0.0:1715330283.967950:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xbb:0x0]: returning size 4096 00000004:00200000:0.0:1715330283.967953:0:7134:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1715330283.967981:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cfc0/0xd895711d66d6f6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xbb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb202 expref: 16 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.967992:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d6f71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xbb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb202 expref: 15 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.967998:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xbb:0x0].0x0 (ffff88009d434300) 00010000:00010000:0.0:1715330283.968000:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1715330283.968001:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013457eac0, rc 0) 00000100:00100000:0.0:1715330283.969219:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+15:16783:x1798653938001408:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 3973us (4150us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.969226:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23140 00000100:00100000:0.0:1715330283.969398:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942404672 00000100:00100000:0.0:1715330283.969403:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942404672 00000100:00100000:0.0:1715330283.969423:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2261 00000100:00100000:0.0:1715330283.969427:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134564700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:8587:x1798653942404672:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330283.969514:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134564700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:8587:x1798653942404672:12345-0@lo:1000:osp_up1-0.0 Request processed in 85us (149us total) trans 4294968303 rc 0/0 00000100:00100000:0.0:1715330283.969519:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2261 00000100:00100000:0.0:1715330283.974825:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330283.974873:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330283.974946:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938001600 00000100:00100000:1.0:1715330283.974954:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938001600 00000100:00100000:1.0:1715330283.974988:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23141 00000100:00100000:1.0:1715330283.974995:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+11:16783:x1798653938001600:12345-192.168.204.49@tcp:36:rmdir.0 00010000:00010000:1.0:1715330283.975029:0:7134:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330283.975039:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66ac0/0xd895711d66d6f55 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x170:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb1f4 expref: 11 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.975048:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x170:0x0].0x0 (ffff8801345c6700) 00010000:00010000:1.0:1715330283.975050:0:7134:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330283.975085:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfdb00/0xd895711d66d6f78 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.975091:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfdb00/0xd895711d66d6f78 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.975099:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfdb00/0xd895711d66d6f78 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT1 00000100:00100000:1.0:1715330283.975114:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942404736:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1715330283.975142:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.975165:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.975182:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942404736 00000100:00100000:0.0:1715330283.975184:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942404736 00000100:00100000:0.0:1715330283.975210:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2262 00000100:00100000:0.0:1715330283.975214:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:7134:x1798653942404736:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330283.975222:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330283.975233:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66d6f7f lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d6f78 expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.975249:0:9408:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66d6f7f lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d6f78 expref: 6 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.975257:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66d6f7f lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6f78 expref: 6 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.975262:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88009d434800) 00010000:00010000:0.0:1715330283.975264:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.975267:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f1440, rc 0) 00000100:00100000:0.0:1715330283.975290:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:7134:x1798653942404736:12345-0@lo:101:mdt00_001.0 Request processed in 75us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.975294:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2262 00000100:00100000:1.0:1715330283.975434:0:7134:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983356 gen 2 00000004:00080000:1.0:1715330283.975439:0:7134:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983349 committed transno 4294983356 00000020:00080000:1.0:1715330283.975444:0:7134:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff88008b04c000 refcount 2 committed 0 result 0 batchid 354 00000020:00080000:1.0:1715330283.975447:0:7134:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009d434000 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff88008b04c780 00000020:00080000:1.0:1715330283.975449:0:7134:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].356 00000020:00080000:1.0:1715330283.975451:0:7134:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009d434700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88006eff7200 00000020:00080000:1.0:1715330283.975453:0:7134:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].355 00000004:00080000:1.0:1715330283.975483:0:7134:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983351 committed transno 4294983356 00000004:00080000:1.0:1715330283.975494:0:7134:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983352 committed transno 4294983356 00000004:00080000:1.0:1715330283.975506:0:7134:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983353 committed transno 4294983356 00000004:00080000:1.0:1715330283.975516:0:7134:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983354 committed transno 4294983356 00000004:00080000:1.0:1715330283.975525:0:7134:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983356 committed transno 4294983356 00000100:00100000:1.0:1715330283.975544:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942404736:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330283.975555:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfdb00/0xd895711d66d6f78 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6f7f expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.975562:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfdb00/0xd895711d66d6f78 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6f7f expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330283.975574:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:1.0:1715330283.975603:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff3c0/0xd895711d66d6f86 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.975609:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff3c0/0xd895711d66d6f86 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.975615:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff3c0/0xd895711d66d6f86 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT1 00000100:00100000:1.0:1715330283.975623:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942404800:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1715330283.975639:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.975658:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.975790:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942404800 00000100:00100000:0.0:1715330283.975793:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942404800 00000100:00100000:0.0:1715330283.975808:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2263 00000100:00100000:0.0:1715330283.975812:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:7134:x1798653942404800:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330283.975818:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330283.975827:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1b00/0xd895711d66d6f8d lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d6f86 expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.975839:0:23404:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1b00/0xd895711d66d6f8d lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d6f86 expref: 7 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.975847:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1b00/0xd895711d66d6f8d lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6f86 expref: 7 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.975852:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x6f4526f6 (ffff88009d434f00) 00010000:00010000:0.0:1715330283.975854:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.975856:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f1b00, rc 0) 00000100:00100000:0.0:1715330283.975875:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7134:x1798653942404800:12345-0@lo:101:mdt00_001.0 Request processed in 62us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.975879:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2263 00000100:00100000:1.0:1715330283.975954:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942404800:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330283.975963:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff3c0/0xd895711d66d6f86 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6f8d expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.975970:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff3c0/0xd895711d66d6f86 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6f8d expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330283.975978:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:1.0:1715330283.976000:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942404864:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330283.976041:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.976058:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47e900 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.976095:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942404864 00000100:00100000:0.0:1715330283.976098:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942404864 00000100:00100000:0.0:1715330283.976109:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2264 00000100:00100000:0.0:1715330283.976112:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7134:x1798653942404864:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330283.976156:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7134:x1798653942404864:12345-0@lo:1000:mdt00_001.0 Request processed in 41us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.976161:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2264 00000100:00100000:1.0:1715330283.976209:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942404864:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330283.976237:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942404928:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330283.976253:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.976261:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47e900 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.976299:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942404928 00000100:00100000:0.0:1715330283.976302:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942404928 00000100:00100000:0.0:1715330283.976314:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2265 00000100:00100000:0.0:1715330283.976317:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7134:x1798653942404928:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330283.976371:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7134:x1798653942404928:12345-0@lo:1000:mdt00_001.0 Request processed in 52us (117us total) trans 0 rc 1/1 00000100:00100000:0.0:1715330283.976376:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2265 00000100:00100000:1.0:1715330283.976427:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942404928:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1715330283.976451:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd680/0xd895711d66d6f94 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x170:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.976456:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd680/0xd895711d66d6f94 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x170:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.976460:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd680/0xd895711d66d6f94 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x170:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT1 00000100:00100000:1.0:1715330283.976467:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942404992:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1715330283.976483:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.976490:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.976543:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942404992 00000100:00100000:0.0:1715330283.976546:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942404992 00000100:00100000:0.0:1715330283.976559:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2266 00000100:00100000:0.0:1715330283.976563:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7134:x1798653942404992:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330283.976569:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330283.976576:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d6f9b lrc: 2/0,0 mode: --/EX res: [0x240000402:0x170:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d6f94 expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.976595:0:9408:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d6f9b lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x170:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d6f94 expref: 8 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.976602:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d6f9b lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x170:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6f94 expref: 8 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.976608:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x170:0x0].0x0 (ffff88009d434900) 00010000:00010000:0.0:1715330283.976611:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1715330283.976612:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f3840, rc 0) 00000100:00100000:0.0:1715330283.976632:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:7134:x1798653942404992:12345-0@lo:101:mdt00_001.0 Request processed in 69us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330283.976639:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2266 00000100:00100000:1.0:1715330283.976688:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942404992:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330283.976696:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd680/0xd895711d66d6f94 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x170:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6f9b expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.976701:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd680/0xd895711d66d6f94 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x170:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6f9b expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.976714:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d6fa2 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x170:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.976720:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d6fa2 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x170:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.976725:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d6fa2 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x170:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.976753:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd200/0xd895711d66d6fa9 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xbb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330283.976760:0:7134:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457df80/0xd895711d66d6f63 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xbb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb1fb expref: 10 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.976766:0:7134:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd200/0xd895711d66d6fa9 lrc: 4/0,1 mode: --/EX res: [0x240000400:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330283.976782:0:7134:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88013457df80/0xd895711d66d6f63 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xbb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb1fb expref: 10 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330283.976792:0:7134:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457df80/0xd895711d66d6f63 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xbb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb1fb expref: 10 pid: 7134 timeout: 358 lvb_type: 0 00000100:00100000:1.0:1715330283.976800:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7134:1798653942405056:192.168.204.49@tcp:104: 00000100:00100000:1.0:1715330283.977005:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47ee40 going to sleep for 11 seconds 00010000:00010000:0.0:1715330283.980536:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457df80/0xd895711d66d6f63 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xbb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb1fb expref: 10 pid: 7134 timeout: 358 lvb_type: 0 00000100:00100000:0.0:1715330283.980546:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7134:1798653942405056:192.168.204.49@tcp:104: 00010000:00010000:0.0:1715330283.980562:0:7134:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd200/0xd895711d66d6fa9 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.980568:0:7134:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd200/0xd895711d66d6fa9 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.980572:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd200/0xd895711d66d6fa9 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.980613:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f0480/0xd895711d66d6fb0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xbb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330283.980619:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f0480/0xd895711d66d6fb0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.980626:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f0480/0xd895711d66d6fb0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT1 00000100:00100000:0.0:1715330283.980639:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7b5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942405120:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1715330283.980669:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.981136:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435240 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.987461:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7b5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942405120:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330283.987486:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f0480/0xd895711d66d6fb0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6fb7 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330283.988109:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7b5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942405312:0@lo:403:mdt00_001.0 00000100:00100000:0.0:1715330283.988161:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.988186:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435240 going to sleep for 11 seconds 00000100:00100000:0.0:1715330283.990751:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7b5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942405312:0@lo:403:mdt00_001.0 00080000:02000000:0.0:1715330283.992223:0:7134:0:(osd_handler.c:2105:osd_trans_start()) *** cfs_fail_loc=19a, val=0*** 00000004:00080000:0.0:1715330283.992235:0:7134:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff880134435240 with version 0 00000020:00080000:0.0:1715330283.992240:0:7134:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff88009396c480 refcount 3 committed 0 result -5 batchid 356 00000020:00080000:0.0:1715330283.992243:0:7134:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009d434d00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result -5 sub_th ffff880134435240 00000020:00080000:0.0:1715330283.992245:0:7134:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009d434100 obd lustre-MDT0001-osd committed 1 started 0 stopped 1 result 0 sub_th ffff88006eff7e00 00010000:00010000:0.0:1715330283.992272:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd200/0xd895711d66d6fa9 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.992280:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd200/0xd895711d66d6fa9 lrc: 2/0,0 mode: EX/EX res: [0x240000400:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.992286:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd200/0xd895711d66d6fa9 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.992291:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfd200 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330283.992295:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd200/0xd895711d66d6fa9 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.992301:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd200/0xd895711d66d6fa9 lrc: 4/0,0 mode: EX/EX res: [0x240000400:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.992314:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xbb:0x0].0x0 (ffff8801345c6d00) 00010000:00010000:0.0:1715330283.992316:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715330283.992320:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd200/0xd895711d66d6fa9 lrc: 2/0,0 mode: --/EX res: [0x240000400:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.992324:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd200/0xd895711d66d6fa9 lrc: 0/0,0 mode: --/EX res: [0x240000400:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.992339:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f0480/0xd895711d66d6fb0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6fb7 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.992346:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f0480/0xd895711d66d6fb0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d6fb7 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.992352:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f0480/0xd895711d66d6fb0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d6fb7 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.992364:0:7134:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1715330283.992370:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000401:0xbb:0x0] 00010000:00010000:0.0:1715330283.992375:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d6fa2 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x170:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.992379:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d6fa2 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x170:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.992384:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d6fa2 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x170:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.992388:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bffa80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330283.992390:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d6fa2 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x170:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.992395:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d6fa2 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x170:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.992401:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x170:0x0].0x0 (ffff8801345c6700) 00010000:00010000:0.0:1715330283.992403:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330283.992405:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d6fa2 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x170:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.992412:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d6fa2 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x170:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330283.992419:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd680/0xd895711d66d6f94 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x170:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6f9b expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.992424:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd680/0xd895711d66d6f94 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x170:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d6f9b expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.992429:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd680/0xd895711d66d6f94 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x170:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d6f9b expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.992437:0:7134:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:0.0:1715330283.992443:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:0.0:1715330283.992446:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfdb00/0xd895711d66d6f78 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6f7f expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.992451:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfdb00/0xd895711d66d6f78 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d6f7f expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.992455:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfdb00/0xd895711d66d6f78 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d6f7f expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.992468:0:7134:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000004:00080000:0.0:1715330283.992472:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:0.0:1715330283.992474:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff3c0/0xd895711d66d6f86 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6f8d expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.992480:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff3c0/0xd895711d66d6f86 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d6f8d expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.992489:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff3c0/0xd895711d66d6f86 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d6f8d expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.992497:0:7134:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1715330283.992524:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1715330283.992529:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f0480/0xd895711d66d6fb0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d6fb7 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.992534:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f0480 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330283.992537:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f0480/0xd895711d66d6fb0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d6fb7 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330283.992542:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f0480/0xd895711d66d6fb0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d6fb7 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.992564:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f0480/0xd895711d66d6fb0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6fb7 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.992569:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330283.992603:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f0480/0xd895711d66d6fb0 lrc: 1/0,0 mode: --/EX res: [0x200000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6fb7 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.992609:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f0480/0xd895711d66d6fb0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6fb7 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.992623:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1715330283.992626:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd680/0xd895711d66d6f94 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x170:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d6f9b expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.992634:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfd680 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330283.992637:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd680/0xd895711d66d6f94 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x170:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d6f9b expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330283.992642:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd680/0xd895711d66d6f94 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x170:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d6f9b expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.992655:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd680/0xd895711d66d6f94 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x170:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6f9b expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.992659:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330283.992669:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd680/0xd895711d66d6f94 lrc: 1/0,0 mode: --/EX res: [0x240000402:0x170:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6f9b expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.992674:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd680/0xd895711d66d6f94 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x170:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6f9b expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.992682:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1715330283.992685:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfdb00/0xd895711d66d6f78 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d6f7f expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.992689:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfdb00 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330283.992692:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfdb00/0xd895711d66d6f78 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d6f7f expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330283.992697:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfdb00/0xd895711d66d6f78 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d6f7f expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.992707:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfdb00/0xd895711d66d6f78 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6f7f expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.992712:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330283.992716:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfdb00/0xd895711d66d6f78 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6f7f expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.992721:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfdb00/0xd895711d66d6f78 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6f7f expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.992745:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715330283.992747:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff3c0/0xd895711d66d6f86 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d6f8d expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.992752:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bff3c0 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330283.992755:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff3c0/0xd895711d66d6f86 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d6f8d expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330283.992760:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff3c0/0xd895711d66d6f86 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d6f8d expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.992772:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff3c0/0xd895711d66d6f86 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6f8d expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.992776:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330283.992870:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff3c0/0xd895711d66d6f86 lrc: 1/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6f8d expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.992876:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff3c0/0xd895711d66d6f86 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6f8d expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330283.992886:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330283.992887:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330283.992889:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330283.992902:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942405504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330283.992941:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.992959:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1715330283.992964:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942405440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330283.992978:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330283.993015:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+9:16783:x1798653938001600:12345-192.168.204.49@tcp:36:rmdir.0 Request processed in 18019us (18140us total) trans 0 rc -5/-5 00000100:00100000:0.0:1715330283.993023:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23141 00010000:00010000:1.0:1715330283.993384:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330283.993392:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942405376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330283.993412:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.993423:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1715330283.993427:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942405568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330283.993438:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330283.993619:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942405568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330283.993625:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942405376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330283.994491:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942405440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330283.994499:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942405504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330284.012241:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938001792 00000100:00100000:0.0:1715330284.012249:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938001792 00000100:00100000:0.0:1715330284.012283:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23142 00000100:00100000:0.0:1715330284.012290:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134567b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+9:16784:x1798653938001792:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:0.0:1715330284.012306:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330284.012322:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3840/0xd895711d66d6fbe lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb209 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.012370:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d6fc5 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.012381:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d6fc5 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.012390:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d6fc5 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.012404:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d6fcc lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x6f4526f7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.012408:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d6fcc lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.012413:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d6fcc lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.012447:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d6fc5 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.012452:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d6fc5 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.012457:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d6fc5 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.012461:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d6fc5 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.012466:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f1440 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330284.012470:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d6fc5 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.012475:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d6fc5 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.012482:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88009d434b00) 00010000:00010000:0.0:1715330284.012485:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330284.012487:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d6fc5 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.012492:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d6fc5 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.012502:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d6fcc lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.012506:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d6fcc lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.012510:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d6fcc lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.012514:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f2d00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330284.012516:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d6fcc lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.012520:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d6fcc lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f4526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.012524:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x6f4526f7 (ffff88009d434800) 00010000:00010000:0.0:1715330284.012526:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330284.012528:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d6fcc lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x6f4526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.012532:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d6fcc lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x6f4526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.012553:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3840/0xd895711d66d6fbe lrc: 1/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb209 expref: 10 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.012560:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3840/0xd895711d66d6fbe lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb209 expref: 10 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.012567:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f3840, rc 0) 00000100:00100000:0.0:1715330284.013256:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134567b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+9:16784:x1798653938001792:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 964us (1154us total) trans 0 rc 301/301 00000100:00100000:0.0:1715330284.013263:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23142 00000100:00100000:0.0:1715330284.018964:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938001856 00000100:00100000:0.0:1715330284.018972:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938001856 00000100:00100000:0.0:1715330284.019010:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23143 00000100:00100000:0.0:1715330284.019017:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134565500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+13:16784:x1798653938001856:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:0.0:1715330284.019033:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330284.019050:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d6fd3 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb210 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.019095:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d6fda lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.019104:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d6fda lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.019113:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d6fda lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000004:00200000:0.0:1715330284.019149:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1715330284.019153:0:7134:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1715330284.019176:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d6fd3 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb210 expref: 15 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.019188:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d6fda lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb210 expref: 14 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.019194:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88009d434600) 00010000:00010000:0.0:1715330284.019196:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1715330284.019198:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f3a80, rc 0) 00000100:00100000:0.0:1715330284.019249:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134565500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+14:16784:x1798653938001856:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 233us (1213us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330284.019255:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23143 00000100:00100000:1.0:1715330284.031512:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938002048 00000100:00100000:1.0:1715330284.031519:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938002048 00010000:00010000:1.0:1715330284.031545:0:9416:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d6ef3 lrc: 5/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb1e6 expref: 9 pid: 7135 timeout: 358 lvb_type: 0 00000100:00100000:1.0:1715330284.031652:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1414 00000100:00100000:1.0:1715330284.031659:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+9:2012:x1798653938002048:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1715330284.031669:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330284.031673:0:9416:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d6ef3 lrc: 5/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb1e6 expref: 9 pid: 7135 timeout: 358 lvb_type: 0 00010000:00010000:1.0:1715330284.031683:0:9416:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d6ef3 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb1e6 expref: 9 pid: 7135 timeout: 358 lvb_type: 0 00010000:00010000:1.0:1715330284.031701:0:9416:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88009d434b00) 00010000:00010000:1.0:1715330284.031706:0:9416:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66ac0/0xd895711d66d6fe8 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d6fe1 expref: 9 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.031944:0:9416:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66ac0/0xd895711d66d6fe8 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xd895711d66d6fe1 expref: 9 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.031951:0:9416:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66ac0/0xd895711d66d6fe8 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xd895711d66d6fe1 expref: 9 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.031974:0:9416:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66ac0/0xd895711d66d6fe8 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6fe1 expref: 9 pid: 24873 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330284.031990:0:9416:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001_UUID:9416:1798653942405888:0@lo:105: 00000100:00100000:1.0:1715330284.032018:0:9416:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330284.032033:0:9416:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47e900 going to sleep for 11 seconds 00000100:00100000:1.0:1715330284.032046:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942405888 00000100:00100000:1.0:1715330284.032049:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942405888 00000100:00100000:1.0:1715330284.032067:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1076 00000100:00100000:1.0:1715330284.032071:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:9416:x1798653942405888:12345-0@lo:105: 00010000:00010000:1.0:1715330284.032079:0:7118:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457eac0/0xd895711d66d6fe1 lrc: 4/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6fe8 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.032087:0:7118:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457eac0/0xd895711d66d6fe1 lrc: 4/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6fe8 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.032094:0:7118:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457eac0/0xd895711d66d6fe1 lrc: 4/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6fe8 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.032099:0:7118:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457eac0/0xd895711d66d6fe1 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d6fe8 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.032104:0:7118:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457eac0/0xd895711d66d6fe1 lrc: 5/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d6fe8 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.032110:0:7118:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457eac0/0xd895711d66d6fe1 lrc: 5/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d6fe8 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.032119:0:7118:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88013457eac0) 00000100:00100000:1.0:1715330284.032141:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:9416:x1798653942405888:12345-0@lo:105: Request processed in 68us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330284.032145:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1076 00000100:00100000:1.0:1715330284.032164:0:9416:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001_UUID:9416:1798653942405888:0@lo:105: 00010000:00010000:1.0:1715330284.032171:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330284.032192:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+8:2012:x1798653938002048:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 534us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330284.032201:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1414 00000100:00100000:1.0:1715330284.032861:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942406080 00000100:00100000:1.0:1715330284.032864:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942406080 00000100:00100000:1.0:1715330284.032880:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2274 00000100:00100000:1.0:1715330284.032885:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7135:x1798653942406080:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330284.037531:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7135:x1798653942406080:12345-0@lo:1000:mdt00_002.0 Request processed in 4639us (4723us total) trans 0 rc -2/-2 00000100:00100000:1.0:1715330284.037544:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2274 00000100:00100000:1.0:1715330284.037744:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942406144 00000100:00100000:1.0:1715330284.037750:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942406144 00000100:00100000:1.0:1715330284.037773:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2275 00000100:00100000:1.0:1715330284.037778:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7135:x1798653942406144:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330284.037859:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7135:x1798653942406144:12345-0@lo:1000:mdt00_002.0 Request processed in 80us (155us total) trans 0 rc -2/-2 00000100:00100000:1.0:1715330284.037864:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2275 00000100:00100000:1.0:1715330284.037960:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942406208 00000100:00100000:1.0:1715330284.037964:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942406208 00000100:00100000:1.0:1715330284.037984:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2276 00000100:00100000:1.0:1715330284.037988:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7135:x1798653942406208:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330284.038035:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7135:x1798653942406208:12345-0@lo:1000:mdt00_002.0 Request processed in 46us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330284.038040:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2276 00000100:00100000:1.0:1715330284.038102:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942406272 00000100:00100000:1.0:1715330284.038105:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942406272 00000100:00100000:1.0:1715330284.038117:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2277 00000100:00100000:1.0:1715330284.038121:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7135:x1798653942406272:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330284.038156:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7135:x1798653942406272:12345-0@lo:1000:mdt00_002.0 Request processed in 34us (66us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330284.038161:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2277 00000100:00100000:1.0:1715330284.039774:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942406400 00000100:00100000:1.0:1715330284.039780:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942406400 00000100:00100000:1.0:1715330284.039806:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2278 00000100:00100000:1.0:1715330284.039811:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134565f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:8587:x1798653942406400:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330284.040193:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134565f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:8587:x1798653942406400:12345-0@lo:1000:osp_up1-0.0 Request processed in 380us (436us total) trans 4294968304 rc 0/0 00000100:00100000:1.0:1715330284.040199:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2278 00010000:00010000:0.0:1715330284.040368:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d6ffd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1500:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.040381:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d6ffd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1500:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.040390:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d6ffd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1500:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.040404:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d7004 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xbe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.040409:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d7004 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.040414:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d7004 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.040432:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f0000/0xd895711d66d700b lrc: 3/0,1 mode: --/PW res: [0x240000401:0xbe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.040437:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f0000/0xd895711d66d700b lrc: 3/0,1 mode: --/PW res: [0x240000401:0xbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.040445:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f0000/0xd895711d66d700b lrc: 3/0,1 mode: --/PW res: [0x240000401:0xbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT0 00000100:00100000:0.0:1715330284.040454:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f4b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942406464:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1715330284.040474:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330284.040483:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009396c600 going to sleep for 11 seconds 00000100:00100000:1.0:1715330284.040540:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942406464 00000100:00100000:1.0:1715330284.040544:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942406464 00000100:00100000:1.0:1715330284.040558:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2279 00000100:00100000:1.0:1715330284.040562:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f4b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:7135:x1798653942406464:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330284.040572:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330284.040594:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfef40/0xd895711d66d7012 lrc: 2/0,0 mode: --/PW res: [0x240000401:0xbe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d700b expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.040607:0:9408:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfef40/0xd895711d66d7012 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d700b expref: 12 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.040616:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfef40/0xd895711d66d7012 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d700b expref: 12 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.040623:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xbe:0x0].0x0 (ffff88008b0d2e00) 00010000:00010000:1.0:1715330284.040625:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330284.040627:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfef40, rc 0) 00000100:00100000:1.0:1715330284.040649:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f4b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:7135:x1798653942406464:12345-0@lo:101:mdt00_002.0 Request processed in 86us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330284.040654:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2279 00000100:00100000:0.0:1715330284.040758:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f4b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942406464:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330284.040768:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f0000/0xd895711d66d700b lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7012 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.040775:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f0000/0xd895711d66d700b lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7012 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330284.040790:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880134567800 reply state ffff88009d62e000 transno 4294983357 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d7004 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.040798:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d7004 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.040803:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xbe:0x0].0x0 (ffff88009d434e00) 00010000:00010000:0.0:1715330284.040805:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330284.040807:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1715330284.040811:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f0000/0xd895711d66d700b lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7012 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.040817:0:7135:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f0000/0xd895711d66d700b lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7012 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1715330284.040824:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0xbe:0x0] 00000004:00010000:0.0:1715330284.040828:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880134567800 reply state ffff88009d62e000 transno 4294983357 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d6ffd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1500:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.040833:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d6ffd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1500:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.040838:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1500:0x0].0x0 (ffff88009d434a00) 00010000:00010000:0.0:1715330284.040840:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330284.040841:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1715330284.040844:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1500:0x0]: returning size 4096 00000004:00080000:0.0:1715330284.041319:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:0.0:1715330284.041327:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457eac0/0xd895711d66d6fe1 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d6fe8 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.041332:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457eac0/0xd895711d66d6fe1 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d6fe8 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.041337:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457eac0/0xd895711d66d6fe1 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d6fe8 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.041453:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1715330284.041457:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:0.0:1715330284.041461:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457df80/0xd895711d66d6fef lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526f7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6ff6 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.041467:0:7135:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457df80/0xd895711d66d6fef lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526f7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d6ff6 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330284.041524:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134567800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+16:16784:x1798653938001984:12345-192.168.204.49@tcp:36:lfs.0 Request processed in 14415us (15256us total) trans 4294983357 rc 0/0 00000100:00100000:0.0:1715330284.041530:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23144 00010000:00010000:1.0:1715330284.041577:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715330284.041582:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457eac0/0xd895711d66d6fe1 lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d6fe8 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.041596:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457eac0 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330284.041601:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457eac0/0xd895711d66d6fe1 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d6fe8 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330284.041607:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457eac0/0xd895711d66d6fe1 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d6fe8 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.041625:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457eac0/0xd895711d66d6fe1 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6fe8 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.041630:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330284.041644:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457eac0/0xd895711d66d6fe1 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6fe8 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.041650:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457eac0/0xd895711d66d6fe1 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d6fe8 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.041661:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330284.041662:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330284.041663:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330284.041712:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942406528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330284.041757:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330284.041812:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942406528 00000100:00100000:1.0:1715330284.041816:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942406528 00000100:00100000:0.0:1715330284.041948:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942406528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330284.060777:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938002176 00000100:00100000:1.0:1715330284.060787:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938002176 00000100:00100000:1.0:1715330284.060832:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23145 00000100:00100000:1.0:1715330284.060839:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+8:16794:x1798653938002176:12345-192.168.204.49@tcp:36:mkdir.0 00000100:00100000:1.0:1715330284.061475:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+8:16794:x1798653938002176:12345-192.168.204.49@tcp:36:mkdir.0 Request processed in 635us (763us total) trans 0 rc -17/-17 00000100:00100000:1.0:1715330284.061481:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23145 00000100:00100000:1.0:1715330284.069996:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938002240 00000100:00100000:1.0:1715330284.070006:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938002240 00000100:00100000:1.0:1715330284.070053:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23146 00000100:00100000:1.0:1715330284.070060:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+8:16795:x1798653938002240:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:1.0:1715330284.070255:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330284.070541:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d7019 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb217 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.070604:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff840/0xd895711d66d7020 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.071010:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff840/0xd895711d66d7020 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330284.071022:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff840/0xd895711d66d7020 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330284.071032:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdf80/0xd895711d66d7027 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x6f4526f7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.071040:0:7135:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db673c0/0xd895711d66d6ff6 lrc: 2/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526f7 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d6fef expref: 10 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.071047:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdf80/0xd895711d66d7027 lrc: 4/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x6f4526f7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330284.071073:0:7135:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88011db673c0/0xd895711d66d6ff6 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526f7 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd895711d66d6fef expref: 10 pid: 24873 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330284.071090:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7135:1798653942406592:0@lo:104: 00000100:00100000:1.0:1715330284.071131:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330284.071145:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47e600 going to sleep for 11 seconds 00000100:00100000:1.0:1715330284.071165:0:7118:0:(service.c:168:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1715330284.071172:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942406592 00000100:00100000:1.0:1715330284.071176:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942406592 00000100:00100000:1.0:1715330284.071196:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1077 00000100:00100000:1.0:1715330284.071200:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca77c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7135:x1798653942406592:12345-0@lo:104: 00010000:00010000:1.0:1715330284.071209:0:7118:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457df80/0xd895711d66d6fef lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526f7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d6ff6 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.071241:0:7118:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1715330284.071246:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca77c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7135:x1798653942406592:12345-0@lo:104: Request processed in 45us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330284.071251:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1077 00000100:00100000:1.0:1715330284.072374:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134565180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942406656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330284.072399:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330284.072448:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7135:1798653942406592:0@lo:104: 00010000:00010000:1.0:1715330284.072460:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdf80/0xd895711d66d7027 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x6f4526f7 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000100:00100000:1.0:1715330284.075268:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880134565180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942406656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330284.100276:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942406976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330284.100304:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330284.100328:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942406976 00000100:00100000:1.0:1715330284.100332:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942406976 00010000:00010000:1.0:1715330284.100348:0:7121:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfef40/0xd895711d66d7012 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0xbe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd895711d66d700b expref: 6 pid: 9408 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330284.100364:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1416 00000100:00100000:1.0:1715330284.100369:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+6:3691:x1798653942406976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330284.100377:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00080000:0.0:1715330284.102071:0:8267:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0001: 356 batchid updated 00010000:00010000:1.0:1715330284.102440:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfef40/0xd895711d66d7012 lrc: 0/0,0 mode: --/PW res: [0x240000401:0xbe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd895711d66d700b expref: 6 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.102453:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xbe:0x0].0x0 (ffff88008b0d2e00) 00010000:00010000:1.0:1715330284.102456:0:7121:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c6c0/0xd895711d66d7058 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330284.102463:0:7121:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c6c0/0xd895711d66d7058 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330284.102469:0:7121:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c6c0/0xd895711d66d7058 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330284.102481:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330284.102508:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942406976:12345-0@lo:103:ldlm_bl.0 Request processed in 2137us (2202us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330284.102515:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1416 00000100:00100000:1.0:1715330284.102542:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942406976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330284.103885:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942407104 00000100:00100000:0.0:1715330284.103890:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942407104 00000100:00100000:0.0:1715330284.103914:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2282 00000100:00100000:0.0:1715330284.103918:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:8278:x1798653942407104:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330284.104030:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:8278:x1798653942407104:12345-0@lo:1000:osp_up0-1.0 Request processed in 111us (1700us total) trans 4294983359 rc 0/0 00000100:00100000:0.0:1715330284.104036:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2282 00000100:00100000:1.0:1715330284.111660:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938002496 00000100:00100000:1.0:1715330284.111664:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938002496 00000100:00100000:1.0:1715330284.111701:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1217 00000100:00100000:1.0:1715330284.111708:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+8:2011:x1798653938002496:12345-192.168.204.49@tcp:103:rmdir.0 00010000:00010000:1.0:1715330284.111751:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330284.111772:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66ac0/0xd895711d66d702e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1500:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb217 expref: 8 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.111785:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1500:0x0].0x0 (ffff88009d678000) 00010000:00010000:1.0:1715330284.111793:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330284.111900:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+7:2011:x1798653938002496:12345-192.168.204.49@tcp:103:rmdir.0 Request processed in 192us (2054us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330284.111906:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1217 00000020:00080000:0.0:1715330284.113699:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 348 committed batchid 347 00000020:00080000:0.0:1715330284.113761:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 347 00000100:00100000:1.0:1715330284.114249:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942407232 00000100:00100000:1.0:1715330284.114253:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942407232 00000100:00100000:1.0:1715330284.114284:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2284 00000100:00100000:1.0:1715330284.114289:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7135:x1798653942407232:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330284.114298:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330284.114403:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d7074 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x6f4526f7 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d706d expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.114419:0:9408:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d7074 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526f7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d706d expref: 7 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.114427:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d7074 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526f7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d706d expref: 7 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.114433:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x6f4526f7 (ffff88008b0d2800) 00010000:00010000:1.0:1715330284.114435:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330284.114437:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bff180, rc 0) 00000100:00100000:1.0:1715330284.114616:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7135:x1798653942407232:12345-0@lo:101:mdt00_002.0 Request processed in 326us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330284.114621:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2284 00000100:00100000:1.0:1715330284.115977:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942407296 00000100:00100000:1.0:1715330284.115982:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942407296 00000100:00100000:1.0:1715330284.115999:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2285 00000100:00100000:1.0:1715330284.116004:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7135:x1798653942407296:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330284.116059:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7135:x1798653942407296:12345-0@lo:1000:mdt00_002.0 Request processed in 54us (1302us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330284.116064:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2285 00000100:00100000:0.0:1715330284.116206:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942407360 00000100:00100000:0.0:1715330284.116209:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942407360 00000100:00100000:0.0:1715330284.116236:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2286 00000100:00100000:0.0:1715330284.116239:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7135:x1798653942407360:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1715330284.116385:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7135:x1798653942407360:12345-0@lo:1000:mdt00_002.0 Request processed in 144us (219us total) trans 0 rc 1/1 00000100:00100000:0.0:1715330284.116391:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2286 00000100:00100000:0.0:1715330284.116542:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942407424 00000100:00100000:0.0:1715330284.116545:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942407424 00000100:00100000:0.0:1715330284.116570:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2287 00000100:00100000:0.0:1715330284.116575:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7135:x1798653942407424:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330284.116581:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330284.116602:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d7082 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1500:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d707b expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.116616:0:23404:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d7082 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1500:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d707b expref: 8 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.116624:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d7082 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1500:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d707b expref: 8 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.116650:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1500:0x0].0x0 (ffff88009d434300) 00010000:00010000:0.0:1715330284.116653:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1715330284.116654:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f3cc0, rc 0) 00000100:00100000:0.0:1715330284.117226:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:7135:x1798653942407424:12345-0@lo:101:mdt00_002.0 Request processed in 650us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330284.117231:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2287 00000100:00100000:0.0:1715330284.122318:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330284.122524:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938002688 00000100:00100000:1.0:1715330284.122531:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938002688 00010000:00010000:1.0:1715330284.122552:0:9416:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d704a lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb225 expref: 18 pid: 7135 timeout: 358 lvb_type: 0 00000100:00100000:1.0:1715330284.122602:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1417 00000100:00100000:1.0:1715330284.122608:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f4b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+18:2012:x1798653938002688:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1715330284.122619:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330284.122625:0:9416:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d704a lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb225 expref: 18 pid: 7135 timeout: 358 lvb_type: 0 00010000:00010000:1.0:1715330284.122636:0:9416:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d704a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb225 expref: 18 pid: 7135 timeout: 358 lvb_type: 0 00010000:00010000:1.0:1715330284.122657:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d704a lrc: 0/0,0 mode: --/PR res: [0x200000400:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb225 expref: 18 pid: 7135 timeout: 358 lvb_type: 0 00010000:00010000:1.0:1715330284.122683:0:9416:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xbe:0x0].0x0 (ffff88009d434e00) 00010000:00010000:1.0:1715330284.122686:0:9416:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d7090 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.122694:0:9416:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d7090 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.122700:0:9416:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d7090 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.122716:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330284.122760:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f4b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+17:2012:x1798653938002688:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 136us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330284.122766:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1417 00000100:00100000:0.0:1715330284.126566:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942407552:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330284.126578:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db673c0/0xd895711d66d7097 lrc: 4/0,1 mode: --/EX res: [0x240000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d709e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.126712:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db673c0/0xd895711d66d7097 lrc: 4/0,1 mode: --/EX res: [0x240000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d709e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330284.129151:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330284.129280:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938002752 00000100:00100000:0.0:1715330284.129288:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938002752 00010000:00010000:0.0:1715330284.129311:0:7121:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c6c0/0xd895711d66d7058 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb22c expref: 7 pid: 7135 timeout: 358 lvb_type: 0 00000100:00100000:0.0:1715330284.129486:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1418 00000100:00100000:0.0:1715330284.129494:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+7:2011:x1798653938002752:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1715330284.129579:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330284.129593:0:7121:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c6c0/0xd895711d66d7058 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb22c expref: 7 pid: 7135 timeout: 358 lvb_type: 0 00010000:00010000:0.0:1715330284.129604:0:7121:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c6c0/0xd895711d66d7058 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb22c expref: 7 pid: 7135 timeout: 358 lvb_type: 0 00010000:00010000:0.0:1715330284.129621:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c6c0/0xd895711d66d7058 lrc: 0/0,0 mode: --/PR res: [0x240000401:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb22c expref: 7 pid: 7135 timeout: 358 lvb_type: 0 00010000:00010000:0.0:1715330284.129633:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xbe:0x0].0x0 (ffff88008b0d2e00) 00010000:00010000:0.0:1715330284.129638:0:7121:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d709e lrc: 2/0,0 mode: --/EX res: [0x240000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7097 expref: 8 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.129646:0:7121:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d709e lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d7097 expref: 8 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.129653:0:7121:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d709e lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d7097 expref: 8 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.129677:0:7121:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d709e lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7097 expref: 8 pid: 23404 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330284.129689:0:7121:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f4b3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:7121:1798653942407680:0@lo:105: 00000100:00100000:0.0:1715330284.129722:0:7121:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330284.129767:0:7121:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009396cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1715330284.129935:0:7121:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f4b3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:7121:1798653942407680:0@lo:105: 00010000:00010000:1.0:1715330284.129946:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330284.129973:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+6:2011:x1798653938002752:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 479us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330284.129979:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1418 00010000:00010000:0.0:1715330284.130211:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db673c0/0xd895711d66d7097 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d709e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.130220:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db673c0/0xd895711d66d7097 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d709e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330284.130855:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f4b0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942407744:0@lo:403:mdt00_002.0 00000100:00100000:0.0:1715330284.130885:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330284.130904:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009396c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330284.132555:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f4b0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942407744:0@lo:403:mdt00_002.0 00000040:00080000:0.0:1715330284.133283:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].334, 664 off514752 00000040:00080000:0.0:1715330284.133409:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].333, 744 off552872 00000004:00080000:0.0:1715330284.133413:0:7135:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88009396c9c0 with version 635 00000100:00100000:1.0:1715330284.133914:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942407872 00000100:00100000:1.0:1715330284.133919:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942407872 00000100:00100000:1.0:1715330284.133947:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2290 00000100:00100000:1.0:1715330284.133951:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:8587:x1798653942407872:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330284.134207:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:8587:x1798653942407872:12345-0@lo:1000:osp_up1-0.0 Request processed in 254us (394us total) trans 4294968305 rc 0/0 00000100:00100000:1.0:1715330284.134213:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2290 00000004:00200000:0.0:1715330284.134308:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1500:0x0]: returning size 4096 00010000:00010000:0.0:1715330284.134326:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d7090 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.134333:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d7090 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.134339:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d7090 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.134344:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330284.134351:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d7090 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.134357:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d7090 lrc: 4/0,0 mode: EX/EX res: [0x200000400:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.134368:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xbe:0x0].0x0 (ffff88009d434e00) 00010000:00010000:0.0:1715330284.134370:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715330284.134373:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d7090 lrc: 2/0,0 mode: --/EX res: [0x200000400:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.134378:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d7090 lrc: 0/0,0 mode: --/EX res: [0x200000400:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.134388:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db673c0/0xd895711d66d7097 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d709e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.134394:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db673c0/0xd895711d66d7097 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d709e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.134400:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db673c0/0xd895711d66d7097 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d709e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.134418:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1715330284.134424:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0xbe:0x0] 00010000:00010000:0.0:1715330284.134428:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d7089 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1500:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.134433:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d7089 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1500:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.134437:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d7089 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1500:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.134441:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64240 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330284.134443:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d7089 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1500:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.134447:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d7089 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1500:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.134452:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1500:0x0].0x0 (ffff88009d434a00) 00010000:00010000:0.0:1715330284.134454:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330284.134456:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d7089 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1500:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.134460:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d7089 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1500:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.134466:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db65f80/0xd895711d66d707b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1500:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7082 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.134471:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db65f80/0xd895711d66d707b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1500:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d7082 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.134481:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db65f80/0xd895711d66d707b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1500:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d7082 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.134488:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:0.0:1715330284.134568:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:0.0:1715330284.134571:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e640/0xd895711d66d705f lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7066 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.134577:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e640/0xd895711d66d705f lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d7066 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.134598:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e640/0xd895711d66d705f lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d7066 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.134614:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000004:00080000:0.0:1715330284.134617:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:0.0:1715330284.134620:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457cd80/0xd895711d66d706d lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526f7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7074 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.134626:0:7135:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457cd80/0xd895711d66d706d lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526f7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7074 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330284.134667:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:16795:x1798653938002624:12345-192.168.204.49@tcp:36:rmdir.0 Request processed in 22722us (23049us total) trans 4294983360 rc 0/0 00000100:00100000:0.0:1715330284.134673:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23150 00010000:00010000:1.0:1715330284.135059:0:7124:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1715330284.135064:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db673c0/0xd895711d66d7097 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d709e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.135070:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db673c0 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330284.135073:0:7124:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db673c0/0xd895711d66d7097 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d709e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330284.135083:0:7124:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db673c0/0xd895711d66d7097 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d709e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.135102:0:7124:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db673c0/0xd895711d66d7097 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d709e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.135112:0:7124:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330284.135134:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db673c0/0xd895711d66d7097 lrc: 1/0,0 mode: --/EX res: [0x240000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d709e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.135140:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db673c0/0xd895711d66d7097 lrc: 0/0,0 mode: --/EX res: [0x240000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d709e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.135152:0:7124:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1715330284.135155:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db65f80/0xd895711d66d707b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1500:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d7082 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.135159:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db65f80 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330284.135161:0:7124:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db65f80/0xd895711d66d707b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1500:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d7082 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330284.135167:0:7124:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db65f80/0xd895711d66d707b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1500:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d7082 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.135178:0:7124:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db65f80/0xd895711d66d707b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1500:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7082 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.135182:0:7124:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330284.135186:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db65f80/0xd895711d66d707b lrc: 1/0,0 mode: --/EX res: [0x200000402:0x1500:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7082 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.135195:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db65f80/0xd895711d66d707b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1500:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7082 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.135202:0:7124:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715330284.135205:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e640/0xd895711d66d705f lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d7066 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.135209:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457e640 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330284.135211:0:7124:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e640/0xd895711d66d705f lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d7066 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330284.135216:0:7124:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e640/0xd895711d66d705f lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d7066 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.135224:0:7124:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e640/0xd895711d66d705f lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7066 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.135228:0:7124:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330284.135235:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e640/0xd895711d66d705f lrc: 1/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7066 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.135240:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e640/0xd895711d66d705f lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7066 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.135247:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330284.135249:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330284.135250:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330284.135253:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330284.135260:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942408064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330284.135281:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330284.135301:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942408064 00000100:00100000:1.0:1715330284.135304:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942408064 00000100:00100000:1.0:1715330284.135320:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1218 00000100:00100000:1.0:1715330284.135324:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+10:3690:x1798653942408064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330284.135331:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330284.135341:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66f40/0xd895711d66d7066 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d705f expref: 10 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.135349:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88009d678f00) 00010000:00010000:1.0:1715330284.135355:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330284.135369:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+9:3690:x1798653942408064:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330284.135374:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1218 00000100:00100000:1.0:1715330284.135389:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942408064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330284.135439:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942408000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330284.135456:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330284.135466:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1715330284.135469:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942407936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330284.135480:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330284.135564:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942408000 00000100:00100000:1.0:1715330284.135567:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942408000 00000100:00100000:1.0:1715330284.135828:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942407936 00000100:00100000:1.0:1715330284.135831:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942407936 00000100:00100000:1.0:1715330284.135843:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1219 00000100:00100000:1.0:1715330284.135846:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f4b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+10:3689:x1798653942408000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330284.135852:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330284.135859:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d7082 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1500:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d707b expref: 10 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.135867:0:9416:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1500:0x0].0x0 (ffff88009d434300) 00010000:00010000:1.0:1715330284.135872:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330284.136100:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f4b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+8:3689:x1798653942408000:12345-0@lo:103:ldlm_bl.0 Request processed in 253us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330284.136105:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1219 00000100:00100000:0.0:1715330284.136235:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942407936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330284.136242:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942408000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330284.145302:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330284.145384:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938002816 00000100:00100000:0.0:1715330284.145393:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938002816 00000100:00100000:0.0:1715330284.145442:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23151 00000100:00100000:0.0:1715330284.145450:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:16796:x1798653938002816:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:0.0:1715330284.145469:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330284.145485:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d70a5 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb233 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.145536:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d70ac lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.145547:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d70ac lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.145556:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d70ac lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.145565:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d70b3 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x6f4526f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.145570:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d70b3 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.145574:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d70b3 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.145628:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d70ac lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.145634:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d70ac lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.145638:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d70ac lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.145643:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d70ac lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.145648:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f2640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330284.145653:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d70ac lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.145658:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d70ac lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.145667:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88009d434600) 00010000:00010000:0.0:1715330284.145669:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330284.145672:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d70ac lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.145677:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d70ac lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.145686:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d70b3 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.145690:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d70b3 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.145694:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d70b3 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.145699:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f1d40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330284.145700:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d70b3 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.145703:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d70b3 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.145707:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x6f4526f8 (ffff88009d434500) 00010000:00010000:0.0:1715330284.145708:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330284.145709:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d70b3 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x6f4526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.145712:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d70b3 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x6f4526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.145754:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d70a5 lrc: 1/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb233 expref: 18 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.145759:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d70a5 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb233 expref: 18 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.145764:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f3cc0, rc 0) 00000100:00100000:0.0:1715330284.145797:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:16796:x1798653938002816:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 349us (505us total) trans 0 rc 301/301 00000100:00100000:0.0:1715330284.145802:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23151 00000100:00100000:0.0:1715330284.149771:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330284.154957:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330284.155003:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938003008 00000100:00100000:0.0:1715330284.155012:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938003008 00000100:00100000:0.0:1715330284.155057:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23153 00000100:00100000:0.0:1715330284.155064:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+7:16796:x1798653938003008:12345-192.168.204.49@tcp:36:lfs.0 00000100:00100000:0.0:1715330284.155147:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f4b0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942408128:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330284.155185:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330284.155208:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330284.155257:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942408128 00000100:00100000:1.0:1715330284.155261:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942408128 00000100:00100000:1.0:1715330284.155296:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2291 00000100:00100000:1.0:1715330284.155301:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f4b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7134:x1798653942408128:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330284.155356:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f4b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7134:x1798653942408128:12345-0@lo:1000:mdt00_001.0 Request processed in 54us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330284.155362:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2291 00000100:00100000:0.0:1715330284.155576:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f4b0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942408128:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330284.155636:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f4b0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942408192:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330284.155655:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330284.155669:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330284.156225:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f4b0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942408192:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1715330284.156259:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2ac0/0xd895711d66d70c8 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.156264:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2ac0/0xd895711d66d70c8 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.156270:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2ac0/0xd895711d66d70c8 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT1 00000100:00100000:0.0:1715330284.156276:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f4b0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942408256:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1715330284.156289:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330284.156303:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435c00 going to sleep for 11 seconds 00000100:00100000:0.0:1715330284.159848:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f4b0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942408256:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330284.159863:0:7134:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2ac0/0xd895711d66d70c8 lrc: 4/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d70cf expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.159871:0:7134:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2ac0/0xd895711d66d70c8 lrc: 4/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d70cf expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330284.159883:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00010000:00010000:0.0:1715330284.160266:0:7134:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2ac0/0xd895711d66d70c8 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d70cf expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.160273:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2ac0/0xd895711d66d70c8 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d70cf expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1715330284.160290:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:0.0:1715330284.160311:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2880/0xd895711d66d70d6 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.160316:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2880/0xd895711d66d70d6 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.160323:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2880/0xd895711d66d70d6 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT1 00000100:00100000:0.0:1715330284.160334:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f4b0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942408448:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1715330284.160356:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330284.160365:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435c00 going to sleep for 11 seconds 00000100:00100000:0.0:1715330284.160980:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f4b0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942408448:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330284.160989:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2880/0xd895711d66d70d6 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d70dd expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.160996:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2880/0xd895711d66d70d6 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d70dd expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1715330284.161005:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:0.0:1715330284.161028:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f4b0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942408512:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330284.161047:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330284.161072:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330284.161325:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f4b0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942408512:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330284.161353:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942408576:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330284.161371:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330284.161388:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47e240 going to sleep for 11 seconds 00000100:00100000:0.0:1715330284.161407:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942408576 00000100:00100000:0.0:1715330284.161411:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942408576 00000100:00100000:0.0:1715330284.161428:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2296 00000100:00100000:0.0:1715330284.161433:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7134:x1798653942408576:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330284.161484:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7134:x1798653942408576:12345-0@lo:1000:mdt00_001.0 Request processed in 51us (111us total) trans 0 rc -2/-2 00000100:00100000:0.0:1715330284.161490:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2296 00000100:00100000:1.0:1715330284.161502:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942408576:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330284.161543:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942408640:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330284.161557:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330284.161563:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47e240 going to sleep for 11 seconds 00000100:00100000:0.0:1715330284.161573:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942408640 00000100:00100000:0.0:1715330284.161576:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942408640 00000100:00100000:0.0:1715330284.161613:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2297 00000100:00100000:0.0:1715330284.161617:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7134:x1798653942408640:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330284.161655:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7134:x1798653942408640:12345-0@lo:1000:mdt00_001.0 Request processed in 38us (97us total) trans 0 rc -2/-2 00000100:00100000:0.0:1715330284.161660:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2297 00000100:00100000:1.0:1715330284.161718:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942408640:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330284.161767:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942408704:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330284.161782:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330284.161789:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47e240 going to sleep for 11 seconds 00000100:00100000:1.0:1715330284.161982:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942408704:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330284.162006:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942408768:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330284.162019:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330284.162026:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47e240 going to sleep for 11 seconds 00000100:00100000:0.0:1715330284.162034:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942408768 00000100:00100000:0.0:1715330284.162037:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942408768 00000100:00100000:0.0:1715330284.162065:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2299 00000100:00100000:0.0:1715330284.162069:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7134:x1798653942408768:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330284.162400:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942408768:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330284.162401:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7134:x1798653942408768:12345-0@lo:1000:mdt00_001.0 Request processed in 330us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330284.162407:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2299 00000040:00080000:1.0:1715330284.163061:0:7134:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].357, 2168 off542784 00000040:00080000:1.0:1715330284.163117:0:7134:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].359, 2368 off594560 00000004:00080000:1.0:1715330284.163121:0:7134:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88012f47e000 with version 686 00000100:00100000:0.0:1715330284.163343:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942408896 00000100:00100000:0.0:1715330284.163346:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942408896 00000100:00100000:0.0:1715330284.163538:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2300 00000100:00100000:0.0:1715330284.163543:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:8278:x1798653942408896:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330284.164048:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:8278:x1798653942408896:12345-0@lo:1000:osp_up0-1.0 Request processed in 504us (814us total) trans 4294983361 rc 0/0 00000100:00100000:0.0:1715330284.164054:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2300 00010000:00010000:1.0:1715330284.164197:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d70e4 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x172:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.164207:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d70e4 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x172:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.164216:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d70e4 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x172:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.164228:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d70eb lrc: 3/0,1 mode: --/PW res: [0x240000400:0xbc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.164233:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d70eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.164238:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d70eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.164253:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcd80/0xd895711d66d70f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xbc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.164257:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcd80/0xd895711d66d70f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xbc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.164264:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcd80/0xd895711d66d70f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xbc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT1 00000100:00100000:1.0:1715330284.164273:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942408960:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1715330284.164291:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330284.164299:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1715330284.164518:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942408960:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330284.164527:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcd80/0xd895711d66d70f2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xbc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d70f9 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.164534:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcd80/0xd895711d66d70f2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xbc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d70f9 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330284.164546:0:7134:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012fa4df80 reply state ffff880091c02000 transno 4294968306 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d70eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.164553:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d70eb lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xbc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.164558:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xbc:0x0].0x0 (ffff88008b0d2700) 00010000:00010000:1.0:1715330284.164785:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330284.164788:0:7134:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1715330284.164793:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcd80/0xd895711d66d70f2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xbc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d70f9 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.164800:0:7134:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcd80/0xd895711d66d70f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xbc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d70f9 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330284.164807:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000401:0xbc:0x0] 00000004:00010000:1.0:1715330284.164810:0:7134:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012fa4df80 reply state ffff880091c02000 transno 4294968306 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d70e4 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x172:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.164817:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d70e4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x172:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.164822:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x172:0x0].0x0 (ffff88008b0d2100) 00010000:00010000:1.0:1715330284.164824:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330284.164828:0:7134:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1715330284.164832:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x172:0x0]: returning size 4096 00000004:00080000:1.0:1715330284.164836:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:1.0:1715330284.164841:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2ac0/0xd895711d66d70c8 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d70cf expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.164847:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2ac0/0xd895711d66d70c8 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d70cf expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.164852:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2ac0/0xd895711d66d70c8 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d70cf expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.164950:0:7134:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1715330284.164953:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:1.0:1715330284.164956:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2880/0xd895711d66d70d6 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d70dd expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.164962:0:7134:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2880/0xd895711d66d70d6 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d70dd expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330284.165018:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+9:16796:x1798653938003008:12345-192.168.204.49@tcp:36:lfs.0 Request processed in 9953us (10066us total) trans 4294968306 rc 0/0 00000100:00100000:1.0:1715330284.165024:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23153 00000100:00100000:1.0:1715330284.165857:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942409024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330284.165881:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330284.166107:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942409024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330284.175376:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330284.185892:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00010000:00010000:1.0:1715330284.186769:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715330284.186775:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2880/0xd895711d66d70d6 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d70dd expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.186782:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f2880 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330284.186787:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2880/0xd895711d66d70d6 lrc: 4/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f8 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd895711d66d70dd expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330284.186794:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2880/0xd895711d66d70d6 lrc: 4/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f8 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd895711d66d70dd expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.186859:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2880/0xd895711d66d70d6 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f8 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d70dd expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.186864:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330284.186934:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2880/0xd895711d66d70d6 lrc: 1/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f8 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d70dd expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.186939:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2880/0xd895711d66d70d6 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f8 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d70dd expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.186958:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330284.186960:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330284.186961:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330284.189350:0:7116:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457cd80/0xd895711d66d706d lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526f7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d7074 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330284.189361:0:7116:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457cd80/0xd895711d66d706d lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526f7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d7074 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.189384:0:7116:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457cd80/0xd895711d66d706d lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x6f4526f7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7074 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.189389:0:7116:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330284.189420:0:7116:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457cd80/0xd895711d66d706d lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x6f4526f7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7074 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1715330284.189436:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983361 is committed 00000001:00080000:0.0:1715330284.189459:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983360 is committed 00000020:00080000:0.0:1715330284.189464:0:7116:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 348 batchid updated 00000020:00080000:0.0:1715330284.189473:0:7116:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88008d667900 refcount 2 committed 0 result 0 batchid 349 00000020:00080000:0.0:1715330284.189476:0:7116:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008b122900 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88008d667780 00000020:00080000:0.0:1715330284.189479:0:7116:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].332 00000020:00080000:0.0:1715330284.189481:0:7116:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008b122e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88009396f600 00000020:00080000:0.0:1715330284.189483:0:7116:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].333 00000020:00080000:0.0:1715330284.189495:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 349 committed batchid 348 00000004:00080000:0.0:1715330284.189570:0:7163:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880134435000 with version 636 00000020:00080000:0.0:1715330284.189577:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 348 cancel update log [0x240000401:0x3:0x0].331: rc = 0 00000020:00080000:0.0:1715330284.189617:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 348 cancel update log [0x200000400:0x3:0x0].332: rc = 0 00000020:00080000:0.0:1715330284.189623:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 348 00010000:00010000:1.0:1715330284.189962:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d6ffd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1500:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.189969:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d6ffd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1500:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.189978:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d6ffd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1500:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.189983:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f21c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330284.189985:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d6ffd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1500:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.189990:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d6ffd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1500:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.189998:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1500:0x0].0x0 (ffff88009d434a00) 00010000:00010000:1.0:1715330284.190000:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330284.190002:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d6ffd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1500:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.190006:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d6ffd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1500:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.190018:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d7004 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.190023:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d7004 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.190028:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d7004 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.190031:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f06c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330284.190033:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d7004 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.190037:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d7004 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.190046:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xbe:0x0].0x0 (ffff88009d434e00) 00010000:00010000:1.0:1715330284.190047:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330284.190049:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d7004 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.190053:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d7004 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00000100:00100000:1.0:1715330284.197336:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330284.201942:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330284.209233:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942409536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330284.209255:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1715330284.217051:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 349 00000004:00080000:0.0:1715330284.217098:0:7163:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880134435a80 with version 637 00000020:00080000:0.0:1715330284.217106:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 349 cancel update log [0x240000401:0x3:0x0].332: rc = 0 00000020:00080000:0.0:1715330284.217153:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 349 cancel update log [0x200000400:0x3:0x0].333: rc = 0 00000020:00080000:0.0:1715330284.217158:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 349 00010000:00010000:0.0:1715330284.217360:0:7134:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d713f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xbc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.217365:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d713f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xbc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000100:00100000:1.0:1715330284.217507:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942409536:0@lo:103:ldlm_bl.0 00000004:00200000:0.0:1715330284.217534:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xbc:0x0]: returning size 4096 00000004:00200000:0.0:1715330284.217538:0:7134:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:0.0:1715330284.217549:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942409664 00000100:00100000:0.0:1715330284.217554:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942409664 00000100:00100000:0.0:1715330284.217596:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2304 00000100:00100000:0.0:1715330284.217600:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:8587:x1798653942409664:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330284.217701:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:8587:x1798653942409664:12345-0@lo:1000:osp_up1-0.0 Request processed in 100us (286us total) trans 4294968308 rc 0/0 00000100:00100000:0.0:1715330284.217707:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2304 00010000:00010000:0.0:1715330284.217777:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d7138 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xbc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb256 expref: 16 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.217889:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d713f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xbc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb256 expref: 15 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.217896:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xbc:0x0].0x0 (ffff88008b233900) 00010000:00010000:0.0:1715330284.217899:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1715330284.217901:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013457e400, rc 0) 00000100:00100000:1.0:1715330284.218069:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+15:16798:x1798653938003456:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 9488us (9610us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330284.218076:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23158 00000100:00100000:0.0:1715330284.220945:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330284.221540:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330284.222129:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938003648 00000100:00100000:1.0:1715330284.222133:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938003648 00000100:00100000:1.0:1715330284.222167:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23159 00000100:00100000:1.0:1715330284.222172:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f4b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+11:16798:x1798653938003648:12345-192.168.204.49@tcp:36:rmdir.0 00010000:00010000:1.0:1715330284.222207:0:7134:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330284.222218:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457cd80/0xd895711d66d7123 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x172:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb248 expref: 11 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.222229:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x172:0x0].0x0 (ffff88008b0d2100) 00010000:00010000:1.0:1715330284.222232:0:7134:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330284.222266:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcfc0/0xd895711d66d7146 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.222272:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcfc0/0xd895711d66d7146 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.222280:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcfc0/0xd895711d66d7146 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT1 00000100:00100000:1.0:1715330284.222295:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091eac000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942409728:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1715330284.222325:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330284.223098:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1715330284.223338:0:7134:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983361 gen 2 00000004:00080000:1.0:1715330284.223344:0:7134:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983358 committed transno 4294983361 00000004:00080000:1.0:1715330284.223361:0:7134:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983359 committed transno 4294983361 00000004:00080000:1.0:1715330284.223372:0:7134:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983361 committed transno 4294983361 00000100:00100000:1.0:1715330284.223388:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091eac000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942409728:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330284.223399:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcfc0/0xd895711d66d7146 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d714d expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.223407:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcfc0/0xd895711d66d7146 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d714d expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330284.223418:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:1.0:1715330284.223431:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc000/0xd895711d66d7154 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.223437:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc000/0xd895711d66d7154 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.223442:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc000/0xd895711d66d7154 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT1 00000100:00100000:1.0:1715330284.223451:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091eac000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942409792:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1715330284.223468:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330284.223475:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1715330284.223660:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942409792 00000100:00100000:0.0:1715330284.223663:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942409792 00000100:00100000:0.0:1715330284.223687:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2306 00000100:00100000:0.0:1715330284.223691:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091eac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7134:x1798653942409792:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330284.223698:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330284.223706:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66d715b lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f8 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d7154 expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.223716:0:9408:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66d715b lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d7154 expref: 8 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.223724:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66d715b lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7154 expref: 8 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.223728:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x6f4526f8 (ffff880093a11c00) 00010000:00010000:0.0:1715330284.223745:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330284.223746:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f2880, rc 0) 00000100:00100000:0.0:1715330284.223770:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091eac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:7134:x1798653942409792:12345-0@lo:101:mdt00_001.0 Request processed in 78us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330284.223775:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2306 00000100:00100000:1.0:1715330284.223778:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091eac000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942409792:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330284.223786:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc000/0xd895711d66d7154 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d715b expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.223792:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc000/0xd895711d66d7154 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d715b expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330284.223800:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:1.0:1715330284.223819:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091eac000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942409856:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330284.223837:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330284.223844:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47e000 going to sleep for 11 seconds 00000100:00100000:1.0:1715330284.223919:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091eac000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942409856:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330284.223951:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091eac000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942409920:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330284.223970:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330284.223978:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47e000 going to sleep for 11 seconds 00000100:00100000:1.0:1715330284.224065:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091eac000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942409920:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1715330284.224092:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd440/0xd895711d66d7162 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x172:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.224097:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd440/0xd895711d66d7162 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x172:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.224102:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd440/0xd895711d66d7162 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x172:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT1 00000100:00100000:1.0:1715330284.224109:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d57100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942409984:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1715330284.224127:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330284.224134:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1715330284.224140:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942409984 00000100:00100000:0.0:1715330284.224143:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942409984 00000100:00100000:0.0:1715330284.224156:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2309 00000100:00100000:0.0:1715330284.224160:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7134:x1798653942409984:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330284.224166:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330284.224173:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d7169 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x172:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d7162 expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.224185:0:9408:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d7169 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x172:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d7162 expref: 8 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.224192:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d7169 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x172:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7162 expref: 8 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.224197:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x172:0x0].0x0 (ffff880093a11900) 00010000:00010000:0.0:1715330284.224199:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1715330284.224201:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f1680, rc 0) 00000100:00100000:0.0:1715330284.224226:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:7134:x1798653942409984:12345-0@lo:101:mdt00_001.0 Request processed in 65us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330284.224231:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2309 00000100:00100000:1.0:1715330284.224234:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d57100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942409984:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330284.224243:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd440/0xd895711d66d7162 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x172:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7169 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.224249:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd440/0xd895711d66d7162 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x172:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7169 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.224263:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d7170 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x172:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.224269:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d7170 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x172:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.224274:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d7170 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x172:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.224285:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc480/0xd895711d66d7177 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xbc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.224293:0:7134:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e640/0xd895711d66d7131 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xbc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb24f expref: 10 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.224298:0:7134:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc480/0xd895711d66d7177 lrc: 4/0,1 mode: --/EX res: [0x240000400:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.224311:0:7134:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e640/0xd895711d66d7131 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xbc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb24f expref: 10 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.224321:0:7134:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e640/0xd895711d66d7131 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xbc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb24f expref: 10 pid: 7134 timeout: 358 lvb_type: 0 00000100:00100000:1.0:1715330284.224333:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d57100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7134:1798653942410048:192.168.204.49@tcp:104: 00000100:00100000:1.0:1715330284.224373:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1715330284.226780:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330284.238016:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942410240 00000100:00100000:0.0:1715330284.238020:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942410240 00000100:00100000:0.0:1715330284.238045:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1083 00000100:00100000:0.0:1715330284.238049:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:7120:x1798653942410240:12345-0@lo:105: 00010000:00010000:0.0:1715330284.238057:0:7118:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d717e lrc: 5/0,1 mode: --/EX res: [0x200000401:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7185 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.238065:0:7118:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d717e lrc: 5/0,1 mode: --/EX res: [0x200000401:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7185 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.238071:0:7118:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d717e lrc: 5/0,1 mode: --/EX res: [0x200000401:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7185 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.238077:0:7118:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d717e lrc: 5/0,1 mode: EX/EX res: [0x200000401:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d7185 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.238082:0:7118:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d717e lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d7185 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.238091:0:7118:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d717e lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d7185 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.238106:0:7118:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88011db66d00) 00000100:00100000:0.0:1715330284.238132:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:7120:x1798653942410240:12345-0@lo:105: Request processed in 82us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330284.238137:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1083 00010000:00010000:0.0:1715330284.244601:0:7123:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1715330284.244608:0:7123:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d717e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d7185 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.244614:0:7123:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66d00 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330284.244618:0:7123:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d717e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d7185 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330284.244625:0:7123:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d717e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d7185 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.244644:0:7123:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d717e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7185 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.244649:0:7123:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1715330284.245429:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f4b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942410496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330284.245456:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1715330284.245772:0:7123:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d717e lrc: 1/0,0 mode: --/EX res: [0x200000401:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7185 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.245780:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d717e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7185 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.245792:0:7123:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1715330284.245796:0:7123:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd440/0xd895711d66d7162 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x172:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d7169 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.245801:0:7123:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfd440 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330284.245805:0:7123:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd440/0xd895711d66d7162 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x172:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d7169 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330284.245811:0:7123:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd440/0xd895711d66d7162 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x172:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d7169 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.245825:0:7123:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd440/0xd895711d66d7162 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x172:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7169 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.245829:0:7123:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330284.245840:0:7123:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd440/0xd895711d66d7162 lrc: 1/0,0 mode: --/EX res: [0x240000402:0x172:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7169 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.245846:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd440/0xd895711d66d7162 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x172:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7169 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.245854:0:7123:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715330284.245856:0:7123:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcfc0/0xd895711d66d7146 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d714d expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.245861:0:7123:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfcfc0 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330284.245864:0:7123:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcfc0/0xd895711d66d7146 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d714d expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330284.245870:0:7123:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcfc0/0xd895711d66d7146 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d714d expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.245882:0:7123:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcfc0/0xd895711d66d7146 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d714d expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.245887:0:7123:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330284.245890:0:7123:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcfc0/0xd895711d66d7146 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d714d expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.245895:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcfc0/0xd895711d66d7146 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d714d expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.245904:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330284.245905:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330284.245907:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330284.246070:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f4b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942410496:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330284.246082:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330284.274439:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938003904 00000100:00100000:0.0:1715330284.274446:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938003904 00000100:00100000:0.0:1715330284.274474:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23161 00000100:00100000:0.0:1715330284.274480:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+13:16799:x1798653938003904:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:0.0:1715330284.274494:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330284.274509:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d71a1 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb264 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.274551:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d71a8 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.274560:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d71a8 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.274568:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d71a8 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.274578:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d71af lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x784526ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.274600:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d71af lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x784526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.274604:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d71af lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x784526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.274635:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d71a8 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.274639:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d71a8 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.274643:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d71a8 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.274647:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d71a8 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.274652:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f06c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330284.274655:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d71a8 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.274660:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d71a8 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.274668:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff880093a11f00) 00010000:00010000:0.0:1715330284.274670:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330284.274673:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d71a8 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.274677:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d71a8 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.274686:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d71af lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x784526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.274691:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d71af lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x784526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.274694:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d71af lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x784526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.274698:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f21c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330284.274700:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d71af lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x784526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.274704:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d71af lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x784526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.274709:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x784526ef (ffff880093a11100) 00010000:00010000:0.0:1715330284.274711:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330284.274713:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d71af lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x784526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.274718:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d71af lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x784526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.274751:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d71a1 lrc: 1/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb264 expref: 14 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.274758:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d71a1 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb264 expref: 14 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.274766:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f1680, rc 0) 00000100:00100000:0.0:1715330284.274805:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+13:16799:x1798653938003904:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 324us (436us total) trans 0 rc 301/301 00000100:00100000:0.0:1715330284.274810:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23161 00000100:00100000:0.0:1715330284.282444:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330284.287526:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938004096 00000100:00100000:0.0:1715330284.287538:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938004096 00000100:00100000:0.0:1715330284.287603:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23163 00000100:00100000:0.0:1715330284.287610:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+14:16799:x1798653938004096:12345-192.168.204.49@tcp:36:lfs.0 00010000:00010000:0.0:1715330284.287665:0:7135:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330284.287692:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d71bd lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb26b expref: 14 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.287711:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88009d678300) 00010000:00010000:0.0:1715330284.287721:0:7135:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715330284.287810:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d71c4 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.287821:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d71c4 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.287829:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d71c4 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.287838:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d71cb lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x784526ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.287843:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d71cb lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x784526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.287847:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d71cb lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x784526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000040:00080000:0.0:1715330284.288572:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].335, 2168 off516920 00000040:00080000:0.0:1715330284.288653:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].334, 2368 off555240 00000004:00080000:0.0:1715330284.288658:0:7135:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880134435d80 with version 638 00010000:00010000:0.0:1715330284.289830:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d71d2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1502:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.289841:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d71d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1502:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.289850:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d71d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1502:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.289865:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d71d9 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xbf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.289870:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d71d9 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.289880:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d71d9 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.289908:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f2640/0xd895711d66d71e0 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xbf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.289913:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f2640/0xd895711d66d71e0 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.289922:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f2640/0xd895711d66d71e0 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT0 00000100:00100000:0.0:1715330284.289938:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f4b1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942410816:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1715330284.289980:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330284.289995:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435900 going to sleep for 11 seconds 00000100:00100000:0.0:1715330284.291783:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f4b1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942410816:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330284.291796:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f2640/0xd895711d66d71e0 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d71e7 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.291805:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f2640/0xd895711d66d71e0 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d71e7 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330284.291823:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8801344c8e00 reply state ffff88008b1ed000 transno 4294983363 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d71d9 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.291832:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d71d9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.291837:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xbf:0x0].0x0 (ffff880093a11b00) 00010000:00010000:0.0:1715330284.291839:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330284.291842:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1715330284.291847:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f2640/0xd895711d66d71e0 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d71e7 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.291852:0:7135:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f2640/0xd895711d66d71e0 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d71e7 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1715330284.291861:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0xbf:0x0] 00000004:00010000:0.0:1715330284.291866:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8801344c8e00 reply state ffff88008b1ed000 transno 4294983363 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d71d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1502:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.291872:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d71d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1502:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.291877:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1502:0x0].0x0 (ffff880093a11200) 00010000:00010000:0.0:1715330284.291879:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330284.291880:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1715330284.291883:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1502:0x0]: returning size 4096 00010000:00010000:0.0:1715330284.291891:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d71c4 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.291898:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d71c4 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.291902:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d71c4 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.291907:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d71c4 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.291911:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f2ac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330284.291914:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d71c4 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.291919:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d71c4 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.291925:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff880093a11d00) 00010000:00010000:0.0:1715330284.291926:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330284.291928:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d71c4 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.291932:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d71c4 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00000004:00010000:0.0:1715330284.291945:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8801344c8e00 reply state ffff88008b1ed000 transno 4294983363 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d71cb lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x784526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.291951:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d71cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x784526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.291955:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x784526ef (ffff880093a11500) 00010000:00010000:0.0:1715330284.291956:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330284.291958:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00000100:00100000:0.0:1715330284.292026:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+15:16799:x1798653938004096:12345-192.168.204.49@tcp:36:lfs.0 Request processed in 4413us (4595us total) trans 4294983363 rc 0/0 00000100:00100000:0.0:1715330284.292033:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23163 00000100:00100000:0.0:1715330284.298603:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938004224 00000100:00100000:0.0:1715330284.298614:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938004224 00000100:00100000:0.0:1715330284.298654:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23164 00000100:00100000:0.0:1715330284.298661:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+15:16800:x1798653938004224:12345-192.168.204.49@tcp:36:mkdir.0 00000100:00100000:0.0:1715330284.298825:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+15:16800:x1798653938004224:12345-192.168.204.49@tcp:36:mkdir.0 Request processed in 164us (305us total) trans 0 rc -17/-17 00000100:00100000:0.0:1715330284.298830:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23164 00000100:00100000:0.0:1715330284.310203:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330284.319870:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330284.321399:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942410944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330284.321426:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1715330284.324237:0:8267:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc000/0xd895711d66d7154 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d715b expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330284.324250:0:8267:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc000/0xd895711d66d7154 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d715b expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.324283:0:8267:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc000/0xd895711d66d7154 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d715b expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.324289:0:8267:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330284.324318:0:8267:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc000/0xd895711d66d7154 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d715b expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1715330284.324336:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968310 is committed 00000001:00080000:0.0:1715330284.324477:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968309 is committed 00000020:00080000:0.0:1715330284.324492:0:8267:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff88012f47e240 refcount 2 committed 0 result 0 batchid 357 00000020:00080000:0.0:1715330284.324495:0:8267:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008b0d2900 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff88012f47e000 00000020:00080000:0.0:1715330284.324498:0:8267:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].359 00000020:00080000:0.0:1715330284.324500:0:8267:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008b0d2000 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88009d6a8e00 00000020:00080000:0.0:1715330284.324502:0:8267:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].357 00000100:00100000:0.0:1715330284.325642:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942410944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330284.332011:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330284.335712:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330284.336993:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942411136 00000100:00100000:1.0:1715330284.336997:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942411136 00000100:00100000:1.0:1715330284.337032:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2315 00000100:00100000:1.0:1715330284.337036:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:7134:x1798653942411136:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330284.337052:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330284.337066:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d7249 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xbf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d7242 expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.337084:0:23404:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67180/0xd895711d66d721f lrc: 2/0,0 mode: PR/PR res: [0x240000401:0xbf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb280 expref: 7 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.337090:0:23404:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d7249 lrc: 4/0,0 mode: --/EX res: [0x240000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d7242 expref: 6 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.337108:0:23404:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67180/0xd895711d66d721f lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xbf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb280 expref: 7 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.337251:0:23404:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67180/0xd895711d66d721f lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xbf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb280 expref: 7 pid: 7134 timeout: 358 lvb_type: 0 00000100:00100000:1.0:1715330284.337265:0:23404:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d54e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:23404:1798653942411200:192.168.204.49@tcp:104: 00000100:00100000:1.0:1715330284.337306:0:23404:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47e900 going to sleep for 11 seconds 00000100:00100000:0.0:1715330284.340563:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330284.341131:0:23404:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d54e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:23404:1798653942411200:192.168.204.49@tcp:104: 00010000:00010000:1.0:1715330284.341163:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d7249 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7242 expref: 6 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.341176:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xbf:0x0].0x0 (ffff88008b233500) 00010000:00010000:1.0:1715330284.341179:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330284.341182:0:23404:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d7249 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7242 expref: 6 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.341191:0:23404:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d7249 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7242 expref: 6 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.341198:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfc240, rc 0) 00000100:00100000:1.0:1715330284.341247:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7134:x1798653942411136:12345-0@lo:101:mdt00_001.0 Request processed in 4209us (4617us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330284.341255:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2315 00000020:00080000:1.0:1715330284.342136:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 350 committed batchid 349 00000020:00080000:1.0:1715330284.342240:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 349 00000100:00100000:1.0:1715330284.343195:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942411328 00000100:00100000:1.0:1715330284.343200:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942411328 00000100:00100000:1.0:1715330284.343221:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2316 00000100:00100000:1.0:1715330284.343225:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7134:x1798653942411328:12345-0@lo:403:mdt00_001.0 00000100:00100000:1.0:1715330284.345952:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7134:x1798653942411328:12345-0@lo:403:mdt00_001.0 Request processed in 2700us (2867us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330284.345985:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2316 00000100:00100000:0.0:1715330284.348223:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942411456 00000100:00100000:0.0:1715330284.348233:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942411456 00000100:00100000:0.0:1715330284.348272:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2317 00000100:00100000:0.0:1715330284.348279:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:8587:x1798653942411456:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330284.348793:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:8587:x1798653942411456:12345-0@lo:1000:osp_up1-0.0 Request processed in 513us (614us total) trans 4294968311 rc 0/0 00000100:00100000:0.0:1715330284.348804:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2317 00000004:00200000:0.0:1715330284.348985:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1502:0x0]: returning size 4096 00010000:00010000:0.0:1715330284.349016:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d723b lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.349034:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d723b lrc: 2/0,0 mode: EX/EX res: [0x200000400:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.349041:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d723b lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.349046:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457c240 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330284.349050:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d723b lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.349072:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d723b lrc: 4/0,0 mode: EX/EX res: [0x200000400:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.349086:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xbf:0x0].0x0 (ffff880093a11b00) 00010000:00010000:0.0:1715330284.349088:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715330284.349092:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d723b lrc: 2/0,0 mode: --/EX res: [0x200000400:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.349108:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d723b lrc: 0/0,0 mode: --/EX res: [0x200000400:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.349119:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67600/0xd895711d66d7242 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7249 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.349130:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67600/0xd895711d66d7242 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d7249 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.349144:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67600/0xd895711d66d7242 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d7249 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.349157:0:7134:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1715330284.349174:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0xbf:0x0] 00010000:00010000:0.0:1715330284.349181:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d7234 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1502:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.349185:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d7234 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1502:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.349193:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d7234 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1502:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.349203:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457d680 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330284.349205:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d7234 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1502:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.349209:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d7234 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1502:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.349216:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1502:0x0].0x0 (ffff880093a11200) 00010000:00010000:0.0:1715330284.349222:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715330284.349230:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d7234 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1502:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.349234:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d7234 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1502:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.349448:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d7226 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.349466:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d7226 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.349469:0:7123:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715330284.349475:0:7123:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67600/0xd895711d66d7242 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d7249 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.349480:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d7226 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.349481:0:7123:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db67600 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330284.349485:0:7123:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67600/0xd895711d66d7242 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d7249 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.349489:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d7226 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00000004:00010000:1.0:1715330284.349491:0:7123:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67600/0xd895711d66d7242 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d7249 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.349498:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457e640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330284.349501:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d7226 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.349504:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d7226 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.349514:0:7123:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67600/0xd895711d66d7242 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7249 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.349515:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88008b233b00) 00010000:00010000:0.0:1715330284.349517:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330284.349520:0:7123:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330284.349529:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d7226 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.349533:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d7226 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.349546:0:7123:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67600/0xd895711d66d7242 lrc: 1/0,0 mode: --/EX res: [0x240000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7249 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330284.349546:0:7134:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012f4b0700 reply state ffff88009d62f000 transno 4294983364 ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cd80/0xd895711d66d722d lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x784526ef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.349552:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67600/0xd895711d66d7242 lrc: 0/0,0 mode: --/EX res: [0x240000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7249 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.349565:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330284.349567:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330284.349568:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330284.349571:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cd80/0xd895711d66d722d lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x784526ef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.349609:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x784526ef (ffff880093a11500) 00010000:00010000:0.0:1715330284.349611:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330284.349614:0:7134:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1715330284.349701:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f4b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+17:16801:x1798653938004544:12345-192.168.204.49@tcp:36:rmdir.0 Request processed in 17563us (17697us total) trans 4294983364 rc 0/0 00000100:00100000:0.0:1715330284.349708:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23168 00000100:00100000:0.0:1715330284.359499:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330284.359620:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938004736 00000100:00100000:1.0:1715330284.359628:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938004736 00000100:00100000:1.0:1715330284.359670:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23169 00000100:00100000:1.0:1715330284.359679:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f4b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+7:16802:x1798653938004736:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:1.0:1715330284.359701:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330284.359721:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc480/0xd895711d66d7250 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb287 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.359893:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d7257 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.359906:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d7257 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.359945:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d7257 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.359964:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc900/0xd895711d66d725e lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x784526f0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.359969:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc900/0xd895711d66d725e lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x784526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.359974:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc900/0xd895711d66d725e lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x784526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.360027:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d7257 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.360032:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d7257 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.360037:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d7257 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.360049:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d7257 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.360055:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfc6c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330284.360059:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d7257 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.360065:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d7257 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.360087:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88009d678c00) 00010000:00010000:1.0:1715330284.360090:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330284.360094:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d7257 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.360099:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d7257 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.360109:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc900/0xd895711d66d725e lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x784526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.360114:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc900/0xd895711d66d725e lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x784526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.360119:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc900/0xd895711d66d725e lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x784526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.360122:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfc900 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330284.360125:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc900/0xd895711d66d725e lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x784526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.360129:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc900/0xd895711d66d725e lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x784526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.360134:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x784526f0 (ffff88008b0d2d00) 00010000:00010000:1.0:1715330284.360136:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330284.360137:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc900/0xd895711d66d725e lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x784526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.360145:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc900/0xd895711d66d725e lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x784526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.360169:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc480/0xd895711d66d7250 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb287 expref: 8 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.360175:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc480/0xd895711d66d7250 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb287 expref: 8 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.360181:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfc480, rc 0) 00000100:00100000:1.0:1715330284.360259:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f4b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+7:16802:x1798653938004736:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 580us (778us total) trans 0 rc 301/301 00000100:00100000:1.0:1715330284.360265:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23169 00000100:00100000:0.0:1715330284.366593:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330284.366628:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938004800 00000100:00100000:0.0:1715330284.366637:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938004800 00000100:00100000:0.0:1715330284.366853:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23170 00000100:00100000:0.0:1715330284.367075:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f4b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:16802:x1798653938004800:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:0.0:1715330284.367099:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330284.367121:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66d7265 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb28e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.367179:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d726c lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.367192:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d726c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330284.367204:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d726c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00200000:0.0:1715330284.367248:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1715330284.367253:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1715330284.367284:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66d7265 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb28e expref: 19 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.367298:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d726c lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb28e expref: 18 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.367305:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88009d434600) 00010000:00010000:0.0:1715330284.367308:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1715330284.367311:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f0000, rc 0) 00000100:00100000:0.0:1715330284.367355:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f4b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+18:16802:x1798653938004800:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 283us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330284.367605:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23170 00000100:00100000:1.0:1715330284.372558:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000004:00080000:0.0:1715330284.374619:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 688 rpc_version 688 00000020:00100000:0.0:1715330284.374653:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1715330284.374661:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012f4b2680 x1798653942411648/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 3976/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715330284.374683:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f4b2680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942411648:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330284.374871:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330284.376464:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffaa80 going to sleep for 11 seconds 00000100:00100000:1.0:1715330284.376614:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942411648 00000100:00100000:1.0:1715330284.376622:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942411648 00000100:00100000:1.0:1715330284.376670:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2318 00000100:00100000:1.0:1715330284.376678:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f4b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:8278:x1798653942411648:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1715330284.377088:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f4b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:8278:x1798653942411648:12345-0@lo:1000:osp_up0-1.0 Request processed in 409us (2333us total) trans 4294983365 rc 0/0 00000100:00100000:1.0:1715330284.377095:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2318 00000100:00100000:1.0:1715330284.395413:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330284.414512:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330284.418451:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330284.422765:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330284.422834:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938005248 00000100:00100000:0.0:1715330284.422843:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938005248 00000100:00100000:0.0:1715330284.422896:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23175 00000100:00100000:0.0:1715330284.422904:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091ead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+18:16804:x1798653938005248:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:0.0:1715330284.422925:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330284.422947:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66d72c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xbd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb2a3 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.423008:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d72ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xbd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.423021:0:7134:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d7296 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xbd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d728f expref: 7 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.423029:0:7134:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d72ce lrc: 4/1,0 mode: --/PR res: [0x200000401:0xbd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.423057:0:7134:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d7296 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xbd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd895711d66d728f expref: 7 pid: 9407 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330284.423073:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f4b1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7134:1798653942411776:0@lo:104: 00000100:00100000:0.0:1715330284.423119:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330284.423145:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330284.423188:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942411776 00000100:00100000:1.0:1715330284.423191:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942411776 00000100:00100000:1.0:1715330284.423221:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1086 00000100:00100000:1.0:1715330284.423225:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d61fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:7134:x1798653942411776:12345-0@lo:104: 00010000:00010000:1.0:1715330284.423235:0:7118:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db661c0/0xd895711d66d728f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xbd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d7296 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.423307:0:7118:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1715330284.423312:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d61fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:7134:x1798653942411776:12345-0@lo:104: Request processed in 87us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330284.423319:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1086 00000100:00100000:0.0:1715330284.423558:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f4b1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7134:1798653942411776:0@lo:104: 00010000:00010000:0.0:1715330284.423572:0:7134:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d72ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xbd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000100:00100000:1.0:1715330284.423629:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942411840 00000100:00100000:1.0:1715330284.423632:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942411840 00010000:00010000:1.0:1715330284.423645:0:7122:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d7296 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xbd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd895711d66d728f expref: 8 pid: 9407 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330284.423681:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1427 00000100:00100000:1.0:1715330284.423685:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+8:3689:x1798653942411840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330284.423692:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1715330284.427637:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983365 is committed 00000001:00080000:0.0:1715330284.427668:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983364 is committed 00000020:00080000:0.0:1715330284.427677:0:7116:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 350 batchid updated 00000020:00080000:0.0:1715330284.427687:0:7116:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff880134435300 refcount 2 committed 0 result 0 batchid 351 00000020:00080000:0.0:1715330284.427691:0:7116:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880093a11a00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff880134435d80 00000020:00080000:0.0:1715330284.427694:0:7116:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].334 00000020:00080000:0.0:1715330284.427698:0:7116:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880093a11900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88006eff7e00 00000020:00080000:0.0:1715330284.427700:0:7116:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].335 00010000:00010000:1.0:1715330284.427760:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d71cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x784526ef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.427769:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d71cb lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x784526ef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.427775:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d71cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x784526ef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.427780:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f3a80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330284.427784:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d71cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x784526ef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.427790:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d71cb lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x784526ef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.427807:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x784526ef (ffff880093a11500) 00010000:00010000:1.0:1715330284.427809:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330284.427813:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d71cb lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x784526ef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.427818:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d71cb lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x784526ef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.427828:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d71d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1502:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.427833:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d71d2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1502:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.427837:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d71d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1502:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.427841:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f3cc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330284.427843:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d71d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1502:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.427847:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d71d2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1502:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.427853:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1502:0x0].0x0 (ffff880093a11200) 00010000:00010000:1.0:1715330284.427854:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330284.427856:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d71d2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1502:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.427861:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d71d2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1502:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.427874:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d71d9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.427879:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d71d9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.427883:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d71d9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.427886:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f1d40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330284.427888:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d71d9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.427892:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d71d9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.427897:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xbf:0x0].0x0 (ffff880093a11b00) 00010000:00010000:1.0:1715330284.427899:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330284.427901:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d71d9 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.427904:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d71d9 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.427916:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cd80/0xd895711d66d722d lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x784526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.427921:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cd80/0xd895711d66d722d lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x784526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.427926:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cd80/0xd895711d66d722d lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x784526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.427929:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457cd80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330284.427931:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cd80/0xd895711d66d722d lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x784526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.427939:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cd80/0xd895711d66d722d lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x784526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.427944:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x784526ef (ffff880093a11500) 00010000:00010000:1.0:1715330284.427946:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330284.427948:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cd80/0xd895711d66d722d lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x784526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.427952:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cd80/0xd895711d66d722d lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x784526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00000020:00080000:1.0:1715330284.427969:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 351 committed batchid 350 00080000:02000000:1.0:1715330284.427984:0:7163:0:(osd_handler.c:2105:osd_trans_start()) *** cfs_fail_loc=19a, val=0*** 00000004:00080000:1.0:1715330284.428040:0:7163:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88012f47e900 with version 640 00000020:00080000:1.0:1715330284.428048:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 350 cancel update log [0x240000401:0x3:0x0].333: rc = 0 00000020:00080000:1.0:1715330284.428127:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 350 cancel update log [0x200000400:0x3:0x0].334: rc = 0 00000020:00080000:1.0:1715330284.428135:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 351 committed batchid 350 00000004:00080000:1.0:1715330284.428192:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 640 rpc_version 640 00000020:00100000:1.0:1715330284.428256:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1715330284.428262:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880091eaf480 x1798653942411968/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1715330284.428280:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091eaf480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942411968:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330284.428344:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330284.428371:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330284.428542:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942411968 00000100:00100000:0.0:1715330284.428556:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942411968 00000100:00100000:0.0:1715330284.428612:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2320 00000100:00100000:0.0:1715330284.428618:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091eae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:8587:x1798653942411968:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330284.428835:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091eae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:8587:x1798653942411968:12345-0@lo:1000:osp_up1-0.0 Request processed in 216us (490us total) trans 4294968313 rc 0/0 00000100:00100000:0.0:1715330284.428841:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2320 00010000:00010000:0.0:1715330284.428859:0:7134:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d72ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xbd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.428865:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d72ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xbd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000004:00200000:0.0:1715330284.428901:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xbd:0x0]: returning size 4096 00000004:00200000:0.0:1715330284.428905:0:7134:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1715330284.428943:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66d72c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xbd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb2a3 expref: 16 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.428955:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d72ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xbd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb2a3 expref: 15 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.428961:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xbd:0x0].0x0 (ffff88008b233c00) 00010000:00010000:0.0:1715330284.428963:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1715330284.428965:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f1f80, rc 0) 00000100:00100000:0.0:1715330284.429001:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091ead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+15:16804:x1798653938005248:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 6097us (6244us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330284.429007:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23175 00000100:00100000:1.0:1715330284.429150:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091eaf480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942411968:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330284.436907:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942412032 00000100:00100000:0.0:1715330284.436917:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942412032 00000100:00100000:0.0:1715330284.437212:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2321 00000100:00100000:0.0:1715330284.437218:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:3691:x1798653942412032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1715330284.437251:0:23404:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445081088 avail 1315618816 00000100:00100000:0.0:1715330284.437311:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:3691:x1798653942412032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (1621us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330284.437317:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2321 00000100:00100000:0.0:1715330284.449043:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942412288 00000100:00100000:0.0:1715330284.449048:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942412288 00000100:00100000:0.0:1715330284.449085:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1087 00000100:00100000:0.0:1715330284.449090:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:7121:x1798653942412288:12345-0@lo:105: 00010000:00010000:0.0:1715330284.449098:0:7118:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457cd80/0xd895711d66d72f1 lrc: 5/0,1 mode: --/EX res: [0x200000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d72f8 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.449106:0:7118:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457cd80/0xd895711d66d72f1 lrc: 5/0,1 mode: --/EX res: [0x200000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d72f8 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.449113:0:7118:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457cd80/0xd895711d66d72f1 lrc: 5/0,1 mode: --/EX res: [0x200000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d72f8 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.449184:0:7118:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457cd80/0xd895711d66d72f1 lrc: 5/0,1 mode: EX/EX res: [0x200000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d72f8 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.449190:0:7118:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457cd80/0xd895711d66d72f1 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d72f8 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.449200:0:7118:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457cd80/0xd895711d66d72f1 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d72f8 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.449381:0:7118:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88013457cd80) 00000100:00100000:0.0:1715330284.449422:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:7121:x1798653942412288:12345-0@lo:105: Request processed in 331us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330284.449428:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1087 00010000:00010000:0.0:1715330284.456708:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715330284.456716:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457cd80/0xd895711d66d72f1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d72f8 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.456721:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457cd80 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330284.456724:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457cd80/0xd895711d66d72f1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d72f8 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330284.456748:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457cd80/0xd895711d66d72f1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d72f8 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.456774:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457cd80/0xd895711d66d72f1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d72f8 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.456779:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330284.456794:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457cd80/0xd895711d66d72f1 lrc: 1/0,0 mode: --/EX res: [0x200000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d72f8 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.456799:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457cd80/0xd895711d66d72f1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xbd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d72f8 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.456812:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330284.456813:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330284.456815:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330284.456860:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1715330284.456869:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d61c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942412544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330284.456898:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330284.457908:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d61c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942412544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330284.482355:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000004:00080000:1.0:1715330284.483694:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 641 rpc_version 641 00000020:00100000:1.0:1715330284.483748:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1715330284.483755:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880091eac380 x1798653942412672/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1715330284.483823:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091eac380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942412672:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330284.483884:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330284.483907:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1715330284.484057:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942412672 00000100:00100000:0.0:1715330284.484075:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942412672 00000100:00100000:0.0:1715330284.484155:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2325 00000100:00100000:0.0:1715330284.484169:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091eaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:8587:x1798653942412672:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330284.484969:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091eaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:8587:x1798653942412672:12345-0@lo:1000:osp_up1-0.0 Request processed in 798us (1083us total) trans 4294968315 rc 0/0 00000100:00100000:0.0:1715330284.484986:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2325 00000100:00100000:1.0:1715330284.484994:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091eac380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942412672:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1715330284.485071:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe880/0xd895711d66d7330 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1504:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.485081:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe880/0xd895711d66d7330 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1504:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.485090:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe880/0xd895711d66d7330 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1504:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.485103:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d7337 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xc0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.485108:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d7337 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.485112:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d7337 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.485135:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfdd40/0xd895711d66d733e lrc: 3/0,1 mode: --/PW res: [0x240000401:0xc0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.485141:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfdd40/0xd895711d66d733e lrc: 3/0,1 mode: --/PW res: [0x240000401:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.485150:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfdd40/0xd895711d66d733e lrc: 3/0,1 mode: --/PW res: [0x240000401:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT0 00000100:00100000:1.0:1715330284.485159:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091eac000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942412736:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1715330284.485188:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330284.485198:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1715330284.485717:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942412736 00000100:00100000:0.0:1715330284.485722:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942412736 00000100:00100000:0.0:1715330284.485767:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2326 00000100:00100000:0.0:1715330284.485772:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130278000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:7135:x1798653942412736:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330284.485785:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330284.485799:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d7345 lrc: 2/0,0 mode: --/PW res: [0x240000401:0xc0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d733e expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.485815:0:9407:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d7345 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d733e expref: 9 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.485825:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d7345 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d733e expref: 9 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.485832:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc0:0x0].0x0 (ffff88009d434900) 00010000:00010000:0.0:1715330284.485835:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330284.485838:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f18c0, rc 0) 00000100:00100000:0.0:1715330284.485873:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130278000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7135:x1798653942412736:12345-0@lo:101:mdt00_002.0 Request processed in 100us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330284.485878:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2326 00000100:00100000:1.0:1715330284.486083:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091eac000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942412736:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330284.486094:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfdd40/0xd895711d66d733e lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7345 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.486103:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfdd40/0xd895711d66d733e lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7345 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330284.486119:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880091ead500 reply state ffff88009aea3000 transno 4294983367 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d7337 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.486128:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d7337 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.486133:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xc0:0x0].0x0 (ffff88008b0d2b00) 00010000:00010000:1.0:1715330284.486135:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330284.486137:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1715330284.486142:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfdd40/0xd895711d66d733e lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7345 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.486149:0:7135:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfdd40/0xd895711d66d733e lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7345 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330284.486157:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0xc0:0x0] 00000004:00010000:1.0:1715330284.486161:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880091ead500 reply state ffff88009aea3000 transno 4294983367 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe880/0xd895711d66d7330 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1504:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.486168:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe880/0xd895711d66d7330 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1504:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.486173:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1504:0x0].0x0 (ffff88008b0d2e00) 00010000:00010000:1.0:1715330284.486175:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330284.486176:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1715330284.486180:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1504:0x0]: returning size 4096 00010000:00010000:1.0:1715330284.486189:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d7322 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.486194:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d7322 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.486199:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d7322 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.486204:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d7322 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.486209:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db67180 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330284.486212:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d7322 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.486219:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d7322 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.486227:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff8800b4207500) 00010000:00010000:1.0:1715330284.486228:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330284.486231:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d7322 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.486236:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d7322 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00000004:00010000:1.0:1715330284.486253:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880091ead500 reply state ffff88009aea3000 transno 4294983367 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d7329 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x784526f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.486259:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d7329 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x784526f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.486264:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x784526f1 (ffff8800b4207b00) 00010000:00010000:1.0:1715330284.486266:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330284.486268:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00000100:00100000:1.0:1715330284.486339:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091ead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+15:16814:x1798653938005760:12345-192.168.204.49@tcp:36:lfs.0 Request processed in 3883us (3988us total) trans 4294983367 rc 0/0 00000100:00100000:1.0:1715330284.486346:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23179 00000100:00100000:1.0:1715330284.497422:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938005888 00000100:00100000:1.0:1715330284.497432:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938005888 00000100:00100000:1.0:1715330284.497484:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23180 00000100:00100000:1.0:1715330284.497491:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+15:16815:x1798653938005888:12345-192.168.204.49@tcp:36:mkdir.0 00000100:00100000:1.0:1715330284.497686:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+15:16815:x1798653938005888:12345-192.168.204.49@tcp:36:mkdir.0 Request processed in 194us (316us total) trans 0 rc -17/-17 00000100:00100000:1.0:1715330284.497693:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23180 00000100:00100000:0.0:1715330284.504836:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938005952 00000100:00100000:0.0:1715330284.504846:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938005952 00000100:00100000:0.0:1715330284.505134:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23181 00000100:00100000:0.0:1715330284.505143:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+15:16816:x1798653938005952:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:0.0:1715330284.505212:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330284.505236:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d734c lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb2b8 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.505438:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d7353 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.505451:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d7353 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.505462:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d7353 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.505473:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66d735a lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x784526f1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.505479:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66d735a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x784526f1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.505484:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66d735a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x784526f1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.505557:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1b00/0xd895711d66d7361 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1504:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.505565:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1b00/0xd895711d66d7361 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1504:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.505570:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1b00/0xd895711d66d7361 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1504:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000004:00200000:0.0:1715330284.506043:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1504:0x0]: returning size 4096 00000004:00200000:0.0:1715330284.506049:0:7134:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1715330284.506082:0:7134:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1b00/0xd895711d66d7361 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1504:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.506106:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d7353 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.506112:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d7353 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.506129:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d7353 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.506135:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d7353 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.506141:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f2d00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330284.506144:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d7353 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.506161:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d7353 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.506172:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88009d434200) 00010000:00010000:0.0:1715330284.506186:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330284.506190:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d7353 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.506195:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d7353 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.506204:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66d735a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x784526f1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.506209:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66d735a lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x784526f1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.506214:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66d735a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x784526f1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.506230:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f1440 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330284.506233:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66d735a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x784526f1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.506237:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66d735a lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x784526f1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.506243:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x784526f1 (ffff8800b4207b00) 00010000:00010000:0.0:1715330284.506245:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330284.506247:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66d735a lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x784526f1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.506252:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66d735a lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x784526f1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.506273:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d734c lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb2b8 expref: 17 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.506288:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1b00/0xd895711d66d7361 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1504:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb2b8 expref: 16 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.506294:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1504:0x0].0x0 (ffff88008b0d2e00) 00010000:00010000:0.0:1715330284.506296:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1715330284.506298:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f1b00, rc 0) 00000100:00100000:0.0:1715330284.506359:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+16:16816:x1798653938005952:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 1216us (1569us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330284.506440:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23181 00000100:00100000:0.0:1715330284.511157:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938006016 00000100:00100000:0.0:1715330284.511166:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938006016 00000100:00100000:0.0:1715330284.511218:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23182 00000100:00100000:0.0:1715330284.511226:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+16:16816:x1798653938006016:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:0.0:1715330284.511245:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330284.511266:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0480/0xd895711d66d7368 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xc0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb2bf expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.511318:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d736f lrc: 3/1,0 mode: --/PR res: [0x200000400:0xc0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.511331:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d736f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xc0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.511341:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d736f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xc0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000004:00200000:0.0:1715330284.511376:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0xc0:0x0]: returning size 4096 00000004:00200000:0.0:1715330284.511381:0:7134:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1715330284.511410:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0480/0xd895711d66d7368 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb2bf expref: 18 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.511435:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d736f lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xc0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb2bf expref: 17 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.511442:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xc0:0x0].0x0 (ffff88008b0d2b00) 00010000:00010000:0.0:1715330284.511445:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1715330284.511448:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f2400, rc 0) 00000100:00100000:0.0:1715330284.511504:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+17:16816:x1798653938006016:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 278us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330284.511510:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23182 00000100:00100000:0.0:1715330284.514717:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938006080 00000100:00100000:0.0:1715330284.514724:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938006080 00000100:00100000:0.0:1715330284.514769:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23183 00000100:00100000:0.0:1715330284.514774:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+11:16816:x1798653938006080:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:0.0:1715330284.514790:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330284.514806:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3840/0xd895711d66d7376 lrc: 2/0,0 mode: --/CR res: [0x240000401:0xc0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb2c6 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.514847:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d737d lrc: 3/1,0 mode: --/PR res: [0x240000401:0xc0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.514858:0:7134:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d7345 lrc: 2/0,0 mode: PW/PW res: [0x240000401:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d733e expref: 8 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.514865:0:7134:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d737d lrc: 4/1,0 mode: --/PR res: [0x240000401:0xc0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.514892:0:7134:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d7345 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd895711d66d733e expref: 8 pid: 9407 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330284.514906:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d61c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7134:1798653942412800:0@lo:104: 00000100:00100000:0.0:1715330284.514944:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330284.514962:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa900 going to sleep for 11 seconds 00000100:00100000:0.0:1715330284.514973:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942412800 00000100:00100000:0.0:1715330284.514975:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942412800 00000100:00100000:0.0:1715330284.515001:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1088 00000100:00100000:0.0:1715330284.515005:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d61ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7134:x1798653942412800:12345-0@lo:104: 00010000:00010000:0.0:1715330284.515016:0:7118:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfdd40/0xd895711d66d733e lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d7345 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.515052:0:7118:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1715330284.515057:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d61ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7134:x1798653942412800:12345-0@lo:104: Request processed in 51us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330284.515062:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1088 00000100:00100000:0.0:1715330284.515092:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d61c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7134:1798653942412800:0@lo:104: 00010000:00010000:0.0:1715330284.515105:0:7134:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d737d lrc: 3/1,0 mode: --/PR res: [0x240000401:0xc0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00000001:00080000:0.0:1715330284.519348:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968315 is committed 00000001:00080000:0.0:1715330284.519386:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968314 is committed 00000020:00080000:0.0:1715330284.519395:0:8267:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0001: 358 batchid updated 00000020:00080000:0.0:1715330284.519402:0:8267:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8800b4333b40 refcount 2 committed 0 result 0 batchid 359 00000020:00080000:0.0:1715330284.519406:0:8267:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009d678a00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8800b4333240 00000020:00080000:0.0:1715330284.519410:0:8267:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].361 00000020:00080000:0.0:1715330284.519412:0:8267:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009d678300 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88011dad0800 00000020:00080000:0.0:1715330284.519414:0:8267:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].359 00000020:00080000:0.0:1715330284.519430:0:8267:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0001: 357 batchid updated 00000100:00100000:0.0:1715330284.520251:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942412992 00000100:00100000:0.0:1715330284.520259:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942412992 00000100:00100000:0.0:1715330284.520302:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2327 00000100:00100000:0.0:1715330284.520309:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:8278:x1798653942412992:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330284.520424:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:8278:x1798653942412992:12345-0@lo:1000:osp_up0-1.0 Request processed in 115us (220us total) trans 4294983368 rc 0/0 00000100:00100000:0.0:1715330284.520430:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2327 00010000:00010000:0.0:1715330284.520452:0:7134:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d737d lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xc0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.520459:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d737d lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xc0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00000004:00200000:0.0:1715330284.520499:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000401:0xc0:0x0]: returning size 4096 00000004:00200000:0.0:1715330284.520503:0:7134:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1715330284.520540:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3840/0xd895711d66d7376 lrc: 0/0,0 mode: --/CR res: [0x240000401:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb2c6 expref: 9 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.520553:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d737d lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xc0:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb2c6 expref: 8 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.520559:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc0:0x0].0x0 (ffff88009d434900) 00010000:00010000:0.0:1715330284.520561:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1715330284.520564:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f1440, rc 0) 00000100:00100000:0.0:1715330284.520629:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+8:16816:x1798653938006080:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 5852us (6244us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330284.520636:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23183 00000100:00100000:0.0:1715330284.521147:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942413120 00000100:00100000:0.0:1715330284.521151:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942413120 00000100:00100000:0.0:1715330284.521174:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2328 00000100:00100000:0.0:1715330284.521178:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:8278:x1798653942413120:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330284.521254:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:8278:x1798653942413120:12345-0@lo:1000:osp_up0-1.0 Request processed in 74us (123us total) trans 4294983369 rc 0/0 00000100:00100000:0.0:1715330284.521259:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2328 00000100:00100000:0.0:1715330284.524306:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938006208 00000100:00100000:0.0:1715330284.524318:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938006208 00000100:00100000:0.0:1715330284.524373:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23184 00000100:00100000:0.0:1715330284.524381:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+17:16816:x1798653938006208:12345-192.168.204.49@tcp:36:rmdir.0 00010000:00010000:0.0:1715330284.524431:0:7134:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330284.524456:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1b00/0xd895711d66d7361 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1504:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb2b8 expref: 17 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.524471:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1504:0x0].0x0 (ffff88008b0d2e00) 00010000:00010000:0.0:1715330284.524476:0:7134:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715330284.524503:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d7384 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.524515:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d7384 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.524525:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d7384 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.524534:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d738b lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x784526f1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.524540:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d738b lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x784526f1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.524546:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d738b lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x784526f1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.524618:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d7392 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1504:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.524624:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d7392 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1504:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.524630:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d7392 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1504:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.524648:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d7399 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xc0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.524656:0:7134:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d736f lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xc0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb2bf expref: 16 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.524662:0:7134:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d7399 lrc: 4/0,1 mode: --/EX res: [0x200000400:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.524691:0:7134:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d736f lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xc0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb2bf expref: 16 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.524704:0:7134:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d736f lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xc0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb2bf expref: 16 pid: 7134 timeout: 359 lvb_type: 0 00000100:00100000:0.0:1715330284.524717:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d61c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7134:1798653942413184:192.168.204.49@tcp:104: 00000100:00100000:0.0:1715330284.524793:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa900 going to sleep for 11 seconds 00000100:00100000:1.0:1715330284.527398:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d61c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7134:1798653942413184:192.168.204.49@tcp:104: 00010000:00010000:1.0:1715330284.527424:0:7134:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d7399 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000100:00100000:0.0:1715330284.527688:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00010000:00010000:1.0:1715330284.528090:0:7134:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d7399 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.528097:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d7399 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.528141:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcb40/0xd895711d66d73a0 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xc0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.528148:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcb40/0xd895711d66d73a0 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.528157:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcb40/0xd895711d66d73a0 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT0 00000100:00100000:1.0:1715330284.528173:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130278380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942413248:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1715330284.528212:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330284.528237:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47e600 going to sleep for 11 seconds 00000100:00100000:0.0:1715330284.528294:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942413248 00000100:00100000:0.0:1715330284.528301:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942413248 00000100:00100000:0.0:1715330284.528343:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2329 00000100:00100000:0.0:1715330284.528348:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013027a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:7134:x1798653942413248:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330284.528362:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330284.528378:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d73a7 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xc0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d73a0 expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.528400:0:9407:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d737d lrc: 2/0,0 mode: PR/PR res: [0x240000401:0xc0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb2c6 expref: 7 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.528412:0:9407:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d73a7 lrc: 4/0,0 mode: --/EX res: [0x240000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d73a0 expref: 6 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.528437:0:9407:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d737d lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xc0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb2c6 expref: 7 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.528446:0:9407:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d737d lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xc0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb2c6 expref: 7 pid: 7134 timeout: 359 lvb_type: 0 00000100:00100000:0.0:1715330284.528457:0:9407:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d61c380 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:9407:1798653942413312:192.168.204.49@tcp:104: 00000100:00100000:0.0:1715330284.528497:0:9407:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa900 going to sleep for 11 seconds 00000100:00100000:0.0:1715330284.533474:0:7134:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968315 gen 2 00000004:00080000:0.0:1715330284.533480:0:7134:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968311 committed transno 4294968315 00000020:00080000:0.0:1715330284.533485:0:7134:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff880091cb2cc0 refcount 2 committed 0 result 0 batchid 352 00000020:00080000:0.0:1715330284.533489:0:7134:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008b233700 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff880091cb2d80 00000020:00080000:0.0:1715330284.533491:0:7134:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].335 00000020:00080000:0.0:1715330284.533494:0:7134:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008b233800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88012f5ca000 00000020:00080000:0.0:1715330284.533496:0:7134:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].336 00000004:00080000:0.0:1715330284.533519:0:7134:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968313 committed transno 4294968315 00000004:00080000:0.0:1715330284.533529:0:7134:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968315 committed transno 4294968315 00000100:00100000:0.0:1715330284.533550:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880130278380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942413248:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330284.533563:0:7134:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcb40/0xd895711d66d73a0 lrc: 4/0,1 mode: --/EX res: [0x240000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d73a7 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.533571:0:7134:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcb40/0xd895711d66d73a0 lrc: 4/0,1 mode: --/EX res: [0x240000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d73a7 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330284.533796:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942413376 00000100:00100000:0.0:1715330284.533800:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942413376 00000100:00100000:0.0:1715330284.533832:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1089 00000100:00100000:0.0:1715330284.533836:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7122:x1798653942413376:12345-0@lo:105: 00010000:00010000:0.0:1715330284.533843:0:7118:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcb40/0xd895711d66d73a0 lrc: 5/0,1 mode: --/EX res: [0x240000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d73a7 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.533850:0:7118:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcb40/0xd895711d66d73a0 lrc: 5/0,1 mode: --/EX res: [0x240000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d73a7 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.534106:0:7118:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcb40/0xd895711d66d73a0 lrc: 5/0,1 mode: --/EX res: [0x240000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d73a7 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.534111:0:7118:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcb40/0xd895711d66d73a0 lrc: 5/0,1 mode: EX/EX res: [0x240000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d73a7 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.534117:0:7118:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcb40/0xd895711d66d73a0 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d73a7 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.534123:0:7118:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcb40/0xd895711d66d73a0 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d73a7 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.534136:0:7118:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff880093bfcb40) 00000100:00100000:0.0:1715330284.534179:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7122:x1798653942413376:12345-0@lo:105: Request processed in 341us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330284.534184:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1089 00010000:00010000:0.0:1715330284.534201:0:7134:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcb40/0xd895711d66d73a0 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d73a7 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.534210:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcb40/0xd895711d66d73a0 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d73a7 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330284.534928:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d61f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942413440:0@lo:403:mdt00_001.0 00000100:00100000:0.0:1715330284.534960:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330284.535539:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa480 going to sleep for 11 seconds 00000020:00080000:0.0:1715330284.536201:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 352 committed batchid 350 00000020:00080000:0.0:1715330284.536267:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 350 00000100:00100000:0.0:1715330284.537542:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d61f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942413440:0@lo:403:mdt00_001.0 00000040:00080000:0.0:1715330284.538466:0:7134:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].338, 664 off520416 00000040:00080000:0.0:1715330284.538599:0:7134:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].338, 744 off560168 00000004:00080000:0.0:1715330284.538604:0:7134:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880091ffa480 with version 642 00000004:00200000:0.0:1715330284.539912:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1504:0x0]: returning size 4096 00010000:00010000:0.0:1715330284.539937:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d7399 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.539946:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d7399 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.539951:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d7399 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.539956:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f1d40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330284.539960:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d7399 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.539966:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d7399 lrc: 4/0,0 mode: EX/EX res: [0x200000400:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.539980:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xc0:0x0].0x0 (ffff88008b0d2b00) 00010000:00010000:0.0:1715330284.539983:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715330284.539987:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d7399 lrc: 2/0,0 mode: --/EX res: [0x200000400:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.539991:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d7399 lrc: 0/0,0 mode: --/EX res: [0x200000400:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.540004:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcb40/0xd895711d66d73a0 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d73a7 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.540010:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcb40/0xd895711d66d73a0 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d73a7 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.540014:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcb40/0xd895711d66d73a0 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d73a7 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.540034:0:7134:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1715330284.540041:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0xc0:0x0] 00010000:00010000:0.0:1715330284.540047:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d7392 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1504:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.540050:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d7392 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1504:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.540054:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d7392 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1504:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.540058:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f1f80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330284.540059:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d7392 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1504:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.540063:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d7392 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1504:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.540073:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1504:0x0].0x0 (ffff88008b0d2e00) 00010000:00010000:0.0:1715330284.540075:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715330284.540077:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d7392 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1504:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.540080:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d7392 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1504:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.540224:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d7384 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.540229:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d7384 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.540233:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d7384 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.540237:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d7384 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.540241:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f2d00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330284.540243:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d7384 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.540248:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d7384 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.540254:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff880092dfd000) 00010000:00010000:0.0:1715330284.540256:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330284.540258:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d7384 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.540262:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d7384 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00000004:00010000:0.0:1715330284.540277:0:7134:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012b55d180 reply state ffff880091c05000 transno 4294983370 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d738b lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x784526f1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.540286:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d738b lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x784526f1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.540293:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x784526f1 (ffff8800b4207b00) 00010000:00010000:0.0:1715330284.540295:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330284.540298:0:7134:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1715330284.540375:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+17:16816:x1798653938006208:12345-192.168.204.49@tcp:36:rmdir.0 Request processed in 15990us (16130us total) trans 4294983370 rc 0/0 00000100:00100000:0.0:1715330284.540383:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23184 00010000:00010000:1.0:1715330284.540586:0:7123:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715330284.540594:0:7123:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcb40/0xd895711d66d73a0 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d73a7 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.540600:0:7123:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfcb40 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330284.540604:0:7123:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcb40/0xd895711d66d73a0 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d73a7 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330284.540610:0:7123:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcb40/0xd895711d66d73a0 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d73a7 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.540639:0:7123:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcb40/0xd895711d66d73a0 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d73a7 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.540644:0:7123:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330284.540675:0:7123:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcb40/0xd895711d66d73a0 lrc: 1/0,0 mode: --/EX res: [0x240000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d73a7 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.540682:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcb40/0xd895711d66d73a0 lrc: 0/0,0 mode: --/EX res: [0x240000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d73a7 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.540698:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330284.540699:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330284.540701:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330284.555809:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330284.556594:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938006400 00000100:00100000:1.0:1715330284.556607:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938006400 00000100:00100000:1.0:1715330284.556677:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23185 00000100:00100000:1.0:1715330284.556685:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d61f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+7:16817:x1798653938006400:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:1.0:1715330284.556707:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330284.556764:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d73ae lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb2cd expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.556878:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe400/0xd895711d66d73b5 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.556891:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe400/0xd895711d66d73b5 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.556901:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe400/0xd895711d66d73b5 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.556914:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d73bc lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x784526f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.556920:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d73bc lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x784526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.556924:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d73bc lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x784526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.556965:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe400/0xd895711d66d73b5 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.556973:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe400/0xd895711d66d73b5 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.556977:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe400/0xd895711d66d73b5 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.556982:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe400/0xd895711d66d73b5 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.556986:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfe400 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330284.556990:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe400/0xd895711d66d73b5 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.556995:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe400/0xd895711d66d73b5 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.557005:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88008b233200) 00010000:00010000:1.0:1715330284.557007:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330284.557011:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe400/0xd895711d66d73b5 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.557015:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe400/0xd895711d66d73b5 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.557036:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d73bc lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x784526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.557040:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d73bc lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x784526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.557043:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d73bc lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x784526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.557047:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfcb40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330284.557049:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d73bc lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x784526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.557053:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d73bc lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x784526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.557059:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x784526f2 (ffff88008b0d2700) 00010000:00010000:1.0:1715330284.557060:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330284.557169:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d73bc lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x784526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.557174:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d73bc lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x784526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.557205:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d73ae lrc: 1/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb2cd expref: 8 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.557212:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d73ae lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb2cd expref: 8 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.557220:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bff600, rc 0) 00000100:00100000:1.0:1715330284.557282:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d61f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+7:16817:x1798653938006400:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 596us (1480us total) trans 0 rc 301/301 00000100:00100000:1.0:1715330284.557288:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23185 00000100:00100000:1.0:1715330284.561417:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938006464 00000100:00100000:1.0:1715330284.561428:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938006464 00000100:00100000:1.0:1715330284.561473:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23186 00000100:00100000:1.0:1715330284.561480:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+17:16817:x1798653938006464:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:1.0:1715330284.561509:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330284.561534:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d73c3 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb2d4 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.561607:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d73ca lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.561620:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d73ca lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.561630:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d73ca lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000004:00200000:1.0:1715330284.561676:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1715330284.561680:0:7134:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1715330284.561707:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d73c3 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb2d4 expref: 19 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.561725:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d73ca lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb2d4 expref: 18 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.561775:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88008b0d2d00) 00010000:00010000:1.0:1715330284.561777:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1715330284.561780:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfc480, rc 0) 00000100:00100000:1.0:1715330284.561829:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+18:16817:x1798653938006464:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 348us (1366us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330284.561836:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23186 00000100:00100000:0.0:1715330284.566288:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330284.571979:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942413824 00000100:00100000:0.0:1715330284.571985:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942413824 00000100:00100000:0.0:1715330284.572052:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2333 00000100:00100000:0.0:1715330284.572058:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7135:x1798653942413824:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330284.572072:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330284.572088:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d73f4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xbe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d73ed expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.572106:0:9407:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d73f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d73ed expref: 10 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.572116:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d73f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d73ed expref: 10 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.572125:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xbe:0x0].0x0 (ffff880092dfdb00) 00010000:00010000:0.0:1715330284.572129:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330284.572131:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f2400, rc 0) 00000100:00100000:0.0:1715330284.572474:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:7135:x1798653942413824:12345-0@lo:101:mdt00_002.0 Request processed in 415us (1200us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330284.572480:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2333 00000100:00100000:0.0:1715330284.593777:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330284.615494:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938006848 00000100:00100000:0.0:1715330284.615516:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938006848 00000100:00100000:0.0:1715330284.615605:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23190 00000100:00100000:0.0:1715330284.615612:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+9:16819:x1798653938006848:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:0.0:1715330284.615648:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330284.615676:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d7417 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xbe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb2e2 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.615782:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d741e lrc: 3/1,0 mode: --/PR res: [0x240000400:0xbe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.615803:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d741e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.615820:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d741e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00000004:00200000:0.0:1715330284.615872:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000400:0xbe:0x0]: returning size 4096 00000004:00200000:0.0:1715330284.615884:0:7134:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1715330284.615935:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d7417 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xbe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb2e2 expref: 11 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.618498:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d741e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb2e2 expref: 10 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.618512:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xbe:0x0].0x0 (ffff8800b4207a00) 00010000:00010000:0.0:1715330284.618515:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1715330284.618528:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f3a80, rc 0) 00000100:00100000:0.0:1715330284.618635:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+10:16819:x1798653938006848:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 3022us (5189us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330284.618643:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23190 00000100:00100000:0.0:1715330284.622307:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330284.623099:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b4c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942413952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330284.623137:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330284.623184:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942413952 00000100:00100000:0.0:1715330284.623194:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942413952 00010000:00010000:0.0:1715330284.623226:0:7121:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d73f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xbe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd895711d66d73ed expref: 10 pid: 9407 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330284.623262:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1433 00000100:00100000:0.0:1715330284.623267:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130279500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+10:3690:x1798653942413952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330284.623278:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1715330284.627362:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983371 is committed 00000001:00080000:0.0:1715330284.627407:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983370 is committed 00000020:00080000:0.0:1715330284.627416:0:7116:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 352 batchid updated 00000020:00080000:0.0:1715330284.627425:0:7116:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88011db63840 refcount 2 committed 0 result 0 batchid 353 00000020:00080000:0.0:1715330284.627430:0:7116:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800b4207d00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88011db63000 00000020:00080000:0.0:1715330284.627433:0:7116:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].337 00000020:00080000:0.0:1715330284.627435:0:7116:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800b4207200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88011dad0600 00000020:00080000:0.0:1715330284.627438:0:7116:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].337 00000020:00080000:0.0:1715330284.627447:0:7116:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 351 batchid updated 00000020:00080000:0.0:1715330284.627462:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 353 committed batchid 352 00000004:00080000:0.0:1715330284.627558:0:7163:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880091ffa180 with version 643 00000020:00080000:0.0:1715330284.627685:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 351 cancel update log [0x240000401:0x3:0x0].334: rc = 0 00000020:00080000:0.0:1715330284.627721:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 351 cancel update log [0x200000400:0x3:0x0].335: rc = 0 00000004:00080000:0.0:1715330284.627759:0:7163:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880091ffacc0 with version 644 00000020:00080000:0.0:1715330284.627762:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 352 cancel update log [0x240000401:0x3:0x0].335: rc = 0 00000020:00080000:0.0:1715330284.627778:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 352 cancel update log [0x200000400:0x3:0x0].336: rc = 0 00000020:00080000:0.0:1715330284.627783:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 352 00010000:00010000:0.0:1715330284.627847:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d73f4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xbe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd895711d66d73ed expref: 6 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.627867:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xbe:0x0].0x0 (ffff880092dfdb00) 00010000:00010000:0.0:1715330284.627872:0:7121:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66880/0xd895711d66d742c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.627881:0:7121:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66880/0xd895711d66d742c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.627888:0:7121:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66880/0xd895711d66d742c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.627907:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330284.627988:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130279500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942413952:12345-0@lo:103:ldlm_bl.0 Request processed in 4718us (4848us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330284.627998:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1433 00000100:00100000:1.0:1715330284.628218:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b4c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942413952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330284.628635:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942414080 00000100:00100000:0.0:1715330284.628642:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942414080 00000100:00100000:0.0:1715330284.629217:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2334 00000100:00100000:0.0:1715330284.629224:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:8587:x1798653942414080:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330284.629508:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:8587:x1798653942414080:12345-0@lo:1000:osp_up1-0.0 Request processed in 283us (1461us total) trans 4294968318 rc 0/0 00000100:00100000:0.0:1715330284.629519:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2334 00000100:00100000:0.0:1715330284.629838:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942414208 00000100:00100000:0.0:1715330284.629842:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942414208 00000100:00100000:0.0:1715330284.629971:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2335 00000100:00100000:0.0:1715330284.629975:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:8587:x1798653942414208:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330284.630046:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:8587:x1798653942414208:12345-0@lo:1000:osp_up1-0.0 Request processed in 70us (275us total) trans 4294968319 rc 0/0 00000100:00100000:0.0:1715330284.630051:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2335 00000100:00100000:0.0:1715330284.650143:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938007104 00000100:00100000:0.0:1715330284.650152:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938007104 00010000:00010000:0.0:1715330284.650188:0:7121:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d741e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb2e2 expref: 10 pid: 7134 timeout: 359 lvb_type: 0 00000100:00100000:0.0:1715330284.650218:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1434 00000100:00100000:0.0:1715330284.650224:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+10:2011:x1798653938007104:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1715330284.650238:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330284.650243:0:7121:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d741e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb2e2 expref: 10 pid: 7134 timeout: 359 lvb_type: 0 00010000:00010000:0.0:1715330284.650254:0:7121:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d741e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb2e2 expref: 10 pid: 7134 timeout: 359 lvb_type: 0 00010000:00010000:0.0:1715330284.650275:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xbe:0x0].0x0 (ffff8800b4207a00) 00010000:00010000:0.0:1715330284.650279:0:7121:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e1c0/0xd895711d66d7448 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.650293:0:7121:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e1c0/0xd895711d66d7448 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.650301:0:7121:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e1c0/0xd895711d66d7448 lrc: 4/0,1 mode: EX/EX res: [0x240000400:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.650319:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330284.650362:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+10:2011:x1798653938007104:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 137us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330284.650368:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1434 00000100:00100000:0.0:1715330284.653721:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938007168 00000100:00100000:0.0:1715330284.653727:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938007168 00010000:00010000:0.0:1715330284.653763:0:7121:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66880/0xd895711d66d742c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb2e9 expref: 15 pid: 7134 timeout: 359 lvb_type: 0 00000100:00100000:0.0:1715330284.653783:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1435 00000100:00100000:0.0:1715330284.653788:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+15:2012:x1798653938007168:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1715330284.653800:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330284.653805:0:7121:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66880/0xd895711d66d742c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb2e9 expref: 15 pid: 7134 timeout: 359 lvb_type: 0 00010000:00010000:0.0:1715330284.653814:0:7121:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66880/0xd895711d66d742c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb2e9 expref: 15 pid: 7134 timeout: 359 lvb_type: 0 00010000:00010000:0.0:1715330284.653833:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66880/0xd895711d66d742c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb2e9 expref: 15 pid: 7134 timeout: 359 lvb_type: 0 00010000:00010000:0.0:1715330284.653844:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xbe:0x0].0x0 (ffff880092dfdb00) 00010000:00010000:0.0:1715330284.653848:0:7121:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d7456 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d744f expref: 5 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.653861:0:7121:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d7456 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d744f expref: 5 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.653868:0:7121:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d7456 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d744f expref: 5 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.653893:0:7121:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d7456 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d744f expref: 5 pid: 23404 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330284.653906:0:7121:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d61e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:7121:1798653942414464:0@lo:105: 00000100:00100000:0.0:1715330284.653936:0:7121:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330284.653950:0:7121:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffae40 going to sleep for 11 seconds 00000100:00100000:0.0:1715330284.653971:0:7118:0:(service.c:168:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1715330284.653980:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942414464 00000100:00100000:0.0:1715330284.653983:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942414464 00000100:00100000:0.0:1715330284.654013:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1091 00000100:00100000:0.0:1715330284.654018:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca77850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:7121:x1798653942414464:12345-0@lo:105: 00010000:00010000:0.0:1715330284.654025:0:7118:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64b40/0xd895711d66d744f lrc: 5/0,1 mode: --/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7456 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.654032:0:7118:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64b40/0xd895711d66d744f lrc: 5/0,1 mode: --/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7456 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.654040:0:7118:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64b40/0xd895711d66d744f lrc: 5/0,1 mode: --/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7456 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.654045:0:7118:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64b40/0xd895711d66d744f lrc: 5/0,1 mode: EX/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d7456 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.654054:0:7118:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64b40/0xd895711d66d744f lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d7456 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.654060:0:7118:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64b40/0xd895711d66d744f lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d7456 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.654073:0:7118:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88011db64b40) 00000100:00100000:0.0:1715330284.654095:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca77850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:7121:x1798653942414464:12345-0@lo:105: Request processed in 77us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330284.654101:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1091 00000100:00100000:0.0:1715330284.654145:0:7121:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d61e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:7121:1798653942414464:0@lo:105: 00010000:00010000:0.0:1715330284.654155:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330284.654184:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+14:2012:x1798653938007168:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 395us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330284.654190:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1435 00010000:00010000:0.0:1715330284.660193:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715330284.660200:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64b40/0xd895711d66d744f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d7456 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.660205:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64b40 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330284.660209:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64b40/0xd895711d66d744f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d7456 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330284.660216:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64b40/0xd895711d66d744f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d7456 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.660237:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64b40/0xd895711d66d744f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7456 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.660244:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330284.660264:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64b40/0xd895711d66d744f lrc: 1/0,0 mode: --/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7456 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.660269:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64b40/0xd895711d66d744f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7456 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.660281:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330284.660283:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330284.660284:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330284.677819:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938007232 00000100:00100000:0.0:1715330284.677829:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938007232 00000100:00100000:0.0:1715330284.677893:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23193 00000100:00100000:0.0:1715330284.677901:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+14:16820:x1798653938007232:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:0.0:1715330284.677928:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330284.677952:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66d745d lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb2f0 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.678027:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d7464 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.678045:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d7464 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.678057:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d7464 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.678073:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d746b lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x784526f3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.678079:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d746b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x784526f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.678089:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d746b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x784526f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.678133:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d7464 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.678138:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d7464 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.678144:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d7464 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.678154:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d7464 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.678159:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f2640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330284.678163:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d7464 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.678169:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d7464 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.678183:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88008b0d2d00) 00010000:00010000:0.0:1715330284.678186:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330284.678190:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d7464 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.678196:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d7464 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.678210:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d746b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x784526f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.678214:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d746b lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x784526f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.678220:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d746b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x784526f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.678224:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f2ac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330284.678226:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d746b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x784526f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.678231:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d746b lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x784526f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.678240:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x784526f3 (ffff880092dfdc00) 00010000:00010000:0.0:1715330284.678242:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330284.678244:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d746b lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x784526f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.678248:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d746b lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x784526f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.678278:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66d745d lrc: 1/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb2f0 expref: 15 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.678285:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66d745d lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb2f0 expref: 15 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.678297:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f2880, rc 0) 00000100:00100000:0.0:1715330284.678358:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+14:16820:x1798653938007232:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 458us (1219us total) trans 0 rc 301/301 00000100:00100000:0.0:1715330284.678365:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23193 00000100:00100000:0.0:1715330284.681857:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938007296 00000100:00100000:0.0:1715330284.681866:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938007296 00000100:00100000:0.0:1715330284.681903:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23194 00000100:00100000:0.0:1715330284.681910:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+10:16820:x1798653938007296:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:0.0:1715330284.681934:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330284.681954:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1680/0xd895711d66d7472 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb2f7 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.682002:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f21c0/0xd895711d66d7479 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.682013:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f21c0/0xd895711d66d7479 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.682022:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f21c0/0xd895711d66d7479 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00000004:00200000:0.0:1715330284.682059:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000401:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1715330284.682063:0:7134:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1715330284.682089:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1680/0xd895711d66d7472 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb2f7 expref: 12 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.682102:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f21c0/0xd895711d66d7479 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb2f7 expref: 11 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.682109:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff880092dfd100) 00010000:00010000:0.0:1715330284.682111:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1715330284.682114:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f21c0, rc 0) 00000100:00100000:0.0:1715330284.682153:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+11:16820:x1798653938007296:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 243us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330284.682159:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23194 00000100:00100000:1.0:1715330284.689525:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330284.710817:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23196 00000100:00100000:0.0:1715330284.710825:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+15:16821:x1798653938007552:12345-192.168.204.49@tcp:36:mkdir.0 00000100:00100000:0.0:1715330284.711012:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+15:16821:x1798653938007552:12345-192.168.204.49@tcp:36:mkdir.0 Request processed in 185us (437us total) trans 0 rc -17/-17 00000100:00100000:0.0:1715330284.711018:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23196 00000100:00100000:0.0:1715330284.719483:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938007616 00000100:00100000:0.0:1715330284.719493:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938007616 00000100:00100000:0.0:1715330284.719664:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23197 00000100:00100000:0.0:1715330284.719672:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+15:16822:x1798653938007616:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:0.0:1715330284.719695:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330284.719720:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d74aa lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb2fe expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.719825:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d74b1 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.719837:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d74b1 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.719847:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d74b1 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.719857:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66d74b8 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x784526f3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.719864:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66d74b8 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x784526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.719868:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66d74b8 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x784526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.720194:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d74bf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1506:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.720202:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d74bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1506:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.720208:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d74bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1506:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000004:00200000:0.0:1715330284.720342:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1506:0x0]: returning size 4096 00000004:00200000:0.0:1715330284.720347:0:7134:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1715330284.720366:0:7134:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d74bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1506:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.720377:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d74b1 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.720382:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d74b1 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.720387:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d74b1 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.720393:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d74b1 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.720399:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f1680 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330284.720402:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d74b1 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.720408:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d74b1 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.720418:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff880092dfde00) 00010000:00010000:0.0:1715330284.720421:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330284.720425:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d74b1 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.720431:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d74b1 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.720441:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66d74b8 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x784526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.720446:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66d74b8 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x784526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.720451:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66d74b8 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x784526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.720455:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f2880 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330284.720458:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66d74b8 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x784526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.720462:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66d74b8 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x784526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.720468:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x784526f3 (ffff8800b4207e00) 00010000:00010000:0.0:1715330284.720470:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330284.720472:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66d74b8 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x784526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.720477:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66d74b8 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x784526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.720497:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d74aa lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb2fe expref: 17 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.720511:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d74bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1506:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb2fe expref: 16 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.720521:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1506:0x0].0x0 (ffff88009ef57400) 00010000:00010000:0.0:1715330284.720523:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1715330284.720525:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f2ac0, rc 0) 00000100:00100000:0.0:1715330284.722011:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+16:16822:x1798653938007616:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 2330us (2743us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330284.722022:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23197 00000100:00100000:0.0:1715330284.724882:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330284.724972:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938007680 00000100:00100000:1.0:1715330284.724983:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938007680 00000100:00100000:1.0:1715330284.725039:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23198 00000100:00100000:1.0:1715330284.725047:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d61fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+16:16822:x1798653938007680:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:1.0:1715330284.725070:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330284.725093:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d74c6 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xc1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb305 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.725149:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66d74cd lrc: 3/1,0 mode: --/PR res: [0x200000400:0xc1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.725162:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66d74cd lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xc1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.725173:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66d74cd lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xc1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000004:00200000:1.0:1715330284.725216:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0xc1:0x0]: returning size 4096 00000004:00200000:1.0:1715330284.725219:0:7134:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1715330284.725249:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d74c6 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xc1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb305 expref: 18 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.725271:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66d74cd lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xc1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb305 expref: 17 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.725279:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xc1:0x0].0x0 (ffff88009ef57a00) 00010000:00010000:1.0:1715330284.725281:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1715330284.725285:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfc6c0, rc 0) 00000100:00100000:1.0:1715330284.725332:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d61fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+17:16822:x1798653938007680:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 285us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330284.725338:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23198 00000100:00100000:1.0:1715330284.732585:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938007744 00000100:00100000:1.0:1715330284.732596:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938007744 00000100:00100000:1.0:1715330284.732643:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23199 00000100:00100000:1.0:1715330284.732651:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+11:16822:x1798653938007744:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:1.0:1715330284.732673:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330284.732695:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d74d4 lrc: 2/0,0 mode: --/CR res: [0x240000401:0xc1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb30c expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.732797:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d74db lrc: 3/1,0 mode: --/PR res: [0x240000401:0xc1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.732810:0:7134:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65f80/0xd895711d66d74a3 lrc: 2/0,0 mode: PW/PW res: [0x240000401:0xc1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d749c expref: 9 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.732931:0:7134:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d74db lrc: 4/1,0 mode: --/PR res: [0x240000401:0xc1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.732966:0:7134:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65f80/0xd895711d66d74a3 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd895711d66d749c expref: 9 pid: 23404 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330284.732982:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013027a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7134:1798653942414976:0@lo:104: 00000100:00100000:1.0:1715330284.733041:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330284.733438:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1715330284.733905:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88013027a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7134:1798653942414976:0@lo:104: 00010000:00010000:1.0:1715330284.733923:0:7134:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d74db lrc: 3/1,0 mode: --/PR res: [0x240000401:0xc1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00000001:00080000:1.0:1715330284.738954:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968321 is committed 00000001:00080000:1.0:1715330284.739008:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968320 is committed 00000020:00080000:1.0:1715330284.739024:0:8267:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0001: 360 batchid updated 00000020:00080000:1.0:1715330284.739047:0:8267:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff880091cb5240 refcount 2 committed 0 result 0 batchid 361 00000020:00080000:1.0:1715330284.739052:0:8267:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800b4207900 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880091cb5cc0 00000020:00080000:1.0:1715330284.739056:0:8267:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].363 00000020:00080000:1.0:1715330284.739058:0:8267:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800b4207c00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88011dad1000 00000020:00080000:1.0:1715330284.739061:0:8267:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].361 00000020:00080000:1.0:1715330284.739094:0:8267:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0001: 359 batchid updated 00000100:00100000:1.0:1715330284.741789:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942415168 00000100:00100000:1.0:1715330284.741797:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942415168 00000100:00100000:1.0:1715330284.741839:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2341 00000100:00100000:1.0:1715330284.741845:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:8278:x1798653942415168:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1715330284.741912:0:7134:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d74db lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xc1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.741919:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d74db lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xc1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00000004:00200000:0.0:1715330284.741962:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000401:0xc1:0x0]: returning size 4096 00000004:00200000:0.0:1715330284.741966:0:7134:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:1.0:1715330284.741969:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:8278:x1798653942415168:12345-0@lo:1000:osp_up0-1.0 Request processed in 123us (319us total) trans 4294983374 rc 0/0 00000100:00100000:1.0:1715330284.741975:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2341 00010000:00010000:0.0:1715330284.742004:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d74d4 lrc: 0/0,0 mode: --/CR res: [0x240000401:0xc1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb30c expref: 9 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.742030:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d74db lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xc1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb30c expref: 8 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.742038:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc1:0x0].0x0 (ffff88009ef57900) 00010000:00010000:0.0:1715330284.742040:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1715330284.742043:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfe1c0, rc 0) 00000100:00100000:0.0:1715330284.742095:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+8:16822:x1798653938007744:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 9435us (9644us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330284.742102:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23199 00000100:00100000:1.0:1715330284.742906:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942415296 00000100:00100000:1.0:1715330284.742910:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942415296 00000100:00100000:1.0:1715330284.742926:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2342 00000100:00100000:1.0:1715330284.742930:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:8278:x1798653942415296:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1715330284.744077:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:8278:x1798653942415296:12345-0@lo:1000:osp_up0-1.0 Request processed in 1144us (2026us total) trans 4294983375 rc 0/0 00000100:00100000:1.0:1715330284.744085:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2342 00000100:00100000:0.0:1715330284.746393:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938007872 00000100:00100000:0.0:1715330284.746407:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938007872 00000100:00100000:0.0:1715330284.746445:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23200 00000100:00100000:0.0:1715330284.746453:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+17:16822:x1798653938007872:12345-192.168.204.49@tcp:36:rmdir.0 00010000:00010000:0.0:1715330284.746504:0:7134:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330284.746530:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d74bf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1506:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb2fe expref: 17 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.746546:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1506:0x0].0x0 (ffff88009ef57400) 00010000:00010000:0.0:1715330284.746550:0:7134:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715330284.746588:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d74e2 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.746600:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d74e2 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.746609:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d74e2 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.746617:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d74e9 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x784526f3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.746623:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d74e9 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x784526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.746628:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d74e9 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x784526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.746693:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d74f0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1506:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.746699:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d74f0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1506:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.746707:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d74f0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1506:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.746722:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d74f7 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xc1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.746746:0:7134:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66d74cd lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xc1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb305 expref: 16 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.746753:0:7134:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d74f7 lrc: 4/0,1 mode: --/EX res: [0x200000400:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.746783:0:7134:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66d74cd lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xc1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb305 expref: 16 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.746795:0:7134:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66d74cd lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xc1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb305 expref: 16 pid: 7134 timeout: 359 lvb_type: 0 00000100:00100000:0.0:1715330284.746808:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d61ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7134:1798653942415360:192.168.204.49@tcp:104: 00000100:00100000:0.0:1715330284.746871:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009d7e3180 going to sleep for 11 seconds 00000100:00100000:1.0:1715330284.749352:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d61ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7134:1798653942415360:192.168.204.49@tcp:104: 00010000:00010000:1.0:1715330284.749380:0:7134:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d74f7 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.750160:0:7134:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d74f7 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.750167:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d74f7 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.750207:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfed00/0xd895711d66d74fe lrc: 3/0,1 mode: --/EX res: [0x240000401:0xc1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.750212:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfed00/0xd895711d66d74fe lrc: 3/0,1 mode: --/EX res: [0x240000401:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.750222:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfed00/0xd895711d66d74fe lrc: 3/0,1 mode: --/EX res: [0x240000401:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT0 00000100:00100000:1.0:1715330284.750238:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013027a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942415424:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1715330284.750275:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330284.750300:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1715330284.752443:0:9407:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b4c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:9407:1798653942415488:192.168.204.49@tcp:104: 00010000:00010000:0.0:1715330284.752470:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66f40/0xd895711d66d7505 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d74fe expref: 6 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.752480:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc1:0x0].0x0 (ffff88009ef57900) 00010000:00010000:0.0:1715330284.752483:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715330284.752485:0:9407:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66f40/0xd895711d66d7505 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d74fe expref: 6 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.752496:0:9407:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66f40/0xd895711d66d7505 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d74fe expref: 6 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.752501:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db66f40, rc 0) 00000100:00100000:0.0:1715330284.752546:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7134:x1798653942415424:12345-0@lo:101:mdt00_001.0 Request processed in 2148us (2269us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330284.752554:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2343 00000100:00100000:1.0:1715330284.752636:0:7134:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968321 gen 2 00000004:00080000:1.0:1715330284.752641:0:7134:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968316 committed transno 4294968321 00000020:00080000:1.0:1715330284.752647:0:7134:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff880091ffa540 refcount 2 committed 0 result 0 batchid 354 00000020:00080000:1.0:1715330284.752650:0:7134:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880092dfd900 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff880091ffa480 00000020:00080000:1.0:1715330284.752653:0:7134:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].338 00000020:00080000:1.0:1715330284.752655:0:7134:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880092dfd300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88009396f600 00000020:00080000:1.0:1715330284.752657:0:7134:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].338 00000004:00080000:1.0:1715330284.752676:0:7134:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968318 committed transno 4294968321 00000004:00080000:1.0:1715330284.752689:0:7134:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968319 committed transno 4294968321 00000004:00080000:1.0:1715330284.752701:0:7134:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968321 committed transno 4294968321 00000100:00100000:1.0:1715330284.752717:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88013027a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942415424:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330284.752750:0:7134:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfed00/0xd895711d66d74fe lrc: 4/0,1 mode: --/EX res: [0x240000401:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7505 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.752759:0:7134:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfed00/0xd895711d66d74fe lrc: 4/0,1 mode: --/EX res: [0x240000401:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7505 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000020:00080000:0.0:1715330284.752994:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 354 committed batchid 352 00000020:00080000:0.0:1715330284.753043:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 352 00010000:00010000:1.0:1715330284.753536:0:7134:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfed00/0xd895711d66d74fe lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7505 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.753545:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfed00/0xd895711d66d74fe lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7505 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330284.754121:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013027a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942415616:0@lo:403:mdt00_001.0 00000100:00100000:1.0:1715330284.754156:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330284.754180:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1715330284.754196:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942415616 00000100:00100000:0.0:1715330284.754200:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942415616 00000100:00100000:0.0:1715330284.754313:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2344 00000100:00100000:0.0:1715330284.754318:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130279500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7134:x1798653942415616:12345-0@lo:403:mdt00_001.0 00000100:00100000:0.0:1715330284.757539:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130279500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7134:x1798653942415616:12345-0@lo:403:mdt00_001.0 Request processed in 3200us (3361us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330284.757552:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2344 00000100:00100000:1.0:1715330284.757725:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88013027a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942415616:0@lo:403:mdt00_001.0 00000040:00080000:1.0:1715330284.759252:0:7134:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].340, 664 off523248 00000040:00080000:1.0:1715330284.759480:0:7134:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].340, 744 off563280 00000004:00080000:1.0:1715330284.759486:0:7134:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88012f47ef00 with version 646 00000100:00100000:0.0:1715330284.761051:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942415744 00000100:00100000:0.0:1715330284.761060:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942415744 00000100:00100000:0.0:1715330284.761099:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2345 00000100:00100000:0.0:1715330284.761106:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:8587:x1798653942415744:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330284.761437:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:8587:x1798653942415744:12345-0@lo:1000:osp_up1-0.0 Request processed in 330us (1576us total) trans 4294968322 rc 0/0 00000100:00100000:0.0:1715330284.761444:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2345 00000004:00200000:1.0:1715330284.762550:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1506:0x0]: returning size 4096 00010000:00010000:1.0:1715330284.762582:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d74f7 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.762592:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d74f7 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.762599:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d74f7 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.762605:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f2400 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330284.762609:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d74f7 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.762616:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d74f7 lrc: 4/0,0 mode: EX/EX res: [0x200000400:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.762634:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xc1:0x0].0x0 (ffff88009ef57a00) 00010000:00010000:1.0:1715330284.762637:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330284.762641:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d74f7 lrc: 2/0,0 mode: --/EX res: [0x200000400:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.762645:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d74f7 lrc: 0/0,0 mode: --/EX res: [0x200000400:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.762657:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfed00/0xd895711d66d74fe lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7505 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.762664:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfed00/0xd895711d66d74fe lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d7505 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.762669:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfed00/0xd895711d66d74fe lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d7505 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.762692:0:7134:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1715330284.762700:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0xc1:0x0] 00010000:00010000:1.0:1715330284.762707:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d74f0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1506:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.762712:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d74f0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1506:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.762716:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d74f0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1506:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.762720:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f0000 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330284.762722:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d74f0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1506:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.763043:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d74f0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1506:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.763052:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1506:0x0].0x0 (ffff88009ef57400) 00010000:00010000:1.0:1715330284.763053:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330284.763057:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d74f0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1506:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.763061:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d74f0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1506:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.763215:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d74e2 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.763221:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d74e2 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.763225:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d74e2 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.763230:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d74e2 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.763233:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f2640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330284.763236:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d74e2 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.763240:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d74e2 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.763246:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff880092dfd200) 00010000:00010000:1.0:1715330284.763248:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330284.763251:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d74e2 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.763255:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d74e2 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00000004:00010000:1.0:1715330284.763268:0:7134:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8801344c8700 reply state ffff88008d55a000 transno 4294983376 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d74e9 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x784526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.763279:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d74e9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x784526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.763285:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x784526f3 (ffff8800b4207e00) 00010000:00010000:1.0:1715330284.763287:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330284.763290:0:7134:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1715330284.763650:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+17:16822:x1798653938007872:12345-192.168.204.49@tcp:36:rmdir.0 Request processed in 17195us (17320us total) trans 4294983376 rc 0/0 00000100:00100000:1.0:1715330284.763657:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23200 00000100:00100000:0.0:1715330284.777872:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938008064 00000100:00100000:0.0:1715330284.777891:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938008064 00000100:00100000:0.0:1715330284.778019:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23201 00000100:00100000:0.0:1715330284.778036:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+7:16823:x1798653938008064:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:0.0:1715330284.778062:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330284.778092:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d750c lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb313 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.778185:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d7513 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.778208:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d7513 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.778234:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d7513 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.778262:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d751a lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x784526f4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.778268:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d751a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x784526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.778285:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d751a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x784526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.778344:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d7513 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.778350:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d7513 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.778354:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d7513 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.778360:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d7513 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.778369:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f2d00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330284.778372:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d7513 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.778379:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d7513 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.778388:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff880092dfd100) 00010000:00010000:0.0:1715330284.778391:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330284.778395:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d7513 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.778400:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d7513 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.778407:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d751a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x784526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.778412:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d751a lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x784526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.778416:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d751a lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x784526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.778420:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f18c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330284.778422:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d751a lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x784526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.778426:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d751a lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x784526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.778651:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x784526f4 (ffff880092dfdc00) 00010000:00010000:0.0:1715330284.778653:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330284.778656:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d751a lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x784526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.778661:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d751a lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x784526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.778686:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d750c lrc: 1/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb313 expref: 8 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.778692:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d750c lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb313 expref: 8 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.778698:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f3cc0, rc 0) 00000100:00100000:0.0:1715330284.779154:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+7:16823:x1798653938008064:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 1118us (1579us total) trans 0 rc 301/301 00000100:00100000:0.0:1715330284.779161:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23201 00000100:00100000:0.0:1715330284.783728:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938008128 00000100:00100000:0.0:1715330284.783755:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938008128 00000100:00100000:0.0:1715330284.783807:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23202 00000100:00100000:0.0:1715330284.783815:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+17:16823:x1798653938008128:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:0.0:1715330284.783839:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330284.783862:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66d7521 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb31a expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.783917:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d7528 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.783928:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d7528 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.783938:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d7528 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000004:00200000:0.0:1715330284.783979:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1715330284.783984:0:7134:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1715330284.784010:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66d7521 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb31a expref: 19 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.784023:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d7528 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb31a expref: 18 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.784030:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff880092dfdd00) 00010000:00010000:0.0:1715330284.784032:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1715330284.784035:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f1f80, rc 0) 00000100:00100000:0.0:1715330284.784090:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+18:16823:x1798653938008128:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 274us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330284.784096:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23202 00000100:00100000:0.0:1715330284.789509:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938008256 00000100:00100000:0.0:1715330284.789519:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938008256 00000100:00100000:0.0:1715330284.789578:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23203 00000100:00100000:0.0:1715330284.789587:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+7:16823:x1798653938008256:12345-192.168.204.49@tcp:36:lfs.0 00010000:00010000:0.0:1715330284.789639:0:7134:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330284.789664:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f21c0/0xd895711d66d7479 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb2f7 expref: 7 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.789680:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff880092dfd100) 00010000:00010000:0.0:1715330284.789689:0:7134:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715330284.789857:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d752f lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.789870:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d752f lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.789879:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d752f lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.789889:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1b00/0xd895711d66d7536 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x784526f4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.789895:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1b00/0xd895711d66d7536 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x784526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.789899:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1b00/0xd895711d66d7536 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x784526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00000040:00080000:0.0:1715330284.790547:0:7134:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].363, 2168 off551280 00000040:00080000:0.0:1715330284.790625:0:7134:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].365, 2368 off603896 00000004:00080000:0.0:1715330284.790630:0:7134:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88009d7e3e40 with version 696 00010000:00010000:0.0:1715330284.792330:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3840/0xd895711d66d753d lrc: 3/0,1 mode: --/PW res: [0x240000402:0x177:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.792341:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3840/0xd895711d66d753d lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x177:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.792357:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3840/0xd895711d66d753d lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x177:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.792370:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0480/0xd895711d66d7544 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xbf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.792384:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0480/0xd895711d66d7544 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.792388:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0480/0xd895711d66d7544 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.792422:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2640/0xd895711d66d754b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xbf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.792428:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2640/0xd895711d66d754b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.792444:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2640/0xd895711d66d754b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT1 00000100:00100000:0.0:1715330284.792455:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d61ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942416000:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1715330284.792490:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330284.794277:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009d7e3180 going to sleep for 11 seconds 00000100:00100000:1.0:1715330284.794344:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942416000 00000100:00100000:1.0:1715330284.794352:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942416000 00000100:00100000:1.0:1715330284.794421:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2347 00000100:00100000:1.0:1715330284.794427:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d61dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7134:x1798653942416000:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330284.794445:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330284.794462:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc000/0xd895711d66d7552 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xbf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d754b expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.794483:0:9407:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc000/0xd895711d66d7552 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d754b expref: 10 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.794494:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc000/0xd895711d66d7552 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d754b expref: 10 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.794501:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xbf:0x0].0x0 (ffff88012ca4df00) 00010000:00010000:1.0:1715330284.794504:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330284.794507:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfc000, rc 0) 00000100:00100000:1.0:1715330284.794552:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d61dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:7134:x1798653942416000:12345-0@lo:101:mdt00_001.0 Request processed in 125us (2061us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330284.794557:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2347 00000100:00100000:0.0:1715330284.794662:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d61ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942416000:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330284.794676:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2640/0xd895711d66d754b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7552 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.794685:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2640/0xd895711d66d754b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7552 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330284.794705:0:7134:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8801344c9500 reply state ffff88008d55d000 transno 4294968323 ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0480/0xd895711d66d7544 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.794714:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0480/0xd895711d66d7544 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.794719:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xbf:0x0].0x0 (ffff880092dfd400) 00010000:00010000:0.0:1715330284.794721:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330284.794725:0:7134:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1715330284.794869:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2640/0xd895711d66d754b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7552 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.794877:0:7134:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2640/0xd895711d66d754b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7552 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1715330284.794890:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000401:0xbf:0x0] 00000004:00010000:0.0:1715330284.794897:0:7134:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8801344c9500 reply state ffff88008d55d000 transno 4294968323 ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3840/0xd895711d66d753d lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x177:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.794904:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3840/0xd895711d66d753d lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x177:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.794908:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x177:0x0].0x0 (ffff880092dfd500) 00010000:00010000:0.0:1715330284.794910:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330284.794912:0:7134:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1715330284.794916:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x177:0x0]: returning size 4096 00010000:00010000:0.0:1715330284.794926:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d752f lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.794930:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d752f lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.794935:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d752f lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.794940:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d752f lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.794944:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f1d40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330284.794947:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d752f lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.794954:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d752f lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.794962:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff880092dfde00) 00010000:00010000:0.0:1715330284.794964:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330284.794968:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d752f lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.794972:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d752f lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00000004:00010000:0.0:1715330284.794988:0:7134:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8801344c9500 reply state ffff88008d55d000 transno 4294968323 ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1b00/0xd895711d66d7536 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x784526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.794994:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1b00/0xd895711d66d7536 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x784526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.794999:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x784526f4 (ffff880092dfd800) 00010000:00010000:0.0:1715330284.795000:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330284.795002:0:7134:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00000100:00100000:0.0:1715330284.795109:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+8:16823:x1798653938008256:12345-192.168.204.49@tcp:36:lfs.0 Request processed in 5521us (5723us total) trans 4294968323 rc 0/0 00000100:00100000:0.0:1715330284.795115:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23203 00000100:00100000:0.0:1715330284.811776:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938008384 00000100:00100000:0.0:1715330284.811787:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938008384 00000100:00100000:0.0:1715330284.811832:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23204 00000100:00100000:0.0:1715330284.811840:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+8:16824:x1798653938008384:12345-192.168.204.49@tcp:36:mkdir.0 00000100:00100000:0.0:1715330284.814876:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+8:16824:x1798653938008384:12345-192.168.204.49@tcp:36:mkdir.0 Request processed in 3019us (4502us total) trans 0 rc -17/-17 00000100:00100000:0.0:1715330284.814900:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23204 00000100:00100000:0.0:1715330284.833067:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938008448 00000100:00100000:0.0:1715330284.833086:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938008448 00000100:00100000:0.0:1715330284.833130:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23205 00000100:00100000:0.0:1715330284.833138:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801345a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+8:16825:x1798653938008448:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:0.0:1715330284.833158:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330284.833181:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d7559 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb321 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.833241:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d7560 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.833254:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d7560 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.833264:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d7560 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.833274:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d7567 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x784526f4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.833279:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d7567 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x784526f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.833284:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d7567 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x784526f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.833346:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0000/0xd895711d66d756e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x177:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.833352:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0000/0xd895711d66d756e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x177:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.833357:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0000/0xd895711d66d756e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x177:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00000004:00200000:0.0:1715330284.833450:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x177:0x0]: returning size 4096 00000004:00200000:0.0:1715330284.833455:0:7134:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1715330284.833472:0:7134:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0000/0xd895711d66d756e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x177:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.833482:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d7560 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.833488:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d7560 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.833493:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d7560 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.833499:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d7560 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.833505:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f18c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330284.833509:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d7560 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.833515:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d7560 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.833525:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88008b374700) 00010000:00010000:0.0:1715330284.833528:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330284.833532:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d7560 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.833536:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d7560 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.833545:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d7567 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x784526f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.833549:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d7567 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x784526f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.833554:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d7567 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x784526f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.833557:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f2d00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330284.833560:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d7567 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x784526f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.833564:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d7567 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x784526f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.833583:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x784526f4 (ffff880092dfd800) 00010000:00010000:0.0:1715330284.833586:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330284.833588:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d7567 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x784526f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.833592:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d7567 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x784526f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.833611:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d7559 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb321 expref: 10 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.833624:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0000/0xd895711d66d756e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x177:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb321 expref: 9 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.833630:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x177:0x0].0x0 (ffff880092dfd500) 00010000:00010000:0.0:1715330284.833632:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1715330284.833634:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f0000, rc 0) 00000100:00100000:0.0:1715330284.833695:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801345a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+9:16825:x1798653938008448:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 557us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330284.833702:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23205 00000100:00100000:0.0:1715330284.841693:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938008512 00000100:00100000:0.0:1715330284.841703:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938008512 00000100:00100000:0.0:1715330284.841774:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23206 00000100:00100000:0.0:1715330284.841781:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801345a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+9:16825:x1798653938008512:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:0.0:1715330284.841801:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330284.841816:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2400/0xd895711d66d7575 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xbf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb328 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.841858:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d757c lrc: 3/1,0 mode: --/PR res: [0x240000400:0xbf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.841868:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d757c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xbf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.841876:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d757c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xbf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00000004:00200000:0.0:1715330284.841910:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000400:0xbf:0x0]: returning size 4096 00000004:00200000:0.0:1715330284.841913:0:7134:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1715330284.841936:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2400/0xd895711d66d7575 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb328 expref: 11 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.841950:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d757c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xbf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb328 expref: 10 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.841957:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xbf:0x0].0x0 (ffff880092dfd400) 00010000:00010000:0.0:1715330284.841960:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1715330284.841962:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f2ac0, rc 0) 00000100:00100000:0.0:1715330284.842004:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801345a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+10:16825:x1798653938008512:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 223us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330284.842009:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23206 00000100:00100000:1.0:1715330284.852976:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942416064 00000100:00100000:1.0:1715330284.852980:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942416064 00000100:00100000:1.0:1715330284.853232:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1094 00000100:00100000:1.0:1715330284.853238:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:7135:x1798653942416064:12345-0@lo:104: 00010000:00010000:1.0:1715330284.853249:0:7118:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2640/0xd895711d66d754b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d7552 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.853297:0:7118:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1715330284.853303:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:7135:x1798653942416064:12345-0@lo:104: Request processed in 65us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330284.853310:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1094 00010000:00010000:1.0:1715330284.853328:0:7124:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715330284.853334:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2640/0xd895711d66d754b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d7552 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.853341:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f2640 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330284.853345:0:7124:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2640/0xd895711d66d754b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xbf:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd895711d66d7552 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330284.853352:0:7124:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2640/0xd895711d66d754b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xbf:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd895711d66d7552 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.853374:0:7124:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2640/0xd895711d66d754b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xbf:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d7552 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.853383:0:7124:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330284.853399:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2640/0xd895711d66d754b lrc: 1/0,0 mode: --/PW res: [0x200000401:0xbf:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d7552 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.853405:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2640/0xd895711d66d754b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xbf:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d7552 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.853420:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330284.853433:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330284.853435:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1715330284.855341:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983377 is committed 00000001:00080000:0.0:1715330284.855668:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983376 is committed 00000020:00080000:0.0:1715330284.855680:0:7116:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 354 batchid updated 00000020:00080000:0.0:1715330284.855691:0:7116:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88011db63480 refcount 2 committed 0 result 0 batchid 355 00000020:00080000:0.0:1715330284.855695:0:7116:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800b4207400 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88011db63240 00000020:00080000:0.0:1715330284.855698:0:7116:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].339 00000020:00080000:0.0:1715330284.855700:0:7116:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800b4207b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88009d6bb400 00000020:00080000:0.0:1715330284.855702:0:7116:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].339 00000020:00080000:0.0:1715330284.855713:0:7116:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 353 batchid updated 00000020:00080000:0.0:1715330284.855755:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 355 committed batchid 354 00080000:02000000:0.0:1715330284.855771:0:7163:0:(osd_handler.c:2105:osd_trans_start()) *** cfs_fail_loc=19a, val=0*** 00000004:00080000:0.0:1715330284.855829:0:7163:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88009d7e3180 with version 647 00000020:00080000:0.0:1715330284.855836:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 353 cancel update log [0x240000401:0x3:0x0].337: rc = 0 00000020:00080000:0.0:1715330284.855881:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 353 cancel update log [0x200000400:0x3:0x0].337: rc = 0 00000004:00080000:0.0:1715330284.855901:0:7163:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880091ffacc0 with version 648 00000020:00080000:0.0:1715330284.855903:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 354 cancel update log [0x240000401:0x3:0x0].338: rc = 0 00000020:00080000:0.0:1715330284.855917:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 354 cancel update log [0x200000400:0x3:0x0].338: rc = 0 00000020:00080000:0.0:1715330284.855922:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 355 committed batchid 354 00000100:00100000:0.0:1715330284.863378:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330284.871261:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b4c0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7135:1798653942416448:192.168.204.49@tcp:104: 00010000:00010000:0.0:1715330284.871283:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65f80/0xd895711d66d75a6 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330284.872957:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65f80/0xd895711d66d75a6 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330284.872965:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65f80/0xd895711d66d75a6 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330284.873006:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcfc0/0xd895711d66d75ad lrc: 3/0,1 mode: --/EX res: [0x200000401:0xbf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.873012:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcfc0/0xd895711d66d75ad lrc: 3/0,1 mode: --/EX res: [0x200000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330284.873021:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcfc0/0xd895711d66d75ad lrc: 3/0,1 mode: --/EX res: [0x200000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT1 00000100:00100000:1.0:1715330284.873037:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130278000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942416512:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1715330284.873076:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330284.873103:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1715330284.878972:0:7135:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983377 gen 2 00000004:00080000:0.0:1715330284.878977:0:7135:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983372 committed transno 4294983377 00000020:00080000:0.0:1715330284.878983:0:7135:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff880091cb2a80 refcount 2 committed 0 result 0 batchid 362 00000020:00080000:0.0:1715330284.878986:0:7135:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008b233600 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880091cb2b40 00000020:00080000:0.0:1715330284.878988:0:7135:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].364 00000020:00080000:0.0:1715330284.878990:0:7135:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008b233a00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88012f5ca400 00000020:00080000:0.0:1715330284.878993:0:7135:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].362 00000004:00080000:0.0:1715330284.879024:0:7135:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983374 committed transno 4294983377 00000004:00080000:0.0:1715330284.879036:0:7135:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983375 committed transno 4294983377 00000004:00080000:0.0:1715330284.879047:0:7135:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983377 committed transno 4294983377 00000100:00100000:0.0:1715330284.879062:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880130278000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942416512:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330284.879077:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcfc0/0xd895711d66d75ad lrc: 4/0,1 mode: --/EX res: [0x200000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d75b4 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.879085:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcfc0/0xd895711d66d75ad lrc: 4/0,1 mode: --/EX res: [0x200000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d75b4 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.881094:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcfc0/0xd895711d66d75ad lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d75b4 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.881105:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcfc0/0xd895711d66d75ad lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d75b4 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330284.881758:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d61c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942416704:0@lo:403:mdt00_002.0 00000100:00100000:0.0:1715330284.881807:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330284.881835:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa540 going to sleep for 11 seconds 00000100:00100000:1.0:1715330284.888483:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d61c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942416704:0@lo:403:mdt00_002.0 00000040:00080000:1.0:1715330284.892215:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].364, 952 off552232 00000040:00080000:1.0:1715330284.892359:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].366, 1032 off604928 00000004:00080000:1.0:1715330284.892365:0:7135:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88012f47eb40 with version 697 00000004:00200000:1.0:1715330284.893929:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x177:0x0]: returning size 4096 00010000:00010000:1.0:1715330284.893954:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65f80/0xd895711d66d75a6 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330284.893963:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65f80/0xd895711d66d75a6 lrc: 2/0,0 mode: EX/EX res: [0x240000400:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330284.893970:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65f80/0xd895711d66d75a6 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330284.893975:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db65f80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330284.893980:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65f80/0xd895711d66d75a6 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330284.893986:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65f80/0xd895711d66d75a6 lrc: 4/0,0 mode: EX/EX res: [0x240000400:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330284.894000:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xbf:0x0].0x0 (ffff880092dfd400) 00010000:00010000:1.0:1715330284.894003:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330284.894008:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65f80/0xd895711d66d75a6 lrc: 2/0,0 mode: --/EX res: [0x240000400:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330284.894013:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65f80/0xd895711d66d75a6 lrc: 0/0,0 mode: --/EX res: [0x240000400:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330284.894027:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcfc0/0xd895711d66d75ad lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d75b4 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.894034:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcfc0/0xd895711d66d75ad lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d75b4 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.894039:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcfc0/0xd895711d66d75ad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d75b4 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.894060:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1715330284.894068:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000401:0xbf:0x0] 00010000:00010000:1.0:1715330284.894075:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66d00/0xd895711d66d759f lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x177:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330284.894080:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66d00/0xd895711d66d759f lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x177:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330284.894084:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66d00/0xd895711d66d759f lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x177:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330284.894089:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66d00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330284.894091:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66d00/0xd895711d66d759f lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x177:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330284.894096:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66d00/0xd895711d66d759f lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x177:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330284.894102:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x177:0x0].0x0 (ffff880092dfd500) 00010000:00010000:1.0:1715330284.894104:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330284.894106:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66d00/0xd895711d66d759f lrc: 2/0,0 mode: --/EX res: [0x240000402:0x177:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330284.894110:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66d00/0xd895711d66d759f lrc: 0/0,0 mode: --/EX res: [0x240000402:0x177:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330284.894255:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66f40/0xd895711d66d7591 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330284.894260:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66f40/0xd895711d66d7591 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330284.894264:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66f40/0xd895711d66d7591 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330284.894269:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66f40/0xd895711d66d7591 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330284.894273:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66f40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330284.894275:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66f40/0xd895711d66d7591 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330284.894280:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66f40/0xd895711d66d7591 lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330284.894286:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88009d696500) 00010000:00010000:1.0:1715330284.894288:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330284.894291:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66f40/0xd895711d66d7591 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330284.894294:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66f40/0xd895711d66d7591 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00000004:00010000:1.0:1715330284.894308:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008d61ce00 reply state ffff88008b33b000 transno 4294968326 ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d7598 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x784526f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330284.894317:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d7598 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x784526f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330284.894322:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x784526f4 (ffff880092dfd800) 00010000:00010000:1.0:1715330284.894324:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330284.894326:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1715330284.894387:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d61ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+10:16825:x1798653938008704:12345-192.168.204.49@tcp:36:rmdir.0 Request processed in 30720us (31014us total) trans 4294968326 rc 0/0 00000100:00100000:1.0:1715330284.894395:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23208 00010000:00010000:1.0:1715330284.896000:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715330284.896010:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcfc0/0xd895711d66d75ad lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d75b4 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.896019:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfcfc0 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330284.896024:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcfc0/0xd895711d66d75ad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d75b4 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330284.896031:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcfc0/0xd895711d66d75ad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d75b4 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.896138:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcfc0/0xd895711d66d75ad lrc: 2/0,0 mode: --/EX res: [0x200000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d75b4 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.896149:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330284.896169:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcfc0/0xd895711d66d75ad lrc: 1/0,0 mode: --/EX res: [0x200000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d75b4 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.896175:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcfc0/0xd895711d66d75ad lrc: 0/0,0 mode: --/EX res: [0x200000401:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d75b4 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.896196:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330284.896198:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330284.896201:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330284.916225:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938008896 00000100:00100000:1.0:1715330284.916233:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938008896 00000100:00100000:1.0:1715330284.916360:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23209 00000100:00100000:1.0:1715330284.916369:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+14:16835:x1798653938008896:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:1.0:1715330284.916389:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330284.916411:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d75bb lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb336 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.916470:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d75c2 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.916482:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d75c2 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.916493:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d75c2 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.916503:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66d75c9 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x784526f5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.916508:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66d75c9 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x784526f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.916514:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66d75c9 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x784526f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.916551:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d75c2 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.916557:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d75c2 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.916562:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d75c2 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.916567:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d75c2 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.916587:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfcd80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330284.916591:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d75c2 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.916598:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d75c2 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.916608:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff880092dfdd00) 00010000:00010000:1.0:1715330284.916610:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330284.916615:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d75c2 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.916620:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d75c2 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.916629:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66d75c9 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x784526f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.916633:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66d75c9 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x784526f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.916637:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66d75c9 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x784526f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.916642:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bff180 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330284.916644:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66d75c9 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x784526f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.916648:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66d75c9 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x784526f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.916654:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x784526f5 (ffff88009d618000) 00010000:00010000:1.0:1715330284.916656:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330284.916657:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66d75c9 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x784526f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.916661:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66d75c9 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x784526f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330284.916686:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d75bb lrc: 1/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb336 expref: 15 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.916693:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d75bb lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb336 expref: 15 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.916700:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfd440, rc 0) 00000100:00100000:1.0:1715330284.916768:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+14:16835:x1798653938008896:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 399us (637us total) trans 0 rc 301/301 00000100:00100000:1.0:1715330284.916774:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23209 00000100:00100000:1.0:1715330284.921035:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330284.921070:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938008960 00000100:00100000:0.0:1715330284.921082:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938008960 00000100:00100000:0.0:1715330284.921136:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23210 00000100:00100000:0.0:1715330284.921145:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+10:16835:x1798653938008960:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:0.0:1715330284.921169:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330284.921189:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2400/0xd895711d66d75d0 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb33d expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.921246:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d75d7 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330284.921259:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d75d7 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.921269:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d75d7 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00000004:00200000:0.0:1715330284.921312:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000401:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1715330284.921316:0:7134:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1715330284.921348:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2400/0xd895711d66d75d0 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb33d expref: 12 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.921361:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d75d7 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb33d expref: 11 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.921368:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88008d68e400) 00010000:00010000:0.0:1715330284.921372:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1715330284.921374:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f3cc0, rc 0) 00000100:00100000:0.0:1715330284.921437:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+11:16835:x1798653938008960:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 292us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330284.921443:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23210 00000100:00100000:0.0:1715330284.931403:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330284.931528:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938009088 00000100:00100000:1.0:1715330284.931537:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938009088 00000100:00100000:1.0:1715330284.931591:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23211 00000100:00100000:1.0:1715330284.931599:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d61ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+14:16835:x1798653938009088:12345-192.168.204.49@tcp:36:lfs.0 00010000:00010000:1.0:1715330284.931650:0:7134:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330284.931676:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d7528 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb31a expref: 14 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.931692:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff880092dfdd00) 00010000:00010000:1.0:1715330284.931701:0:7134:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330284.931770:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d75de lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.931782:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d75de lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.931790:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d75de lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.931799:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66d75e5 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x784526f5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.931804:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66d75e5 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x784526f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.931809:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66d75e5 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x784526f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000040:00080000:1.0:1715330284.932451:0:7134:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].342, 2168 off526456 00000040:00080000:1.0:1715330284.932515:0:7134:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].341, 2368 off565648 00000004:00080000:1.0:1715330284.932519:0:7134:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88012f47e900 with version 649 00000100:00100000:0.0:1715330284.932761:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942417024 00000100:00100000:0.0:1715330284.932765:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942417024 00000100:00100000:0.0:1715330284.932789:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2353 00000100:00100000:0.0:1715330284.932794:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:8587:x1798653942417024:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330284.933121:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:8587:x1798653942417024:12345-0@lo:1000:osp_up1-0.0 Request processed in 325us (401us total) trans 4294968327 rc 0/0 00000100:00100000:0.0:1715330284.933127:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2353 00010000:00010000:1.0:1715330284.933762:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d75ec lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1508:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.933772:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d75ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1508:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.933782:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d75ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1508:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.933795:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff840/0xd895711d66d75f3 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xc2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.933799:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff840/0xd895711d66d75f3 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.933804:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff840/0xd895711d66d75f3 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.933826:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff3c0/0xd895711d66d75fa lrc: 3/0,1 mode: --/PW res: [0x240000401:0xc2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.933831:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff3c0/0xd895711d66d75fa lrc: 3/0,1 mode: --/PW res: [0x240000401:0xc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.933839:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff3c0/0xd895711d66d75fa lrc: 3/0,1 mode: --/PW res: [0x240000401:0xc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT0 00000100:00100000:1.0:1715330284.933849:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130278380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942417088:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1715330284.933872:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330284.933888:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330284.936650:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942417088 00000100:00100000:0.0:1715330284.936659:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942417088 00000100:00100000:0.0:1715330284.936702:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2354 00000100:00100000:0.0:1715330284.936708:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130278000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7134:x1798653942417088:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330284.936744:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330284.936765:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d7601 lrc: 2/0,0 mode: --/PW res: [0x240000401:0xc2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d75fa expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.936788:0:23404:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d7601 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d75fa expref: 10 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.936800:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d7601 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d75fa expref: 10 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330284.936807:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc2:0x0].0x0 (ffff88008d68ea00) 00010000:00010000:0.0:1715330284.936811:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330284.936813:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f2d00, rc 0) 00000100:00100000:0.0:1715330284.936872:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130278000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7134:x1798653942417088:12345-0@lo:101:mdt00_001.0 Request processed in 163us (2999us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330284.936878:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2354 00000100:00100000:1.0:1715330284.937002:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880130278380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942417088:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330284.937017:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff3c0/0xd895711d66d75fa lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7601 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.937026:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff3c0/0xd895711d66d75fa lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7601 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330284.937046:0:7134:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008d61ea00 reply state ffff88009c606000 transno 4294983379 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff840/0xd895711d66d75f3 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.937056:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff840/0xd895711d66d75f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.937062:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xc2:0x0].0x0 (ffff88009d618900) 00010000:00010000:1.0:1715330284.937063:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330284.937066:0:7134:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1715330284.937071:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff3c0/0xd895711d66d75fa lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7601 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.937077:0:7134:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff3c0/0xd895711d66d75fa lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7601 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330284.937087:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0xc2:0x0] 00000004:00010000:1.0:1715330284.937092:0:7134:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008d61ea00 reply state ffff88009c606000 transno 4294983379 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d75ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1508:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.937097:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d75ec lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1508:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.937102:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1508:0x0].0x0 (ffff88009d618d00) 00010000:00010000:1.0:1715330284.937104:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330284.937105:0:7134:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1715330284.937109:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1508:0x0]: returning size 4096 00010000:00010000:1.0:1715330284.937119:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d75de lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.937123:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d75de lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.937127:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d75de lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.937131:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d75de lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.937136:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfef40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330284.937140:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d75de lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.937146:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d75de lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.937154:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88009d618f00) 00010000:00010000:1.0:1715330284.937156:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330284.937159:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d75de lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.937163:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d75de lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00000004:00010000:1.0:1715330284.937177:0:7134:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008d61ea00 reply state ffff88009c606000 transno 4294983379 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66d75e5 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x784526f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.937183:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66d75e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x784526f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330284.937187:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x784526f5 (ffff88009d618100) 00010000:00010000:1.0:1715330284.937188:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330284.937190:0:7134:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00000100:00100000:1.0:1715330284.937253:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d61ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+15:16835:x1798653938009088:12345-192.168.204.49@tcp:36:lfs.0 Request processed in 5653us (5860us total) trans 4294983379 rc 0/0 00000100:00100000:1.0:1715330284.937260:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23211 00000100:00100000:1.0:1715330284.960605:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938009216 00000100:00100000:1.0:1715330284.960615:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938009216 00000100:00100000:0.0:1715330284.960693:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23212 00000100:00100000:0.0:1715330284.960701:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+15:16836:x1798653938009216:12345-192.168.204.49@tcp:36:mkdir.0 00000100:00100000:0.0:1715330284.960871:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+15:16836:x1798653938009216:12345-192.168.204.49@tcp:36:mkdir.0 Request processed in 170us (344us total) trans 0 rc -17/-17 00000100:00100000:0.0:1715330284.960876:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23212 00000100:00100000:1.0:1715330284.975305:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330284.982523:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330284.990023:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330284.991472:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942417216 00000100:00100000:0.0:1715330284.991476:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942417216 00010000:00010000:0.0:1715330284.991495:0:7121:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d7601 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd895711d66d75fa expref: 10 pid: 23404 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330284.991527:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1442 00000100:00100000:0.0:1715330284.991532:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+10:3688:x1798653942417216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330284.991541:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330284.995545:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1b00/0xd895711d66d7536 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x784526f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.995555:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1b00/0xd895711d66d7536 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x784526f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.995561:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1b00/0xd895711d66d7536 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x784526f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.995575:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f1b00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330284.995580:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1b00/0xd895711d66d7536 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x784526f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.995587:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1b00/0xd895711d66d7536 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x784526f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.995604:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x784526f4 (ffff880092dfd800) 00010000:00010000:0.0:1715330284.995607:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330284.995610:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1b00/0xd895711d66d7536 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x784526f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.995614:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1b00/0xd895711d66d7536 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x784526f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.995632:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3840/0xd895711d66d753d lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x177:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.995636:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3840/0xd895711d66d753d lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x177:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.995640:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3840/0xd895711d66d753d lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x177:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.995643:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f3840 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330284.995645:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3840/0xd895711d66d753d lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x177:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.995649:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3840/0xd895711d66d753d lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x177:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.995654:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x177:0x0].0x0 (ffff880092dfd500) 00010000:00010000:0.0:1715330284.995656:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330284.995657:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3840/0xd895711d66d753d lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x177:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.995664:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3840/0xd895711d66d753d lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x177:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.995676:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0480/0xd895711d66d7544 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.995680:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0480/0xd895711d66d7544 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.995684:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0480/0xd895711d66d7544 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.995687:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f0480 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330284.995690:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0480/0xd895711d66d7544 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.995693:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0480/0xd895711d66d7544 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.995698:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xbf:0x0].0x0 (ffff880092dfd400) 00010000:00010000:0.0:1715330284.995699:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330284.995701:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0480/0xd895711d66d7544 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.995705:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0480/0xd895711d66d7544 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330284.995719:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d7598 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x784526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330284.995723:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d7598 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x784526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330284.995728:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d7598 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x784526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330284.995749:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db65d40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330284.995751:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d7598 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x784526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330284.995755:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d7598 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x784526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330284.995761:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x784526f4 (ffff880092dfd800) 00010000:00010000:0.0:1715330284.995763:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330284.995765:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d7598 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x784526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330284.995768:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d7598 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x784526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330284.995913:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d7601 lrc: 0/0,0 mode: --/PW res: [0x240000401:0xc2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd895711d66d75fa expref: 6 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330284.995926:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc2:0x0].0x0 (ffff88008d68ea00) 00010000:00010000:1.0:1715330284.995930:0:7121:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88013457ed00/0xd895711d66d7639 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.995939:0:7121:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457ed00/0xd895711d66d7639 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.995945:0:7121:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457ed00/0xd895711d66d7639 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330284.995972:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330284.996008:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942417216:12345-0@lo:103:ldlm_bl.0 Request processed in 4475us (5103us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330284.996017:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1442 00000100:00100000:1.0:1715330284.996675:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942417472 00000100:00100000:1.0:1715330284.996679:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942417472 00000100:00100000:1.0:1715330284.996708:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2356 00000100:00100000:1.0:1715330284.996713:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:8278:x1798653942417472:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1715330284.996813:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:8278:x1798653942417472:12345-0@lo:1000:osp_up0-1.0 Request processed in 98us (375us total) trans 4294983381 rc 0/0 00000100:00100000:1.0:1715330284.996819:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2356 00000100:00100000:1.0:1715330284.999901:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330285.005932:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330285.006042:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938009600 00000100:00100000:0.0:1715330285.006049:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938009600 00010000:00010000:0.0:1715330285.006095:0:7121:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cd80/0xd895711d66d762b lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb34b expref: 17 pid: 7135 timeout: 359 lvb_type: 0 00000100:00100000:0.0:1715330285.006131:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1443 00000100:00100000:0.0:1715330285.006139:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+17:2011:x1798653938009600:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1715330285.006152:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330285.006294:0:7121:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cd80/0xd895711d66d762b lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb34b expref: 17 pid: 7135 timeout: 359 lvb_type: 0 00010000:00010000:0.0:1715330285.006306:0:7121:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cd80/0xd895711d66d762b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb34b expref: 17 pid: 7135 timeout: 359 lvb_type: 0 00010000:00010000:0.0:1715330285.006328:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cd80/0xd895711d66d762b lrc: 0/0,0 mode: --/PR res: [0x200000400:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb34b expref: 17 pid: 7135 timeout: 359 lvb_type: 0 00010000:00010000:0.0:1715330285.006382:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xc2:0x0].0x0 (ffff88009d618900) 00010000:00010000:0.0:1715330285.006387:0:7121:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d7655 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.006396:0:7121:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d7655 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.006402:0:7121:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d7655 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.006433:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330285.006793:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+16:2011:x1798653938009600:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 653us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.006801:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1443 00000100:00100000:0.0:1715330285.007597:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942417600 00000100:00100000:0.0:1715330285.007603:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942417600 00000100:00100000:0.0:1715330285.007639:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2357 00000100:00100000:0.0:1715330285.007644:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:7134:x1798653942417600:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330285.007660:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330285.007676:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d7663 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xc2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d765c expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.007700:0:9407:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457ed00/0xd895711d66d7639 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb352 expref: 7 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.007707:0:9407:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d7663 lrc: 4/0,0 mode: --/EX res: [0x240000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d765c expref: 6 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.007728:0:9407:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88013457ed00/0xd895711d66d7639 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb352 expref: 7 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.007758:0:9407:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457ed00/0xd895711d66d7639 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb352 expref: 7 pid: 7134 timeout: 359 lvb_type: 0 00000100:00100000:0.0:1715330285.007767:0:9407:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d61ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:9407:1798653942417664:192.168.204.49@tcp:104: 00000100:00100000:0.0:1715330285.007824:0:9407:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffab40 going to sleep for 11 seconds 00000100:00100000:0.0:1715330285.012619:0:9407:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d61ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:9407:1798653942417664:192.168.204.49@tcp:104: 00010000:00010000:0.0:1715330285.012650:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d7663 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d765c expref: 6 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.012661:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc2:0x0].0x0 (ffff88008d68ea00) 00010000:00010000:0.0:1715330285.012663:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715330285.012666:0:9407:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d7663 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d765c expref: 6 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.012674:0:9407:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d7663 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d765c expref: 6 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.012680:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f2d00, rc 0) 00000100:00100000:0.0:1715330285.012729:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7134:x1798653942417600:12345-0@lo:101:mdt00_001.0 Request processed in 5083us (5222us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.012762:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2357 00000100:00100000:1.0:1715330285.012951:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000020:00080000:0.0:1715330285.013118:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 356 committed batchid 354 00000020:00080000:0.0:1715330285.013154:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 354 00000100:00080000:0.0:1715330285.014281:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001-osp-MDT0000 older than 1715330255 00000100:00100000:1.0:1715330285.016269:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942417792 00000100:00100000:1.0:1715330285.016278:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942417792 00000100:00100000:1.0:1715330285.016576:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2358 00000100:00100000:1.0:1715330285.016583:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7134:x1798653942417792:12345-0@lo:403:mdt00_001.0 00000100:00100000:1.0:1715330285.019546:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7134:x1798653942417792:12345-0@lo:403:mdt00_001.0 Request processed in 2954us (4548us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.019560:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2358 00000100:00100000:1.0:1715330285.021923:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942417920 00000100:00100000:1.0:1715330285.021929:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942417920 00000100:00100000:0.0:1715330285.023028:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2359 00000100:00100000:0.0:1715330285.023037:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:8587:x1798653942417920:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330285.023927:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:8587:x1798653942417920:12345-0@lo:1000:osp_up1-0.0 Request processed in 889us (2676us total) trans 4294968328 rc 0/0 00000100:00100000:0.0:1715330285.023936:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2359 00000004:00200000:0.0:1715330285.024124:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1508:0x0]: returning size 4096 00010000:00010000:0.0:1715330285.024150:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d7655 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.024160:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d7655 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.024167:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d7655 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.024172:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64b40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330285.024176:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d7655 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.024183:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d7655 lrc: 4/0,0 mode: EX/EX res: [0x200000400:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.024198:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xc2:0x0].0x0 (ffff88009d618900) 00010000:00010000:0.0:1715330285.024201:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715330285.024205:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d7655 lrc: 2/0,0 mode: --/EX res: [0x200000400:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.024209:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d7655 lrc: 0/0,0 mode: --/EX res: [0x200000400:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.024220:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457dd40/0xd895711d66d765c lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7663 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.024226:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457dd40/0xd895711d66d765c lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d7663 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.024232:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457dd40/0xd895711d66d765c lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d7663 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.024389:0:7134:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1715330285.024398:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0xc2:0x0] 00010000:00010000:0.0:1715330285.024406:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66d764e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1508:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.024410:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66d764e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1508:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.024415:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66d764e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1508:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.024418:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66d00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330285.024420:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66d764e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1508:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.024424:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66d764e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1508:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.024430:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1508:0x0].0x0 (ffff88009d618d00) 00010000:00010000:0.0:1715330285.024432:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715330285.024435:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66d764e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1508:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.024439:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66d764e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1508:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.024607:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d7640 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.024612:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d7640 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.024617:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d7640 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.024622:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d7640 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.024626:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66f40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330285.024628:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d7640 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.024633:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d7640 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.024640:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff8800a7e58700) 00010000:00010000:0.0:1715330285.024642:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330285.024644:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d7640 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.024648:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d7640 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00000004:00010000:0.0:1715330285.024660:0:7134:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008d7f0a80 reply state ffff88008b33f000 transno 4294983382 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65f80/0xd895711d66d7647 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x784526f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.024669:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65f80/0xd895711d66d7647 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x784526f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.024674:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x784526f5 (ffff88009d618100) 00010000:00010000:0.0:1715330285.024676:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330285.024678:0:7134:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1715330285.025542:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+17:16837:x1798653938009536:12345-192.168.204.49@tcp:36:rmdir.0 Request processed in 25364us (25649us total) trans 4294983382 rc 0/0 00000100:00100000:0.0:1715330285.025553:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23216 00000100:00100000:0.0:1715330285.042170:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330285.055969:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330285.066671:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330285.069013:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942418112 00000100:00100000:0.0:1715330285.069018:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942418112 00000100:00100000:0.0:1715330285.069061:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2360 00000100:00100000:0.0:1715330285.069066:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ba2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:8278:x1798653942418112:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330285.069376:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ba2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:8278:x1798653942418112:12345-0@lo:1000:osp_up0-1.0 Request processed in 309us (505us total) trans 4294983383 rc 0/0 00000100:00100000:0.0:1715330285.069383:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2360 00000100:00100000:0.0:1715330285.071146:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942418176 00000100:00100000:0.0:1715330285.071152:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942418176 00000100:00100000:0.0:1715330285.071185:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2361 00000100:00100000:0.0:1715330285.071235:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7134:x1798653942418176:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330285.071251:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330285.071266:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d76b0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d76a9 expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.071285:0:23404:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d76b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d76a9 expref: 10 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.071293:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d76b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d76a9 expref: 10 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.071299:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc0:0x0].0x0 (ffff88008d68e100) 00010000:00010000:0.0:1715330285.071301:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330285.071303:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f2d00, rc 0) 00000100:00100000:0.0:1715330285.071421:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:7134:x1798653942418176:12345-0@lo:101:mdt00_001.0 Request processed in 230us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.071427:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2361 00000100:00100000:1.0:1715330285.088332:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330285.101291:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330285.101368:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938010112 00000100:00100000:0.0:1715330285.101378:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938010112 00000100:00100000:0.0:1715330285.101426:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23221 00000100:00100000:0.0:1715330285.101434:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+8:16840:x1798653938010112:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:0.0:1715330285.101456:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330285.101478:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2400/0xd895711d66d76b7 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb367 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.101541:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d76be lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330285.101553:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d76be lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330285.101578:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d76be lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330285.101588:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f06c0/0xd895711d66d76c5 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x784526f6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330285.101594:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f06c0/0xd895711d66d76c5 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x784526f6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330285.101600:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f06c0/0xd895711d66d76c5 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x784526f6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330285.101670:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2880/0xd895711d66d76cc lrc: 3/1,0 mode: --/PR res: [0x240000402:0x179:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330285.101677:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2880/0xd895711d66d76cc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x179:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330285.101683:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2880/0xd895711d66d76cc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x179:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000004:00200000:0.0:1715330285.101793:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x179:0x0]: returning size 4096 00000004:00200000:0.0:1715330285.101797:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1715330285.101816:0:7135:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2880/0xd895711d66d76cc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x179:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330285.101825:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d76be lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330285.101831:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d76be lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330285.101836:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d76be lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330285.101842:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d76be lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330285.101848:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f18c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330285.101851:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d76be lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330285.101858:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d76be lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330285.101868:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88008d68e600) 00010000:00010000:0.0:1715330285.101871:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330285.101876:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d76be lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330285.101881:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d76be lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330285.101892:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f06c0/0xd895711d66d76c5 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x784526f6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330285.101897:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f06c0/0xd895711d66d76c5 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x784526f6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330285.101902:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f06c0/0xd895711d66d76c5 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x784526f6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330285.101905:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f06c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330285.101907:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f06c0/0xd895711d66d76c5 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x784526f6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330285.101912:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f06c0/0xd895711d66d76c5 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x784526f6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330285.101917:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x784526f6 (ffff88008b233700) 00010000:00010000:0.0:1715330285.101919:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330285.101922:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f06c0/0xd895711d66d76c5 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x784526f6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330285.101927:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f06c0/0xd895711d66d76c5 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x784526f6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330285.101946:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2400/0xd895711d66d76b7 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb367 expref: 10 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.101961:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2880/0xd895711d66d76cc lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x179:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb367 expref: 9 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.101967:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x179:0x0].0x0 (ffff88008b233600) 00010000:00010000:0.0:1715330285.101970:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1715330285.101972:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f2880, rc 0) 00000100:00100000:0.0:1715330285.102020:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+9:16840:x1798653938010112:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 586us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.102027:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23221 00000100:00100000:0.0:1715330285.116434:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330285.121989:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938010240 00000100:00100000:0.0:1715330285.122002:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938010240 00000100:00100000:0.0:1715330285.122214:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23223 00000100:00100000:0.0:1715330285.122223:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+18:16840:x1798653938010240:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:0.0:1715330285.122242:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330285.122270:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d76e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb375 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.122325:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d76e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330285.122336:0:7135:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d76b0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d76a9 expref: 9 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.122344:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d76e8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xc0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330285.122374:0:7135:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d76b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd895711d66d76a9 expref: 9 pid: 23404 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330285.122388:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d61ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7135:1798653942418240:0@lo:104: 00000100:00100000:0.0:1715330285.122435:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330285.122459:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffaf00 going to sleep for 11 seconds 00000100:00080000:0.0:1715330285.122604:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000-osp-MDT0001 older than 1715330255 00010000:00010000:0.0:1715330285.122631:0:7124:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715330285.122637:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e640/0xd895711d66d76a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d76b0 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.122643:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457e640 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330285.122647:0:7124:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e640/0xd895711d66d76a9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc0:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd895711d66d76b0 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330285.122655:0:7124:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e640/0xd895711d66d76a9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc0:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd895711d66d76b0 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.122677:0:7124:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e640/0xd895711d66d76a9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc0:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d76b0 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.122683:0:7124:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1715330285.122781:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d61ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7135:1798653942418240:0@lo:104: 00010000:00010000:1.0:1715330285.122796:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d76e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330285.123239:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e640/0xd895711d66d76a9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xc0:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d76b0 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.123247:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e640/0xd895711d66d76a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc0:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d76b0 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.123261:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330285.123263:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330285.123265:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330285.123274:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d61c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942418304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330285.123298:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:0.0:1715330285.125583:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983383 is committed 00000001:00080000:0.0:1715330285.125623:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983382 is committed 00000020:00080000:0.0:1715330285.125632:0:7116:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 356 batchid updated 00000020:00080000:0.0:1715330285.125643:0:7116:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88012f47e600 refcount 2 committed 0 result 0 batchid 357 00000020:00080000:0.0:1715330285.125647:0:7116:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009d618600 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88012f47e900 00000020:00080000:0.0:1715330285.125688:0:7116:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].341 00000020:00080000:0.0:1715330285.125690:0:7116:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009d618c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88009d6a9000 00000020:00080000:0.0:1715330285.125693:0:7116:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].342 00000020:00080000:0.0:1715330285.125703:0:7116:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 355 batchid updated 00000020:00080000:0.0:1715330285.125783:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 357 committed batchid 356 00000004:00080000:0.0:1715330285.125863:0:7163:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880091ffaa80 with version 651 00000020:00080000:0.0:1715330285.125870:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 355 cancel update log [0x240000401:0x3:0x0].339: rc = 0 00000020:00080000:0.0:1715330285.125901:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 355 cancel update log [0x200000400:0x3:0x0].339: rc = 0 00000004:00080000:0.0:1715330285.125918:0:7163:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880091ffa900 with version 652 00000020:00080000:0.0:1715330285.125921:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 356 cancel update log [0x240000401:0x3:0x0].340: rc = 0 00000020:00080000:0.0:1715330285.125933:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 356 cancel update log [0x200000400:0x3:0x0].340: rc = 0 00000020:00080000:0.0:1715330285.125939:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 356 00000100:00100000:0.0:1715330285.127970:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942418432 00000100:00100000:0.0:1715330285.127977:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942418432 00000100:00100000:0.0:1715330285.128011:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2362 00000100:00100000:0.0:1715330285.128018:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:8587:x1798653942418432:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1715330285.128048:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d76e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.128054:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d76e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00200000:1.0:1715330285.128094:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc0:0x0]: returning size 4096 00000004:00200000:1.0:1715330285.128098:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1715330285.128134:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d76e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb375 expref: 16 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.128147:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d76e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc0:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb375 expref: 15 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330285.128152:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:8587:x1798653942418432:12345-0@lo:1000:osp_up1-0.0 Request processed in 133us (287us total) trans 4294968330 rc 0/0 00010000:00010000:1.0:1715330285.128153:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc0:0x0].0x0 (ffff88008d68e100) 00010000:00010000:1.0:1715330285.128155:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1715330285.128157:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f2400, rc 0) 00000100:00100000:0.0:1715330285.128159:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2362 00000100:00100000:1.0:1715330285.128206:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+15:16840:x1798653938010240:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 5984us (6295us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.128214:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23223 00000100:00100000:1.0:1715330285.128505:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942418560 00000100:00100000:1.0:1715330285.128509:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942418560 00000100:00100000:1.0:1715330285.128525:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2363 00000100:00100000:1.0:1715330285.128530:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:8587:x1798653942418560:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330285.128618:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:8587:x1798653942418560:12345-0@lo:1000:osp_up1-0.0 Request processed in 86us (218us total) trans 4294968331 rc 0/0 00000100:00100000:1.0:1715330285.128624:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2363 00000100:00100000:1.0:1715330285.129090:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d61c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942418304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330285.133628:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330285.133752:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938010368 00000100:00100000:1.0:1715330285.133761:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938010368 00000100:00100000:1.0:1715330285.133803:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23224 00000100:00100000:1.0:1715330285.133810:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d61c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+10:16840:x1798653938010368:12345-192.168.204.49@tcp:36:rmdir.0 00010000:00010000:1.0:1715330285.134043:0:7135:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330285.134069:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2880/0xd895711d66d76cc lrc: 0/0,0 mode: --/PR res: [0x240000402:0x179:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb367 expref: 10 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.134084:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x179:0x0].0x0 (ffff88008b233600) 00010000:00010000:1.0:1715330285.134088:0:7135:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330285.134115:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d76ef lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.134126:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d76ef lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.134135:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d76ef lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.134148:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd680/0xd895711d66d76f6 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x784526f6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.134153:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd680/0xd895711d66d76f6 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x784526f6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.134158:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd680/0xd895711d66d76f6 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x784526f6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.134213:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d76fd lrc: 3/0,1 mode: --/EX res: [0x240000402:0x179:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.134219:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d76fd lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x179:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.134224:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d76fd lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x179:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.134237:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd200/0xd895711d66d7704 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xc0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.134244:0:7135:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457d680/0xd895711d66d76da lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb36e expref: 9 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.134251:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd200/0xd895711d66d7704 lrc: 4/0,1 mode: --/EX res: [0x240000400:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.134279:0:7135:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88013457d680/0xd895711d66d76da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb36e expref: 9 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.134290:0:7135:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457d680/0xd895711d66d76da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb36e expref: 9 pid: 7134 timeout: 359 lvb_type: 0 00000100:00100000:1.0:1715330285.134307:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7135:1798653942418624:192.168.204.49@tcp:104: 00000100:00100000:1.0:1715330285.134372:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330285.138345:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7135:1798653942418624:192.168.204.49@tcp:104: 00010000:00010000:1.0:1715330285.138372:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd200/0xd895711d66d7704 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000100:00100000:1.0:1715330285.139756:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330285.139847:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938010432 00000100:00100000:0.0:1715330285.139855:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938010432 00010000:00010000:0.0:1715330285.139892:0:7121:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013457d680/0xd895711d66d76da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb36e expref: 10 pid: 7134 timeout: 359 lvb_type: 0 00000100:00100000:0.0:1715330285.139928:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1446 00000100:00100000:0.0:1715330285.139936:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a3a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+10:2012:x1798653938010432:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1715330285.139950:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330285.139956:0:7121:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88013457d680/0xd895711d66d76da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc0:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb36e expref: 10 pid: 7134 timeout: 359 lvb_type: 0 00010000:00010000:0.0:1715330285.139968:0:7121:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88013457d680/0xd895711d66d76da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc0:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb36e expref: 10 pid: 7134 timeout: 359 lvb_type: 0 00010000:00010000:0.0:1715330285.139991:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457d680/0xd895711d66d76da lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc0:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb36e expref: 10 pid: 7134 timeout: 359 lvb_type: 0 00010000:00010000:0.0:1715330285.140006:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc0:0x0].0x0 (ffff88008b233b00) 00010000:00010000:0.0:1715330285.140010:0:7121:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd200/0xd895711d66d7704 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330285.140018:0:7121:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd200/0xd895711d66d7704 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330285.140025:0:7121:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd200/0xd895711d66d7704 lrc: 4/0,1 mode: EX/EX res: [0x240000400:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330285.140043:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330285.140082:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012a3a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+9:2012:x1798653938010432:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 145us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.140089:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1446 00010000:00010000:1.0:1715330285.140331:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd200/0xd895711d66d7704 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.140339:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd200/0xd895711d66d7704 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.140376:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfeac0/0xd895711d66d770b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.140382:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfeac0/0xd895711d66d770b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.140391:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfeac0/0xd895711d66d770b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT1 00000100:00100000:1.0:1715330285.140408:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942418688:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1715330285.140439:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330285.140450:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330285.141241:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942418688 00000100:00100000:0.0:1715330285.141246:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942418688 00000100:00100000:0.0:1715330285.141271:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2364 00000100:00100000:0.0:1715330285.141276:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:7135:x1798653942418688:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330285.141294:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330285.141310:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d7712 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d770b expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.141330:0:23404:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d76e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb375 expref: 14 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.141338:0:23404:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d7712 lrc: 4/0,0 mode: --/EX res: [0x200000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d770b expref: 6 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.141357:0:23404:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d76e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb375 expref: 14 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.141367:0:23404:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d76e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb375 expref: 14 pid: 7135 timeout: 359 lvb_type: 0 00000100:00100000:0.0:1715330285.141376:0:23404:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d61c700 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:23404:1798653942418752:192.168.204.49@tcp:104: 00000100:00100000:0.0:1715330285.141415:0:23404:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa9c0 going to sleep for 11 seconds 00010000:00010000:0.0:1715330285.141459:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330285.143354:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330285.143358:0:23404:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d61c700 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:23404:1798653942418752:192.168.204.49@tcp:104: 00000100:00100000:0.0:1715330285.143375:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938010496 00010000:00010000:1.0:1715330285.143381:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d7712 lrc: 3/0,0 mode: --/EX res: [0x200000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d770b expref: 6 pid: 23404 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330285.143381:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938010496 00010000:00010000:1.0:1715330285.143397:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc0:0x0].0x0 (ffff88008d68e100) 00010000:00010000:1.0:1715330285.143400:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715330285.143400:0:7121:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d76e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb375 expref: 15 pid: 7135 timeout: 359 lvb_type: 0 00010000:00010000:1.0:1715330285.143403:0:23404:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d7712 lrc: 3/0,0 mode: --/EX res: [0x200000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d770b expref: 6 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.143410:0:23404:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d7712 lrc: 3/0,0 mode: --/EX res: [0x200000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d770b expref: 6 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.143415:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f06c0, rc 0) 00000100:00100000:0.0:1715330285.143423:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1447 00000100:00100000:0.0:1715330285.143429:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d61ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+15:2011:x1798653938010496:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1715330285.143438:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330285.143443:0:7121:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d76e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb375 expref: 15 pid: 7135 timeout: 359 lvb_type: 0 00000100:00100000:1.0:1715330285.143450:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:7135:x1798653942418688:12345-0@lo:101:mdt00_002.0 Request processed in 2173us (3010us total) trans 0 rc 0/0 00010000:00010000:0.0:1715330285.143456:0:7121:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d76e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb375 expref: 15 pid: 7135 timeout: 359 lvb_type: 0 00000100:00100000:1.0:1715330285.143457:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2364 00010000:00010000:0.0:1715330285.143473:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d76e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb375 expref: 15 pid: 7135 timeout: 359 lvb_type: 0 00010000:00010000:0.0:1715330285.143481:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc0:0x0].0x0 (ffff88008d68e100) 00010000:00010000:0.0:1715330285.143484:0:7121:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d7712 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d770b expref: 5 pid: 23404 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330285.143489:0:7135:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983383 gen 2 00010000:00010000:0.0:1715330285.143491:0:7121:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d7712 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d770b expref: 5 pid: 23404 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330285.143495:0:7135:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983378 committed transno 4294983383 00010000:00010000:0.0:1715330285.143498:0:7121:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d7712 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d770b expref: 5 pid: 23404 timeout: 0 lvb_type: 0 00000020:00080000:1.0:1715330285.143500:0:7135:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff88012f47e240 refcount 2 committed 0 result 0 batchid 364 00000020:00080000:1.0:1715330285.143504:0:7135:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88012ca4dc00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff88012f47eb40 00000020:00080000:1.0:1715330285.143507:0:7135:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].366 00000020:00080000:1.0:1715330285.143509:0:7135:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88012ca4d100 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88009d6a9200 00000020:00080000:1.0:1715330285.143511:0:7135:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].364 00010000:00010000:0.0:1715330285.143517:0:7121:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d7712 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d770b expref: 5 pid: 23404 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330285.143527:0:7121:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d61c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:7121:1798653942418816:0@lo:105: 00000004:00080000:1.0:1715330285.143531:0:7135:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983380 committed transno 4294983383 00000004:00080000:1.0:1715330285.143548:0:7135:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983381 committed transno 4294983383 00000100:00100000:0.0:1715330285.143552:0:7121:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1715330285.143559:0:7135:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983383 committed transno 4294983383 00000100:00100000:0.0:1715330285.143562:0:7121:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffaf00 going to sleep for 11 seconds 00000100:00100000:1.0:1715330285.143592:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942418688:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330285.143605:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfeac0/0xd895711d66d770b lrc: 4/0,1 mode: --/EX res: [0x200000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7712 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.143617:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfeac0/0xd895711d66d770b lrc: 4/0,1 mode: --/EX res: [0x200000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7712 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.143826:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfeac0/0xd895711d66d770b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7712 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.143833:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfeac0/0xd895711d66d770b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7712 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330285.143882:0:7121:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d61c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:7121:1798653942418816:0@lo:105: 00010000:00010000:0.0:1715330285.143889:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330285.144111:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d61ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+14:2011:x1798653938010496:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 680us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.144117:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1447 00000100:00100000:1.0:1715330285.144311:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942418880:0@lo:403:mdt00_002.0 00000100:00100000:1.0:1715330285.144339:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330285.144359:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330285.144449:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942418880 00000100:00100000:0.0:1715330285.144452:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942418880 00000100:00100000:0.0:1715330285.144467:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2365 00000100:00100000:0.0:1715330285.144472:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:7135:x1798653942418880:12345-0@lo:403:mdt00_002.0 00000100:00100000:0.0:1715330285.146063:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:7135:x1798653942418880:12345-0@lo:403:mdt00_002.0 Request processed in 1586us (1717us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.146072:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2365 00000100:00100000:1.0:1715330285.146157:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942418880:0@lo:403:mdt00_002.0 00000040:00080000:1.0:1715330285.147200:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].366, 664 off555064 00000040:00080000:1.0:1715330285.147328:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].368, 744 off608040 00000004:00080000:1.0:1715330285.147333:0:7135:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88012f47e9c0 with version 701 00000100:00100000:0.0:1715330285.147540:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942419008 00000100:00100000:0.0:1715330285.147545:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942419008 00000100:00100000:0.0:1715330285.147592:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2366 00000100:00100000:0.0:1715330285.147598:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:8278:x1798653942419008:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330285.148025:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:8278:x1798653942419008:12345-0@lo:1000:osp_up0-1.0 Request processed in 427us (561us total) trans 4294983384 rc 0/0 00000100:00100000:0.0:1715330285.148033:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2366 00000004:00200000:1.0:1715330285.148154:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x179:0x0]: returning size 4096 00010000:00010000:1.0:1715330285.148310:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd200/0xd895711d66d7704 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.148321:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd200/0xd895711d66d7704 lrc: 2/0,0 mode: EX/EX res: [0x240000400:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.148327:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd200/0xd895711d66d7704 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.148333:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfd200 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330285.148337:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd200/0xd895711d66d7704 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.148347:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd200/0xd895711d66d7704 lrc: 4/0,0 mode: EX/EX res: [0x240000400:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.148362:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc0:0x0].0x0 (ffff88008b233b00) 00010000:00010000:1.0:1715330285.148364:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330285.148367:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd200/0xd895711d66d7704 lrc: 2/0,0 mode: --/EX res: [0x240000400:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.148372:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd200/0xd895711d66d7704 lrc: 0/0,0 mode: --/EX res: [0x240000400:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.148385:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfeac0/0xd895711d66d770b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7712 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.148392:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfeac0/0xd895711d66d770b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d7712 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.148399:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfeac0/0xd895711d66d770b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d7712 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.148411:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1715330285.148416:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000401:0xc0:0x0] 00010000:00010000:1.0:1715330285.148421:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d76fd lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x179:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.148426:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d76fd lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x179:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.148430:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d76fd lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x179:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.148435:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bffa80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330285.148438:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d76fd lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x179:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.148443:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d76fd lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x179:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.148448:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x179:0x0].0x0 (ffff88008b233600) 00010000:00010000:1.0:1715330285.148450:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330285.148452:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d76fd lrc: 2/0,0 mode: --/EX res: [0x240000402:0x179:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.148456:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d76fd lrc: 0/0,0 mode: --/EX res: [0x240000402:0x179:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.148559:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d76ef lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.148578:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d76ef lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.148583:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d76ef lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.148588:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d76ef lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.148591:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfdb00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330285.148593:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d76ef lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.148598:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d76ef lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.148604:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88009d618e00) 00010000:00010000:1.0:1715330285.148606:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330285.148609:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d76ef lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.148613:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d76ef lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00000004:00010000:1.0:1715330285.148625:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008d61c380 reply state ffff88009c600000 transno 4294968332 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd680/0xd895711d66d76f6 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x784526f6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.148634:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd680/0xd895711d66d76f6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x784526f6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.148641:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x784526f6 (ffff88008b233700) 00000100:00100000:0.0:1715330285.148642:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942419072 00010000:00010000:1.0:1715330285.148643:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330285.148645:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1715330285.148646:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942419072 00000100:00100000:0.0:1715330285.148673:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1235 00000100:00100000:0.0:1715330285.148677:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+7:3691:x1798653942419072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330285.148685:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330285.148697:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d7712 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d770b expref: 7 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.148707:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc0:0x0].0x0 (ffff88008d68e100) 00000100:00100000:1.0:1715330285.148708:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d61c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+10:16840:x1798653938010368:12345-192.168.204.49@tcp:36:rmdir.0 Request processed in 14896us (15085us total) trans 4294968332 rc 0/0 00000100:00100000:1.0:1715330285.148714:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23224 00010000:00010000:0.0:1715330285.148714:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330285.148750:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+6:3691:x1798653942419072:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.148756:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1235 00000100:00100000:1.0:1715330285.166908:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330285.166946:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938010560 00000100:00100000:1.0:1715330285.166955:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938010560 00000100:00100000:1.0:1715330285.167020:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23225 00000100:00100000:1.0:1715330285.167028:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+14:16841:x1798653938010560:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:1.0:1715330285.167051:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330285.167074:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d7719 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb37c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.167137:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d7720 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.167151:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d7720 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.167165:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d7720 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.167179:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d7727 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x784526f7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.167184:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d7727 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x784526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.167189:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d7727 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x784526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.167232:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d7720 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.167237:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d7720 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.167242:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d7720 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.167247:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d7720 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.167253:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bffa80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330285.167257:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d7720 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.167263:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d7720 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.167273:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88008b233900) 00010000:00010000:1.0:1715330285.167276:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330285.167281:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d7720 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.167287:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d7720 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.167300:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d7727 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x784526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.167304:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d7727 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x784526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.167309:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d7727 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x784526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.167314:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfd200 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330285.167316:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d7727 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x784526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.167321:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d7727 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x784526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.167326:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x784526f7 (ffff88009d618e00) 00010000:00010000:1.0:1715330285.167328:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330285.167330:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d7727 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x784526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.167334:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d7727 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x784526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.167361:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d7719 lrc: 1/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb37c expref: 15 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.167368:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d7719 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb37c expref: 15 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.167376:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfdb00, rc 0) 00000100:00100000:1.0:1715330285.167425:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+14:16841:x1798653938010560:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 397us (528us total) trans 0 rc 301/301 00000100:00100000:1.0:1715330285.167432:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23225 00000100:00100000:1.0:1715330285.173846:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330285.181249:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938010752 00000100:00100000:0.0:1715330285.181259:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938010752 00000100:00100000:0.0:1715330285.181316:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23227 00000100:00100000:0.0:1715330285.181325:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+14:16841:x1798653938010752:12345-192.168.204.49@tcp:36:lfs.0 00010000:00010000:0.0:1715330285.181379:0:7134:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330285.181409:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d7686 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb360 expref: 14 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.181437:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88008b233900) 00010000:00010000:0.0:1715330285.181446:0:7134:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715330285.181509:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66d773c lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.181522:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66d773c lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.181531:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66d773c lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.181543:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d7743 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x784526f7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.181548:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d7743 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x784526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.181553:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d7743 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x784526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000040:00080000:1.0:1715330285.183289:0:7134:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].344, 2168 off529288 00000040:00080000:1.0:1715330285.183361:0:7134:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].343, 2368 off568760 00000004:00080000:1.0:1715330285.183367:0:7134:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880091ffaf00 with version 653 00000100:00100000:0.0:1715330285.183626:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942419200 00000100:00100000:0.0:1715330285.183632:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942419200 00000100:00100000:0.0:1715330285.183673:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2367 00000100:00100000:0.0:1715330285.183679:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:8587:x1798653942419200:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330285.184015:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:8587:x1798653942419200:12345-0@lo:1000:osp_up1-0.0 Request processed in 335us (457us total) trans 4294968333 rc 0/0 00000100:00100000:0.0:1715330285.184022:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2367 00010000:00010000:0.0:1715330285.185043:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0480/0xd895711d66d774a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x150a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.185059:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0480/0xd895711d66d774a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x150a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.185070:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0480/0xd895711d66d774a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x150a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.185086:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d7751 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xc3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.185091:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d7751 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.185096:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d7751 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.185121:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f1b00/0xd895711d66d7758 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xc3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.185126:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f1b00/0xd895711d66d7758 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.185136:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f1b00/0xd895711d66d7758 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT0 00000100:00100000:0.0:1715330285.185147:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d61c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942419264:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1715330285.185175:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330285.185198:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffae40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330285.185259:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942419264 00000100:00100000:1.0:1715330285.185264:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942419264 00000100:00100000:1.0:1715330285.185361:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2368 00000100:00100000:1.0:1715330285.185367:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130278a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7134:x1798653942419264:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330285.185382:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330285.185398:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d775f lrc: 2/0,0 mode: --/PW res: [0x240000401:0xc3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d7758 expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.185416:0:9407:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d775f lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d7758 expref: 10 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.185426:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d775f lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7758 expref: 10 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.185435:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc3:0x0].0x0 (ffff88009d618200) 00010000:00010000:1.0:1715330285.185438:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330285.185440:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfdb00, rc 0) 00000100:00100000:1.0:1715330285.185480:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130278a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7134:x1798653942419264:12345-0@lo:101:mdt00_001.0 Request processed in 113us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.185489:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2368 00000100:00100000:1.0:1715330285.194225:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330285.202130:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330285.206111:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938011008 00000100:00100000:1.0:1715330285.206119:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938011008 00000100:00100000:1.0:1715330285.206161:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23230 00000100:00100000:1.0:1715330285.206167:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+16:16844:x1798653938011008:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:1.0:1715330285.206183:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330285.206198:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d7782 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xc3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb391 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.206241:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d7789 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xc3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.206251:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d7789 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.206259:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d7789 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00200000:1.0:1715330285.206297:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0xc3:0x0]: returning size 4096 00000004:00200000:1.0:1715330285.206300:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1715330285.206323:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d7782 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb391 expref: 18 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.206350:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d7789 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb391 expref: 17 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.206357:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xc3:0x0].0x0 (ffff88008b091800) 00010000:00010000:1.0:1715330285.206360:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1715330285.206363:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bffa80, rc 0) 00000100:00100000:1.0:1715330285.206416:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:16844:x1798653938011008:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 248us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.206422:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23230 00000100:00100000:0.0:1715330285.208374:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330285.210424:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942419328 00000100:00100000:0.0:1715330285.210428:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942419328 00000100:00100000:0.0:1715330285.210466:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1100 00000100:00100000:0.0:1715330285.210471:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7134:x1798653942419328:12345-0@lo:104: 00010000:00010000:0.0:1715330285.210481:0:7118:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f1b00/0xd895711d66d7758 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d775f expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.210531:0:7118:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1715330285.210536:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7134:x1798653942419328:12345-0@lo:104: Request processed in 65us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.210543:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1100 00000100:00100000:0.0:1715330285.211223:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942419392 00000100:00100000:0.0:1715330285.211227:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942419392 00010000:00010000:0.0:1715330285.211244:0:7121:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d775f lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd895711d66d7758 expref: 10 pid: 9407 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330285.211328:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1448 00000100:00100000:0.0:1715330285.211333:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+10:3689:x1798653942419392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330285.211380:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1715330285.214225:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968333 is committed 00000001:00080000:0.0:1715330285.214264:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968332 is committed 00000020:00080000:0.0:1715330285.214273:0:8267:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0001: 364 batchid updated 00000020:00080000:0.0:1715330285.214286:0:8267:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff880091cb2f00 refcount 2 committed 0 result 0 batchid 365 00000020:00080000:0.0:1715330285.214291:0:8267:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008b233a00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880091cb2d80 00000020:00080000:0.0:1715330285.214294:0:8267:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].367 00000020:00080000:0.0:1715330285.214296:0:8267:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008b233200 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88012f5ca400 00000020:00080000:0.0:1715330285.214299:0:8267:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].365 00000020:00080000:0.0:1715330285.214318:0:8267:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0001: 363 batchid updated 00010000:00010000:0.0:1715330285.214381:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d775f lrc: 0/0,0 mode: --/PW res: [0x240000401:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd895711d66d7758 expref: 6 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.214397:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc3:0x0].0x0 (ffff88009d618200) 00010000:00010000:0.0:1715330285.214402:0:7121:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65200/0xd895711d66d7797 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330285.214411:0:7121:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65200/0xd895711d66d7797 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330285.214418:0:7121:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65200/0xd895711d66d7797 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330285.214437:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330285.214500:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942419392:12345-0@lo:103:ldlm_bl.0 Request processed in 3165us (3306us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.214510:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1448 00010000:00010000:1.0:1715330285.214595:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457df80/0xd895711d66d7694 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x784526f6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.214605:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013457df80/0xd895711d66d7694 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x784526f6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.214611:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013457df80/0xd895711d66d7694 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x784526f6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.214617:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457df80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330285.214621:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457df80/0xd895711d66d7694 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x784526f6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.214627:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457df80/0xd895711d66d7694 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x784526f6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.214638:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x784526f6 (ffff88008b233700) 00010000:00010000:1.0:1715330285.214640:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330285.214644:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013457df80/0xd895711d66d7694 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x784526f6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.214649:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457df80/0xd895711d66d7694 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x784526f6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.214658:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457eac0/0xd895711d66d769b lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x179:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.214663:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013457eac0/0xd895711d66d769b lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x179:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.214669:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013457eac0/0xd895711d66d769b lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x179:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.214673:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457eac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330285.214675:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457eac0/0xd895711d66d769b lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x179:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.214680:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457eac0/0xd895711d66d769b lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x179:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.214686:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x179:0x0].0x0 (ffff88008b233600) 00010000:00010000:1.0:1715330285.214688:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330285.214690:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013457eac0/0xd895711d66d769b lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x179:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.214694:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457eac0/0xd895711d66d769b lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x179:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.214711:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457cfc0/0xd895711d66d76a2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.214716:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013457cfc0/0xd895711d66d76a2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.214722:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013457cfc0/0xd895711d66d76a2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.214726:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457cfc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330285.214728:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457cfc0/0xd895711d66d76a2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.214750:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457cfc0/0xd895711d66d76a2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.214761:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc0:0x0].0x0 (ffff88008b233b00) 00010000:00010000:1.0:1715330285.214763:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330285.214766:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013457cfc0/0xd895711d66d76a2 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.214770:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457cfc0/0xd895711d66d76a2 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.214784:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd680/0xd895711d66d76f6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x784526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.214788:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd680/0xd895711d66d76f6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x784526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.214793:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd680/0xd895711d66d76f6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x784526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.214797:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfd680 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330285.214799:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd680/0xd895711d66d76f6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x784526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.214804:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd680/0xd895711d66d76f6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x784526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.214810:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x784526f6 (ffff88008b233700) 00010000:00010000:1.0:1715330285.214811:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330285.214813:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd680/0xd895711d66d76f6 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x784526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.214817:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd680/0xd895711d66d76f6 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x784526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00000004:00080000:0.0:1715330285.214916:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 702 rpc_version 702 00000020:00100000:0.0:1715330285.214948:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1715330285.214968:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880130279500 x1798653942419520/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715330285.214988:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130279500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942419520:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330285.215024:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330285.215049:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa540 going to sleep for 11 seconds 00000100:00100000:1.0:1715330285.216306:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942419520 00000100:00100000:1.0:1715330285.216315:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942419520 00000100:00100000:1.0:1715330285.216356:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2369 00000100:00100000:1.0:1715330285.216362:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013027a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:8278:x1798653942419520:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1715330285.216663:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013027a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:8278:x1798653942419520:12345-0@lo:1000:osp_up0-1.0 Request processed in 301us (1639us total) trans 4294983386 rc 0/0 00000100:00100000:1.0:1715330285.216670:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2369 00000100:00100000:0.0:1715330285.217553:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880130279500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942419520:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1715330285.217575:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 703 rpc_version 703 00000020:00100000:0.0:1715330285.217594:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1715330285.217599:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880130278000 x1798653942419648/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715330285.217622:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880130278000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942419648:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330285.217652:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330285.217662:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa540 going to sleep for 11 seconds 00000100:00100000:0.0:1715330285.217785:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942419648 00000100:00100000:0.0:1715330285.217789:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942419648 00000100:00100000:0.0:1715330285.217823:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2370 00000100:00100000:0.0:1715330285.217828:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:8278:x1798653942419648:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330285.217915:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:8278:x1798653942419648:12345-0@lo:1000:osp_up0-1.0 Request processed in 85us (261us total) trans 4294983387 rc 0/0 00000100:00100000:0.0:1715330285.217921:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2370 00000100:00100000:1.0:1715330285.217938:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880130278000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942419648:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330285.221211:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330285.226664:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330285.227858:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942419776 00000100:00100000:0.0:1715330285.227862:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942419776 00000100:00100000:0.0:1715330285.227896:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2371 00000100:00100000:0.0:1715330285.227901:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:7134:x1798653942419776:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330285.227913:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330285.227924:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1f80/0xd895711d66d77c1 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xc3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d77ba expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.227939:0:23404:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65200/0xd895711d66d7797 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb398 expref: 7 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.227946:0:23404:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1f80/0xd895711d66d77c1 lrc: 4/0,0 mode: --/EX res: [0x240000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d77ba expref: 6 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.227962:0:23404:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65200/0xd895711d66d7797 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb398 expref: 7 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.227972:0:23404:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65200/0xd895711d66d7797 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb398 expref: 7 pid: 7134 timeout: 359 lvb_type: 0 00000100:00100000:0.0:1715330285.227981:0:23404:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344c9180 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:23404:1798653942419840:192.168.204.49@tcp:104: 00000100:00100000:0.0:1715330285.228017:0:23404:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa180 going to sleep for 11 seconds 00000100:00100000:0.0:1715330285.229632:0:23404:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344c9180 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:23404:1798653942419840:192.168.204.49@tcp:104: 00010000:00010000:0.0:1715330285.229654:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1f80/0xd895711d66d77c1 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d77ba expref: 6 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.229664:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc3:0x0].0x0 (ffff88009d618200) 00010000:00010000:0.0:1715330285.229666:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715330285.229669:0:23404:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1f80/0xd895711d66d77c1 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d77ba expref: 6 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.229680:0:23404:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1f80/0xd895711d66d77c1 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d77ba expref: 6 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.229688:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f1f80, rc 0) 00000100:00100000:0.0:1715330285.229728:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7134:x1798653942419776:12345-0@lo:101:mdt00_001.0 Request processed in 1826us (2327us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.229760:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2371 00000020:00080000:0.0:1715330285.229988:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 358 committed batchid 356 00000020:00080000:0.0:1715330285.230024:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 356 00000100:00100000:0.0:1715330285.231802:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330285.232925:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942419968 00000100:00100000:0.0:1715330285.232932:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942419968 00000100:00100000:0.0:1715330285.232977:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2372 00000100:00100000:0.0:1715330285.232983:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7134:x1798653942419968:12345-0@lo:403:mdt00_001.0 00000100:00100000:0.0:1715330285.235061:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7134:x1798653942419968:12345-0@lo:403:mdt00_001.0 Request processed in 2072us (2151us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.235073:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2372 00000100:00100000:0.0:1715330285.237184:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942420096 00000100:00100000:0.0:1715330285.237192:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942420096 00000100:00100000:0.0:1715330285.237222:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2373 00000100:00100000:0.0:1715330285.237228:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:8587:x1798653942420096:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330285.237608:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:8587:x1798653942420096:12345-0@lo:1000:osp_up1-0.0 Request processed in 379us (605us total) trans 4294968334 rc 0/0 00000100:00100000:0.0:1715330285.237616:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2373 00010000:00010000:0.0:1715330285.238344:0:7124:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715330285.238350:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c6c0/0xd895711d66d77ba lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d77c1 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.238357:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457c6c0 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330285.238361:0:7124:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c6c0/0xd895711d66d77ba lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d77c1 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330285.238367:0:7124:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c6c0/0xd895711d66d77ba lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d77c1 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.238389:0:7124:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c6c0/0xd895711d66d77ba lrc: 2/0,0 mode: --/EX res: [0x240000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d77c1 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.238394:0:7124:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330285.238410:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c6c0/0xd895711d66d77ba lrc: 1/0,0 mode: --/EX res: [0x240000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d77c1 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.238420:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c6c0/0xd895711d66d77ba lrc: 0/0,0 mode: --/EX res: [0x240000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d77c1 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.238432:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330285.238433:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330285.238434:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330285.238441:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1715330285.238451:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942420160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330285.238475:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330285.239008:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942420160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330285.246888:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330285.250413:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330285.250533:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938011456 00000100:00100000:1.0:1715330285.250539:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938011456 00000100:00100000:1.0:1715330285.250584:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23234 00000100:00100000:1.0:1715330285.250590:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:16845:x1798653938011456:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:1.0:1715330285.250604:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330285.250619:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66d77dd lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb3a6 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.250655:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff840/0xd895711d66d77e4 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.250664:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff840/0xd895711d66d77e4 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.250672:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff840/0xd895711d66d77e4 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00200000:1.0:1715330285.250702:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1715330285.250705:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1715330285.250728:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66d77dd lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb3a6 expref: 19 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.250755:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff840/0xd895711d66d77e4 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb3a6 expref: 18 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.250762:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88009d618300) 00010000:00010000:1.0:1715330285.250765:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1715330285.250767:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bff840, rc 0) 00000100:00100000:1.0:1715330285.250794:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+18:16845:x1798653938011456:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 204us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.250799:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23234 00000100:00100000:0.0:1715330285.257401:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330285.270914:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942420224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1715330285.270966:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330285.271002:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942420224 00000100:00100000:0.0:1715330285.271007:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942420224 00000100:00100000:0.0:1715330285.271039:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1715330285.271045:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942420224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1715330285.271071:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 17022400 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1715330285.271098:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942420224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.271103:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:0.0:1715330285.271118:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330255 00000100:00100000:0.0:1715330285.271140:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942420224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1715330285.281993:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330285.285171:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1715330285.285186:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b4c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942420480:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1715330285.285233:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1715330285.285686:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330255 00000100:00100000:0.0:1715330285.288933:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330285.289210:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938011776 00000100:00100000:1.0:1715330285.289716:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938011776 00000100:00100000:1.0:1715330285.289773:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23237 00000100:00100000:1.0:1715330285.289780:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+8:16847:x1798653938011776:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:1.0:1715330285.289794:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330285.289809:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdf80/0xd895711d66d7815 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb3ad expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.289855:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d781c lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.289865:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d781c lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.289873:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d781c lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.289881:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d7823 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x784526f8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.289886:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d7823 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x784526f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.289895:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d7823 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x784526f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.289947:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfef40/0xd895711d66d782a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x17b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.289953:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfef40/0xd895711d66d782a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x17b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.289958:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfef40/0xd895711d66d782a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x17b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000004:00200000:1.0:1715330285.290022:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x17b:0x0]: returning size 4096 00000004:00200000:1.0:1715330285.290026:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1715330285.290041:0:7135:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfef40/0xd895711d66d782a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x17b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.290050:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d781c lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.290055:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d781c lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.290061:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d781c lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.290065:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d781c lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.290070:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfe640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330285.290074:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d781c lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.290080:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d781c lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.290089:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88009d618400) 00010000:00010000:1.0:1715330285.290108:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330285.290111:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d781c lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.290116:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d781c lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.290124:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d7823 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x784526f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.290129:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d7823 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x784526f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.290134:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d7823 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x784526f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.290137:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bff3c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330285.290139:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d7823 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x784526f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.290143:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d7823 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x784526f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.290148:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x784526f8 (ffff8801345c6400) 00010000:00010000:1.0:1715330285.290150:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330285.290152:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d7823 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x784526f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.290157:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d7823 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x784526f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.290174:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdf80/0xd895711d66d7815 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb3ad expref: 10 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.290186:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfef40/0xd895711d66d782a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x17b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb3ad expref: 9 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.290192:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x17b:0x0].0x0 (ffff88008d4e1500) 00010000:00010000:1.0:1715330285.290194:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1715330285.290196:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfef40, rc 0) 00000100:00100000:1.0:1715330285.290246:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+9:16847:x1798653938011776:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 466us (1318us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.290252:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23237 00000100:00100000:0.0:1715330285.292916:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330285.296095:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330285.297460:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942420544 00000100:00100000:0.0:1715330285.297463:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942420544 00000100:00100000:0.0:1715330285.297492:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1102 00000100:00100000:0.0:1715330285.297496:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:7134:x1798653942420544:12345-0@lo:104: 00010000:00010000:0.0:1715330285.297505:0:7118:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457df80/0xd895711d66d7807 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d780e expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.297538:0:7118:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1715330285.297543:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:7134:x1798653942420544:12345-0@lo:104: Request processed in 46us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.297548:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1102 00010000:00010000:0.0:1715330285.297574:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715330285.297579:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457df80/0xd895711d66d7807 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d780e expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.297585:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457df80 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330285.297590:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457df80/0xd895711d66d7807 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc1:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd895711d66d780e expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330285.297597:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457df80/0xd895711d66d7807 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc1:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd895711d66d780e expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.297619:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457df80/0xd895711d66d7807 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc1:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d780e expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.297624:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330285.297639:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457df80/0xd895711d66d7807 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xc1:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d780e expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.297644:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457df80/0xd895711d66d7807 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc1:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d780e expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.302062:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330285.302065:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330285.302067:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1715330285.303141:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983389 is committed 00000001:00080000:0.0:1715330285.303594:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983388 is committed 00000020:00080000:0.0:1715330285.303603:0:7116:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 358 batchid updated 00000020:00080000:0.0:1715330285.303612:0:7116:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff880091ffa780 refcount 2 committed 0 result 0 batchid 359 00000020:00080000:0.0:1715330285.303615:0:7116:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008b091200 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff880091ffaf00 00000020:00080000:0.0:1715330285.303618:0:7116:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].343 00000020:00080000:0.0:1715330285.303620:0:7116:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008b091a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88012f5cae00 00000020:00080000:0.0:1715330285.303622:0:7116:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].344 00000020:00080000:0.0:1715330285.303631:0:7116:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 357 batchid updated 00000020:00080000:0.0:1715330285.303651:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 359 committed batchid 358 00000004:00080000:0.0:1715330285.303718:0:7163:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880091ffa180 with version 655 00000020:00080000:0.0:1715330285.303724:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 357 cancel update log [0x240000401:0x3:0x0].341: rc = 0 00000020:00080000:0.0:1715330285.303765:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 357 cancel update log [0x200000400:0x3:0x0].342: rc = 0 00000004:00080000:0.0:1715330285.303785:0:7163:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880091ffab40 with version 656 00000020:00080000:0.0:1715330285.303788:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 358 cancel update log [0x240000401:0x3:0x0].342: rc = 0 00000020:00080000:0.0:1715330285.303800:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 358 cancel update log [0x200000400:0x3:0x0].343: rc = 0 00000020:00080000:0.0:1715330285.303805:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 358 00000100:00100000:0.0:1715330285.303884:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942420736 00000100:00100000:0.0:1715330285.303888:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942420736 00000100:00100000:0.0:1715330285.303909:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2376 00000100:00100000:0.0:1715330285.303914:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:8587:x1798653942420736:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330285.304009:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:8587:x1798653942420736:12345-0@lo:1000:osp_up1-0.0 Request processed in 94us (136us total) trans 4294968336 rc 0/0 00000100:00100000:0.0:1715330285.304015:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2376 00000100:00100000:0.0:1715330285.304130:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942420864 00000100:00100000:0.0:1715330285.304133:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942420864 00000100:00100000:0.0:1715330285.304151:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2377 00000100:00100000:0.0:1715330285.304156:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:8587:x1798653942420864:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330285.304370:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:8587:x1798653942420864:12345-0@lo:1000:osp_up1-0.0 Request processed in 213us (246us total) trans 4294968337 rc 0/0 00000100:00100000:0.0:1715330285.304375:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2377 00000100:00100000:0.0:1715330285.317128:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942420992 00000100:00100000:0.0:1715330285.317132:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942420992 00000100:00100000:0.0:1715330285.317166:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2378 00000100:00100000:0.0:1715330285.317171:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:7134:x1798653942420992:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330285.317183:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330285.317195:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d7870 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d7869 expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.317212:0:23404:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d7846 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb3bb expref: 14 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.317224:0:23404:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d7870 lrc: 4/0,0 mode: --/EX res: [0x200000401:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d7869 expref: 6 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.317241:0:23404:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d7846 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb3bb expref: 14 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.317251:0:23404:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d7846 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb3bb expref: 14 pid: 7134 timeout: 359 lvb_type: 0 00000100:00100000:0.0:1715330285.317260:0:23404:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344cb480 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:23404:1798653942421056:192.168.204.49@tcp:104: 00000100:00100000:0.0:1715330285.317287:0:23404:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffaf00 going to sleep for 11 seconds 00010000:00010000:0.0:1715330285.321607:0:23404:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d7846 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb3bb expref: 15 pid: 7134 timeout: 359 lvb_type: 0 00000100:00100000:0.0:1715330285.321620:0:23404:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344cb480 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:23404:1798653942421056:192.168.204.49@tcp:104: 00010000:00010000:0.0:1715330285.321634:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d7870 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7869 expref: 6 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.321641:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc1:0x0].0x0 (ffff88008b233b00) 00010000:00010000:0.0:1715330285.321644:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715330285.321645:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f1f80, rc 0) 00000100:00100000:0.0:1715330285.321683:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:7134:x1798653942420992:12345-0@lo:101:mdt00_001.0 Request processed in 4511us (4656us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.321689:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2378 00000100:00100000:0.0:1715330285.322343:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942421184 00000100:00100000:0.0:1715330285.322347:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942421184 00000100:00100000:0.0:1715330285.322362:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2379 00000100:00100000:0.0:1715330285.322366:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:7134:x1798653942421184:12345-0@lo:403:mdt00_001.0 00000100:00100000:0.0:1715330285.323584:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:7134:x1798653942421184:12345-0@lo:403:mdt00_001.0 Request processed in 1215us (1282us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.323592:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2379 00000100:00100000:0.0:1715330285.324867:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942421312 00000100:00100000:0.0:1715330285.324872:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942421312 00000100:00100000:0.0:1715330285.324893:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2380 00000100:00100000:0.0:1715330285.324898:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:8278:x1798653942421312:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330285.325090:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:8278:x1798653942421312:12345-0@lo:1000:osp_up0-1.0 Request processed in 190us (262us total) trans 4294983390 rc 0/0 00000100:00100000:0.0:1715330285.325096:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2380 00000100:00100000:0.0:1715330285.327749:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1715330285.327759:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942421376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330285.327793:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330285.328112:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942421376 00000100:00100000:0.0:1715330285.328116:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942421376 00000100:00100000:0.0:1715330285.328141:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1237 00000100:00100000:0.0:1715330285.328146:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+7:3688:x1798653942421376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330285.328155:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330285.328167:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d7870 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d7869 expref: 7 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.328177:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc1:0x0].0x0 (ffff88008b233b00) 00010000:00010000:0.0:1715330285.328182:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330285.328201:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+6:3688:x1798653942421376:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.328210:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1237 00000100:00100000:0.0:1715330285.341032:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330285.348336:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330285.357297:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330285.357465:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938012352 00000100:00100000:0.0:1715330285.357474:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938012352 00000100:00100000:0.0:1715330285.357512:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23243 00000100:00100000:0.0:1715330285.357518:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+10:16849:x1798653938012352:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:0.0:1715330285.357535:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330285.357554:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d78a1 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb3d0 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.357613:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0000/0xd895711d66d78a8 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330285.357625:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0000/0xd895711d66d78a8 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330285.357635:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0000/0xd895711d66d78a8 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000004:00200000:0.0:1715330285.357676:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000401:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1715330285.357680:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1715330285.357707:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d78a1 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb3d0 expref: 12 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.357720:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0000/0xd895711d66d78a8 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb3d0 expref: 11 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.357727:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88012bd8b300) 00010000:00010000:0.0:1715330285.357758:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1715330285.357761:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f0000, rc 0) 00000100:00100000:0.0:1715330285.357806:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+11:16849:x1798653938012352:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 286us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.357812:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23243 00000100:00100000:0.0:1715330285.364915:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330285.365853:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942421504 00000100:00100000:0.0:1715330285.365856:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942421504 00000100:00100000:0.0:1715330285.365878:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2382 00000100:00100000:0.0:1715330285.365882:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d799500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:7134:x1798653942421504:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330285.365941:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d799500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:7134:x1798653942421504:12345-0@lo:1000:mdt00_001.0 Request processed in 58us (144us total) trans 0 rc -2/-2 00000100:00100000:0.0:1715330285.365946:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2382 00000100:00100000:0.0:1715330285.373049:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330285.380221:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942422080 00000100:00100000:0.0:1715330285.380225:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942422080 00000100:00100000:0.0:1715330285.380240:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2389 00000100:00100000:0.0:1715330285.380244:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7134:x1798653942422080:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330285.380282:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7134:x1798653942422080:12345-0@lo:1000:mdt00_001.0 Request processed in 37us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.380287:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2389 00000100:00100000:0.0:1715330285.381720:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942422272 00000100:00100000:0.0:1715330285.381724:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942422272 00000100:00100000:0.0:1715330285.382006:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2391 00000100:00100000:0.0:1715330285.382011:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:7134:x1798653942422272:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330285.382022:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330285.382034:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d78e0 lrc: 2/0,0 mode: --/PW res: [0x240000401:0xc4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d78d9 expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.382065:0:9408:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d78e0 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d78d9 expref: 12 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.382076:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d78e0 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d78d9 expref: 12 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.382081:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc4:0x0].0x0 (ffff88012bd8bb00) 00010000:00010000:0.0:1715330285.382083:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330285.382085:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f2ac0, rc 0) 00000100:00100000:0.0:1715330285.382115:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:7134:x1798653942422272:12345-0@lo:101:mdt00_001.0 Request processed in 103us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.382119:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2391 00000100:00100000:0.0:1715330285.402023:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330285.419848:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330285.420214:0:9413:0:(service.c:168:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1715330285.420222:0:9413:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942422400 00000100:00100000:0.0:1715330285.420225:0:9413:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942422400 00000100:00100000:0.0:1715330285.420245:0:9413:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1105 00000100:00100000:0.0:1715330285.420248:0:9413:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa96c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:7134:x1798653942422400:12345-0@lo:104: 00010000:00010000:0.0:1715330285.420256:0:9413:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db65f80/0xd895711d66d78bd lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d78c4 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.420299:0:9413:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1715330285.420305:0:9413:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa96c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:7134:x1798653942422400:12345-0@lo:104: Request processed in 55us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.420310:0:9413:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1105 00010000:00010000:1.0:1715330285.420379:0:7124:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715330285.420385:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db65f80/0xd895711d66d78bd lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d78c4 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.420391:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db65f80 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330285.420395:0:7124:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db65f80/0xd895711d66d78bd lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526ef bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd895711d66d78c4 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330285.420401:0:7124:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db65f80/0xd895711d66d78bd lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526ef bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd895711d66d78c4 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.420420:0:7124:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db65f80/0xd895711d66d78bd lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x814526ef bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d78c4 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.420425:0:7124:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330285.420452:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db65f80/0xd895711d66d78bd lrc: 1/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x814526ef bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d78c4 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.420461:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db65f80/0xd895711d66d78bd lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x814526ef bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d78c4 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.420476:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330285.420477:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330285.420478:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1715330285.427783:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968339 is committed 00000001:00080000:0.0:1715330285.427808:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968338 is committed 00000020:00080000:0.0:1715330285.427815:0:8267:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0001: 366 batchid updated 00000020:00080000:0.0:1715330285.427823:0:8267:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff880091ffc0c0 refcount 2 committed 0 result 0 batchid 367 00000020:00080000:0.0:1715330285.427827:0:8267:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008b233700 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880091ffc9c0 00000020:00080000:0.0:1715330285.427830:0:8267:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].369 00000020:00080000:0.0:1715330285.427832:0:8267:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8801345c6c00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8801344c7a00 00000020:00080000:0.0:1715330285.427834:0:8267:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].368 00000020:00080000:0.0:1715330285.427842:0:8267:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0001: 365 batchid updated 00010000:00010000:1.0:1715330285.428030:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db661c0/0xd895711d66d77f2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x784526f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.428038:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db661c0/0xd895711d66d77f2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x784526f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.428043:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011db661c0/0xd895711d66d77f2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x784526f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.428049:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db661c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330285.428052:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db661c0/0xd895711d66d77f2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x784526f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.428058:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db661c0/0xd895711d66d77f2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x784526f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.428066:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x784526f8 (ffff8801345c6400) 00010000:00010000:1.0:1715330285.428068:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330285.428071:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011db661c0/0xd895711d66d77f2 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x784526f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.428075:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db661c0/0xd895711d66d77f2 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x784526f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.428083:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457cfc0/0xd895711d66d77f9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x17b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.428088:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013457cfc0/0xd895711d66d77f9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x17b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.428091:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013457cfc0/0xd895711d66d77f9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x17b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.428095:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457cfc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330285.428097:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457cfc0/0xd895711d66d77f9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x17b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.428100:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457cfc0/0xd895711d66d77f9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x17b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.428105:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x17b:0x0].0x0 (ffff88008d4e1500) 00010000:00010000:1.0:1715330285.428106:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330285.428109:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013457cfc0/0xd895711d66d77f9 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x17b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.428112:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457cfc0/0xd895711d66d77f9 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x17b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.428123:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457eac0/0xd895711d66d7800 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.428127:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013457eac0/0xd895711d66d7800 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xc1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.428131:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013457eac0/0xd895711d66d7800 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.428135:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457eac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330285.428137:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457eac0/0xd895711d66d7800 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.428144:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457eac0/0xd895711d66d7800 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xc1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.428148:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc1:0x0].0x0 (ffff88008d4e1200) 00010000:00010000:1.0:1715330285.428150:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330285.428152:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013457eac0/0xd895711d66d7800 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xc1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.428155:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457eac0/0xd895711d66d7800 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xc1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.428165:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e880/0xd895711d66d7854 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x784526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.428170:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e880/0xd895711d66d7854 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x784526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.428174:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e880/0xd895711d66d7854 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x784526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.428177:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457e880 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330285.428178:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e880/0xd895711d66d7854 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x784526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.428181:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e880/0xd895711d66d7854 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x784526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.428185:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x784526f8 (ffff8801345c6400) 00010000:00010000:1.0:1715330285.428187:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330285.428189:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e880/0xd895711d66d7854 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x784526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.428192:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e880/0xd895711d66d7854 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x784526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00000100:00100000:0.0:1715330285.432673:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942422656 00000100:00100000:0.0:1715330285.432678:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942422656 00000100:00100000:0.0:1715330285.432723:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2393 00000100:00100000:0.0:1715330285.432727:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d61c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:8278:x1798653942422656:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330285.432996:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d61c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:8278:x1798653942422656:12345-0@lo:1000:osp_up0-1.0 Request processed in 268us (1249us total) trans 4294983392 rc 0/0 00000100:00100000:0.0:1715330285.433001:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2393 00000100:00100000:1.0:1715330285.442034:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330285.446884:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330285.446942:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938012928 00000100:00100000:0.0:1715330285.446950:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938012928 00000100:00100000:0.0:1715330285.446980:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23249 00000100:00100000:0.0:1715330285.446986:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091eafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+7:16859:x1798653938012928:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:0.0:1715330285.446999:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330285.447013:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d791f lrc: 2/0,0 mode: --/CR res: [0x240000401:0xc4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb3ec expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.447052:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2640/0xd895711d66d7926 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xc4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330285.447062:0:7135:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d78e0 lrc: 2/0,0 mode: PW/PW res: [0x240000401:0xc4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d78d9 expref: 5 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.447072:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2640/0xd895711d66d7926 lrc: 4/1,0 mode: --/PR res: [0x240000401:0xc4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330285.447092:0:7135:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d78e0 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd895711d66d78d9 expref: 5 pid: 9408 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330285.447105:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f4b2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7135:1798653942422848:0@lo:104: 00000100:00100000:0.0:1715330285.447135:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330285.447148:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa540 going to sleep for 11 seconds 00000100:00100000:0.0:1715330285.447619:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f4b2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7135:1798653942422848:0@lo:104: 00010000:00010000:0.0:1715330285.447631:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2640/0xd895711d66d7926 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xc4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000100:00100000:0.0:1715330285.447811:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d61df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942422912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330285.447835:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1715330285.448812:0:8267:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0001: 367 batchid updated 00010000:00010000:1.0:1715330285.448965:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d78e0 lrc: 0/0,0 mode: --/PW res: [0x240000401:0xc4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd895711d66d78d9 expref: 6 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.448975:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc4:0x0].0x0 (ffff88012bd8bb00) 00010000:00010000:1.0:1715330285.448979:0:7122:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2640/0xd895711d66d7926 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xc4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.448985:0:7122:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2640/0xd895711d66d7926 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xc4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.448990:0:7122:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2640/0xd895711d66d7926 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0xc4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330285.449022:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2640/0xd895711d66d7926 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xc4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330285.449028:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2640/0xd895711d66d7926 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xc4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000004:00200000:0.0:1715330285.449060:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000401:0xc4:0x0]: returning size 4096 00000004:00200000:0.0:1715330285.449063:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1715330285.449089:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d791f lrc: 0/0,0 mode: --/CR res: [0x240000401:0xc4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb3ec expref: 9 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.449099:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2640/0xd895711d66d7926 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xc4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb3ec expref: 8 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.449108:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc4:0x0].0x0 (ffff88012bd8bb00) 00010000:00010000:0.0:1715330285.449111:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1715330285.449112:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f2640, rc 0) 00000100:00100000:0.0:1715330285.449141:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091eafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+8:16859:x1798653938012928:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 2154us (2262us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.449146:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23249 00010000:00010000:1.0:1715330285.449183:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330285.449206:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079f3b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942422912:12345-0@lo:103:ldlm_bl.0 Request processed in 1288us (1370us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.449212:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1456 00000100:00100000:0.0:1715330285.451847:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d61df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942422912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330285.455762:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938012992 00000100:00100000:1.0:1715330285.455768:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938012992 00000100:00100000:1.0:1715330285.455818:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1239 00000100:00100000:1.0:1715330285.455824:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801345a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72de1896-1df4-4b3a-930a-9116d2c66168+8:2012:x1798653938012992:12345-192.168.204.49@tcp:103:rmdir.0 00010000:00010000:1.0:1715330285.455835:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330285.455857:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f180/0xd895711d66d78fc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x150c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb3d7 expref: 8 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.455868:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x150c:0x0].0x0 (ffff88009ef18600) 00010000:00010000:1.0:1715330285.455876:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330285.455908:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801345a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72de1896-1df4-4b3a-930a-9116d2c66168+7:2012:x1798653938012992:12345-192.168.204.49@tcp:103:rmdir.0 Request processed in 83us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.455914:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1239 00000100:00100000:1.0:1715330285.457797:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938013120 00000100:00100000:1.0:1715330285.457804:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938013120 00000100:00100000:1.0:1715330285.457842:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23250 00000100:00100000:1.0:1715330285.457848:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801345a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+18:16859:x1798653938013120:12345-192.168.204.49@tcp:36:rmdir.0 00010000:00010000:1.0:1715330285.457883:0:7135:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330285.457898:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d790a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x150c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb3de expref: 18 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.457909:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x150c:0x0].0x0 (ffff88008d4e1600) 00010000:00010000:1.0:1715330285.457912:0:7135:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330285.457947:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd440/0xd895711d66d792d lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.457953:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd440/0xd895711d66d792d lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.457961:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd440/0xd895711d66d792d lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT0 00000100:00100000:1.0:1715330285.457976:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091eaea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942423104:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1715330285.458013:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330285.458033:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330285.458221:0:7135:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968339 gen 2 00000004:00080000:1.0:1715330285.458226:0:7135:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968334 committed transno 4294968339 00000020:00080000:1.0:1715330285.458231:0:7135:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff880091ffcd80 refcount 2 committed 0 result 0 batchid 360 00000020:00080000:1.0:1715330285.458234:0:7135:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8801345c6a00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff880091ffc300 00000020:00080000:1.0:1715330285.458237:0:7135:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].344 00000020:00080000:1.0:1715330285.458238:0:7135:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8801345c6900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8801344c6a00 00000020:00080000:1.0:1715330285.458240:0:7135:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].345 00000004:00080000:1.0:1715330285.458261:0:7135:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968336 committed transno 4294968339 00000004:00080000:1.0:1715330285.458271:0:7135:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968337 committed transno 4294968339 00000004:00080000:1.0:1715330285.458280:0:7135:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968339 committed transno 4294968339 00000100:00100000:1.0:1715330285.458299:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091eaea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942423104:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330285.458309:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd440/0xd895711d66d792d lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7934 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.458317:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd440/0xd895711d66d792d lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7934 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330285.458327:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:1.0:1715330285.458339:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff180/0xd895711d66d793b lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x814526ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.458344:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff180/0xd895711d66d793b lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x814526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.458349:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff180/0xd895711d66d793b lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x814526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT0 00000100:00100000:1.0:1715330285.458357:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091eaea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942423168:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1715330285.458375:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330285.458385:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330285.458394:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942423168 00000100:00100000:1.0:1715330285.458397:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942423168 00000100:00100000:1.0:1715330285.458410:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2397 00000100:00100000:1.0:1715330285.458414:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091eadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7135:x1798653942423168:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330285.458420:0:24873:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330285.458428:0:24873:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d7942 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x814526ef bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d793b expref: -99 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.458438:0:24873:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d7942 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d793b expref: 8 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.458445:0:24873:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d7942 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d793b expref: 8 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.458450:0:24873:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x814526ef (ffff88009d618700) 00010000:00010000:1.0:1715330285.458452:0:24873:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330285.458453:0:24873:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfcd80, rc 0) 00000100:00100000:1.0:1715330285.458468:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091eadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:7135:x1798653942423168:12345-0@lo:101:mdt00_002.0 Request processed in 54us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.458472:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2397 00000100:00100000:1.0:1715330285.458489:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091eaea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942423168:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330285.458495:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff180/0xd895711d66d793b lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7942 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.458500:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff180/0xd895711d66d793b lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7942 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330285.458507:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:1.0:1715330285.458525:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091eaea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942423232:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330285.458540:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330285.458546:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1715330285.458553:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942423232 00000100:00100000:1.0:1715330285.458556:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942423232 00000100:00100000:1.0:1715330285.458576:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2398 00000100:00100000:1.0:1715330285.458579:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091eaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:7135:x1798653942423232:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330285.458612:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091eaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:7135:x1798653942423232:12345-0@lo:1000:mdt00_002.0 Request processed in 32us (72us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.458617:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2398 00000100:00100000:1.0:1715330285.458631:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091eaea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942423232:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330285.458652:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091eaea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942423296:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330285.458665:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330285.458671:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1715330285.458676:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942423296 00000100:00100000:1.0:1715330285.458678:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942423296 00000100:00100000:1.0:1715330285.458686:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2399 00000100:00100000:1.0:1715330285.458689:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:7135:x1798653942423296:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330285.458803:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:7135:x1798653942423296:12345-0@lo:1000:mdt00_002.0 Request processed in 111us (136us total) trans 0 rc 1/1 00000100:00100000:1.0:1715330285.458807:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2399 00000100:00100000:1.0:1715330285.458824:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091eaea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942423296:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1715330285.458847:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcfc0/0xd895711d66d7949 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x150c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.458852:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcfc0/0xd895711d66d7949 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x150c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.458857:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcfc0/0xd895711d66d7949 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x150c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT0 00000100:00100000:1.0:1715330285.458863:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091eaea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942423360:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1715330285.458879:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330285.458892:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330285.458900:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942423360 00000100:00100000:1.0:1715330285.458903:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942423360 00000100:00100000:1.0:1715330285.458914:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2400 00000100:00100000:1.0:1715330285.458917:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:7135:x1798653942423360:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330285.458922:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330285.458930:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc000/0xd895711d66d7950 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x150c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d7949 expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.458940:0:9407:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc000/0xd895711d66d7950 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x150c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d7949 expref: 9 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.458947:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc000/0xd895711d66d7950 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x150c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7949 expref: 9 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.458953:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x150c:0x0].0x0 (ffff88009d618100) 00010000:00010000:1.0:1715330285.458955:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1715330285.458956:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfc000, rc 0) 00000100:00100000:1.0:1715330285.458973:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7135:x1798653942423360:12345-0@lo:101:mdt00_002.0 Request processed in 55us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.459272:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2400 00000100:00100000:1.0:1715330285.459293:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091eaea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942423360:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330285.459300:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcfc0/0xd895711d66d7949 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x150c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7950 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.459307:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcfc0/0xd895711d66d7949 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x150c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7950 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.459325:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfed00/0xd895711d66d7957 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x150c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.459331:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfed00/0xd895711d66d7957 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x150c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.459337:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfed00/0xd895711d66d7957 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x150c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.459348:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66d795e lrc: 3/0,1 mode: --/EX res: [0x200000400:0xc4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.459356:0:7135:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66880/0xd895711d66d7918 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xc4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb3e5 expref: 17 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.459362:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66d795e lrc: 4/0,1 mode: --/EX res: [0x200000400:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.459376:0:7135:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66880/0xd895711d66d7918 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xc4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb3e5 expref: 17 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.459527:0:7135:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66880/0xd895711d66d7918 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xc4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb3e5 expref: 17 pid: 7134 timeout: 359 lvb_type: 0 00000100:00100000:1.0:1715330285.459537:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d56d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7135:1798653942423424:192.168.204.49@tcp:104: 00000100:00100000:1.0:1715330285.459810:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330285.463483:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d56d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7135:1798653942423424:192.168.204.49@tcp:104: 00010000:00010000:1.0:1715330285.463579:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66d795e lrc: 3/0,1 mode: --/EX res: [0x200000400:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.463786:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66d795e lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.463792:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66d795e lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.463822:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7965 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xc4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.463826:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7965 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.463833:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7965 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT0 00000100:00100000:1.0:1715330285.463846:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d56d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942423488:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1715330285.463873:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330285.463884:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330285.463895:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942423488 00000100:00100000:1.0:1715330285.463903:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942423488 00000100:00100000:1.0:1715330285.463966:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2401 00000100:00100000:1.0:1715330285.463971:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:7135:x1798653942423488:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330285.463984:0:24873:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330285.463996:0:24873:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d796c lrc: 2/0,0 mode: --/EX res: [0x240000401:0xc4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d7965 expref: -99 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.464011:0:24873:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2640/0xd895711d66d7926 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0xc4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb3ec expref: 6 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.464018:0:24873:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d796c lrc: 4/0,0 mode: --/EX res: [0x240000401:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d7965 expref: 9 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.464035:0:24873:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2640/0xd895711d66d7926 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xc4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb3ec expref: 6 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.464045:0:24873:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2640/0xd895711d66d7926 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xc4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb3ec expref: 6 pid: 7135 timeout: 359 lvb_type: 0 00000100:00100000:1.0:1715330285.464053:0:24873:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091eaea00 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:24873:1798653942423552:192.168.204.49@tcp:104: 00000100:00100000:1.0:1715330285.464073:0:24873:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1715330285.465689:0:24873:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091eaea00 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:24873:1798653942423552:192.168.204.49@tcp:104: 00010000:00010000:1.0:1715330285.465706:0:24873:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d796c lrc: 3/0,0 mode: --/EX res: [0x240000401:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7965 expref: 9 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.465714:0:24873:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc4:0x0].0x0 (ffff88012bd8bb00) 00010000:00010000:1.0:1715330285.465716:0:24873:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330285.465719:0:24873:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d796c lrc: 3/0,0 mode: --/EX res: [0x240000401:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7965 expref: 9 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.465725:0:24873:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d796c lrc: 3/0,0 mode: --/EX res: [0x240000401:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7965 expref: 9 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.465750:0:24873:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfc240, rc 0) 00000100:00100000:1.0:1715330285.465778:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7135:x1798653942423488:12345-0@lo:101:mdt00_002.0 Request processed in 1806us (1904us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.465784:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2401 00000100:00100000:0.0:1715330285.468167:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d56d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942423488:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330285.468184:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7965 lrc: 4/0,1 mode: --/EX res: [0x240000401:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d796c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.468194:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7965 lrc: 4/0,1 mode: --/EX res: [0x240000401:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d796c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330285.471043:0:9413:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942423616 00000100:00100000:0.0:1715330285.471046:0:9413:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942423616 00000100:00100000:0.0:1715330285.471121:0:9413:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1107 00000100:00100000:0.0:1715330285.471126:0:9413:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d61c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:7121:x1798653942423616:12345-0@lo:105: 00010000:00010000:0.0:1715330285.471135:0:9413:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7965 lrc: 5/0,1 mode: --/EX res: [0x240000401:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d796c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.471142:0:9413:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7965 lrc: 5/0,1 mode: --/EX res: [0x240000401:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d796c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.471149:0:9413:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7965 lrc: 5/0,1 mode: --/EX res: [0x240000401:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d796c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.471159:0:9413:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7965 lrc: 5/0,1 mode: EX/EX res: [0x240000401:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d796c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.471164:0:9413:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7965 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d796c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.471170:0:9413:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7965 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d796c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.471246:0:9413:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff880093bfc6c0) 00000100:00100000:0.0:1715330285.471278:0:9413:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d61c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:7121:x1798653942423616:12345-0@lo:105: Request processed in 151us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.471283:0:9413:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1107 00010000:00010000:1.0:1715330285.471336:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7965 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d796c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.471347:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7965 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d796c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330285.471873:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091eaea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942423680:0@lo:403:mdt00_002.0 00000100:00100000:1.0:1715330285.471901:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330285.471910:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1715330285.471932:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942423680 00000100:00100000:1.0:1715330285.471934:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942423680 00000100:00100000:1.0:1715330285.471949:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2402 00000100:00100000:1.0:1715330285.471952:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7135:x1798653942423680:12345-0@lo:403:mdt00_002.0 00000100:00100000:1.0:1715330285.473244:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7135:x1798653942423680:12345-0@lo:403:mdt00_002.0 Request processed in 1288us (1339us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.473252:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2402 00000100:00100000:1.0:1715330285.473293:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091eaea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942423680:0@lo:403:mdt00_002.0 00000040:00080000:1.0:1715330285.474031:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].347, 664 off532784 00000040:00080000:1.0:1715330285.474133:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].346, 744 off572616 00000004:00080000:1.0:1715330285.474137:0:7135:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88012f47ed80 with version 658 00000100:00100000:1.0:1715330285.474872:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942423808 00000100:00100000:1.0:1715330285.474877:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942423808 00000004:00200000:1.0:1715330285.480306:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x150c:0x0]: returning size 4096 00010000:00010000:1.0:1715330285.480327:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66d795e lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.480335:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66d795e lrc: 2/0,0 mode: EX/EX res: [0x200000400:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.480342:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66d795e lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.480350:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfe1c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330285.480354:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66d795e lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.480360:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66d795e lrc: 4/0,0 mode: EX/EX res: [0x200000400:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.480372:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xc4:0x0].0x0 (ffff88008d4e1000) 00010000:00010000:1.0:1715330285.480374:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330285.480377:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66d795e lrc: 2/0,0 mode: --/EX res: [0x200000400:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.480382:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66d795e lrc: 0/0,0 mode: --/EX res: [0x200000400:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.480392:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7965 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d796c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.480398:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7965 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d796c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.480403:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7965 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d796c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.480422:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1715330285.480429:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0xc4:0x0] 00010000:00010000:1.0:1715330285.480434:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfed00/0xd895711d66d7957 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x150c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.480438:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfed00/0xd895711d66d7957 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x150c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.480447:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfed00/0xd895711d66d7957 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x150c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.480451:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfed00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330285.480453:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfed00/0xd895711d66d7957 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x150c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.480457:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfed00/0xd895711d66d7957 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x150c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.480463:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x150c:0x0].0x0 (ffff88008d4e1600) 00010000:00010000:1.0:1715330285.480465:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330285.480467:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfed00/0xd895711d66d7957 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x150c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.480471:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfed00/0xd895711d66d7957 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x150c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.480479:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcfc0/0xd895711d66d7949 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x150c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7950 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.480484:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcfc0/0xd895711d66d7949 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x150c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d7950 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.480490:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcfc0/0xd895711d66d7949 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x150c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d7950 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.480501:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:1.0:1715330285.480627:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:1.0:1715330285.480631:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd440/0xd895711d66d792d lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7934 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.480642:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd440/0xd895711d66d792d lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d7934 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.480647:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd440/0xd895711d66d792d lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d7934 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.480657:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000004:00080000:1.0:1715330285.480659:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:1.0:1715330285.480663:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff180/0xd895711d66d793b lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7942 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.480669:0:7135:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff180/0xd895711d66d793b lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7942 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330285.480721:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801345a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:16859:x1798653938013120:12345-192.168.204.49@tcp:36:rmdir.0 Request processed in 22871us (24943us total) trans 4294983395 rc 0/0 00000100:00100000:1.0:1715330285.480741:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23250 00010000:00010000:1.0:1715330285.480756:0:7124:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1715330285.480761:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7965 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d796c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.480767:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfc6c0 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330285.480771:0:7124:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7965 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d796c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330285.480777:0:7124:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7965 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d796c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.480804:0:7124:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7965 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d796c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.480809:0:7124:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330285.480824:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7965 lrc: 1/0,0 mode: --/EX res: [0x240000401:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d796c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.480830:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7965 lrc: 0/0,0 mode: --/EX res: [0x240000401:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d796c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.480840:0:7124:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1715330285.480842:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcfc0/0xd895711d66d7949 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x150c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d7950 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.480846:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfcfc0 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330285.480848:0:7124:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcfc0/0xd895711d66d7949 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x150c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d7950 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330285.480854:0:7124:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcfc0/0xd895711d66d7949 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x150c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d7950 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.480864:0:7124:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcfc0/0xd895711d66d7949 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x150c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7950 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.480868:0:7124:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330285.480876:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcfc0/0xd895711d66d7949 lrc: 1/0,0 mode: --/EX res: [0x200000402:0x150c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7950 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.480882:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcfc0/0xd895711d66d7949 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x150c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7950 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.480893:0:7124:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715330285.480895:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd440/0xd895711d66d792d lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d7934 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.480900:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfd440 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330285.480902:0:7124:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd440/0xd895711d66d792d lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d7934 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330285.480908:0:7124:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd440/0xd895711d66d792d lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d7934 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.480917:0:7124:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd440/0xd895711d66d792d lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7934 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.480921:0:7124:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330285.480925:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd440/0xd895711d66d792d lrc: 1/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7934 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.480930:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd440/0xd895711d66d792d lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7934 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.480937:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330285.480939:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330285.480940:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330285.480949:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942423936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330285.480977:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330285.480992:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1715330285.480996:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942424000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330285.481010:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330285.481025:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942423936 00000100:00100000:1.0:1715330285.481029:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942423936 00000100:00100000:1.0:1715330285.481049:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942424000 00000100:00100000:1.0:1715330285.481051:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942424000 00000100:00100000:1.0:1715330285.481060:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1240 00000100:00100000:1.0:1715330285.481064:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+11:3690:x1798653942423936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330285.481072:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330285.481083:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc000/0xd895711d66d7950 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x150c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d7949 expref: 11 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.481091:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x150c:0x0].0x0 (ffff88009d618100) 00010000:00010000:1.0:1715330285.481096:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330285.481113:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+10:3690:x1798653942423936:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.481118:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1240 00000100:00100000:1.0:1715330285.481126:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1241 00000100:00100000:1.0:1715330285.481129:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+9:3690:x1798653942424000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330285.481134:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330285.481141:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c000/0xd895711d66d7934 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d792d expref: 9 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.481149:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88009ef18e00) 00010000:00010000:1.0:1715330285.481153:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330285.481164:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+8:3690:x1798653942424000:12345-0@lo:103:ldlm_bl.0 Request processed in 34us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.481169:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1241 00000100:00100000:1.0:1715330285.481188:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942424000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330285.481195:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942423936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330285.500957:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938013312 00000100:00100000:1.0:1715330285.500966:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938013312 00000100:00100000:1.0:1715330285.501011:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23251 00000100:00100000:1.0:1715330285.501018:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091eaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:16860:x1798653938013312:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:1.0:1715330285.501038:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330285.501053:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d7973 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb3f3 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.501102:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d797a lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.501112:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d797a lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.501121:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d797a lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.501130:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d7981 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x814526f0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.501135:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d7981 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.501139:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d7981 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.501173:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d797a lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.501178:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d797a lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.501187:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d797a lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.501192:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d797a lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.501196:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfc480 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330285.501200:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d797a lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.501205:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d797a lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.501213:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88009d618300) 00010000:00010000:1.0:1715330285.501216:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330285.501219:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d797a lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.501223:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d797a lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.501234:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d7981 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.501239:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d7981 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.501243:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d7981 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.501247:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bffcc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330285.501249:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d7981 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.501257:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d7981 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.501262:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x814526f0 (ffff88009d618000) 00010000:00010000:1.0:1715330285.501264:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330285.501266:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d7981 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x814526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.501270:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d7981 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x814526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.501293:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d7973 lrc: 1/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb3f3 expref: 18 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.501300:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d7973 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb3f3 expref: 18 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.501307:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfc900, rc 0) 00000100:00100000:1.0:1715330285.501354:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091eaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:16860:x1798653938013312:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 336us (2092us total) trans 0 rc 301/301 00000100:00100000:1.0:1715330285.501360:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23251 00000100:00100000:0.0:1715330285.507079:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330285.512435:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330285.512530:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938013504 00000100:00100000:1.0:1715330285.512538:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938013504 00000100:00100000:1.0:1715330285.512595:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23253 00000100:00100000:1.0:1715330285.512602:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f4b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+7:16860:x1798653938013504:12345-192.168.204.49@tcp:36:lfs.0 00000100:00100000:1.0:1715330285.512690:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942424064:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330285.512757:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330285.512771:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330285.512859:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942424064 00000100:00100000:0.0:1715330285.512862:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942424064 00000100:00100000:0.0:1715330285.512892:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2404 00000100:00100000:0.0:1715330285.512896:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7135:x1798653942424064:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1715330285.512951:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7135:x1798653942424064:12345-0@lo:1000:mdt00_002.0 Request processed in 54us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.512956:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2404 00000100:00100000:1.0:1715330285.513069:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942424064:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330285.513104:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942424128:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330285.513122:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330285.513130:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330285.513371:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942424128:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1715330285.513406:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfe880/0xd895711d66d7996 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.513414:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfe880/0xd895711d66d7996 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.513422:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfe880/0xd895711d66d7996 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT1 00000100:00100000:1.0:1715330285.513430:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942424192:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1715330285.513447:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330285.513455:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47e180 going to sleep for 11 seconds 00000100:00100000:0.0:1715330285.513499:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942424192 00000100:00100000:0.0:1715330285.513502:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942424192 00000100:00100000:0.0:1715330285.513517:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2406 00000100:00100000:0.0:1715330285.513520:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7135:x1798653942424192:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330285.513527:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330285.513539:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d799d lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d7996 expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.513555:0:9407:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff840/0xd895711d66d77e4 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb3a6 expref: 16 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.513575:0:9407:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d799d lrc: 4/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d7996 expref: 10 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.513593:0:9407:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff840/0xd895711d66d77e4 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb3a6 expref: 16 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.513603:0:9407:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff840/0xd895711d66d77e4 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb3a6 expref: 16 pid: 7135 timeout: 359 lvb_type: 0 00000100:00100000:0.0:1715330285.513612:0:9407:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b4c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:9407:1798653942424256:192.168.204.49@tcp:104: 00000100:00100000:0.0:1715330285.513656:0:9407:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa480 going to sleep for 11 seconds 00000100:00100000:0.0:1715330285.518949:0:9407:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b4c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:9407:1798653942424256:192.168.204.49@tcp:104: 00010000:00010000:0.0:1715330285.518973:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d799d lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7996 expref: 10 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.518984:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88009d618300) 00010000:00010000:0.0:1715330285.518986:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330285.518989:0:9407:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d799d lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7996 expref: 10 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.518996:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f2640, rc 0) 00000100:00100000:0.0:1715330285.519044:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:7135:x1798653942424192:12345-0@lo:101:mdt00_002.0 Request processed in 5522us (5594us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.519054:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2406 00000100:00100000:1.0:1715330285.519201:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938013568 00000100:00100000:1.0:1715330285.519207:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938013568 00010000:00010000:1.0:1715330285.519225:0:7122:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff840/0xd895711d66d77e4 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb3a6 expref: 17 pid: 7135 timeout: 359 lvb_type: 0 00000100:00100000:1.0:1715330285.519244:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1459 00000100:00100000:1.0:1715330285.519249:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079f3b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:2012:x1798653938013568:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1715330285.519259:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330285.519263:0:7122:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff840/0xd895711d66d77e4 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb3a6 expref: 17 pid: 7135 timeout: 359 lvb_type: 0 00010000:00010000:1.0:1715330285.519271:0:7122:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff840/0xd895711d66d77e4 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb3a6 expref: 17 pid: 7135 timeout: 359 lvb_type: 0 00010000:00010000:1.0:1715330285.519287:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff840/0xd895711d66d77e4 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb3a6 expref: 17 pid: 7135 timeout: 359 lvb_type: 0 00010000:00010000:1.0:1715330285.519301:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88009d618300) 00010000:00010000:1.0:1715330285.519305:0:7122:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d799d lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7996 expref: 9 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.519312:0:7122:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d799d lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d7996 expref: 9 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.519318:0:7122:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d799d lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d7996 expref: 9 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.519339:0:7122:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d799d lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7996 expref: 9 pid: 9407 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330285.519349:0:7122:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:7122:1798653942424320:0@lo:105: 00000100:00100000:1.0:1715330285.519376:0:7122:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330285.519386:0:7122:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330285.519437:0:9413:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942424320 00000100:00100000:0.0:1715330285.519440:0:9413:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942424320 00000100:00100000:0.0:1715330285.519456:0:9413:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1108 00000100:00100000:0.0:1715330285.519460:0:9413:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:7122:x1798653942424320:12345-0@lo:105: 00010000:00010000:0.0:1715330285.519466:0:9413:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfe880/0xd895711d66d7996 lrc: 5/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d799d expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.519474:0:9413:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfe880/0xd895711d66d7996 lrc: 5/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d799d expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.519480:0:9413:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfe880/0xd895711d66d7996 lrc: 5/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d799d expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.519485:0:9413:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfe880/0xd895711d66d7996 lrc: 5/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d799d expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.519491:0:9413:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfe880/0xd895711d66d7996 lrc: 6/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d799d expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.519497:0:9413:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfe880/0xd895711d66d7996 lrc: 6/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d799d expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.519506:0:9413:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff880093bfe880) 00000100:00100000:0.0:1715330285.519537:0:9413:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:7122:x1798653942424320:12345-0@lo:105: Request processed in 75us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.519542:0:9413:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1108 00000100:00100000:0.0:1715330285.519722:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942424384 00000100:00100000:0.0:1715330285.519725:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942424384 00000100:00100000:0.0:1715330285.519752:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2407 00000100:00100000:0.0:1715330285.519756:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d61ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:7135:x1798653942424384:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330285.519768:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330285.519778:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d79ab lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x814526f0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d79a4 expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.519790:0:9407:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d79ab lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d79a4 expref: 11 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.519798:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d79ab lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d79a4 expref: 11 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.519804:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x814526f0 (ffff88009b985600) 00010000:00010000:0.0:1715330285.519806:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330285.519808:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f1d40, rc 0) 00000100:00100000:0.0:1715330285.519824:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d61ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:7135:x1798653942424384:12345-0@lo:101:mdt00_002.0 Request processed in 68us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.519828:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2407 00000100:00100000:1.0:1715330285.520524:0:7122:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:7122:1798653942424320:0@lo:105: 00010000:00010000:1.0:1715330285.520533:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330285.520591:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079f3b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72de1896-1df4-4b3a-930a-9116d2c66168+16:2012:x1798653938013568:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 1310us (1710us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.520598:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1459 00000004:00080000:0.0:1715330285.523639:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 709 rpc_version 709 00000020:00100000:0.0:1715330285.523664:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1715330285.523670:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88009b4c2a00 x1798653942424832/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715330285.523684:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b4c2a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942424832:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330285.523718:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330285.523754:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa480 going to sleep for 11 seconds 00000100:00100000:1.0:1715330285.524328:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b4c2a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942424832:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330285.525306:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7b4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942424896:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330285.525316:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f180/0xd895711d66d79c0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d79c7 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.525324:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f180/0xd895711d66d79c0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d79c7 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330285.525337:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012f4b0e00 reply state ffff88009aea0000 transno 4294968341 ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e1c0/0xd895711d66d79b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330285.525344:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e1c0/0xd895711d66d79b9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330285.525349:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc2:0x0].0x0 (ffff88009ef18100) 00010000:00010000:0.0:1715330285.525351:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330285.525354:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1715330285.525358:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f180/0xd895711d66d79c0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d79c7 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.525364:0:7135:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f180/0xd895711d66d79c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d79c7 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1715330285.525371:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000401:0xc2:0x0] 00000004:00010000:0.0:1715330285.525375:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012f4b0e00 reply state ffff88009aea0000 transno 4294968341 ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c000/0xd895711d66d79b2 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330285.525380:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c000/0xd895711d66d79b2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330285.525384:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x17e:0x0].0x0 (ffff88009ef18b00) 00010000:00010000:0.0:1715330285.525386:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330285.525388:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1715330285.525391:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x17e:0x0]: returning size 4096 00000004:00080000:0.0:1715330285.525396:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:0.0:1715330285.525401:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfe880/0xd895711d66d7996 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d799d expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.525408:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfe880/0xd895711d66d7996 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d799d expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.525414:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfe880/0xd895711d66d7996 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d799d expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.525435:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1715330285.525438:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:0.0:1715330285.525442:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d79a4 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d79ab expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.525448:0:7135:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d79a4 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d79ab expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330285.526199:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f4b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+9:16860:x1798653938013504:12345-192.168.204.49@tcp:36:lfs.0 Request processed in 13595us (13769us total) trans 4294968341 rc 0/0 00000100:00100000:0.0:1715330285.526206:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23253 00000100:00100000:1.0:1715330285.526458:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942424960 00000100:00100000:1.0:1715330285.526463:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942424960 00000100:00100000:1.0:1715330285.526489:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1243 00000100:00100000:1.0:1715330285.526493:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+13:3688:x1798653942424960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330285.526500:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330285.526510:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d799d lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d7996 expref: 13 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.526521:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88009d618300) 00010000:00010000:1.0:1715330285.526630:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330285.526820:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942424960:12345-0@lo:103:ldlm_bl.0 Request processed in 326us (1162us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.526826:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1243 00000100:00100000:0.0:1715330285.535724:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938013696 00000100:00100000:0.0:1715330285.535756:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938013696 00000100:00100000:1.0:1715330285.535832:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23254 00000100:00100000:1.0:1715330285.535840:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+16:16861:x1798653938013696:12345-192.168.204.49@tcp:36:mkdir.0 00000100:00100000:1.0:1715330285.535967:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+16:16861:x1798653938013696:12345-192.168.204.49@tcp:36:mkdir.0 Request processed in 127us (311us total) trans 0 rc -17/-17 00000100:00100000:1.0:1715330285.535974:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23254 00000100:00100000:0.0:1715330285.548352:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330285.548659:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938013760 00000100:00100000:1.0:1715330285.548668:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938013760 00000100:00100000:1.0:1715330285.548714:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23255 00000100:00100000:1.0:1715330285.548720:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+16:16862:x1798653938013760:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:1.0:1715330285.548755:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330285.548771:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe880/0xd895711d66d79ce lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb401 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.548816:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d79d5 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.548829:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d79d5 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.548837:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d79d5 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.548844:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66d79dc lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x814526f0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.548850:0:7135:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d79ab lrc: 2/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d79a4 expref: 11 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.548856:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66d79dc lrc: 4/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x814526f0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.548878:0:7135:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d79ab lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd895711d66d79a4 expref: 11 pid: 9407 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330285.548889:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801345a7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7135:1798653942425024:0@lo:104: 00000100:00100000:1.0:1715330285.548921:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330285.548934:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1715330285.548955:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942425024 00000100:00100000:1.0:1715330285.548958:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942425024 00000100:00100000:1.0:1715330285.548977:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1109 00000100:00100000:1.0:1715330285.548981:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:7135:x1798653942425024:12345-0@lo:104: 00010000:00010000:1.0:1715330285.548988:0:7118:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d79a4 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d79ab expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.549015:0:7118:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1715330285.549019:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:7135:x1798653942425024:12345-0@lo:104: Request processed in 38us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.549024:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1109 00010000:00010000:1.0:1715330285.549037:0:7124:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715330285.549041:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d79a4 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d79ab expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.549046:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66d00 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330285.549051:0:7124:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d79a4 lrc: 4/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f0 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd895711d66d79ab expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330285.549057:0:7124:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d79a4 lrc: 4/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f0 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd895711d66d79ab expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.549073:0:7124:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d79a4 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x814526f0 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d79ab expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.549077:0:7124:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330285.549089:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d79a4 lrc: 1/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x814526f0 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d79ab expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.549094:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d79a4 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x814526f0 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d79ab expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.549109:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330285.549110:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330285.549111:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330285.549126:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801345a7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7135:1798653942425024:0@lo:104: 00010000:00010000:1.0:1715330285.549138:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66d79dc lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x814526f0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000100:00100000:1.0:1715330285.549177:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942425088:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330285.549199:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330285.549223:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942425088 00000100:00100000:1.0:1715330285.549226:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942425088 00010000:00010000:1.0:1715330285.549237:0:7122:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d79ab lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd895711d66d79a4 expref: 12 pid: 9407 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330285.549251:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1460 00000100:00100000:1.0:1715330285.549255:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801345a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+12:3689:x1798653942425088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330285.549263:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330285.555909:0:7116:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff180/0xd895711d66d793b lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d7942 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330285.555923:0:7116:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff180/0xd895711d66d793b lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d7942 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.555955:0:7116:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff180/0xd895711d66d793b lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x814526ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7942 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.555960:0:7116:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330285.555989:0:7116:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff180/0xd895711d66d793b lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x814526ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7942 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1715330285.556005:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983396 is committed 00000001:00080000:1.0:1715330285.556026:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983395 is committed 00000020:00080000:1.0:1715330285.556033:0:7116:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 360 batchid updated 00000020:00080000:1.0:1715330285.556042:0:7116:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8800b43330c0 refcount 2 committed 0 result 0 batchid 361 00000020:00080000:1.0:1715330285.556045:0:7116:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008d4e1b00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8800b4333840 00000020:00080000:1.0:1715330285.556048:0:7116:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].345 00000020:00080000:1.0:1715330285.556050:0:7116:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008d4e1100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88006eff6000 00000020:00080000:1.0:1715330285.556052:0:7116:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].346 00000020:00080000:1.0:1715330285.556060:0:7116:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 359 batchid updated 00000020:00080000:1.0:1715330285.556074:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 361 committed batchid 360 00000004:00080000:1.0:1715330285.556154:0:7163:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88012f47ec00 with version 659 00000020:00080000:1.0:1715330285.556160:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 359 cancel update log [0x240000401:0x3:0x0].343: rc = 0 00000020:00080000:1.0:1715330285.556188:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 359 cancel update log [0x200000400:0x3:0x0].344: rc = 0 00000004:00080000:1.0:1715330285.556200:0:7163:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88012f47ea80 with version 660 00000020:00080000:1.0:1715330285.556202:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 360 cancel update log [0x240000401:0x3:0x0].344: rc = 0 00000020:00080000:1.0:1715330285.556212:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 360 cancel update log [0x200000400:0x3:0x0].345: rc = 0 00000020:00080000:1.0:1715330285.556217:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 360 00010000:00010000:1.0:1715330285.556256:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d79ab lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x814526f0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd895711d66d79a4 expref: 7 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.556265:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x814526f0 (ffff88009b985600) 00010000:00010000:1.0:1715330285.556268:0:7122:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66d79dc lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x814526f0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.556276:0:7122:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66d79dc lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.556281:0:7122:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66d79dc lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.556295:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330285.556324:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801345a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+6:3689:x1798653942425088:12345-0@lo:103:ldlm_bl.0 Request processed in 7067us (7123us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.556332:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1460 00000100:00100000:1.0:1715330285.556347:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942425152 00000100:00100000:1.0:1715330285.556352:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942425152 00000100:00100000:1.0:1715330285.556382:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1244 00000100:00100000:1.0:1715330285.556387:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+7:3691:x1798653942425152:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:1.0:1715330285.556395:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330285.556404:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d7942 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x814526ef bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d793b expref: 7 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.556413:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x814526ef (ffff88009d618700) 00010000:00010000:1.0:1715330285.556418:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330285.556436:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+6:3691:x1798653942425152:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 49us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.556441:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1244 00000100:00100000:1.0:1715330285.556467:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942425088:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330285.556486:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66d79dc lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.556491:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66d79dc lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000100:00100000:1.0:1715330285.556543:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942425344:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330285.556575:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330285.556584:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330285.556593:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942425280 00000100:00100000:1.0:1715330285.556595:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942425280 00000100:00100000:1.0:1715330285.556610:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942425344 00000100:00100000:1.0:1715330285.556611:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942425344 00000100:00100000:1.0:1715330285.556620:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2415 00000100:00100000:1.0:1715330285.556624:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:8587:x1798653942425280:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330285.556701:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:8587:x1798653942425280:12345-0@lo:1000:osp_up1-0.0 Request processed in 75us (269us total) trans 4294968342 rc 0/0 00000100:00100000:1.0:1715330285.556707:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2415 00000100:00100000:1.0:1715330285.556715:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2416 00000100:00100000:1.0:1715330285.556719:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7135:x1798653942425344:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330285.556764:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7135:x1798653942425344:12345-0@lo:1000:mdt00_002.0 Request processed in 44us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.556770:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2416 00000100:00100000:1.0:1715330285.556788:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942425344:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330285.556799:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942425472 00000100:00100000:1.0:1715330285.556801:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942425472 00000100:00100000:1.0:1715330285.557579:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2417 00000100:00100000:1.0:1715330285.557584:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:8587:x1798653942425472:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330285.558748:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:8587:x1798653942425472:12345-0@lo:1000:osp_up1-0.0 Request processed in 1162us (1962us total) trans 4294968343 rc 0/0 00000100:00100000:1.0:1715330285.558755:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2417 00010000:00010000:1.0:1715330285.558796:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcb40/0xd895711d66d79e3 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x17e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.558804:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcb40/0xd895711d66d79e3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x17e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.558811:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcb40/0xd895711d66d79e3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x17e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00010000:1.0:1715330285.558827:0:7135:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcb40/0xd895711d66d79e3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x17e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.558837:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d79d5 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.558845:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d79d5 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.558849:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d79d5 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.558854:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d79d5 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.558858:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfdd40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330285.558861:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d79d5 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.558866:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d79d5 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.559054:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88009d618c00) 00010000:00010000:1.0:1715330285.559057:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330285.559061:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d79d5 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.559066:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d79d5 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.559075:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66d79dc lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.559080:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66d79dc lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.559084:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66d79dc lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.559088:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bff600 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330285.559091:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66d79dc lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.559096:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66d79dc lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.559102:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x814526f0 (ffff88009b985600) 00010000:00010000:1.0:1715330285.559105:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330285.559107:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66d79dc lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x814526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.559111:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66d79dc lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x814526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.559138:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe880/0xd895711d66d79ce lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb401 expref: 15 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.559149:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcb40/0xd895711d66d79e3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x17e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb401 expref: 14 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.559155:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x17e:0x0].0x0 (ffff88009d618f00) 00010000:00010000:1.0:1715330285.559157:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1715330285.559159:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfcb40, rc 0) 00000100:00100000:1.0:1715330285.559190:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+14:16862:x1798653938013760:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 10470us (10846us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.559195:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23255 00000100:00100000:0.0:1715330285.564309:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330285.564408:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938013824 00000100:00100000:1.0:1715330285.564415:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938013824 00000100:00100000:1.0:1715330285.564457:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23256 00000100:00100000:1.0:1715330285.564464:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+9:16862:x1798653938013824:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:1.0:1715330285.564484:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330285.564499:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe400/0xd895711d66d79ea lrc: 2/0,0 mode: --/CR res: [0x240000402:0x17e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb408 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.564542:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d79f1 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x17e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.564552:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d79f1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x17e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.564576:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d79f1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x17e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000004:00200000:1.0:1715330285.564671:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x17e:0x0]: returning size 4096 00000004:00200000:1.0:1715330285.564675:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1715330285.564701:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe400/0xd895711d66d79ea lrc: 0/0,0 mode: --/CR res: [0x240000402:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb408 expref: 11 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.564712:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d79f1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x17e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb408 expref: 10 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.564719:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x17e:0x0].0x0 (ffff88009ef18b00) 00010000:00010000:1.0:1715330285.564722:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1715330285.564724:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfcd80, rc 0) 00000100:00100000:1.0:1715330285.564788:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+10:16862:x1798653938013824:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 324us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.564795:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23256 00000100:00100000:1.0:1715330285.573525:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938013888 00000100:00100000:1.0:1715330285.573533:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938013888 00000100:00100000:1.0:1715330285.573595:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23257 00000100:00100000:1.0:1715330285.573603:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+10:16862:x1798653938013888:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:1.0:1715330285.573618:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330285.573635:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d79f8 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xc2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb40f expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.573677:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff840/0xd895711d66d79ff lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.573687:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff840/0xd895711d66d79ff lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.573696:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff840/0xd895711d66d79ff lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000004:00200000:1.0:1715330285.573748:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000400:0xc2:0x0]: returning size 4096 00000004:00200000:1.0:1715330285.573751:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1715330285.573780:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d79f8 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xc2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb40f expref: 12 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.573795:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff840/0xd895711d66d79ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb40f expref: 11 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.573812:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc2:0x0].0x0 (ffff88009ef18100) 00010000:00010000:1.0:1715330285.573815:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1715330285.573817:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bff840, rc 0) 00000100:00100000:1.0:1715330285.573861:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+11:16862:x1798653938013888:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 258us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.573867:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23257 00000100:00100000:0.0:1715330285.576358:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330285.577612:0:9413:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942425536 00000100:00100000:0.0:1715330285.577620:0:9413:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942425536 00000100:00100000:0.0:1715330285.577662:0:9413:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1110 00000100:00100000:0.0:1715330285.577668:0:9413:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:7134:x1798653942425536:12345-0@lo:104: 00010000:00010000:0.0:1715330285.577681:0:9413:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f180/0xd895711d66d79c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d79c7 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.577905:0:9413:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1715330285.577910:0:9413:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:7134:x1798653942425536:12345-0@lo:104: Request processed in 243us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.577918:0:9413:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1110 00000020:00080000:0.0:1715330285.582361:0:7116:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 361 batchid updated 00000020:00080000:1.0:1715330285.582446:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 361 00000004:00080000:1.0:1715330285.582499:0:7163:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88012f47e000 with version 661 00000020:00080000:1.0:1715330285.582514:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 361 cancel update log [0x240000401:0x3:0x0].345: rc = 0 00000020:00080000:1.0:1715330285.582588:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 361 cancel update log [0x200000400:0x3:0x0].346: rc = 0 00000020:00080000:1.0:1715330285.582595:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 361 00000004:00080000:0.0:1715330285.582688:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 661 rpc_version 661 00000020:00100000:0.0:1715330285.582720:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1715330285.582728:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88009b4c0000 x1798653942425728/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715330285.582761:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b4c0000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942425728:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330285.582815:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330285.582843:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa240 going to sleep for 11 seconds 00000100:00100000:0.0:1715330285.582880:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942425600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330285.582936:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942425728 00000100:00100000:1.0:1715330285.582942:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942425728 00000100:00100000:1.0:1715330285.582973:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2418 00000100:00100000:1.0:1715330285.582978:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:8587:x1798653942425728:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330285.583834:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:8587:x1798653942425728:12345-0@lo:1000:osp_up1-0.0 Request processed in 853us (1017us total) trans 4294968344 rc 0/0 00000100:00100000:1.0:1715330285.583844:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2418 00000100:00100000:0.0:1715330285.583934:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b4c0000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942425728:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330285.588941:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330285.588989:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330285.590190:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942425792 00000100:00100000:1.0:1715330285.590194:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942425792 00000100:00100000:1.0:1715330285.590214:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2419 00000100:00100000:1.0:1715330285.590219:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:7134:x1798653942425792:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330285.590228:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330285.590242:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d7a1b lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d7a14 expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.590845:0:23404:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d7a1b lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d7a14 expref: 6 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.590856:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d7a1b lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7a14 expref: 6 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.590861:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88009d618100) 00010000:00010000:1.0:1715330285.590864:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330285.590866:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfc900, rc 0) 00000100:00100000:1.0:1715330285.590952:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:7134:x1798653942425792:12345-0@lo:101:mdt00_001.0 Request processed in 732us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.590964:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2419 00000020:00080000:0.0:1715330285.591274:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 368 committed batchid 367 00000020:00080000:0.0:1715330285.591330:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 367 00000100:00100000:1.0:1715330285.591518:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942425856 00000100:00100000:1.0:1715330285.591522:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942425856 00000100:00100000:1.0:1715330285.591548:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2420 00000100:00100000:1.0:1715330285.591553:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:7134:x1798653942425856:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330285.591581:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330285.591591:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d7a29 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x814526f0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d7a22 expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.591602:0:23404:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d7a29 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d7a22 expref: 7 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.591609:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d7a29 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7a22 expref: 7 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.591614:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x814526f0 (ffff88009d618300) 00010000:00010000:1.0:1715330285.591621:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330285.591623:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bffcc0, rc 0) 00000100:00100000:1.0:1715330285.591646:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7134:x1798653942425856:12345-0@lo:101:mdt00_001.0 Request processed in 93us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.591651:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2420 00000100:00100000:1.0:1715330285.591863:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942425920 00000100:00100000:1.0:1715330285.591866:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942425920 00000100:00100000:1.0:1715330285.591883:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2421 00000100:00100000:1.0:1715330285.591886:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7134:x1798653942425920:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330285.591941:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7134:x1798653942425920:12345-0@lo:1000:mdt00_001.0 Request processed in 53us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.591949:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2421 00000100:00100000:1.0:1715330285.592003:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942425984 00000100:00100000:1.0:1715330285.592005:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942425984 00000100:00100000:1.0:1715330285.592023:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2422 00000100:00100000:1.0:1715330285.592026:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7134:x1798653942425984:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330285.592087:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7134:x1798653942425984:12345-0@lo:1000:mdt00_001.0 Request processed in 59us (93us total) trans 0 rc 1/1 00000100:00100000:1.0:1715330285.592091:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2422 00000100:00100000:1.0:1715330285.592163:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942426048 00000100:00100000:1.0:1715330285.592165:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942426048 00000100:00100000:1.0:1715330285.592176:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2423 00000100:00100000:1.0:1715330285.592179:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7134:x1798653942426048:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330285.592185:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330285.592192:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d7a37 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x17e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d7a30 expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.592202:0:23404:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d7a37 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x17e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d7a30 expref: 8 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.592208:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d7a37 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x17e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7a30 expref: 8 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.592220:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x17e:0x0].0x0 (ffff88009d618d00) 00010000:00010000:1.0:1715330285.592222:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1715330285.592224:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfc480, rc 0) 00000100:00100000:1.0:1715330285.592245:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:7134:x1798653942426048:12345-0@lo:101:mdt00_001.0 Request processed in 65us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.592253:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2423 00000100:00100000:1.0:1715330285.600719:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330285.601837:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942426176 00000100:00100000:1.0:1715330285.601845:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942426176 00000100:00100000:1.0:1715330285.602524:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2424 00000100:00100000:1.0:1715330285.602531:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:7134:x1798653942426176:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330285.602547:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330285.602574:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc000/0xd895711d66d7a53 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d7a4c expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.602596:0:23404:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457dd40/0xd895711d66d7a0d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb416 expref: 13 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.602603:0:23404:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc000/0xd895711d66d7a53 lrc: 4/0,0 mode: --/EX res: [0x200000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d7a4c expref: 9 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.602625:0:23404:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013457dd40/0xd895711d66d7a0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb416 expref: 13 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.602634:0:23404:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457dd40/0xd895711d66d7a0d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb416 expref: 13 pid: 7134 timeout: 360 lvb_type: 0 00000100:00100000:1.0:1715330285.602645:0:23404:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:23404:1798653942426240:192.168.204.49@tcp:104: 00000100:00100000:1.0:1715330285.602687:0:23404:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47e180 going to sleep for 11 seconds 00000100:00100000:0.0:1715330285.605981:0:23404:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:23404:1798653942426240:192.168.204.49@tcp:104: 00010000:00010000:0.0:1715330285.606005:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc000/0xd895711d66d7a53 lrc: 3/0,0 mode: --/EX res: [0x200000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7a4c expref: 9 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.606016:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2:0x0].0x0 (ffff8800b4184800) 00010000:00010000:0.0:1715330285.606018:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715330285.606020:0:23404:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc000/0xd895711d66d7a53 lrc: 3/0,0 mode: --/EX res: [0x200000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7a4c expref: 9 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.606028:0:23404:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc000/0xd895711d66d7a53 lrc: 3/0,0 mode: --/EX res: [0x200000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7a4c expref: 9 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.606033:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfc000, rc 0) 00000100:00100000:0.0:1715330285.606081:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7134:x1798653942426176:12345-0@lo:101:mdt00_001.0 Request processed in 3549us (4268us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.606089:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2424 00000100:00100000:0.0:1715330285.606135:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330285.606465:0:9413:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942426304 00000100:00100000:0.0:1715330285.606468:0:9413:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942426304 00000100:00100000:0.0:1715330285.606493:0:9413:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1111 00000100:00100000:0.0:1715330285.606497:0:9413:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:7121:x1798653942426304:12345-0@lo:105: 00010000:00010000:0.0:1715330285.606504:0:9413:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66400/0xd895711d66d7a4c lrc: 5/0,1 mode: --/EX res: [0x200000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7a53 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.606511:0:9413:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66400/0xd895711d66d7a4c lrc: 5/0,1 mode: --/EX res: [0x200000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7a53 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.606517:0:9413:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66400/0xd895711d66d7a4c lrc: 5/0,1 mode: --/EX res: [0x200000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7a53 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.606523:0:9413:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66400/0xd895711d66d7a4c lrc: 5/0,1 mode: EX/EX res: [0x200000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d7a53 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.606532:0:9413:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66400/0xd895711d66d7a4c lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d7a53 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.606538:0:9413:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66400/0xd895711d66d7a4c lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d7a53 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.606548:0:9413:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88011db66400) 00000100:00100000:0.0:1715330285.606579:0:9413:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:7121:x1798653942426304:12345-0@lo:105: Request processed in 81us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.606584:0:9413:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1111 00000100:00100000:0.0:1715330285.607474:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942426368 00000100:00100000:0.0:1715330285.607477:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942426368 00000100:00100000:0.0:1715330285.607493:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2425 00000100:00100000:0.0:1715330285.607497:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7134:x1798653942426368:12345-0@lo:403:mdt00_001.0 00000100:00100000:0.0:1715330285.608991:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7134:x1798653942426368:12345-0@lo:403:mdt00_001.0 Request processed in 1490us (1596us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.608999:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2425 00000004:00080000:0.0:1715330285.612012:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 710 rpc_version 710 00000020:00100000:0.0:1715330285.612039:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1715330285.612046:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88009b4c1880 x1798653942426496/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1808/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715330285.612064:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b4c1880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942426496:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330285.612108:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330285.612121:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa240 going to sleep for 11 seconds 00000100:00100000:0.0:1715330285.613398:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b4c1880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942426496:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1715330285.613635:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1715330285.613645:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942426560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330285.613672:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330285.613688:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942426624:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330285.613703:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330285.613862:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091c3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942426624:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330285.613901:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942426560:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330285.614210:0:7124:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715330285.614215:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f3c0/0xd895711d66d7a14 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d7a1b expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.614221:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457f3c0 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330285.614225:0:7124:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f3c0/0xd895711d66d7a14 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d7a1b expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330285.614231:0:7124:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f3c0/0xd895711d66d7a14 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d7a1b expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.614246:0:7124:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f3c0/0xd895711d66d7a14 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7a1b expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.614250:0:7124:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330285.614270:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f3c0/0xd895711d66d7a14 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7a1b expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.614276:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f3c0/0xd895711d66d7a14 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7a1b expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.614285:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330285.614286:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330285.614288:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330285.614292:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1715330285.614298:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b4c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942426688:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330285.614317:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330285.614690:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b4c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942426688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330285.627503:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330285.632715:0:7130:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938014400 00000100:00100000:1.0:1715330285.632722:0:7130:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938014400 00000100:00100000:1.0:1715330285.632774:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 327 00000100:00100000:1.0:1715330285.632781:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2014:x1798653938014400:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:1.0:1715330285.632828:0:7130:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2014:x1798653938014400:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 47us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.632834:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 327 00000100:00100000:0.0:1715330285.633195:0:9399:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938014464 00000100:00100000:0.0:1715330285.633199:0:9399:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938014464 00000100:00100000:0.0:1715330285.633229:0:9399:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938014528 00000100:00100000:0.0:1715330285.633231:0:9399:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938014528 00000100:00100000:0.0:1715330285.633243:0:9399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 166 00000100:00100000:0.0:1715330285.633247:0:9399:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72de1896-1df4-4b3a-930a-9116d2c66168+7:2014:x1798653938014464:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:0.0:1715330285.633270:0:9399:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72de1896-1df4-4b3a-930a-9116d2c66168+7:2014:x1798653938014464:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 22us (1250us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.633278:0:9399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 166 00000100:00100000:0.0:1715330285.633286:0:9399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 167 00000100:00100000:0.0:1715330285.633289:0:9399:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938014528:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:0.0:1715330285.633300:0:9399:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938014528:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 11us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.633304:0:9399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 167 00000100:00080000:0.0:1715330285.633313:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330255 00000100:00080000:0.0:1715330285.633315:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330255 00000100:00080000:0.0:1715330285.633317:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330255 00000100:00100000:0.0:1715330285.633350:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330285.633399:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938014592 00000100:00100000:0.0:1715330285.633402:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938014592 00000100:00100000:0.0:1715330285.634384:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23261 00000100:00100000:0.0:1715330285.634389:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+13:16863:x1798653938014592:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:0.0:1715330285.634400:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330285.634416:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d7a6f lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb424 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.634457:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d7a76 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330285.634467:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d7a76 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330285.634475:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d7a76 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00200000:0.0:1715330285.634514:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1715330285.634518:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1715330285.634547:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d7a6f lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb424 expref: 15 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.634569:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d7a76 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb424 expref: 14 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.634794:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88012bd8b800) 00010000:00010000:0.0:1715330285.634798:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1715330285.634800:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f2640, rc 0) 00000100:00100000:0.0:1715330285.634836:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+14:16863:x1798653938014592:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 446us (1485us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.634841:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23261 00000100:00100000:0.0:1715330285.639152:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330285.639317:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938014720 00000100:00100000:0.0:1715330285.639325:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938014720 00000100:00100000:0.0:1715330285.639468:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23262 00000100:00100000:0.0:1715330285.639475:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+14:16863:x1798653938014720:12345-192.168.204.49@tcp:36:lfs.0 00000100:00100000:0.0:1715330285.639622:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013027a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942426752:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1715330285.639667:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330285.639695:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330285.639952:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88013027a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942426752:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1715330285.639985:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013027a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942426816:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1715330285.640001:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330285.640064:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330285.640276:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88013027a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942426816:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1715330285.640314:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f21c0/0xd895711d66d7a7d lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330285.640321:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f21c0/0xd895711d66d7a7d lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330285.640328:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f21c0/0xd895711d66d7a7d lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT0 00000100:00100000:0.0:1715330285.640336:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013027a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942426880:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1715330285.640353:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330285.640376:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa540 going to sleep for 11 seconds 00000100:00100000:0.0:1715330285.642895:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88013027a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942426880:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330285.642906:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f21c0/0xd895711d66d7a7d lrc: 4/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7a84 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.642913:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f21c0/0xd895711d66d7a7d lrc: 4/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7a84 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330285.643471:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330285.644462:0:9413:0:(service.c:168:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1715330285.644471:0:9413:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942427008 00000100:00100000:0.0:1715330285.644474:0:9413:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942427008 00000100:00100000:0.0:1715330285.644501:0:9413:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1112 00000100:00100000:0.0:1715330285.644505:0:9413:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b291050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:10674:x1798653942427008:12345-0@lo:105: 00010000:00010000:0.0:1715330285.644513:0:9413:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f21c0/0xd895711d66d7a7d lrc: 5/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7a84 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.644521:0:9413:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f21c0/0xd895711d66d7a7d lrc: 5/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7a84 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.644532:0:9413:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f21c0/0xd895711d66d7a7d lrc: 5/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7a84 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.644538:0:9413:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f21c0/0xd895711d66d7a7d lrc: 5/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d7a84 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.644543:0:9413:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f21c0/0xd895711d66d7a7d lrc: 6/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d7a84 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.644549:0:9413:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f21c0/0xd895711d66d7a7d lrc: 6/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d7a84 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.644580:0:9413:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8800ad9f21c0) 00000100:00100000:0.0:1715330285.644603:0:9413:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b291050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:10674:x1798653942427008:12345-0@lo:105: Request processed in 97us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.644608:0:9413:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1112 00010000:00010000:1.0:1715330285.644620:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f21c0/0xd895711d66d7a7d lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7a84 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.644628:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f21c0/0xd895711d66d7a7d lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7a84 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330285.644645:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:1.0:1715330285.644665:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc900/0xd895711d66d7a8b lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x814526f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.644671:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc900/0xd895711d66d7a8b lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x814526f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.644678:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc900/0xd895711d66d7a8b lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x814526f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT0 00000100:00100000:1.0:1715330285.644689:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942427072:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1715330285.644716:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330285.644727:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4333c00 going to sleep for 11 seconds 00000004:00080000:0.0:1715330285.646520:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 662 rpc_version 662 00000020:00100000:0.0:1715330285.646540:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1715330285.646546:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88013027b100 x1798653942427520/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715330285.646571:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013027b100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942427520:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330285.646598:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330285.646619:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa240 going to sleep for 11 seconds 00000100:00100000:0.0:1715330285.649119:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942427648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330285.649144:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330285.649783:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942427648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330285.659987:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330285.668323:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330285.669024:0:9413:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942427712 00000100:00100000:0.0:1715330285.669029:0:9413:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942427712 00000100:00100000:0.0:1715330285.669055:0:9413:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1113 00000100:00100000:0.0:1715330285.669059:0:9413:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:7135:x1798653942427712:12345-0@lo:104: 00010000:00010000:0.0:1715330285.669067:0:9413:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc900/0xd895711d66d7a8b lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d7a92 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.669279:0:9413:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1715330285.669285:0:9413:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:7135:x1798653942427712:12345-0@lo:104: Request processed in 225us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.669290:0:9413:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1113 00000100:00100000:0.0:1715330285.669440:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942427776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330285.669463:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1715330285.675170:0:8267:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457d200/0xd895711d66d7a22 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d7a29 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330285.675186:0:8267:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457d200/0xd895711d66d7a22 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d7a29 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.675221:0:8267:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457d200/0xd895711d66d7a22 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x814526f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7a29 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.675226:0:8267:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330285.676071:0:8267:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457d200/0xd895711d66d7a22 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x814526f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7a29 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1715330285.676090:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968346 is committed 00000001:00080000:1.0:1715330285.676115:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968345 is committed 00000020:00080000:1.0:1715330285.676121:0:8267:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0001: 368 batchid updated 00000020:00080000:1.0:1715330285.676134:0:8267:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff880134435c00 refcount 2 committed 0 result 0 batchid 369 00000020:00080000:1.0:1715330285.676138:0:8267:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009ef18d00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880134435d80 00000020:00080000:1.0:1715330285.676140:0:8267:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].371 00000020:00080000:1.0:1715330285.676142:0:8267:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009ef18e00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8801344c6c00 00000020:00080000:1.0:1715330285.676145:0:8267:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].370 00010000:00010000:1.0:1715330285.676162:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c000/0xd895711d66d79b2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.676169:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c000/0xd895711d66d79b2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.676175:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c000/0xd895711d66d79b2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.676180:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457c000 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330285.676183:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c000/0xd895711d66d79b2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.676189:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c000/0xd895711d66d79b2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.676197:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x17e:0x0].0x0 (ffff88009ef18b00) 00010000:00010000:1.0:1715330285.676199:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330285.676202:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c000/0xd895711d66d79b2 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.676206:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c000/0xd895711d66d79b2 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.676216:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e1c0/0xd895711d66d79b9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.676221:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e1c0/0xd895711d66d79b9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.676226:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e1c0/0xd895711d66d79b9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.676230:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457e1c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330285.676232:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e1c0/0xd895711d66d79b9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.676236:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e1c0/0xd895711d66d79b9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.676245:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc2:0x0].0x0 (ffff88009ef18100) 00010000:00010000:1.0:1715330285.676246:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330285.676248:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e1c0/0xd895711d66d79b9 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.676252:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e1c0/0xd895711d66d79b9 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00000020:00080000:0.0:1715330285.676514:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 369 committed batchid 368 00000004:00080000:0.0:1715330285.676821:0:8285:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff880091ffacc0 with version 711 00000020:00080000:0.0:1715330285.676833:0:8285:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 368 cancel update log [0x200000401:0x3:0x0].370: rc = 0 00000020:00080000:0.0:1715330285.676866:0:8285:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 368 cancel update log [0x240000400:0x3:0x0].369: rc = 0 00000020:00080000:0.0:1715330285.676871:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 368 00000100:00100000:0.0:1715330285.676890:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942427776:0@lo:103:ldlm_bl.0 00000004:00080000:1.0:1715330285.676940:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 711 rpc_version 711 00000020:00100000:1.0:1715330285.676954:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1715330285.676961:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008b0c2d80 x1798653942428032/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1715330285.676972:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c2d80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942428032:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1715330285.676995:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330285.677005:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4333780 going to sleep for 11 seconds 00000100:00100000:0.0:1715330285.677272:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c2d80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942428032:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330285.680459:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330285.684256:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330285.686415:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330285.686722:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942428096 00000100:00100000:0.0:1715330285.686725:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942428096 00000100:00100000:0.0:1715330285.686775:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1114 00000100:00100000:0.0:1715330285.686780:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7134:x1798653942428096:12345-0@lo:104: 00010000:00010000:0.0:1715330285.686788:0:7118:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db64d80/0xd895711d66d7aa7 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d7aae expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.686835:0:7118:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1715330285.686840:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7134:x1798653942428096:12345-0@lo:104: Request processed in 60us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.686845:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1114 00000100:00100000:0.0:1715330285.687000:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942428160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330285.687023:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1715330285.688172:0:8267:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0001: 369 batchid updated 00000020:00080000:0.0:1715330285.688216:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 369 00000004:00080000:0.0:1715330285.688257:0:8285:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff880091ffa480 with version 712 00000020:00080000:0.0:1715330285.688269:0:8285:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 369 cancel update log [0x200000401:0x3:0x0].371: rc = 0 00000004:00080000:1.0:1715330285.688284:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 712 rpc_version 712 00000020:00100000:1.0:1715330285.688302:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1715330285.688308:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88009d419180 x1798653942428288/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000020:00080000:0.0:1715330285.688315:0:8285:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 369 cancel update log [0x240000400:0x3:0x0].370: rc = 0 00000100:00100000:1.0:1715330285.688319:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d419180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942428288:0@lo:1000:osp_up0-1.0 00000020:00080000:0.0:1715330285.688320:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 369 00000100:00100000:0.0:1715330285.688338:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091c3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942428160:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330285.688347:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330285.688357:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b43336c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330285.688367:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942428288 00000100:00100000:0.0:1715330285.688370:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942428288 00000100:00100000:0.0:1715330285.688387:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2440 00000100:00100000:0.0:1715330285.688391:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d419880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:8278:x1798653942428288:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330285.688472:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d419880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:8278:x1798653942428288:12345-0@lo:1000:osp_up0-1.0 Request processed in 80us (124us total) trans 4294983400 rc 0/0 00000100:00100000:0.0:1715330285.688478:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2440 00000100:00100000:1.0:1715330285.688498:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d419180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942428288:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330285.692927:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330285.692966:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330285.693518:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942428352 00000100:00100000:0.0:1715330285.693521:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942428352 00000100:00100000:0.0:1715330285.693536:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2441 00000100:00100000:0.0:1715330285.693540:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:7134:x1798653942428352:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330285.693548:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330285.693569:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d7b02 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d7afb expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.693584:0:9407:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d7b02 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d7afb expref: 6 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.693592:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d7b02 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7afb expref: 6 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.693598:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88012bd8b900) 00010000:00010000:0.0:1715330285.693600:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330285.693602:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f1440, rc 0) 00000100:00100000:0.0:1715330285.693622:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7134:x1798653942428352:12345-0@lo:101:mdt00_001.0 Request processed in 81us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.693626:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2441 00000020:00080000:1.0:1715330285.694844:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 362 committed batchid 361 00000020:00080000:1.0:1715330285.694887:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 361 00000100:00100000:0.0:1715330285.695149:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942428416 00000100:00100000:0.0:1715330285.695153:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942428416 00000100:00100000:0.0:1715330285.695217:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2442 00000100:00100000:0.0:1715330285.695222:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7134:x1798653942428416:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330285.695230:0:24873:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330285.695240:0:24873:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f21c0/0xd895711d66d7b10 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x814526f1 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d7b09 expref: -99 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.695252:0:24873:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f21c0/0xd895711d66d7b10 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d7b09 expref: 7 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.695260:0:24873:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f21c0/0xd895711d66d7b10 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7b09 expref: 7 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.695271:0:24873:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x814526f1 (ffff88012bd8b200) 00010000:00010000:0.0:1715330285.695273:0:24873:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330285.695275:0:24873:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f21c0, rc 0) 00000100:00100000:0.0:1715330285.695373:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7134:x1798653942428416:12345-0@lo:101:mdt00_001.0 Request processed in 150us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.695377:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2442 00000100:00100000:0.0:1715330285.695544:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942428480 00000100:00100000:0.0:1715330285.695547:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942428480 00000100:00100000:0.0:1715330285.695641:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2443 00000100:00100000:0.0:1715330285.695644:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7134:x1798653942428480:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330285.695766:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7134:x1798653942428480:12345-0@lo:1000:mdt00_001.0 Request processed in 120us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.695772:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2443 00000100:00100000:1.0:1715330285.696055:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942428544 00000100:00100000:1.0:1715330285.696058:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942428544 00000100:00100000:1.0:1715330285.696147:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2444 00000100:00100000:1.0:1715330285.696151:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7134:x1798653942428544:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330285.696201:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7134:x1798653942428544:12345-0@lo:1000:mdt00_001.0 Request processed in 50us (182us total) trans 0 rc 1/1 00000100:00100000:1.0:1715330285.696206:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2444 00000100:00100000:0.0:1715330285.709144:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938015424 00000100:00100000:0.0:1715330285.709153:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938015424 00010000:00010000:0.0:1715330285.709180:0:7122:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d7ae6 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xc5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb439 expref: 18 pid: 7135 timeout: 360 lvb_type: 0 00000100:00100000:0.0:1715330285.709214:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1467 00000100:00100000:0.0:1715330285.709220:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72de1896-1df4-4b3a-930a-9116d2c66168+18:2012:x1798653938015424:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1715330285.709231:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330285.709236:0:7122:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d7ae6 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xc5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb439 expref: 18 pid: 7135 timeout: 360 lvb_type: 0 00010000:00010000:0.0:1715330285.709246:0:7122:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d7ae6 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xc5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb439 expref: 18 pid: 7135 timeout: 360 lvb_type: 0 00010000:00010000:0.0:1715330285.709267:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d7ae6 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xc5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb439 expref: 18 pid: 7135 timeout: 360 lvb_type: 0 00010000:00010000:0.0:1715330285.709277:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xc5:0x0].0x0 (ffff88008b233b00) 00010000:00010000:0.0:1715330285.709281:0:7122:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d7b2c lrc: 3/0,1 mode: --/EX res: [0x200000400:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.709288:0:7122:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d7b2c lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.709294:0:7122:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d7b2c lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.709321:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330285.709362:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:2012:x1798653938015424:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 141us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.709368:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1467 00000100:00100000:0.0:1715330285.709482:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942428736 00000100:00100000:0.0:1715330285.709485:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942428736 00000100:00100000:0.0:1715330285.709512:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2446 00000100:00100000:0.0:1715330285.709516:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:7134:x1798653942428736:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330285.709528:0:24873:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330285.709540:0:24873:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d7b3a lrc: 2/0,0 mode: --/EX res: [0x240000401:0xc5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d7b33 expref: -99 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.709567:0:24873:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457ef40/0xd895711d66d7af4 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0xc5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb440 expref: 6 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.709574:0:24873:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d7b3a lrc: 4/0,0 mode: --/EX res: [0x240000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d7b33 expref: 9 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.709591:0:24873:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88013457ef40/0xd895711d66d7af4 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xc5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb440 expref: 6 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.709600:0:24873:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457ef40/0xd895711d66d7af4 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xc5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb440 expref: 6 pid: 7134 timeout: 360 lvb_type: 0 00000100:00100000:0.0:1715330285.709609:0:24873:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba64700 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:24873:1798653942428800:192.168.204.49@tcp:104: 00000100:00100000:0.0:1715330285.709630:0:24873:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330285.713168:0:24873:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba64700 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:24873:1798653942428800:192.168.204.49@tcp:104: 00010000:00010000:1.0:1715330285.713192:0:24873:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d7b3a lrc: 3/0,0 mode: --/EX res: [0x240000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7b33 expref: 9 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.713203:0:24873:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc5:0x0].0x0 (ffff88009ef18600) 00010000:00010000:1.0:1715330285.713206:0:24873:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330285.713208:0:24873:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d7b3a lrc: 3/0,0 mode: --/EX res: [0x240000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7b33 expref: 9 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.713216:0:24873:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d7b3a lrc: 3/0,0 mode: --/EX res: [0x240000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7b33 expref: 9 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.713221:0:24873:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f1d40, rc 0) 00000100:00100000:1.0:1715330285.713268:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7134:x1798653942428736:12345-0@lo:101:mdt00_001.0 Request processed in 3751us (3822us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.713275:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2446 00000100:00100000:1.0:1715330285.713754:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938015488 00000100:00100000:1.0:1715330285.713760:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938015488 00010000:00010000:1.0:1715330285.713778:0:7122:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013457ef40/0xd895711d66d7af4 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xc5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb440 expref: 7 pid: 7134 timeout: 360 lvb_type: 0 00000100:00100000:1.0:1715330285.713811:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1468 00000100:00100000:1.0:1715330285.713817:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72de1896-1df4-4b3a-930a-9116d2c66168+7:2012:x1798653938015488:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1715330285.713828:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330285.714005:0:7122:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88013457ef40/0xd895711d66d7af4 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xc5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb440 expref: 7 pid: 7134 timeout: 360 lvb_type: 0 00010000:00010000:1.0:1715330285.714017:0:7122:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88013457ef40/0xd895711d66d7af4 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xc5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb440 expref: 7 pid: 7134 timeout: 360 lvb_type: 0 00010000:00010000:1.0:1715330285.714032:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457ef40/0xd895711d66d7af4 lrc: 0/0,0 mode: --/PR res: [0x240000401:0xc5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb440 expref: 7 pid: 7134 timeout: 360 lvb_type: 0 00010000:00010000:1.0:1715330285.714040:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc5:0x0].0x0 (ffff88009ef18600) 00010000:00010000:1.0:1715330285.714044:0:7122:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d7b3a lrc: 2/0,0 mode: --/EX res: [0x240000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7b33 expref: 8 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.714051:0:7122:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d7b3a lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d7b33 expref: 8 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.714057:0:7122:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d7b3a lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d7b33 expref: 8 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.714079:0:7122:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d7b3a lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7b33 expref: 8 pid: 24873 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330285.714090:0:7122:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d41b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:7122:1798653942428864:0@lo:105: 00000100:00100000:1.0:1715330285.714114:0:7122:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330285.714138:0:7122:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b43336c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330285.714156:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942428864 00000100:00100000:0.0:1715330285.714163:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942428864 00000100:00100000:0.0:1715330285.714189:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1115 00000100:00100000:0.0:1715330285.714193:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d41a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7122:x1798653942428864:12345-0@lo:105: 00010000:00010000:0.0:1715330285.714200:0:7118:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f600/0xd895711d66d7b33 lrc: 5/0,1 mode: --/EX res: [0x240000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7b3a expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.714208:0:7118:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f600/0xd895711d66d7b33 lrc: 5/0,1 mode: --/EX res: [0x240000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7b3a expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.714214:0:7118:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f600/0xd895711d66d7b33 lrc: 5/0,1 mode: --/EX res: [0x240000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7b3a expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.714220:0:7118:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f600/0xd895711d66d7b33 lrc: 5/0,1 mode: EX/EX res: [0x240000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d7b3a expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.714225:0:7118:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f600/0xd895711d66d7b33 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d7b3a expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.714265:0:7118:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f600/0xd895711d66d7b33 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d7b3a expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.714286:0:7118:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88013457f600) 00000100:00100000:0.0:1715330285.714318:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d41a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7122:x1798653942428864:12345-0@lo:105: Request processed in 124us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.714323:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1115 00000100:00100000:1.0:1715330285.715012:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942428928 00000100:00100000:1.0:1715330285.715015:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942428928 00000100:00100000:1.0:1715330285.715031:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2447 00000100:00100000:1.0:1715330285.715035:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7134:x1798653942428928:12345-0@lo:403:mdt00_001.0 00000100:00100000:1.0:1715330285.716414:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7134:x1798653942428928:12345-0@lo:403:mdt00_001.0 Request processed in 1375us (1472us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.716421:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2447 00000100:00100000:1.0:1715330285.716465:0:7122:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d41b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:7122:1798653942428864:0@lo:105: 00010000:00010000:1.0:1715330285.716476:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330285.716504:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72de1896-1df4-4b3a-930a-9116d2c66168+6:2012:x1798653938015488:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 2686us (2862us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.716511:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1468 00000100:00100000:0.0:1715330285.721164:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091c3c380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942429056:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1715330285.721826:0:7124:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1715330285.721831:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f600/0xd895711d66d7b33 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d7b3a expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.721836:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457f600 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330285.721840:0:7124:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f600/0xd895711d66d7b33 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d7b3a expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330285.721846:0:7124:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f600/0xd895711d66d7b33 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d7b3a expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.721869:0:7124:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f600/0xd895711d66d7b33 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7b3a expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.721874:0:7124:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330285.723150:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f600/0xd895711d66d7b33 lrc: 1/0,0 mode: --/EX res: [0x240000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7b3a expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.723158:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f600/0xd895711d66d7b33 lrc: 0/0,0 mode: --/EX res: [0x240000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7b3a expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.723171:0:7124:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1715330285.723174:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e400/0xd895711d66d7b17 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x150e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d7b1e expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.723179:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457e400 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330285.723182:0:7124:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e400/0xd895711d66d7b17 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x150e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d7b1e expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330285.723188:0:7124:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e400/0xd895711d66d7b17 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x150e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d7b1e expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.723202:0:7124:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e400/0xd895711d66d7b17 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x150e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7b1e expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.723207:0:7124:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330285.723217:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e400/0xd895711d66d7b17 lrc: 1/0,0 mode: --/EX res: [0x200000402:0x150e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7b1e expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.723222:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e400/0xd895711d66d7b17 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x150e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7b1e expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.723231:0:7124:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715330285.723234:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457cd80/0xd895711d66d7afb lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d7b02 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.723238:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457cd80 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330285.723241:0:7124:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457cd80/0xd895711d66d7afb lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d7b02 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330285.723246:0:7124:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457cd80/0xd895711d66d7afb lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d7b02 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.723256:0:7124:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457cd80/0xd895711d66d7afb lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7b02 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.723260:0:7124:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330285.723265:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457cd80/0xd895711d66d7afb lrc: 1/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7b02 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.723270:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457cd80/0xd895711d66d7afb lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7b02 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.723278:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330285.723279:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330285.723280:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330285.723300:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1715330285.723311:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942429120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330285.723348:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330285.723366:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942429184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330285.723379:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330285.723388:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1715330285.723392:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942429248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330285.723407:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330285.724263:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942429248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330285.724270:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942429184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330285.724286:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942429120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330285.736921:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330285.745633:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938015616 00000100:00100000:0.0:1715330285.745640:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938015616 00000100:00100000:0.0:1715330285.745672:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23270 00000100:00100000:0.0:1715330285.745678:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+6:16866:x1798653938015616:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:0.0:1715330285.745694:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330285.745709:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d7b56 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb44e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.745762:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d7b5d lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330285.745771:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d7b5d lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330285.745780:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d7b5d lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000004:00200000:0.0:1715330285.745815:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000401:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1715330285.745819:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1715330285.745842:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d7b56 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb44e expref: 8 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.745853:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d7b5d lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb44e expref: 7 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.745859:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88012bd8b600) 00010000:00010000:0.0:1715330285.745861:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1715330285.745863:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f3a80, rc 0) 00000100:00100000:0.0:1715330285.745912:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+7:16866:x1798653938015616:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 233us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.745917:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23270 00000100:00100000:0.0:1715330285.756662:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330285.756689:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938015744 00000100:00100000:0.0:1715330285.756696:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938015744 00000100:00100000:0.0:1715330285.756767:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23271 00000100:00100000:0.0:1715330285.756775:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+7:16866:x1798653938015744:12345-192.168.204.49@tcp:36:lfs.0 00000100:00100000:0.0:1715330285.756865:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba65880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942429312:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1715330285.756906:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330285.756921:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffab40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330285.757143:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba65880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942429312:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330285.757179:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d41b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942429376:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330285.757198:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330285.757218:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4333840 going to sleep for 11 seconds 00000100:00100000:0.0:1715330285.757238:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942429376 00000100:00100000:0.0:1715330285.757241:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942429376 00000100:00100000:1.0:1715330285.757465:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d41b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942429376:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1715330285.757498:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc480/0xd895711d66d7b64 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.757505:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc480/0xd895711d66d7b64 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.757528:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc480/0xd895711d66d7b64 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT1 00000100:00100000:1.0:1715330285.757536:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d41b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942429440:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1715330285.757566:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330285.757583:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b43336c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330285.757634:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942429440 00000100:00100000:0.0:1715330285.757640:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942429440 00000100:00100000:0.0:1715330285.757708:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2451 00000100:00100000:0.0:1715330285.757712:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d61b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:7135:x1798653942429440:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330285.757719:0:24873:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330285.757740:0:24873:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d7b6b lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d7b64 expref: -99 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.757757:0:24873:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d7a76 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb424 expref: 16 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.757764:0:24873:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d7b6b lrc: 4/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d7b64 expref: 9 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.757779:0:24873:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d7a76 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb424 expref: 16 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.757788:0:24873:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d7a76 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb424 expref: 16 pid: 7135 timeout: 360 lvb_type: 0 00000100:00100000:0.0:1715330285.757796:0:24873:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba66300 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:24873:1798653942429504:192.168.204.49@tcp:104: 00000100:00100000:0.0:1715330285.757831:0:24873:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffc300 going to sleep for 11 seconds 00000100:00100000:0.0:1715330285.761205:0:24873:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba66300 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:24873:1798653942429504:192.168.204.49@tcp:104: 00010000:00010000:0.0:1715330285.761228:0:24873:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d7b6b lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7b64 expref: 9 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.761237:0:24873:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88012bd8b800) 00010000:00010000:0.0:1715330285.761239:0:24873:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330285.761241:0:24873:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d7b6b lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7b64 expref: 9 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.761247:0:24873:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f0000, rc 0) 00000100:00100000:0.0:1715330285.761278:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d61b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7135:x1798653942429440:12345-0@lo:101:mdt00_002.0 Request processed in 3565us (3723us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.761284:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2451 00000100:00100000:1.0:1715330285.768489:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330285.770024:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1469 00000100:00100000:0.0:1715330285.770032:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d61aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:72de1896-1df4-4b3a-930a-9116d2c66168+17:2011:x1798653938015808:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1715330285.770045:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330285.770050:0:10674:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d7a76 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb424 expref: 17 pid: 7135 timeout: 360 lvb_type: 0 00010000:00010000:0.0:1715330285.770060:0:10674:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d7a76 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb424 expref: 17 pid: 7135 timeout: 360 lvb_type: 0 00010000:00010000:0.0:1715330285.770077:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d7a76 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb424 expref: 17 pid: 7135 timeout: 360 lvb_type: 0 00010000:00010000:0.0:1715330285.770089:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88012bd8b800) 00010000:00010000:0.0:1715330285.770094:0:10674:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d7b6b lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7b64 expref: 8 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.770102:0:10674:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d7b6b lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d7b64 expref: 8 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.770109:0:10674:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d7b6b lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d7b64 expref: 8 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.770134:0:10674:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d7b6b lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7b64 expref: 8 pid: 24873 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330285.770146:0:10674:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba66300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:10674:1798653942429568:0@lo:105: 00000100:00100000:0.0:1715330285.770182:0:10674:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330285.770207:0:10674:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffc300 going to sleep for 11 seconds 00000100:00100000:1.0:1715330285.770250:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942429568 00000100:00100000:1.0:1715330285.770253:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942429568 00000100:00100000:1.0:1715330285.770275:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1116 00000100:00100000:1.0:1715330285.770279:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:10674:x1798653942429568:12345-0@lo:105: 00010000:00010000:1.0:1715330285.770287:0:7118:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc480/0xd895711d66d7b64 lrc: 5/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7b6b expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.770295:0:7118:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc480/0xd895711d66d7b64 lrc: 5/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7b6b expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.770301:0:7118:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc480/0xd895711d66d7b64 lrc: 5/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7b6b expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.770307:0:7118:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc480/0xd895711d66d7b64 lrc: 5/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d7b6b expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.770312:0:7118:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc480/0xd895711d66d7b64 lrc: 6/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d7b6b expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.770318:0:7118:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc480/0xd895711d66d7b64 lrc: 6/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d7b6b expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.770331:0:7118:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff880093bfc480) 00000100:00100000:1.0:1715330285.770355:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:10674:x1798653942429568:12345-0@lo:105: Request processed in 75us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.770360:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1116 00010000:00010000:0.0:1715330285.770403:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc480/0xd895711d66d7b64 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7b6b expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.770410:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc480/0xd895711d66d7b64 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7b6b expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1715330285.770429:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:0.0:1715330285.770451:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1f80/0xd895711d66d7b72 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x814526f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330285.770456:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1f80/0xd895711d66d7b72 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x814526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330285.770464:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1f80/0xd895711d66d7b72 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x814526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT1 00000100:00100000:0.0:1715330285.770475:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba65880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942429632:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1715330285.770498:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330285.770508:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffc540 going to sleep for 11 seconds 00000100:00100000:0.0:1715330285.770528:0:10674:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba66300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:10674:1798653942429568:0@lo:105: 00010000:00010000:0.0:1715330285.770536:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330285.770574:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d61aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:72de1896-1df4-4b3a-930a-9116d2c66168+16:2011:x1798653938015808:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 542us (2092us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.770580:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1469 00000100:00100000:1.0:1715330285.770791:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942429632 00000100:00100000:1.0:1715330285.770795:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942429632 00000100:00100000:1.0:1715330285.770820:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2452 00000100:00100000:1.0:1715330285.770825:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7135:x1798653942429632:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330285.770838:0:24873:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330285.770850:0:24873:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff840/0xd895711d66d7b79 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x814526f2 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d7b72 expref: -99 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.770864:0:24873:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff840/0xd895711d66d7b79 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d7b72 expref: 10 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.770873:0:24873:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff840/0xd895711d66d7b79 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7b72 expref: 10 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.770878:0:24873:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x814526f2 (ffff88009bbf0900) 00010000:00010000:1.0:1715330285.770880:0:24873:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330285.770882:0:24873:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bff840, rc 0) 00000100:00100000:1.0:1715330285.770903:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:7135:x1798653942429632:12345-0@lo:101:mdt00_002.0 Request processed in 77us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.770907:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2452 00000100:00100000:0.0:1715330285.770972:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba65880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942429632:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330285.770980:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1f80/0xd895711d66d7b72 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7b79 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.770986:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1f80/0xd895711d66d7b72 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7b79 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1715330285.770995:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:0.0:1715330285.771017:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba65880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942429696:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1715330285.771038:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330285.771060:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffc300 going to sleep for 11 seconds 00000100:00100000:0.0:1715330285.771255:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba65880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942429696:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1715330285.771285:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba65880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942429760:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1715330285.771305:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330285.771348:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffc300 going to sleep for 11 seconds 00000100:00100000:0.0:1715330285.771669:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba65880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942429760:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1715330285.771718:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba65880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942429824:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1715330285.771808:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330285.771830:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffc300 going to sleep for 11 seconds 00000100:00100000:1.0:1715330285.771878:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942429824 00000100:00100000:1.0:1715330285.771881:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942429824 00000100:00100000:1.0:1715330285.771898:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2455 00000100:00100000:1.0:1715330285.771902:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:7135:x1798653942429824:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330285.771947:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:7135:x1798653942429824:12345-0@lo:1000:mdt00_002.0 Request processed in 43us (138us total) trans 0 rc -2/-2 00000100:00100000:1.0:1715330285.771952:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2455 00000100:00100000:0.0:1715330285.772017:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba65880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942429824:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1715330285.772052:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba65880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942429888:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1715330285.772069:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330285.772087:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffc300 going to sleep for 11 seconds 00000100:00100000:1.0:1715330285.772333:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942429888 00000100:00100000:1.0:1715330285.772337:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942429888 00000100:00100000:1.0:1715330285.772365:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2456 00000100:00100000:1.0:1715330285.772369:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:7135:x1798653942429888:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330285.772646:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:7135:x1798653942429888:12345-0@lo:1000:mdt00_002.0 Request processed in 275us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.772651:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2456 00000100:00100000:0.0:1715330285.772694:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba65880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942429888:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1715330285.772724:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba65880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942429952:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1715330285.772757:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330285.772764:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffc300 going to sleep for 11 seconds 00000100:00100000:1.0:1715330285.772805:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942429952 00000100:00100000:1.0:1715330285.772808:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942429952 00000100:00100000:1.0:1715330285.772893:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2457 00000100:00100000:1.0:1715330285.772897:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:7135:x1798653942429952:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330285.772930:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:7135:x1798653942429952:12345-0@lo:1000:mdt00_002.0 Request processed in 33us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.772935:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2457 00000100:00100000:0.0:1715330285.773001:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba65880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942429952:0@lo:1000:mdt00_002.0 00000040:00080000:0.0:1715330285.773473:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].372, 2168 off564888 00000040:00080000:0.0:1715330285.773524:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].373, 2368 off616632 00000004:00080000:0.0:1715330285.773528:0:7135:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff880091ffc540 with version 713 00000004:00080000:1.0:1715330285.773582:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 713 rpc_version 713 00000020:00100000:1.0:1715330285.773600:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1715330285.773606:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008d61a300 x1798653942430080/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1715330285.773617:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d61a300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942430080:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1715330285.773640:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330285.773647:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4333840 going to sleep for 11 seconds 00000100:00100000:0.0:1715330285.774386:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d61a300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942430080:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1715330285.774493:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d7b80 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x180:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.774505:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d7b80 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x180:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.774515:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d7b80 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x180:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.774531:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d7b87 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.774536:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d7b87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.774540:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d7b87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.774571:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd440/0xd895711d66d7b8e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.774576:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd440/0xd895711d66d7b8e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.774584:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd440/0xd895711d66d7b8e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT1 00000100:00100000:1.0:1715330285.774593:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d618e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942430144:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1715330285.774613:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330285.774621:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4333300 going to sleep for 11 seconds 00000100:00100000:0.0:1715330285.774675:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942430144 00000100:00100000:0.0:1715330285.774678:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942430144 00000100:00100000:0.0:1715330285.774694:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2459 00000100:00100000:0.0:1715330285.774698:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d61ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:7135:x1798653942430144:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330285.774708:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330285.774720:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d7b95 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d7b8e expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.774756:0:23404:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d7b95 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d7b8e expref: 12 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.774765:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d7b95 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7b8e expref: 12 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.774772:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc3:0x0].0x0 (ffff88012bd8b300) 00010000:00010000:0.0:1715330285.774774:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330285.774776:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f3840, rc 0) 00000100:00100000:0.0:1715330285.774797:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d61ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:7135:x1798653942430144:12345-0@lo:101:mdt00_002.0 Request processed in 99us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.774802:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2459 00000100:00100000:1.0:1715330285.775260:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d618e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942430144:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330285.775271:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd440/0xd895711d66d7b8e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7b95 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.775278:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd440/0xd895711d66d7b8e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7b95 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330285.775291:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009ba67800 reply state ffff88009ac9f000 transno 4294968348 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d7b87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.775303:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d7b87 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.775308:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc3:0x0].0x0 (ffff88009bbf0d00) 00010000:00010000:1.0:1715330285.775311:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330285.775313:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1715330285.775318:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd440/0xd895711d66d7b8e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7b95 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.775325:0:7135:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd440/0xd895711d66d7b8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7b95 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330285.775332:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000401:0xc3:0x0] 00000004:00010000:1.0:1715330285.775336:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009ba67800 reply state ffff88009ac9f000 transno 4294968348 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d7b80 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x180:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.775342:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d7b80 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x180:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330285.775347:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x180:0x0].0x0 (ffff88009bbf0200) 00010000:00010000:1.0:1715330285.775349:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330285.775351:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1715330285.775354:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x180:0x0]: returning size 4096 00000004:00080000:1.0:1715330285.775359:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:1.0:1715330285.775363:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc480/0xd895711d66d7b64 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7b6b expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.775369:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc480/0xd895711d66d7b64 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d7b6b expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.775375:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc480/0xd895711d66d7b64 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d7b6b expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.775388:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1715330285.775391:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:1.0:1715330285.775394:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1f80/0xd895711d66d7b72 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7b79 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.775400:0:7135:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1f80/0xd895711d66d7b72 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7b79 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330285.775458:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+9:16866:x1798653938015744:12345-192.168.204.49@tcp:36:lfs.0 Request processed in 18682us (18801us total) trans 4294968348 rc 0/0 00000100:00100000:1.0:1715330285.775464:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23271 00000100:00100000:0.0:1715330285.775665:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942430208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330285.775687:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330285.775800:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942430208 00000100:00100000:0.0:1715330285.775803:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942430208 00000100:00100000:0.0:1715330285.775821:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1255 00000100:00100000:0.0:1715330285.775825:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942430208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330285.775832:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330285.775841:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d7b6b lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d7b64 expref: 12 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.775849:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88012bd8b800) 00010000:00010000:0.0:1715330285.775854:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330285.775869:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+11:3690:x1798653942430208:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.775874:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1255 00000100:00100000:0.0:1715330285.775889:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942430208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330285.794114:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938015936 00000100:00100000:1.0:1715330285.794122:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938015936 00000100:00100000:1.0:1715330285.794164:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23272 00000100:00100000:1.0:1715330285.794170:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+16:16867:x1798653938015936:12345-192.168.204.49@tcp:36:mkdir.0 00000100:00100000:1.0:1715330285.794293:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+16:16867:x1798653938015936:12345-192.168.204.49@tcp:36:mkdir.0 Request processed in 122us (426us total) trans 0 rc -17/-17 00000100:00100000:1.0:1715330285.794299:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23272 00000100:00100000:0.0:1715330285.803888:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00010000:00010000:0.0:1715330285.804483:0:7124:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715330285.804490:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1f80/0xd895711d66d7b72 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d7b79 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.804498:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f1f80 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330285.804503:0:7124:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1f80/0xd895711d66d7b72 lrc: 4/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f2 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd895711d66d7b79 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330285.804510:0:7124:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1f80/0xd895711d66d7b72 lrc: 4/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f2 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd895711d66d7b79 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.804530:0:7124:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1f80/0xd895711d66d7b72 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x814526f2 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d7b79 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.804534:0:7124:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330285.804572:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1f80/0xd895711d66d7b72 lrc: 1/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x814526f2 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d7b79 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.804578:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1f80/0xd895711d66d7b72 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x814526f2 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d7b79 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330285.804584:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942430336:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330285.804591:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330285.804592:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330285.804593:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330285.804609:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330285.804626:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942430336 00000100:00100000:0.0:1715330285.804629:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942430336 00010000:00010000:0.0:1715330285.804642:0:10674:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff840/0xd895711d66d7b79 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f2 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd895711d66d7b72 expref: 11 pid: 24873 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330285.804659:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1470 00000100:00100000:0.0:1715330285.804663:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d618e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+11:3691:x1798653942430336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330285.804671:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1715330285.806515:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942430400:0@lo:103:jbd2/dm-0-8.0 00000020:00080000:1.0:1715330285.806548:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 362 00000100:00100000:0.0:1715330285.806550:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1715330285.806601:0:7163:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8800b4333900 with version 664 00000020:00080000:1.0:1715330285.806607:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 362 cancel update log [0x240000401:0x3:0x0].346: rc = 0 00080000:02000000:1.0:1715330285.806629:0:7163:0:(osd_handler.c:2105:osd_trans_start()) *** cfs_fail_loc=19a, val=0*** 00000040:00020000:1.0:1715330285.806638:0:7163:0:(llog_cat.c:737:llog_cat_cancel_arr_rec()) lustre-MDT0000-osd: fail to cancel 1 llog-records: rc = -5 00000040:00020000:1.0:1715330285.806640:0:7163:0:(llog_cat.c:773:llog_cat_cancel_records()) lustre-MDT0000-osd: fail to cancel 1 of 1 llog-records: rc = -5 00000020:00080000:1.0:1715330285.806642:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 362 cancel update log [0x200000400:0x3:0x0].347: rc = -5 00000020:00080000:1.0:1715330285.806647:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 363 committed batchid 362 00000020:00080000:1.0:1715330285.806668:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 362 00000100:00100000:1.0:1715330285.806677:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942430400 00000100:00100000:1.0:1715330285.806681:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942430400 00000100:00100000:1.0:1715330285.806702:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1256 00000100:00100000:1.0:1715330285.806707:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+7:3688:x1798653942430400:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:1.0:1715330285.806715:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330285.806726:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f21c0/0xd895711d66d7b10 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x814526f1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d7b09 expref: 7 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.806748:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x814526f1 (ffff88012bd8b200) 00010000:00010000:1.0:1715330285.806753:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330285.806785:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+6:3688:x1798653942430400:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 77us (234us total) trans 0 rc 0/0 00000004:00080000:0.0:1715330285.806785:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 664 rpc_version 664 00000100:00100000:1.0:1715330285.806790:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1256 00000020:00100000:0.0:1715330285.806798:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1715330285.806804:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88009ba65c00 x1798653942430528/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715330285.806815:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba65c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942430528:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330285.806838:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330285.806859:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffc9c0 going to sleep for 11 seconds 00010000:00010000:0.0:1715330285.806898:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff840/0xd895711d66d7b79 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x814526f2 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd895711d66d7b72 expref: 7 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.806906:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x814526f2 (ffff88009bbf0900) 00010000:00010000:0.0:1715330285.806909:0:10674:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d7baa lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x814526f2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.806915:0:10674:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d7baa lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.806920:0:10674:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d7baa lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.806931:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330285.806957:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d618e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+6:3691:x1798653942430336:12345-0@lo:103:ldlm_bl.0 Request processed in 2293us (2347us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.806962:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1470 00000100:00100000:0.0:1715330285.807006:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba65c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942430528:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330285.807035:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942430336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330285.812348:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330285.825443:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938016128 00000100:00100000:0.0:1715330285.825451:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938016128 00000100:00100000:0.0:1715330285.825484:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23275 00000100:00100000:0.0:1715330285.825491:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+10:16869:x1798653938016128:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:0.0:1715330285.825505:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330285.825520:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0480/0xd895711d66d7bc6 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xc3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb463 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.825573:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d7bcd lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330285.825584:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d7bcd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330285.825591:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d7bcd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000004:00200000:0.0:1715330285.825625:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000400:0xc3:0x0]: returning size 4096 00000004:00200000:0.0:1715330285.825629:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1715330285.825654:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0480/0xd895711d66d7bc6 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb463 expref: 12 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.825666:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d7bcd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb463 expref: 11 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.825673:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc3:0x0].0x0 (ffff88009bbf0d00) 00010000:00010000:0.0:1715330285.825676:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1715330285.825678:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f3cc0, rc 0) 00000100:00100000:0.0:1715330285.825716:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+11:16869:x1798653938016128:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 224us (1418us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.825722:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23275 00000100:00100000:0.0:1715330285.828366:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330285.828659:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942430656 00000100:00100000:0.0:1715330285.828663:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942430656 00000100:00100000:0.0:1715330285.828681:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1118 00000100:00100000:0.0:1715330285.828685:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:7134:x1798653942430656:12345-0@lo:104: 00010000:00010000:0.0:1715330285.828693:0:7118:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd440/0xd895711d66d7b8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d7b95 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.828724:0:7118:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1715330285.828728:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:7134:x1798653942430656:12345-0@lo:104: Request processed in 43us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.828749:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1118 00000100:00100000:1.0:1715330285.830387:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942430720 00000100:00100000:1.0:1715330285.830391:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942430720 00010000:00010000:1.0:1715330285.830405:0:10674:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d7b95 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd895711d66d7b8e expref: 6 pid: 23404 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330285.830421:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1471 00000100:00100000:1.0:1715330285.830425:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+6:3688:x1798653942430720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330285.830432:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00080000:1.0:1715330285.832522:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 363 00000004:00080000:1.0:1715330285.832577:0:7163:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8800b4333300 with version 665 00000020:00080000:1.0:1715330285.832615:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 363 cancel update log [0x240000401:0x3:0x0].347: rc = 0 00000020:00080000:1.0:1715330285.832665:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 363 cancel update log [0x200000400:0x3:0x0].348: rc = 0 00000020:00080000:1.0:1715330285.832673:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 363 00010000:00010000:1.0:1715330285.832709:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d7b95 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd895711d66d7b8e expref: 6 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.832720:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc3:0x0].0x0 (ffff88012bd8b300) 00010000:00010000:1.0:1715330285.832724:0:10674:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db646c0/0xd895711d66d7bdb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330285.832747:0:10674:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db646c0/0xd895711d66d7bdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330285.832754:0:10674:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db646c0/0xd895711d66d7bdb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330285.832989:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330285.833118:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942430720:12345-0@lo:103:ldlm_bl.0 Request processed in 2691us (2819us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.833124:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1471 00000100:00100000:0.0:1715330285.838133:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330285.838439:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330285.838498:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938016256 00000100:00100000:1.0:1715330285.838502:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938016256 00000100:00100000:1.0:1715330285.838537:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1257 00000100:00100000:1.0:1715330285.838542:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d41b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:72de1896-1df4-4b3a-930a-9116d2c66168+15:2013:x1798653938016256:12345-192.168.204.49@tcp:103:rmdir.0 00010000:00010000:1.0:1715330285.838551:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330285.838576:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d7bb1 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x180:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb455 expref: 15 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.838587:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x180:0x0].0x0 (ffff880129caf700) 00010000:00010000:1.0:1715330285.838595:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330285.838692:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942430912 00000100:00100000:0.0:1715330285.838696:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942430912 00000100:00100000:1.0:1715330285.838720:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d41b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:72de1896-1df4-4b3a-930a-9116d2c66168+14:2013:x1798653938016256:12345-192.168.204.49@tcp:103:rmdir.0 Request processed in 177us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.838722:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2463 00000100:00100000:1.0:1715330285.838727:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1257 00000100:00100000:0.0:1715330285.838727:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:7134:x1798653942430912:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330285.838753:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330285.838764:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1b00/0xd895711d66d7be9 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d7be2 expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.838781:0:23404:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1b00/0xd895711d66d7be9 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d7be2 expref: 6 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.838791:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1b00/0xd895711d66d7be9 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7be2 expref: 6 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.838796:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88012bd8b000) 00010000:00010000:0.0:1715330285.838800:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330285.838802:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f1b00, rc 0) 00000100:00100000:0.0:1715330285.838826:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:7134:x1798653942430912:12345-0@lo:101:mdt00_001.0 Request processed in 99us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.838831:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2463 00000020:00080000:1.0:1715330285.838974:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 370 committed batchid 369 00000020:00080000:1.0:1715330285.839015:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 369 00000100:00100000:0.0:1715330285.839088:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942430976 00000100:00100000:0.0:1715330285.839091:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942430976 00000100:00100000:0.0:1715330285.839117:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2464 00000100:00100000:0.0:1715330285.839121:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:7134:x1798653942430976:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330285.839128:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330285.839264:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66d7bf7 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x814526f2 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d7bf0 expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.839278:0:9407:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66d7bf7 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d7bf0 expref: 7 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.839286:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66d7bf7 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7bf0 expref: 7 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.839291:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x814526f2 (ffff88012bd8bf00) 00010000:00010000:0.0:1715330285.839294:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330285.839296:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f18c0, rc 0) 00000100:00100000:0.0:1715330285.839316:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7134:x1798653942430976:12345-0@lo:101:mdt00_001.0 Request processed in 194us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.839321:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2464 00000100:00100000:0.0:1715330285.839722:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942431040 00000100:00100000:0.0:1715330285.839725:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942431040 00000100:00100000:0.0:1715330285.839770:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2465 00000100:00100000:0.0:1715330285.839774:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7134:x1798653942431040:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330285.839828:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7134:x1798653942431040:12345-0@lo:1000:mdt00_001.0 Request processed in 52us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.839834:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2465 00000100:00100000:0.0:1715330285.840155:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942431168 00000100:00100000:0.0:1715330285.840158:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942431168 00000100:00100000:0.0:1715330285.840170:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2467 00000100:00100000:0.0:1715330285.840174:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7134:x1798653942431168:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330285.840213:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330285.840221:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d7c05 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x180:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d7bfe expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.840233:0:9407:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d7c05 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x180:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d7bfe expref: 8 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.840241:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d7c05 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x180:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7bfe expref: 8 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.840246:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x180:0x0].0x0 (ffff88012bd8b800) 00010000:00010000:0.0:1715330285.840249:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1715330285.840251:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f06c0, rc 0) 00000100:00100000:0.0:1715330285.840270:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:7134:x1798653942431168:12345-0@lo:101:mdt00_001.0 Request processed in 95us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.840275:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2467 00000100:00100000:0.0:1715330285.848504:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330285.848563:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938016448 00000100:00100000:1.0:1715330285.848570:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938016448 00010000:00010000:1.0:1715330285.848594:0:10674:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d7bcd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb463 expref: 11 pid: 7135 timeout: 360 lvb_type: 0 00000100:00100000:1.0:1715330285.848626:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1472 00000100:00100000:1.0:1715330285.848633:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079f3a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:72de1896-1df4-4b3a-930a-9116d2c66168+11:2011:x1798653938016448:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1715330285.848645:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330285.848649:0:10674:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d7bcd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb463 expref: 11 pid: 7135 timeout: 360 lvb_type: 0 00010000:00010000:1.0:1715330285.848659:0:10674:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d7bcd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb463 expref: 11 pid: 7135 timeout: 360 lvb_type: 0 00010000:00010000:1.0:1715330285.848676:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d7bcd lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb463 expref: 11 pid: 7135 timeout: 360 lvb_type: 0 00010000:00010000:1.0:1715330285.848994:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc3:0x0].0x0 (ffff88009bbf0d00) 00010000:00010000:1.0:1715330285.848998:0:10674:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f840/0xd895711d66d7c13 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.849006:0:10674:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f840/0xd895711d66d7c13 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.849015:0:10674:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f840/0xd895711d66d7c13 lrc: 4/0,1 mode: EX/EX res: [0x240000400:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330285.849039:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330285.849087:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079f3a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:72de1896-1df4-4b3a-930a-9116d2c66168+10:2011:x1798653938016448:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 453us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.849094:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1472 00000100:00100000:0.0:1715330285.849187:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942431296 00000100:00100000:0.0:1715330285.849191:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942431296 00000100:00100000:0.0:1715330285.849223:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2468 00000100:00100000:0.0:1715330285.849228:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:7134:x1798653942431296:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330285.849241:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330285.849254:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d7c21 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d7c1a expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.849271:0:9407:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db646c0/0xd895711d66d7bdb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb46a expref: 13 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.849279:0:9407:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d7c21 lrc: 4/0,0 mode: --/EX res: [0x200000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d7c1a expref: 9 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.849296:0:9407:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011db646c0/0xd895711d66d7bdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb46a expref: 13 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.849306:0:9407:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db646c0/0xd895711d66d7bdb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb46a expref: 13 pid: 7134 timeout: 360 lvb_type: 0 00000100:00100000:0.0:1715330285.849314:0:9407:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d41b100 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:9407:1798653942431360:192.168.204.49@tcp:104: 00000100:00100000:0.0:1715330285.849351:0:9407:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffc180 going to sleep for 11 seconds 00000100:00100000:0.0:1715330285.851685:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330285.851783:0:9407:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d41b100 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:9407:1798653942431360:192.168.204.49@tcp:104: 00010000:00010000:1.0:1715330285.851802:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d7c21 lrc: 3/0,0 mode: --/EX res: [0x200000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7c1a expref: 9 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.851810:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc3:0x0].0x0 (ffff88012bd8b300) 00010000:00010000:1.0:1715330285.851812:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330285.851815:0:9407:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d7c21 lrc: 3/0,0 mode: --/EX res: [0x200000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7c1a expref: 9 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.851822:0:9407:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d7c21 lrc: 3/0,0 mode: --/EX res: [0x200000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7c1a expref: 9 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.851828:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f2400, rc 0) 00000100:00100000:1.0:1715330285.851869:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7134:x1798653942431296:12345-0@lo:101:mdt00_001.0 Request processed in 2641us (2701us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.851876:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2468 00000100:00100000:1.0:1715330285.851898:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938016512 00000100:00100000:1.0:1715330285.851901:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938016512 00010000:00010000:1.0:1715330285.851916:0:10674:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db646c0/0xd895711d66d7bdb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb46a expref: 14 pid: 7134 timeout: 360 lvb_type: 0 00000100:00100000:1.0:1715330285.851934:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1473 00000100:00100000:1.0:1715330285.851939:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d419180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:72de1896-1df4-4b3a-930a-9116d2c66168+14:2011:x1798653938016512:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1715330285.851946:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330285.851951:0:10674:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011db646c0/0xd895711d66d7bdb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb46a expref: 14 pid: 7134 timeout: 360 lvb_type: 0 00010000:00010000:1.0:1715330285.851959:0:10674:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011db646c0/0xd895711d66d7bdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb46a expref: 14 pid: 7134 timeout: 360 lvb_type: 0 00010000:00010000:1.0:1715330285.851973:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db646c0/0xd895711d66d7bdb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb46a expref: 14 pid: 7134 timeout: 360 lvb_type: 0 00010000:00010000:1.0:1715330285.851983:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc3:0x0].0x0 (ffff88012bd8b300) 00010000:00010000:1.0:1715330285.851986:0:10674:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d7c21 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7c1a expref: 8 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.851993:0:10674:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d7c21 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d7c1a expref: 8 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.851999:0:10674:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d7c21 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d7c1a expref: 8 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.852015:0:10674:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d7c21 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7c1a expref: 8 pid: 9407 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330285.852024:0:10674:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d61aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:10674:1798653942431424:0@lo:105: 00000100:00100000:1.0:1715330285.852046:0:10674:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330285.852057:0:10674:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4333240 going to sleep for 11 seconds 00000100:00100000:1.0:1715330285.853913:0:10674:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d61aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:10674:1798653942431424:0@lo:105: 00010000:00010000:1.0:1715330285.853923:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330285.853957:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d419180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:72de1896-1df4-4b3a-930a-9116d2c66168+13:2011:x1798653938016512:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 2016us (2273us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.853964:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1473 00000100:00100000:1.0:1715330285.854236:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942431488 00000100:00100000:1.0:1715330285.854240:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942431488 00000100:00100000:1.0:1715330285.854268:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2469 00000100:00100000:1.0:1715330285.854272:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7134:x1798653942431488:12345-0@lo:403:mdt00_001.0 00000100:00100000:1.0:1715330285.855667:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7134:x1798653942431488:12345-0@lo:403:mdt00_001.0 Request processed in 1392us (1466us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.855674:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2469 00000004:00080000:0.0:1715330285.859307:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 714 rpc_version 714 00000020:00100000:0.0:1715330285.859337:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1715330285.859345:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88009d41a680 x1798653942431616/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2352/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715330285.859364:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d41a680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942431616:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330285.859411:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330285.859438:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330285.859992:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d41a680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942431616:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1715330285.860128:0:7123:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715330285.860134:0:7123:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457d680/0xd895711d66d7c1a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d7c21 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.860141:0:7123:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457d680 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330285.860145:0:7123:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457d680/0xd895711d66d7c1a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d7c21 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330285.860151:0:7123:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457d680/0xd895711d66d7c1a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d7c21 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.860171:0:7123:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457d680/0xd895711d66d7c1a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7c21 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.860176:0:7123:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330285.860202:0:7123:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457d680/0xd895711d66d7c1a lrc: 1/0,0 mode: --/EX res: [0x200000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7c21 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.860208:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457d680/0xd895711d66d7c1a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7c21 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.860223:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330285.860224:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330285.860226:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330285.860273:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d645180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942431680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330285.860299:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330285.860313:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1715330285.860317:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942431744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330285.860328:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330285.860382:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942431680 00000100:00100000:0.0:1715330285.860385:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942431680 00000100:00100000:0.0:1715330285.860414:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942431744 00000100:00100000:0.0:1715330285.860416:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942431744 00000100:00100000:0.0:1715330285.860428:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1258 00000100:00100000:0.0:1715330285.860431:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d61aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+11:3690:x1798653942431680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330285.860442:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330285.860453:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d7c21 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d7c1a expref: 11 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.860463:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc3:0x0].0x0 (ffff88012bd8b300) 00010000:00010000:0.0:1715330285.860469:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330285.860487:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d61aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+10:3690:x1798653942431680:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.860493:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1258 00000100:00100000:0.0:1715330285.860502:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1259 00000100:00100000:0.0:1715330285.860506:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d618e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+9:3690:x1798653942431744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330285.860511:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330285.860517:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d7c05 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x180:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d7bfe expref: 9 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.860524:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x180:0x0].0x0 (ffff88012bd8b800) 00010000:00010000:0.0:1715330285.860529:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330285.860541:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d618e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+8:3690:x1798653942431744:12345-0@lo:103:ldlm_bl.0 Request processed in 34us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.860545:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1259 00000100:00100000:1.0:1715330285.860616:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942431744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330285.860622:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d645180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942431680:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330285.862411:0:7124:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715330285.862418:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c240/0xd895711d66d7be2 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d7be9 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.862428:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457c240 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330285.862431:0:7124:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c240/0xd895711d66d7be2 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d7be9 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330285.862442:0:7124:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c240/0xd895711d66d7be2 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d7be9 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.862463:0:7124:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c240/0xd895711d66d7be2 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7be9 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.862472:0:7124:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330285.862497:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c240/0xd895711d66d7be2 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7be9 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.862503:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c240/0xd895711d66d7be2 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7be9 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.862516:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330285.862517:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330285.862519:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330285.862609:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942431808 00000100:00100000:1.0:1715330285.862614:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942431808 00000100:00100000:1.0:1715330285.862642:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1260 00000100:00100000:1.0:1715330285.862647:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+8:3688:x1798653942431808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330285.862656:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330285.862666:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1b00/0xd895711d66d7be9 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d7be2 expref: 8 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.862677:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88012bd8b000) 00010000:00010000:1.0:1715330285.862682:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330285.862706:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+7:3688:x1798653942431808:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.862711:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1260 00000100:00100000:0.0:1715330285.872875:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330285.879530:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330285.879601:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938016640 00000100:00100000:1.0:1715330285.879609:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938016640 00000100:00100000:1.0:1715330285.879645:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23279 00000100:00100000:1.0:1715330285.879651:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d647800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+13:16878:x1798653938016640:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:1.0:1715330285.879665:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330285.879681:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d7c3d lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb478 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.879721:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d7c44 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.879745:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d7c44 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330285.879753:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d7c44 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00200000:1.0:1715330285.879786:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1715330285.879789:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1715330285.879813:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d7c3d lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb478 expref: 15 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.879831:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d7c44 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb478 expref: 14 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.879842:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff8800b1fd9b00) 00010000:00010000:1.0:1715330285.879844:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1715330285.879847:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfcfc0, rc 0) 00000100:00100000:1.0:1715330285.879880:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d647800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+14:16878:x1798653938016640:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 229us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.879884:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23279 00000100:00100000:0.0:1715330285.887312:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330285.892209:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942432000:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330285.892284:0:7134:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e400/0xd895711d66d7c4b lrc: 4/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7c52 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.892293:0:7134:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e400/0xd895711d66d7c4b lrc: 4/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7c52 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330285.892359:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330285.892413:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938016832 00000100:00100000:0.0:1715330285.892418:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938016832 00010000:00010000:0.0:1715330285.892437:0:7120:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d7b5d lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb44e expref: 10 pid: 7135 timeout: 360 lvb_type: 0 00000100:00100000:0.0:1715330285.892455:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1474 00000100:00100000:0.0:1715330285.892460:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d61bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72de1896-1df4-4b3a-930a-9116d2c66168+10:2011:x1798653938016832:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1715330285.892470:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330285.892475:0:7120:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d7b5d lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb44e expref: 10 pid: 7135 timeout: 360 lvb_type: 0 00010000:00010000:0.0:1715330285.892483:0:7120:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d7b5d lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb44e expref: 10 pid: 7135 timeout: 360 lvb_type: 0 00010000:00010000:0.0:1715330285.892499:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d7b5d lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb44e expref: 10 pid: 7135 timeout: 360 lvb_type: 0 00010000:00010000:0.0:1715330285.892511:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88012bd8b600) 00010000:00010000:0.0:1715330285.892514:0:7120:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f600/0xd895711d66d7c52 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7c4b expref: 8 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.892521:0:7120:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f600/0xd895711d66d7c52 lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d7c4b expref: 8 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.892528:0:7120:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f600/0xd895711d66d7c52 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d7c4b expref: 8 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.892561:0:7120:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f600/0xd895711d66d7c52 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7c4b expref: 8 pid: 23404 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330285.892572:0:7120:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d644000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001_UUID:7120:1798653942432128:0@lo:105: 00000100:00100000:0.0:1715330285.892595:0:7120:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330285.892608:0:7120:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330285.892620:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942432128 00000100:00100000:0.0:1715330285.892623:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942432128 00000100:00100000:0.0:1715330285.892647:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1120 00000100:00100000:0.0:1715330285.892651:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d645500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7120:x1798653942432128:12345-0@lo:105: 00010000:00010000:0.0:1715330285.892658:0:7118:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e400/0xd895711d66d7c4b lrc: 5/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7c52 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.892665:0:7118:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e400/0xd895711d66d7c4b lrc: 5/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7c52 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.892671:0:7118:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e400/0xd895711d66d7c4b lrc: 5/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7c52 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.892677:0:7118:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e400/0xd895711d66d7c4b lrc: 5/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d7c52 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.892683:0:7118:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e400/0xd895711d66d7c4b lrc: 6/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d7c52 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.892689:0:7118:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e400/0xd895711d66d7c4b lrc: 6/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d7c52 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.892774:0:7118:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88013457e400) 00000100:00100000:0.0:1715330285.892795:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d645500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7120:x1798653942432128:12345-0@lo:105: Request processed in 143us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.892801:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1120 00000100:00100000:1.0:1715330285.892811:0:7120:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d644000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001_UUID:7120:1798653942432128:0@lo:105: 00010000:00010000:0.0:1715330285.892815:0:7134:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e400/0xd895711d66d7c4b lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7c52 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.892821:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715330285.892825:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e400/0xd895711d66d7c4b lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7c52 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1715330285.892841:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:0.0:1715330285.892864:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f2880/0xd895711d66d7c59 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x814526f3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.892870:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f2880/0xd895711d66d7c59 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x814526f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.892877:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f2880/0xd895711d66d7c59 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x814526f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT0 00000100:00100000:0.0:1715330285.892888:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d647b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942432192:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1715330285.892907:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330285.894031:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d61bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72de1896-1df4-4b3a-930a-9116d2c66168+9:2011:x1798653938016832:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 1567us (1670us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.894039:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1474 00000100:00100000:1.0:1715330285.894203:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942432192 00000100:00100000:1.0:1715330285.894207:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942432192 00000100:00100000:0.0:1715330285.894211:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffcc00 going to sleep for 11 seconds 00000100:00100000:1.0:1715330285.894225:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2474 00000100:00100000:1.0:1715330285.894229:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d644e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7134:x1798653942432192:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330285.894241:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330285.894251:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d7c60 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x814526f3 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d7c59 expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.894266:0:23404:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d7c60 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526f3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d7c59 expref: 10 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.894274:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d7c60 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526f3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7c59 expref: 10 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.894285:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x814526f3 (ffff8800b1fd9d00) 00010000:00010000:1.0:1715330285.894287:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330285.894289:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfc6c0, rc 0) 00000100:00100000:1.0:1715330285.894309:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d644e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7134:x1798653942432192:12345-0@lo:101:mdt00_001.0 Request processed in 80us (1401us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.894314:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2474 00000100:00100000:0.0:1715330285.894895:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d647b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942432192:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330285.894906:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f2880/0xd895711d66d7c59 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526f3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7c60 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.894915:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f2880/0xd895711d66d7c59 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526f3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7c60 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1715330285.895037:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:0.0:1715330285.895065:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d647b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942432256:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330285.895090:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330285.895113:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffc000 going to sleep for 11 seconds 00000100:00100000:1.0:1715330285.895397:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942432256 00000100:00100000:1.0:1715330285.895401:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942432256 00000100:00100000:1.0:1715330285.895430:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2475 00000100:00100000:1.0:1715330285.895434:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d646a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7134:x1798653942432256:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330285.895485:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d646a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7134:x1798653942432256:12345-0@lo:1000:mdt00_001.0 Request processed in 50us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.895490:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2475 00000100:00100000:0.0:1715330285.895572:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d647b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942432256:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330285.895608:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d647b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942432320:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330285.895626:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330285.895634:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffc000 going to sleep for 11 seconds 00000100:00100000:1.0:1715330285.895672:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942432320 00000100:00100000:1.0:1715330285.895675:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942432320 00000100:00100000:1.0:1715330285.895691:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2476 00000100:00100000:1.0:1715330285.895694:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d647480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7134:x1798653942432320:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330285.895768:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d647480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7134:x1798653942432320:12345-0@lo:1000:mdt00_001.0 Request processed in 72us (140us total) trans 0 rc -2/-2 00000100:00100000:1.0:1715330285.895773:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2476 00000100:00100000:0.0:1715330285.895854:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d647b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942432320:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330285.895902:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d647b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942432384:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330285.895920:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330285.895928:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffc000 going to sleep for 11 seconds 00000100:00100000:1.0:1715330285.896023:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942432384 00000100:00100000:1.0:1715330285.896027:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942432384 00000100:00100000:1.0:1715330285.896041:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2477 00000100:00100000:1.0:1715330285.896045:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d646300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7134:x1798653942432384:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330285.896085:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d646300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7134:x1798653942432384:12345-0@lo:1000:mdt00_001.0 Request processed in 39us (164us total) trans 0 rc -2/-2 00000100:00100000:1.0:1715330285.896090:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2477 00000100:00100000:0.0:1715330285.896147:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d647b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942432384:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330285.896179:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d647b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942432448:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330285.896195:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330285.896204:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffc000 going to sleep for 11 seconds 00000100:00100000:1.0:1715330285.896245:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942432448 00000100:00100000:1.0:1715330285.896248:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942432448 00000100:00100000:1.0:1715330285.896262:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2478 00000100:00100000:1.0:1715330285.896265:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d645880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7134:x1798653942432448:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330285.896304:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d645880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7134:x1798653942432448:12345-0@lo:1000:mdt00_001.0 Request processed in 37us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.896308:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2478 00000100:00100000:0.0:1715330285.896391:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d647b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942432448:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330285.896420:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d647b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942432512:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330285.896435:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330285.896453:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffc000 going to sleep for 11 seconds 00000100:00100000:1.0:1715330285.896596:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942432512 00000100:00100000:1.0:1715330285.896599:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942432512 00000100:00100000:1.0:1715330285.896648:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2479 00000100:00100000:1.0:1715330285.896652:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d645c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7134:x1798653942432512:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330285.896857:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d645c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7134:x1798653942432512:12345-0@lo:1000:mdt00_001.0 Request processed in 203us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.896862:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2479 00000100:00100000:0.0:1715330285.896931:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d647b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942432512:0@lo:1000:mdt00_001.0 00000040:00080000:0.0:1715330285.897485:0:7134:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].350, 2168 off537784 00000040:00080000:0.0:1715330285.897548:0:7134:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].349, 2368 off578096 00000004:00080000:0.0:1715330285.897565:0:7134:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880091ffcc00 with version 666 00000100:00100000:1.0:1715330285.897687:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942432640 00000100:00100000:1.0:1715330285.897691:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942432640 00000100:00100000:1.0:1715330285.897763:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2480 00000100:00100000:1.0:1715330285.897767:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:8587:x1798653942432640:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330285.898326:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:8587:x1798653942432640:12345-0@lo:1000:osp_up1-0.0 Request processed in 557us (673us total) trans 4294968352 rc 0/0 00000100:00100000:1.0:1715330285.898332:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2480 00010000:00010000:0.0:1715330285.898459:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d7c67 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1510:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.898470:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d7c67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1510:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.898478:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d7c67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1510:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.898491:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d7c6e lrc: 3/0,1 mode: --/PW res: [0x200000400:0xc6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.898497:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d7c6e lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.898501:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d7c6e lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.898518:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f1b00/0xd895711d66d7c75 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xc6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.898523:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f1b00/0xd895711d66d7c75 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.898530:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f1b00/0xd895711d66d7c75 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT0 00000100:00100000:0.0:1715330285.898539:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d647b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942432704:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1715330285.898571:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330285.898590:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffc240 going to sleep for 11 seconds 00000100:00100000:1.0:1715330285.898683:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942432704 00000100:00100000:1.0:1715330285.898687:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942432704 00000100:00100000:1.0:1715330285.898709:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2481 00000100:00100000:1.0:1715330285.898713:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d645f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:7134:x1798653942432704:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330285.898722:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330285.898748:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d7c7c lrc: 2/0,0 mode: --/PW res: [0x240000401:0xc6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d7c75 expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.898762:0:23404:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d7c7c lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d7c75 expref: 12 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.898770:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d7c7c lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7c75 expref: 12 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.898776:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc6:0x0].0x0 (ffff8800b1fd9e00) 00010000:00010000:1.0:1715330285.898778:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330285.898780:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfed00, rc 0) 00000100:00100000:1.0:1715330285.898799:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d645f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:7134:x1798653942432704:12345-0@lo:101:mdt00_001.0 Request processed in 86us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.898803:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2481 00000100:00100000:0.0:1715330285.898859:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d647b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942432704:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330285.898867:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f1b00/0xd895711d66d7c75 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7c7c expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.898874:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f1b00/0xd895711d66d7c75 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7c7c expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330285.898886:0:7134:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009d646680 reply state ffff88008b334000 transno 4294983404 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d7c6e lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.898897:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d7c6e lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.898903:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xc6:0x0].0x0 (ffff88012bd8b200) 00010000:00010000:0.0:1715330285.898905:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330285.898906:0:7134:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1715330285.898911:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f1b00/0xd895711d66d7c75 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7c7c expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.898917:0:7134:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f1b00/0xd895711d66d7c75 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7c7c expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1715330285.898924:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0xc6:0x0] 00000004:00010000:0.0:1715330285.898928:0:7134:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009d646680 reply state ffff88008b334000 transno 4294983404 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d7c67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1510:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.898933:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d7c67 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1510:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.898938:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1510:0x0].0x0 (ffff88012bd8b300) 00010000:00010000:0.0:1715330285.898940:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330285.898941:0:7134:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1715330285.898945:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1510:0x0]: returning size 4096 00000004:00080000:0.0:1715330285.898949:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:0.0:1715330285.898953:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e400/0xd895711d66d7c4b lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7c52 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.898959:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e400/0xd895711d66d7c4b lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d7c52 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.898964:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e400/0xd895711d66d7c4b lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d7c52 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.898981:0:7134:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1715330285.898985:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:0.0:1715330285.898988:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f2880/0xd895711d66d7c59 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526f3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7c60 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.898994:0:7134:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f2880/0xd895711d66d7c59 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526f3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7c60 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330285.899038:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d646680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+16:16878:x1798653938016768:12345-192.168.204.49@tcp:36:lfs.0 Request processed in 11578us (11731us total) trans 4294983404 rc 0/0 00000100:00100000:0.0:1715330285.899044:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23280 00000100:00100000:0.0:1715330285.899329:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942432768 00000100:00100000:0.0:1715330285.899332:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942432768 00000100:00100000:0.0:1715330285.899456:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1261 00000100:00100000:0.0:1715330285.899460:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091eaca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+12:3688:x1798653942432768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330285.899468:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330285.899477:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f600/0xd895711d66d7c52 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d7c4b expref: 12 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.899485:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88012bd8b600) 00010000:00010000:0.0:1715330285.899491:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330285.899522:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091eaca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+11:3688:x1798653942432768:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.899527:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1261 00000100:00100000:1.0:1715330285.907794:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330285.913923:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00010000:00010000:1.0:1715330285.918178:0:7123:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715330285.918184:0:7123:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f2880/0xd895711d66d7c59 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526f3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d7c60 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.918191:0:7123:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f2880 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330285.918195:0:7123:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f2880/0xd895711d66d7c59 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526f3 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd895711d66d7c60 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330285.918203:0:7123:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f2880/0xd895711d66d7c59 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526f3 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd895711d66d7c60 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.918228:0:7123:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f2880/0xd895711d66d7c59 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x814526f3 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d7c60 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.918233:0:7123:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330285.918257:0:7123:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f2880/0xd895711d66d7c59 lrc: 1/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x814526f3 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d7c60 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.918263:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f2880/0xd895711d66d7c59 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x814526f3 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d7c60 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.918276:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330285.918277:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330285.918279:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330285.919401:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942432896 00000100:00100000:1.0:1715330285.919405:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942432896 00010000:00010000:1.0:1715330285.919421:0:7122:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d7c60 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526f3 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd895711d66d7c59 expref: 11 pid: 23404 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330285.919437:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1475 00000100:00100000:1.0:1715330285.919441:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079f39c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+11:3690:x1798653942432896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330285.919449:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1715330285.922529:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942432960:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1715330285.922602:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330285.922648:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942432960 00000100:00100000:0.0:1715330285.922654:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942432960 00000100:00100000:0.0:1715330285.922678:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1262 00000100:00100000:0.0:1715330285.922684:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+7:3691:x1798653942432960:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1715330285.922693:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330285.922706:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66d7bf7 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x814526f2 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d7bf0 expref: 7 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.922720:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x814526f2 (ffff88012bd8bf00) 00010000:00010000:0.0:1715330285.922727:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330285.922767:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+6:3691:x1798653942432960:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 82us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.922772:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1262 00000100:00100000:0.0:1715330285.923336:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942433024 00000100:00100000:0.0:1715330285.923339:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942433024 00000100:00100000:0.0:1715330285.923355:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2482 00000100:00100000:0.0:1715330285.923359:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:7134:x1798653942433024:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330285.923402:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:7134:x1798653942433024:12345-0@lo:1000:mdt00_001.0 Request processed in 43us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.923406:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2482 00000020:00080000:1.0:1715330285.923495:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 371 committed batchid 370 00000004:00080000:1.0:1715330285.923573:0:8285:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff880091ffa480 with version 715 00000020:00080000:1.0:1715330285.923589:0:8285:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 370 cancel update log [0x200000401:0x3:0x0].372: rc = 0 00000004:00080000:0.0:1715330285.923593:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 715 rpc_version 715 00000020:00100000:0.0:1715330285.923604:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1715330285.923608:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88009d647b80 x1798653942433152/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715330285.923617:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d647b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942433152:0@lo:1000:osp_up0-1.0 00000020:00080000:1.0:1715330285.923620:0:8285:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 370 cancel update log [0x240000400:0x3:0x0].371: rc = 0 00000020:00080000:1.0:1715330285.923628:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 370 00000100:00100000:0.0:1715330285.923634:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330285.923640:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffc240 going to sleep for 11 seconds 00000100:00100000:1.0:1715330285.923644:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091c3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942432960:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1715330285.923649:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942433152 00000100:00100000:0.0:1715330285.923650:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942433152 00000100:00100000:0.0:1715330285.923663:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2483 00000100:00100000:0.0:1715330285.923668:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d646d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:8278:x1798653942433152:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330285.923772:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d646d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:8278:x1798653942433152:12345-0@lo:1000:osp_up0-1.0 Request processed in 102us (136us total) trans 4294983405 rc 0/0 00000100:00100000:0.0:1715330285.923777:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2483 00000100:00100000:1.0:1715330285.923792:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d647b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942433152:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1715330285.934214:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330285.939007:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330285.939364:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942433216 00000100:00100000:1.0:1715330285.939366:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942433216 00000100:00100000:1.0:1715330285.939395:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1122 00000100:00100000:1.0:1715330285.939398:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7134:x1798653942433216:12345-0@lo:104: 00010000:00010000:1.0:1715330285.939406:0:7118:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f1b00/0xd895711d66d7c75 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d7c7c expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.939444:0:7118:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1715330285.939449:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7134:x1798653942433216:12345-0@lo:104: Request processed in 50us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.939454:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1122 00000100:00100000:0.0:1715330285.939818:0:10673:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942433280 00000100:00100000:0.0:1715330285.939823:0:10673:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942433280 00010000:00010000:0.0:1715330285.939839:0:10673:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d7c7c lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd895711d66d7c75 expref: 6 pid: 23404 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330285.939856:0:10673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1476 00000100:00100000:0.0:1715330285.939861:0:10673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+6:3688:x1798653942433280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330285.939868:0:10673:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330285.941189:0:10673:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d7c7c lrc: 0/0,0 mode: --/PW res: [0x240000401:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd895711d66d7c75 expref: 6 pid: 23404 timeout: 0 lvb_type: 0 00000020:00080000:1.0:1715330285.941247:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 371 00010000:00010000:0.0:1715330285.941279:0:10673:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc6:0x0].0x0 (ffff8800b1fd9e00) 00010000:00010000:0.0:1715330285.941283:0:10673:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d7cc2 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00000004:00080000:1.0:1715330285.941284:0:8285:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff880091ffa780 with version 716 00010000:00010000:0.0:1715330285.941288:0:10673:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d7cc2 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330285.941291:0:10673:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d7cc2 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT1 00000020:00080000:1.0:1715330285.941292:0:8285:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 371 cancel update log [0x200000401:0x3:0x0].373: rc = 0 00010000:00010000:0.0:1715330285.941306:0:10673:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330285.941326:0:10673:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942433280:12345-0@lo:103:ldlm_bl.0 Request processed in 1466us (1546us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.941331:0:10673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1476 00000020:00080000:1.0:1715330285.941333:0:8285:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 371 cancel update log [0x240000400:0x3:0x0].372: rc = 0 00000020:00080000:1.0:1715330285.941338:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 371 00000004:00080000:1.0:1715330285.941343:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 716 rpc_version 716 00000020:00100000:1.0:1715330285.941358:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1715330285.941363:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88009b5ef100 x1798653942433408/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1715330285.941376:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5ef100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942433408:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1715330285.941403:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330285.941413:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffae40 going to sleep for 11 seconds 00000100:00100000:0.0:1715330285.941526:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942433408 00000100:00100000:0.0:1715330285.941529:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942433408 00000100:00100000:0.0:1715330285.941543:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2484 00000100:00100000:0.0:1715330285.941546:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:8278:x1798653942433408:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330285.941622:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:8278:x1798653942433408:12345-0@lo:1000:osp_up0-1.0 Request processed in 75us (218us total) trans 4294983406 rc 0/0 00000100:00100000:0.0:1715330285.941626:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2484 00000100:00100000:1.0:1715330285.942458:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5ef100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942433408:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330285.945427:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942433472 00000100:00100000:0.0:1715330285.945431:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942433472 00000100:00100000:0.0:1715330285.945450:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2485 00000100:00100000:0.0:1715330285.945454:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:7134:x1798653942433472:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330285.945463:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330285.945474:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d7cd0 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d7cc9 expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.945489:0:23404:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d7cd0 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d7cc9 expref: 6 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.945497:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d7cd0 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7cc9 expref: 6 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.945503:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88012bd8b400) 00010000:00010000:0.0:1715330285.945505:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330285.945507:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f3a80, rc 0) 00000100:00100000:0.0:1715330285.945545:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7134:x1798653942433472:12345-0@lo:101:mdt00_001.0 Request processed in 89us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.945564:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2485 00000020:00080000:1.0:1715330285.946590:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 364 committed batchid 363 00000020:00080000:1.0:1715330285.946629:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 363 00000100:00100000:0.0:1715330285.946786:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942433536 00000100:00100000:0.0:1715330285.946790:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942433536 00000100:00100000:0.0:1715330285.946868:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2486 00000100:00100000:0.0:1715330285.946874:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7134:x1798653942433536:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330285.946882:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330285.946891:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f06c0/0xd895711d66d7cde lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x814526f3 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d7cd7 expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.946904:0:23404:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f06c0/0xd895711d66d7cde lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526f3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d7cd7 expref: 7 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.946912:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f06c0/0xd895711d66d7cde lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526f3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7cd7 expref: 7 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.946918:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x814526f3 (ffff88012bd8b500) 00010000:00010000:0.0:1715330285.946920:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330285.946922:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f06c0, rc 0) 00000100:00100000:0.0:1715330285.946957:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7134:x1798653942433536:12345-0@lo:101:mdt00_001.0 Request processed in 82us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.946962:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2486 00000100:00100000:0.0:1715330285.947369:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942433600 00000100:00100000:0.0:1715330285.947372:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942433600 00000100:00100000:0.0:1715330285.948747:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942433728 00000100:00100000:0.0:1715330285.948751:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942433728 00000100:00100000:0.0:1715330285.948766:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2489 00000100:00100000:0.0:1715330285.948770:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7134:x1798653942433728:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330285.948778:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330285.948787:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2400/0xd895711d66d7cec lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1510:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d7ce5 expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.948803:0:23404:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67cc0/0xd895711d66d7c98 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1510:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb47f expref: 7 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.948815:0:23404:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2400/0xd895711d66d7cec lrc: 4/0,0 mode: --/EX res: [0x200000402:0x1510:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d7ce5 expref: 8 pid: 23404 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330285.948817:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00010000:00010000:0.0:1715330285.948832:0:23404:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67cc0/0xd895711d66d7c98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1510:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb47f expref: 7 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.948843:0:23404:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67cc0/0xd895711d66d7c98 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1510:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb47f expref: 7 pid: 7134 timeout: 360 lvb_type: 0 00000100:00100000:0.0:1715330285.948852:0:23404:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d644000 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:23404:1798653942433792:192.168.204.49@tcp:104: 00000100:00100000:0.0:1715330285.948897:0:23404:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffca80 going to sleep for 11 seconds 00000100:00100000:0.0:1715330285.948908:0:10673:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938017280 00000100:00100000:0.0:1715330285.948911:0:10673:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938017280 00010000:00010000:0.0:1715330285.948922:0:10673:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67cc0/0xd895711d66d7c98 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x1510:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb47f expref: 8 pid: 7134 timeout: 360 lvb_type: 0 00000100:00100000:0.0:1715330285.948937:0:10673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1477 00000100:00100000:0.0:1715330285.948942:0:10673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:72de1896-1df4-4b3a-930a-9116d2c66168+8:2012:x1798653938017280:12345-192.168.204.49@tcp:103:rmdir.0 00010000:00010000:0.0:1715330285.948948:0:10673:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330285.948952:0:10673:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67cc0/0xd895711d66d7c98 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x1510:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb47f expref: 8 pid: 7134 timeout: 360 lvb_type: 0 00010000:00010000:0.0:1715330285.948961:0:10673:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67cc0/0xd895711d66d7c98 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1510:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb47f expref: 8 pid: 7134 timeout: 360 lvb_type: 0 00010000:00010000:0.0:1715330285.948972:0:10673:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1510:0x0].0x0 (ffff8800aa391e00) 00010000:00010000:0.0:1715330285.948976:0:10673:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2400/0xd895711d66d7cec lrc: 3/0,0 mode: --/EX res: [0x200000402:0x1510:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d7ce5 expref: 8 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.948984:0:10673:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2400/0xd895711d66d7cec lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1510:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xd895711d66d7ce5 expref: 8 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.948990:0:10673:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2400/0xd895711d66d7cec lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1510:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xd895711d66d7ce5 expref: 8 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.949004:0:10673:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2400/0xd895711d66d7cec lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1510:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7ce5 expref: 8 pid: 23404 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330285.949011:0:10673:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d644700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001_UUID:10673:1798653942433856:0@lo:105: 00000100:00100000:0.0:1715330285.949033:0:10673:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330285.949050:0:10673:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffc180 going to sleep for 11 seconds 00000100:00100000:0.0:1715330285.949870:0:10673:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d644700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001_UUID:10673:1798653942433856:0@lo:105: 00010000:00010000:0.0:1715330285.949879:0:10673:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330285.950594:0:10673:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:72de1896-1df4-4b3a-930a-9116d2c66168+8:2012:x1798653938017280:12345-192.168.204.49@tcp:103:rmdir.0 Request processed in 1650us (1776us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.950601:0:10673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1477 00010000:00010000:0.0:1715330285.951699:0:23404:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.204.49@tcp) returned -22 from blocking AST (req@ffff88009d644000 x1798653942433792) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67cc0/0xd895711d66d7c98 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x1510:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb47f expref: 7 pid: 7134 timeout: 360 lvb_type: 0 00010000:00010000:0.0:1715330285.951711:0:23404:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67cc0/0xd895711d66d7c98 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1510:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb47f expref: 7 pid: 7134 timeout: 360 lvb_type: 0 00000100:00100000:0.0:1715330285.951764:0:23404:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d644000 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:23404:1798653942433792:192.168.204.49@tcp:104: 00010000:00010000:0.0:1715330285.951776:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1510:0x0].0x0 (ffff8800aa391e00) 00010000:00010000:0.0:1715330285.951783:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2400/0xd895711d66d7cec lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1510:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7ce5 expref: 8 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.951790:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1510:0x0].0x0 (ffff8800aa391e00) 00010000:00010000:0.0:1715330285.951792:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1715330285.951794:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f2400, rc 0) 00000100:00100000:0.0:1715330285.951824:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:7134:x1798653942433728:12345-0@lo:101:mdt00_001.0 Request processed in 3053us (3098us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.951830:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2489 00000100:00100000:0.0:1715330285.954150:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7134:1798653942433920:192.168.204.49@tcp:104: 00010000:00010000:0.0:1715330285.954165:0:7134:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d8c0/0xd895711d66d7cfa lrc: 3/0,1 mode: --/EX res: [0x200000400:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000100:00100000:0.0:1715330285.961103:0:10673:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938017472 00000100:00100000:0.0:1715330285.961112:0:10673:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938017472 00010000:00010000:0.0:1715330285.961142:0:10673:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d7cb4 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb48d expref: 18 pid: 7134 timeout: 360 lvb_type: 0 00000100:00100000:0.0:1715330285.961164:0:10673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1478 00000100:00100000:0.0:1715330285.961171:0:10673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:72de1896-1df4-4b3a-930a-9116d2c66168+18:2011:x1798653938017472:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1715330285.961182:0:10673:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330285.961187:0:10673:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d7cb4 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb48d expref: 18 pid: 7134 timeout: 360 lvb_type: 0 00010000:00010000:0.0:1715330285.961199:0:10673:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d7cb4 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb48d expref: 18 pid: 7134 timeout: 360 lvb_type: 0 00010000:00010000:0.0:1715330285.961217:0:10673:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d7cb4 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb48d expref: 18 pid: 7134 timeout: 360 lvb_type: 0 00010000:00010000:0.0:1715330285.961252:0:10673:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xc6:0x0].0x0 (ffff88012bd8b200) 00010000:00010000:0.0:1715330285.961256:0:10673:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d8c0/0xd895711d66d7cfa lrc: 3/0,1 mode: --/EX res: [0x200000400:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.961264:0:10673:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d8c0/0xd895711d66d7cfa lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.961270:0:10673:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d8c0/0xd895711d66d7cfa lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330285.961564:0:10673:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330285.961686:0:7134:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d8c0/0xd895711d66d7cfa lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330285.961693:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d8c0/0xd895711d66d7cfa lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330285.961728:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7d01 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xc6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330285.961756:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7d01 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330285.961765:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7d01 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT0 00000100:00100000:1.0:1715330285.961781:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942433984:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1715330285.961812:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330285.961826:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffae40 going to sleep for 11 seconds 00000100:00100000:0.0:1715330285.961879:0:10673:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:72de1896-1df4-4b3a-930a-9116d2c66168+17:2011:x1798653938017472:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 707us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.961886:0:10673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1478 00000100:00100000:0.0:1715330285.961906:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942433984 00000100:00100000:0.0:1715330285.961909:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942433984 00000100:00100000:0.0:1715330285.961937:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2490 00000100:00100000:0.0:1715330285.961942:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:7134:x1798653942433984:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330285.961955:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330285.962067:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d7d08 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xc6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d7d01 expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.962083:0:23404:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d7cc2 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb494 expref: 6 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.962091:0:23404:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d7d08 lrc: 4/0,0 mode: --/EX res: [0x240000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d7d01 expref: 9 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.962122:0:23404:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d7cc2 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb494 expref: 6 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.962132:0:23404:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d7cc2 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb494 expref: 6 pid: 7134 timeout: 360 lvb_type: 0 00000100:00100000:0.0:1715330285.962141:0:23404:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d644000 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:23404:1798653942434048:192.168.204.49@tcp:104: 00000100:00100000:0.0:1715330285.962323:0:23404:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffca80 going to sleep for 11 seconds 00000100:00100000:0.0:1715330285.966228:0:23404:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d644000 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:23404:1798653942434048:192.168.204.49@tcp:104: 00010000:00010000:0.0:1715330285.966258:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d7d08 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7d01 expref: 9 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.966269:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc6:0x0].0x0 (ffff8800b1fd9e00) 00010000:00010000:0.0:1715330285.966272:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715330285.966275:0:23404:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d7d08 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7d01 expref: 9 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.966283:0:23404:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d7d08 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7d01 expref: 9 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.966288:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f3cc0, rc 0) 00000100:00100000:0.0:1715330285.966428:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7134:x1798653942433984:12345-0@lo:101:mdt00_001.0 Request processed in 4483us (4613us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.966435:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2490 00000100:00100000:1.0:1715330285.966677:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942433984:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330285.966693:0:7134:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7d01 lrc: 4/0,1 mode: --/EX res: [0x240000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7d08 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.966701:0:7134:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7d01 lrc: 4/0,1 mode: --/EX res: [0x240000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7d08 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330285.967161:0:10673:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938017536 00000100:00100000:0.0:1715330285.967166:0:10673:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938017536 00010000:00010000:0.0:1715330285.967184:0:10673:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d7cc2 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb494 expref: 7 pid: 7134 timeout: 360 lvb_type: 0 00000100:00100000:0.0:1715330285.967210:0:10673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1479 00000100:00100000:0.0:1715330285.967216:0:10673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:72de1896-1df4-4b3a-930a-9116d2c66168+7:2012:x1798653938017536:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1715330285.967226:0:10673:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330285.967231:0:10673:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d7cc2 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb494 expref: 7 pid: 7134 timeout: 360 lvb_type: 0 00010000:00010000:0.0:1715330285.967240:0:10673:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d7cc2 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb494 expref: 7 pid: 7134 timeout: 360 lvb_type: 0 00010000:00010000:0.0:1715330285.967257:0:10673:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d7cc2 lrc: 0/0,0 mode: --/PR res: [0x240000401:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb494 expref: 7 pid: 7134 timeout: 360 lvb_type: 0 00010000:00010000:0.0:1715330285.967501:0:10673:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc6:0x0].0x0 (ffff8800b1fd9e00) 00010000:00010000:0.0:1715330285.967506:0:10673:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d7d08 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7d01 expref: 8 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.967514:0:10673:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d7d08 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d7d01 expref: 8 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.967521:0:10673:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d7d08 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d7d01 expref: 8 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.967543:0:10673:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d7d08 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7d01 expref: 8 pid: 23404 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330285.967563:0:10673:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d644000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001_UUID:10673:1798653942434112:0@lo:105: 00000100:00100000:0.0:1715330285.967589:0:10673:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330285.967927:0:10673:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffca80 going to sleep for 11 seconds 00000100:00100000:1.0:1715330285.968058:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942434112 00000100:00100000:1.0:1715330285.968062:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942434112 00000100:00100000:1.0:1715330285.968080:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1124 00000100:00100000:1.0:1715330285.968084:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d644700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:10673:x1798653942434112:12345-0@lo:105: 00010000:00010000:1.0:1715330285.968092:0:7118:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7d01 lrc: 5/0,1 mode: --/EX res: [0x240000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7d08 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.968099:0:7118:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7d01 lrc: 5/0,1 mode: --/EX res: [0x240000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7d08 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.968106:0:7118:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7d01 lrc: 5/0,1 mode: --/EX res: [0x240000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7d08 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.968112:0:7118:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7d01 lrc: 5/0,1 mode: EX/EX res: [0x240000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d7d08 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.968118:0:7118:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7d01 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d7d08 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.968125:0:7118:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7d01 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d7d08 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.968146:0:7118:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff880093bfc6c0) 00000100:00100000:1.0:1715330285.968169:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d644700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:10673:x1798653942434112:12345-0@lo:105: Request processed in 85us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330285.968175:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1124 00000100:00100000:0.0:1715330285.968993:0:10673:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d644000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001_UUID:10673:1798653942434112:0@lo:105: 00010000:00010000:0.0:1715330285.969005:0:10673:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330285.969044:0:10673:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:72de1896-1df4-4b3a-930a-9116d2c66168+6:2012:x1798653938017536:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 1826us (1944us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.969051:0:10673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1479 00010000:00010000:0.0:1715330285.969069:0:7134:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7d01 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7d08 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.969076:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7d01 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7d08 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330285.969576:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d644000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942434176:0@lo:403:mdt00_001.0 00000100:00100000:0.0:1715330285.969606:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330285.969616:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffca80 going to sleep for 11 seconds 00000100:00100000:0.0:1715330285.969624:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942434176 00000100:00100000:0.0:1715330285.969627:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942434176 00000100:00100000:0.0:1715330285.969644:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2491 00000100:00100000:0.0:1715330285.969648:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7134:x1798653942434176:12345-0@lo:403:mdt00_001.0 00000100:00100000:0.0:1715330285.975855:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7134:x1798653942434176:12345-0@lo:403:mdt00_001.0 Request processed in 6199us (6241us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.975867:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2491 00000100:00100000:1.0:1715330285.975948:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d644000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942434176:0@lo:403:mdt00_001.0 00000040:00080000:1.0:1715330285.976728:0:7134:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].351, 664 off538448 00000040:00080000:1.0:1715330285.976886:0:7134:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].350, 744 off578840 00000004:00080000:1.0:1715330285.976890:0:7134:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880091ffae40 with version 667 00000100:00100000:0.0:1715330285.978473:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942434304 00000100:00100000:0.0:1715330285.978480:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942434304 00000100:00100000:0.0:1715330285.978524:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2492 00000100:00100000:0.0:1715330285.978530:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:8587:x1798653942434304:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330285.978907:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:8587:x1798653942434304:12345-0@lo:1000:osp_up1-0.0 Request processed in 376us (1567us total) trans 4294968353 rc 0/0 00000100:00100000:0.0:1715330285.978915:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2492 00000004:00200000:1.0:1715330285.979032:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1510:0x0]: returning size 4096 00010000:00010000:1.0:1715330285.979052:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d8c0/0xd895711d66d7cfa lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330285.979060:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d8c0/0xd895711d66d7cfa lrc: 2/0,0 mode: EX/EX res: [0x200000400:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330285.979066:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d8c0/0xd895711d66d7cfa lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330285.979072:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457d8c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330285.979075:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d8c0/0xd895711d66d7cfa lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330285.979081:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d8c0/0xd895711d66d7cfa lrc: 4/0,0 mode: EX/EX res: [0x200000400:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330285.979093:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xc6:0x0].0x0 (ffff88012bd8b200) 00010000:00010000:1.0:1715330285.979096:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330285.979099:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d8c0/0xd895711d66d7cfa lrc: 2/0,0 mode: --/EX res: [0x200000400:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330285.979104:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d8c0/0xd895711d66d7cfa lrc: 0/0,0 mode: --/EX res: [0x200000400:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330285.979114:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7d01 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7d08 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.979120:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7d01 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d7d08 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.979129:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7d01 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d7d08 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.979154:0:7134:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1715330285.979160:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0xc6:0x0] 00010000:00010000:1.0:1715330285.979165:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d7cf3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1510:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330285.979170:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d7cf3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1510:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330285.979174:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d7cf3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1510:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330285.979178:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457c480 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330285.979180:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d7cf3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1510:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330285.979184:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d7cf3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1510:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330285.979191:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1510:0x0].0x0 (ffff88012bd8b300) 00010000:00010000:1.0:1715330285.979193:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330285.979195:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d7cf3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1510:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330285.979199:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d7cf3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1510:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330285.979207:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457ef40/0xd895711d66d7ce5 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1510:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7cec expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.979217:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457ef40/0xd895711d66d7ce5 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1510:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d7cec expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.979223:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457ef40/0xd895711d66d7ce5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1510:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d7cec expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.979839:0:7134:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:1.0:1715330285.979957:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:1.0:1715330285.979962:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db64480/0xd895711d66d7cc9 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7cd0 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.979969:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db64480/0xd895711d66d7cc9 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d7cd0 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.979974:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db64480/0xd895711d66d7cc9 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d7cd0 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.980011:0:7124:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1715330285.980017:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7d01 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d7d08 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.980023:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfc6c0 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330285.980027:0:7124:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7d01 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d7d08 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330285.980033:0:7124:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7d01 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d7d08 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.980055:0:7124:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7d01 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7d08 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.980061:0:7124:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330285.980088:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7d01 lrc: 1/0,0 mode: --/EX res: [0x240000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7d08 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.980093:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7d01 lrc: 0/0,0 mode: --/EX res: [0x240000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7d08 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.980105:0:7124:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1715330285.980108:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457ef40/0xd895711d66d7ce5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1510:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d7cec expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.980112:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457ef40 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330285.980115:0:7124:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457ef40/0xd895711d66d7ce5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1510:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d7cec expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330285.980121:0:7124:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457ef40/0xd895711d66d7ce5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1510:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d7cec expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.980139:0:7124:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457ef40/0xd895711d66d7ce5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1510:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7cec expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.980143:0:7124:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330285.980767:0:7134:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00000004:00080000:1.0:1715330285.980773:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:1.0:1715330285.980785:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942434496:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330285.980937:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457ef40/0xd895711d66d7ce5 lrc: 1/0,0 mode: --/EX res: [0x200000402:0x1510:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7cec expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.980944:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457ef40/0xd895711d66d7ce5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1510:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7cec expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.980956:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330285.980957:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330285.980959:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330285.981222:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330285.981299:0:10673:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942434368 00000100:00100000:0.0:1715330285.981304:0:10673:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942434368 00000100:00100000:0.0:1715330285.981335:0:10673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1263 00000100:00100000:0.0:1715330285.981340:0:10673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+10:3688:x1798653942434368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330285.981349:0:10673:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330285.981361:0:10673:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d7d08 lrc: 0/0,0 mode: --/EX res: [0x240000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d7d01 expref: 10 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.981372:0:10673:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc6:0x0].0x0 (ffff8800b1fd9e00) 00010000:00010000:0.0:1715330285.981380:0:10673:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330285.981412:0:10673:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+9:3688:x1798653942434368:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.981418:0:10673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1263 00010000:00010000:1.0:1715330285.981458:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db64240/0xd895711d66d7cd7 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526f3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7cde expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.981465:0:7134:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db64240/0xd895711d66d7cd7 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526f3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7cde expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330285.981494:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330285.981508:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1715330285.981512:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942434432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330285.981529:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330285.981656:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1265 00000100:00100000:0.0:1715330285.981661:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+9:3691:x1798653942434432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330285.981667:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330285.981675:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2400/0xd895711d66d7cec lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1510:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d7ce5 expref: 9 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330285.981683:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1510:0x0].0x0 (ffff8800aa391e00) 00010000:00010000:0.0:1715330285.981688:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330285.981839:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942434496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330285.981877:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+17:16880:x1798653938017408:12345-192.168.204.49@tcp:36:rmdir.0 Request processed in 36637us (36768us total) trans 4294983407 rc 0/0 00000100:00100000:1.0:1715330285.981883:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23286 00000100:00100000:0.0:1715330285.981940:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+7:3691:x1798653942434432:12345-0@lo:103:ldlm_bl.0 Request processed in 278us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330285.981946:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1265 00000100:00100000:1.0:1715330285.982376:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942434432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330285.997441:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938017600 00000100:00100000:1.0:1715330285.997449:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938017600 00000100:00100000:1.0:1715330285.997713:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23287 00000100:00100000:1.0:1715330285.997720:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+17:16881:x1798653938017600:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:1.0:1715330285.997760:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330285.997777:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcb40/0xd895711d66d7d0f lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb49b expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.997824:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d7d16 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330285.997834:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d7d16 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330285.997843:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d7d16 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330285.997853:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66d7d1d lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x814526f4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330285.997858:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66d7d1d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330285.997866:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66d7d1d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330285.997901:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d7d16 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330285.997906:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d7d16 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330285.997910:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d7d16 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330285.997914:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d7d16 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330285.997919:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfcd80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330285.997922:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d7d16 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330285.997927:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d7d16 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330285.997935:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff8800b1fd9b00) 00010000:00010000:1.0:1715330285.997938:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330285.997941:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d7d16 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330285.997946:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d7d16 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330285.997959:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66d7d1d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330285.997964:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66d7d1d lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330285.997968:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66d7d1d lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330285.997972:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfe1c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330285.997974:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66d7d1d lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330285.997978:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66d7d1d lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330285.997984:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x814526f4 (ffff88008b2f5f00) 00010000:00010000:1.0:1715330285.997986:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330285.997988:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66d7d1d lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x814526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330285.997992:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66d7d1d lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x814526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330285.998016:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcb40/0xd895711d66d7d0f lrc: 1/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb49b expref: 18 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.998023:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcb40/0xd895711d66d7d0f lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb49b expref: 18 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330285.998030:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfcb40, rc 0) 00000100:00100000:1.0:1715330285.998204:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+17:16881:x1798653938017600:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 482us (834us total) trans 0 rc 301/301 00000100:00100000:1.0:1715330285.998211:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23287 00000100:00100000:1.0:1715330286.000861:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330286.000905:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938017664 00000100:00100000:0.0:1715330286.000910:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938017664 00000100:00100000:0.0:1715330286.000936:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23288 00000100:00100000:0.0:1715330286.000941:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+6:16881:x1798653938017664:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:0.0:1715330286.000954:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330286.000970:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2400/0xd895711d66d7d24 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb4a2 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.001004:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d7d2b lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.001011:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d7d2b lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330286.001018:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d7d2b lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00000004:00200000:0.0:1715330286.001051:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000401:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1715330286.001054:0:7134:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1715330286.001074:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2400/0xd895711d66d7d24 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb4a2 expref: 8 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.001089:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d7d2b lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb4a2 expref: 7 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.001095:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88012bd8b600) 00010000:00010000:0.0:1715330286.001097:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1715330286.001099:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f3cc0, rc 0) 00000100:00100000:0.0:1715330286.001533:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+7:16881:x1798653938017664:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 590us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.001539:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23288 00000100:00100000:0.0:1715330286.007152:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942434560 00000100:00100000:0.0:1715330286.007156:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942434560 00000100:00100000:0.0:1715330286.007190:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2493 00000100:00100000:0.0:1715330286.007195:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:7134:x1798653942434560:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330286.007367:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:7134:x1798653942434560:12345-0@lo:1000:mdt00_001.0 Request processed in 171us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.007374:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2493 00000100:00100000:0.0:1715330286.008187:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942434624 00000100:00100000:0.0:1715330286.008191:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942434624 00000100:00100000:0.0:1715330286.008214:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2494 00000100:00100000:0.0:1715330286.008218:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:7134:x1798653942434624:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330286.008280:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:7134:x1798653942434624:12345-0@lo:1000:mdt00_001.0 Request processed in 61us (663us total) trans 0 rc -2/-2 00000100:00100000:0.0:1715330286.008285:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2494 00000100:00100000:0.0:1715330286.014273:0:10673:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938017856 00000100:00100000:0.0:1715330286.014278:0:10673:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938017856 00010000:00010000:0.0:1715330286.014300:0:10673:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d7c44 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb478 expref: 17 pid: 7135 timeout: 360 lvb_type: 0 00000100:00100000:0.0:1715330286.014333:0:10673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1480 00000100:00100000:0.0:1715330286.014339:0:10673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:72de1896-1df4-4b3a-930a-9116d2c66168+17:2011:x1798653938017856:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1715330286.014349:0:10673:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330286.014354:0:10673:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d7c44 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb478 expref: 17 pid: 7135 timeout: 360 lvb_type: 0 00010000:00010000:0.0:1715330286.014364:0:10673:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d7c44 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb478 expref: 17 pid: 7135 timeout: 360 lvb_type: 0 00010000:00010000:0.0:1715330286.014381:0:10673:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d7c44 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb478 expref: 17 pid: 7135 timeout: 360 lvb_type: 0 00010000:00010000:0.0:1715330286.014391:0:10673:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff8800b1fd9b00) 00010000:00010000:0.0:1715330286.014394:0:10673:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d7d39 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7d32 expref: 8 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.014402:0:10673:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d7d39 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d7d32 expref: 8 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.014408:0:10673:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d7d39 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d7d32 expref: 8 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.014430:0:10673:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d7d39 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7d32 expref: 8 pid: 9408 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330286.014441:0:10673:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4eb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:10673:1798653942434816:0@lo:105: 00000100:00100000:0.0:1715330286.014468:0:10673:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330286.014479:0:10673:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffce40 going to sleep for 11 seconds 00000100:00100000:0.0:1715330286.015026:0:10673:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4eb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:10673:1798653942434816:0@lo:105: 00010000:00010000:0.0:1715330286.015035:0:10673:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330286.015059:0:10673:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:72de1896-1df4-4b3a-930a-9116d2c66168+16:2011:x1798653938017856:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 720us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.015065:0:10673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1480 00000004:00080000:0.0:1715330286.018581:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 717 rpc_version 717 00000020:00100000:0.0:1715330286.018602:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1715330286.018607:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008d4eb480 x1798653942435328/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715330286.018618:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4eb480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942435328:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330286.018645:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330286.018654:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffce40 going to sleep for 11 seconds 00000100:00100000:0.0:1715330286.023141:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4eb480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942435328:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330286.025007:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1715330286.025016:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942435456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330286.025037:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330286.025054:0:10673:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942435456 00000100:00100000:0.0:1715330286.025057:0:10673:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942435456 00000100:00100000:0.0:1715330286.025072:0:10673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1266 00000100:00100000:0.0:1715330286.025075:0:10673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+12:3689:x1798653942435456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330286.025081:0:10673:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330286.025092:0:10673:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d7d39 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d7d32 expref: 12 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.025101:0:10673:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff8800b1fd9b00) 00010000:00010000:0.0:1715330286.025107:0:10673:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330286.025125:0:10673:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+11:3689:x1798653942435456:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.025130:0:10673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1266 00000100:00100000:0.0:1715330286.025150:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942435456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330286.042453:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330286.042518:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938018048 00000100:00100000:1.0:1715330286.042525:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938018048 00000100:00100000:1.0:1715330286.042570:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23291 00000100:00100000:1.0:1715330286.042576:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+16:16883:x1798653938018048:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:1.0:1715330286.042592:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330286.042608:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d7d6a lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb4a9 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.042652:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d7d71 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.042661:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d7d71 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.042668:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d7d71 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.042674:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d7d78 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x814526f4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.042680:0:7135:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c000/0xd895711d66d7d47 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f4 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7d40 expref: 10 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.042685:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d7d78 lrc: 4/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x814526f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.042706:0:7135:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c000/0xd895711d66d7d47 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f4 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd895711d66d7d40 expref: 10 pid: 9408 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330286.042717:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5ee300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7135:1798653942435520:0@lo:104: 00000100:00100000:1.0:1715330286.042769:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.042780:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa000 going to sleep for 11 seconds 00000100:00100000:0.0:1715330286.042839:0:7118:0:(service.c:168:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1715330286.042847:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942435520 00000100:00100000:0.0:1715330286.042849:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942435520 00000100:00100000:0.0:1715330286.042870:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1126 00000100:00100000:0.0:1715330286.042874:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca76450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:7135:x1798653942435520:12345-0@lo:104: 00010000:00010000:0.0:1715330286.042882:0:7118:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64fc0/0xd895711d66d7d40 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d7d47 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.042912:0:7118:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1715330286.042916:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca76450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:7135:x1798653942435520:12345-0@lo:104: Request processed in 41us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.042920:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1126 00010000:00010000:0.0:1715330286.042952:0:7124:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715330286.042957:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64fc0/0xd895711d66d7d40 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d7d47 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.042963:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64fc0 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330286.042967:0:7124:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64fc0/0xd895711d66d7d40 lrc: 4/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f4 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd895711d66d7d47 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330286.042974:0:7124:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64fc0/0xd895711d66d7d40 lrc: 4/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f4 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd895711d66d7d47 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.042992:0:7124:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64fc0/0xd895711d66d7d40 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x814526f4 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d7d47 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.042998:0:7124:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330286.043024:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64fc0/0xd895711d66d7d40 lrc: 1/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x814526f4 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d7d47 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.043029:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64fc0/0xd895711d66d7d40 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x814526f4 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d7d47 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.043043:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330286.043044:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330286.043046:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330286.043054:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942435584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330286.043073:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.043202:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5ee300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7135:1798653942435520:0@lo:104: 00010000:00010000:1.0:1715330286.043214:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d7d78 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x814526f4 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000020:00080000:1.0:1715330286.051972:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 365 committed batchid 364 00000100:00100000:0.0:1715330286.052125:0:10673:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942435648 00000100:00100000:0.0:1715330286.052133:0:10673:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942435648 00000100:00100000:0.0:1715330286.052162:0:10673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1267 00000100:00100000:0.0:1715330286.052168:0:10673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+7:3690:x1798653942435648:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1715330286.052178:0:10673:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330286.052190:0:10673:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f06c0/0xd895711d66d7cde lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x814526f3 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d7cd7 expref: 7 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.052200:0:10673:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x814526f3 (ffff88012bd8b500) 00010000:00010000:0.0:1715330286.052206:0:10673:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330286.052234:0:10673:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+6:3690:x1798653942435648:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 65us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.052240:0:10673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1267 00000100:00100000:0.0:1715330286.052595:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942435584:0@lo:103:ldlm_bl.0 00000004:00080000:1.0:1715330286.052955:0:7163:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880091ffacc0 with version 668 00000020:00080000:1.0:1715330286.052962:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 364 cancel update log [0x240000401:0x3:0x0].348: rc = 0 00000020:00080000:1.0:1715330286.052996:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 364 cancel update log [0x200000400:0x3:0x0].349: rc = 0 00000020:00080000:1.0:1715330286.053002:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 364 00010000:00010000:1.0:1715330286.053012:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d7d78 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.053018:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d7d78 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000100:00100000:1.0:1715330286.053082:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5ee300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942435712:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330286.053110:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.053120:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4333300 going to sleep for 11 seconds 00000100:00100000:1.0:1715330286.053317:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2504 00000100:00100000:1.0:1715330286.053323:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7135:x1798653942435712:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330286.053378:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7135:x1798653942435712:12345-0@lo:1000:mdt00_002.0 Request processed in 55us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.053383:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2504 00000100:00100000:1.0:1715330286.053405:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5ee300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942435712:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1715330286.053433:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66d7d7f lrc: 3/1,0 mode: --/PR res: [0x240000402:0x182:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.053441:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66d7d7f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x182:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.053451:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66d7d7f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x182:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00010000:1.0:1715330286.053466:0:7135:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66d7d7f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x182:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.053477:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d7d71 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.053481:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d7d71 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.053485:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d7d71 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.053490:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d7d71 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.053494:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfef40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330286.053497:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d7d71 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.053502:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d7d71 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.053509:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88008b2f5900) 00010000:00010000:1.0:1715330286.053510:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330286.053513:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d7d71 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.053517:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d7d71 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.053525:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d7d78 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.053528:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d7d78 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.053532:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d7d78 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.053535:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfdf80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330286.053537:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d7d78 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.053540:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d7d78 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.053545:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x814526f4 (ffff88009ef18100) 00010000:00010000:1.0:1715330286.053557:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330286.053559:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d7d78 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x814526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.053564:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d7d78 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x814526f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.053590:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d7d6a lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb4a9 expref: 15 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.053604:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66d7d7f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x182:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb4a9 expref: 14 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.053610:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x182:0x0].0x0 (ffff8800b1fd9d00) 00010000:00010000:1.0:1715330286.053612:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1715330286.053613:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bff3c0, rc 0) 00000100:00100000:1.0:1715330286.054620:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+14:16883:x1798653938018048:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 12043us (12172us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.054628:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23291 00000100:00100000:1.0:1715330286.061873:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330286.066703:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938018176 00000100:00100000:0.0:1715330286.066712:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938018176 00000100:00100000:0.0:1715330286.066779:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23293 00000100:00100000:0.0:1715330286.066787:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+10:16883:x1798653938018176:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:0.0:1715330286.066801:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330286.066866:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2400/0xd895711d66d7d94 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xc4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb4b7 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.066908:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d7d9b lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.066918:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d7d9b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330286.066927:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d7d9b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00000004:00200000:0.0:1715330286.066962:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000400:0xc4:0x0]: returning size 4096 00000004:00200000:0.0:1715330286.066965:0:7134:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1715330286.066990:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2400/0xd895711d66d7d94 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xc4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb4b7 expref: 12 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.067382:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d7d9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb4b7 expref: 11 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.067390:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc4:0x0].0x0 (ffff880092d89200) 00010000:00010000:0.0:1715330286.067392:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1715330286.067394:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f3a80, rc 0) 00000100:00100000:0.0:1715330286.068060:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+11:16883:x1798653938018176:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 1272us (1410us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.068067:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23293 00000100:00100000:0.0:1715330286.074033:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330286.074719:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942435904 00000100:00100000:0.0:1715330286.074722:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942435904 00000100:00100000:0.0:1715330286.074793:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1127 00000100:00100000:0.0:1715330286.074798:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801345a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:7134:x1798653942435904:12345-0@lo:104: 00010000:00010000:0.0:1715330286.074807:0:7118:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db661c0/0xd895711d66d7d5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d7d63 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.074850:0:7118:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1715330286.074855:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801345a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:7134:x1798653942435904:12345-0@lo:104: Request processed in 56us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.074860:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1127 00010000:00010000:1.0:1715330286.074922:0:7123:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715330286.074928:0:7123:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db661c0/0xd895711d66d7d5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d7d63 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.074934:0:7123:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db661c0 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330286.074939:0:7123:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db661c0/0xd895711d66d7d5c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc4:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd895711d66d7d63 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330286.074947:0:7123:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db661c0/0xd895711d66d7d5c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc4:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd895711d66d7d63 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.074967:0:7123:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db661c0/0xd895711d66d7d5c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc4:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d7d63 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.074972:0:7123:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330286.074997:0:7123:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db661c0/0xd895711d66d7d5c lrc: 1/0,0 mode: --/PW res: [0x200000401:0xc4:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d7d63 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.075002:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db661c0/0xd895711d66d7d5c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc4:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d7d63 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.075017:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330286.075018:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330286.075019:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1715330286.078125:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 365 00000004:00080000:1.0:1715330286.078176:0:7163:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8800b4333300 with version 669 00000020:00080000:1.0:1715330286.078183:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 365 cancel update log [0x240000401:0x3:0x0].349: rc = 0 00000020:00080000:1.0:1715330286.078240:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 365 cancel update log [0x200000400:0x3:0x0].350: rc = 0 00000020:00080000:1.0:1715330286.078246:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 365 00000100:00100000:0.0:1715330286.078497:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942436096 00000100:00100000:0.0:1715330286.078502:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942436096 00000100:00100000:0.0:1715330286.078524:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2506 00000100:00100000:0.0:1715330286.078528:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d799500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:8587:x1798653942436096:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330286.078890:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d799500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:8587:x1798653942436096:12345-0@lo:1000:osp_up1-0.0 Request processed in 360us (457us total) trans 4294968356 rc 0/0 00000100:00100000:1.0:1715330286.078897:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2506 00000100:00100000:1.0:1715330286.081110:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330286.084292:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942436160 00000100:00100000:1.0:1715330286.084296:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942436160 00000100:00100000:1.0:1715330286.084326:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2507 00000100:00100000:1.0:1715330286.084330:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:7134:x1798653942436160:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330286.084339:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330286.084351:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66d7db7 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d7db0 expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.084368:0:9408:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66d7db7 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d7db0 expref: 6 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.084377:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66d7db7 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7db0 expref: 6 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.084383:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff8800b1fd9b00) 00010000:00010000:1.0:1715330286.084385:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330286.084387:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfe640, rc 0) 00000100:00100000:1.0:1715330286.084416:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:7134:x1798653942436160:12345-0@lo:101:mdt00_001.0 Request processed in 85us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.084420:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2507 00000020:00080000:1.0:1715330286.084752:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 372 committed batchid 371 00000020:00080000:1.0:1715330286.084790:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 371 00000100:00100000:1.0:1715330286.085574:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942436288 00000100:00100000:1.0:1715330286.085578:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942436288 00000100:00100000:1.0:1715330286.085623:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2509 00000100:00100000:1.0:1715330286.085627:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7134:x1798653942436288:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330286.085673:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7134:x1798653942436288:12345-0@lo:1000:mdt00_001.0 Request processed in 45us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.085678:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2509 00000100:00100000:1.0:1715330286.091311:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938018496 00000100:00100000:1.0:1715330286.091316:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938018496 00010000:00010000:1.0:1715330286.091336:0:7120:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d7d9b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb4b7 expref: 11 pid: 7134 timeout: 360 lvb_type: 0 00000100:00100000:1.0:1715330286.091365:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1483 00000100:00100000:1.0:1715330286.091371:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d798000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72de1896-1df4-4b3a-930a-9116d2c66168+11:2011:x1798653938018496:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1715330286.091381:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330286.091385:0:7120:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d7d9b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb4b7 expref: 11 pid: 7134 timeout: 360 lvb_type: 0 00010000:00010000:1.0:1715330286.091394:0:7120:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d7d9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb4b7 expref: 11 pid: 7134 timeout: 360 lvb_type: 0 00010000:00010000:1.0:1715330286.091409:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d7d9b lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb4b7 expref: 11 pid: 7134 timeout: 360 lvb_type: 0 00010000:00010000:1.0:1715330286.091423:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc4:0x0].0x0 (ffff880092d89200) 00010000:00010000:1.0:1715330286.091427:0:7120:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88013457dd40/0xd895711d66d7de1 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330286.091434:0:7120:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457dd40/0xd895711d66d7de1 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330286.091440:0:7120:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457dd40/0xd895711d66d7de1 lrc: 4/0,1 mode: EX/EX res: [0x240000400:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330286.091453:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330286.091489:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d798000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72de1896-1df4-4b3a-930a-9116d2c66168+10:2011:x1798653938018496:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 116us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.091494:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1483 00000100:00100000:0.0:1715330286.093602:0:23404:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d61ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:23404:1798653942436608:192.168.204.49@tcp:104: 00010000:00010000:0.0:1715330286.093620:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d7def lrc: 3/0,0 mode: --/EX res: [0x200000401:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7de8 expref: 9 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.093628:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc4:0x0].0x0 (ffff88009ef18a00) 00010000:00010000:0.0:1715330286.093631:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715330286.093634:0:23404:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d7def lrc: 3/0,0 mode: --/EX res: [0x200000401:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7de8 expref: 9 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.093641:0:23404:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d7def lrc: 3/0,0 mode: --/EX res: [0x200000401:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7de8 expref: 9 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.093650:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db673c0, rc 0) 00000100:00100000:0.0:1715330286.093690:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d41a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7134:x1798653942436544:12345-0@lo:101:mdt00_001.0 Request processed in 1918us (2026us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.093701:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2512 00000100:00100000:0.0:1715330286.094631:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330286.097009:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942436736 00000100:00100000:0.0:1715330286.097013:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942436736 00000100:00100000:0.0:1715330286.097044:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2513 00000100:00100000:0.0:1715330286.097049:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7134:x1798653942436736:12345-0@lo:403:mdt00_001.0 00000100:00100000:0.0:1715330286.099377:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7134:x1798653942436736:12345-0@lo:403:mdt00_001.0 Request processed in 2324us (2520us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.099385:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2513 00000004:00080000:0.0:1715330286.101931:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 718 rpc_version 718 00000020:00100000:0.0:1715330286.101957:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1715330286.101964:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008d4e8000 x1798653942436864/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1808/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715330286.101981:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e8000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942436864:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330286.102020:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330286.102043:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffc540 going to sleep for 11 seconds 00000100:00100000:0.0:1715330286.103140:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e8000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942436864:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1715330286.104292:0:7124:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1715330286.104298:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457ed00/0xd895711d66d7de8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d7def expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.104303:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457ed00 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330286.104307:0:7124:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457ed00/0xd895711d66d7de8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d7def expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330286.104311:0:7124:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457ed00/0xd895711d66d7de8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d7def expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.104331:0:7124:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457ed00/0xd895711d66d7de8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7def expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.104336:0:7124:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330286.104350:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457ed00/0xd895711d66d7de8 lrc: 1/0,0 mode: --/EX res: [0x200000401:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7def expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.104354:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457ed00/0xd895711d66d7de8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7def expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.104364:0:7124:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1715330286.104366:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457eac0/0xd895711d66d7dcc lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x182:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d7dd3 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.104370:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457eac0 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330286.104373:0:7124:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457eac0/0xd895711d66d7dcc lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x182:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d7dd3 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330286.104377:0:7124:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457eac0/0xd895711d66d7dcc lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x182:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d7dd3 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.104386:0:7124:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457eac0/0xd895711d66d7dcc lrc: 2/0,0 mode: --/EX res: [0x240000402:0x182:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7dd3 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.104390:0:7124:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330286.104393:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457eac0/0xd895711d66d7dcc lrc: 1/0,0 mode: --/EX res: [0x240000402:0x182:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7dd3 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.104398:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457eac0/0xd895711d66d7dcc lrc: 0/0,0 mode: --/EX res: [0x240000402:0x182:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7dd3 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.104405:0:7124:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715330286.104407:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e880/0xd895711d66d7db0 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d7db7 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.104411:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457e880 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330286.104413:0:7124:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e880/0xd895711d66d7db0 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d7db7 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330286.104418:0:7124:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e880/0xd895711d66d7db0 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d7db7 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.104428:0:7124:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e880/0xd895711d66d7db0 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7db7 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.104432:0:7124:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330286.104440:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e880/0xd895711d66d7db0 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7db7 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.104445:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e880/0xd895711d66d7db0 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7db7 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330286.104752:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942436928 00000100:00100000:1.0:1715330286.104757:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942436928 00000100:00100000:1.0:1715330286.104777:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942436992 00000100:00100000:1.0:1715330286.104779:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942436992 00000100:00100000:1.0:1715330286.104789:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1269 00000100:00100000:1.0:1715330286.104794:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+11:3688:x1798653942436928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330286.104802:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330286.104814:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d7def lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d7de8 expref: 11 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.105576:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc4:0x0].0x0 (ffff88009ef18a00) 00010000:00010000:1.0:1715330286.105583:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330286.105609:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+8:3688:x1798653942436928:12345-0@lo:103:ldlm_bl.0 Request processed in 814us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.105613:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1269 00010000:00010000:0.0:1715330286.105760:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330286.105763:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330286.105765:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330286.122579:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938018688 00000100:00100000:1.0:1715330286.122587:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938018688 00000100:00100000:1.0:1715330286.122621:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23297 00000100:00100000:1.0:1715330286.122628:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d61c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+13:16884:x1798653938018688:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:1.0:1715330286.122643:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330286.122660:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66d7e0b lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb4cc expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.122701:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66d7e12 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.122711:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66d7e12 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.122719:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66d7e12 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00200000:1.0:1715330286.122773:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1715330286.122776:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1715330286.122801:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66d7e0b lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb4cc expref: 15 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.122815:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66d7e12 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb4cc expref: 14 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.122821:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88009ef25b00) 00010000:00010000:1.0:1715330286.122824:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1715330286.122826:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfeac0, rc 0) 00000100:00100000:1.0:1715330286.122875:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d61c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+14:16884:x1798653938018688:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 246us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.122881:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23297 00000100:00100000:0.0:1715330286.139795:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938018816 00000100:00100000:0.0:1715330286.139805:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938018816 00000100:00100000:0.0:1715330286.139837:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23298 00000100:00100000:0.0:1715330286.139843:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d61c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+14:16884:x1798653938018816:12345-192.168.204.49@tcp:36:lfs.0 00000100:00100000:0.0:1715330286.139917:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942437120:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1715330286.139958:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330286.139971:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffc180 going to sleep for 11 seconds 00000100:00100000:1.0:1715330286.142071:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942437120 00000100:00100000:1.0:1715330286.142078:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942437120 00000100:00100000:1.0:1715330286.142110:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2515 00000100:00100000:1.0:1715330286.142116:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:7135:x1798653942437120:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330286.142202:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:7135:x1798653942437120:12345-0@lo:1000:mdt00_002.0 Request processed in 85us (2243us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.142209:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2515 00000100:00100000:0.0:1715330286.142235:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942437120:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1715330286.142288:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942437184:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1715330286.142308:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330286.142317:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffc180 going to sleep for 11 seconds 00000100:00100000:1.0:1715330286.142351:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942437184 00000100:00100000:1.0:1715330286.142354:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942437184 00000100:00100000:1.0:1715330286.142605:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2516 00000100:00100000:1.0:1715330286.142610:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:7135:x1798653942437184:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330286.142665:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:7135:x1798653942437184:12345-0@lo:1000:mdt00_002.0 Request processed in 54us (355us total) trans 0 rc -2/-2 00000100:00100000:1.0:1715330286.142670:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2516 00000100:00100000:0.0:1715330286.142996:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942437184:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1715330286.143030:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f3840/0xd895711d66d7e19 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.143038:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f3840/0xd895711d66d7e19 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.143046:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f3840/0xd895711d66d7e19 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT0 00000100:00100000:0.0:1715330286.143054:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942437248:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330286.143056:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330286.143072:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330286.143095:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffcf00 going to sleep for 11 seconds 00000100:00100000:1.0:1715330286.143108:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942437248 00000100:00100000:1.0:1715330286.143111:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942437248 00000100:00100000:1.0:1715330286.143125:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2517 00000100:00100000:1.0:1715330286.143129:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:7135:x1798653942437248:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330286.143137:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330286.143147:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d7e20 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d7e19 expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.143171:0:9408:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d7d2b lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb4a2 expref: 9 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.143178:0:9408:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d7e20 lrc: 4/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d7e19 expref: 9 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.143195:0:9408:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d7d2b lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb4a2 expref: 9 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.143205:0:9408:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d7d2b lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb4a2 expref: 9 pid: 7134 timeout: 360 lvb_type: 0 00000100:00100000:1.0:1715330286.144831:0:9408:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5ed880 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:9408:1798653942437312:192.168.204.49@tcp:104: 00000100:00100000:1.0:1715330286.144883:0:9408:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330286.149259:0:9408:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5ed880 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:9408:1798653942437312:192.168.204.49@tcp:104: 00010000:00010000:1.0:1715330286.149281:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d7e20 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7e19 expref: 9 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.149290:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88012bd8b600) 00010000:00010000:1.0:1715330286.149293:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330286.149296:0:9408:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d7e20 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7e19 expref: 9 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.149303:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bffa80, rc 0) 00000100:00100000:1.0:1715330286.149345:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7135:x1798653942437248:12345-0@lo:101:mdt00_002.0 Request processed in 6214us (6271us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.149352:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2517 00000100:00100000:0.0:1715330286.149374:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942437248:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330286.149389:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f3840/0xd895711d66d7e19 lrc: 4/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7e20 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.149398:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f3840/0xd895711d66d7e19 lrc: 4/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7e20 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330286.150344:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942437376 00000100:00100000:0.0:1715330286.150347:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942437376 00000100:00100000:0.0:1715330286.150363:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1129 00000100:00100000:0.0:1715330286.150366:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d61ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7122:x1798653942437376:12345-0@lo:105: 00010000:00010000:0.0:1715330286.150372:0:7118:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f3840/0xd895711d66d7e19 lrc: 5/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7e20 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.150379:0:7118:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f3840/0xd895711d66d7e19 lrc: 5/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7e20 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.150384:0:7118:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f3840/0xd895711d66d7e19 lrc: 5/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7e20 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.150389:0:7118:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f3840/0xd895711d66d7e19 lrc: 5/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d7e20 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.150394:0:7118:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f3840/0xd895711d66d7e19 lrc: 6/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d7e20 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.150399:0:7118:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f3840/0xd895711d66d7e19 lrc: 6/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d7e20 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.150418:0:7118:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8800ad9f3840) 00000100:00100000:0.0:1715330286.150438:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d61ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7122:x1798653942437376:12345-0@lo:105: Request processed in 71us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.150442:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1129 00010000:00010000:1.0:1715330286.150488:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f3840/0xd895711d66d7e19 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7e20 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.150494:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f3840/0xd895711d66d7e19 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7e20 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330286.150509:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:1.0:1715330286.150527:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd680/0xd895711d66d7e27 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x814526f5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.150532:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd680/0xd895711d66d7e27 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x814526f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.150541:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd680/0xd895711d66d7e27 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x814526f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT0 00000100:00100000:1.0:1715330286.150561:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942437440:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1715330286.150579:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.150587:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330286.150962:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942437440 00000100:00100000:0.0:1715330286.150967:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942437440 00000100:00100000:0.0:1715330286.150989:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2518 00000100:00100000:0.0:1715330286.150993:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7135:x1798653942437440:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330286.151005:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330286.151015:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0480/0xd895711d66d7e2e lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x814526f5 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d7e27 expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.151027:0:9408:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0480/0xd895711d66d7e2e lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526f5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d7e27 expref: 10 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.151035:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0480/0xd895711d66d7e2e lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526f5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7e27 expref: 10 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.151041:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x814526f5 (ffff88012bd8b400) 00010000:00010000:0.0:1715330286.151043:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330286.151045:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f0480, rc 0) 00000100:00100000:0.0:1715330286.151065:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7135:x1798653942437440:12345-0@lo:101:mdt00_002.0 Request processed in 72us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.151070:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2518 00000100:00100000:1.0:1715330286.151290:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942437440:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330286.151300:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd680/0xd895711d66d7e27 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526f5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7e2e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.151308:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd680/0xd895711d66d7e27 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526f5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7e2e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330286.151318:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:1.0:1715330286.151340:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942437504:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330286.151360:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.151368:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa480 going to sleep for 11 seconds 00000100:00100000:0.0:1715330286.151396:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942437504 00000100:00100000:0.0:1715330286.151400:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942437504 00000100:00100000:0.0:1715330286.151414:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2519 00000100:00100000:0.0:1715330286.151417:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7135:x1798653942437504:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1715330286.151895:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7135:x1798653942437504:12345-0@lo:1000:mdt00_002.0 Request processed in 475us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.151901:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2519 00000100:00100000:1.0:1715330286.151951:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942437504:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330286.151979:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942437568:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330286.151997:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.152005:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa480 going to sleep for 11 seconds 00000100:00100000:0.0:1715330286.152047:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942437568 00000100:00100000:0.0:1715330286.152050:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942437568 00000100:00100000:0.0:1715330286.152071:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2520 00000100:00100000:0.0:1715330286.152075:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7135:x1798653942437568:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1715330286.152129:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7135:x1798653942437568:12345-0@lo:1000:mdt00_002.0 Request processed in 53us (131us total) trans 0 rc -2/-2 00000100:00100000:0.0:1715330286.152134:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2520 00000100:00100000:1.0:1715330286.152211:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942437568:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330286.152256:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942437632:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330286.152273:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.152280:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa480 going to sleep for 11 seconds 00000100:00100000:1.0:1715330286.152474:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942437632:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330286.152506:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942437696:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330286.152522:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.152637:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa480 going to sleep for 11 seconds 00000100:00100000:0.0:1715330286.152679:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942437696 00000100:00100000:0.0:1715330286.152682:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942437696 00000100:00100000:0.0:1715330286.152767:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2522 00000100:00100000:0.0:1715330286.152771:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7135:x1798653942437696:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1715330286.152810:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7135:x1798653942437696:12345-0@lo:1000:mdt00_002.0 Request processed in 38us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.152814:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2522 00000100:00100000:1.0:1715330286.152922:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942437696:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330286.152952:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942437760:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330286.152968:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.152976:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa480 going to sleep for 11 seconds 00000100:00100000:1.0:1715330286.153254:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942437760:0@lo:1000:mdt00_002.0 00000040:00080000:1.0:1715330286.153795:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].352, 2168 off540616 00000040:00080000:1.0:1715330286.153868:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].351, 2368 off581208 00000004:00080000:1.0:1715330286.153873:0:7135:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880091ffa0c0 with version 670 00010000:00010000:1.0:1715330286.155673:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d7e35 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1512:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.155689:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d7e35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1512:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.155697:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d7e35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1512:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.155711:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d7e3c lrc: 3/0,1 mode: --/PW res: [0x200000400:0xc7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.155717:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d7e3c lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.155722:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d7e3c lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.155752:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff3c0/0xd895711d66d7e43 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xc7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.155757:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff3c0/0xd895711d66d7e43 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.155765:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff3c0/0xd895711d66d7e43 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT0 00000100:00100000:1.0:1715330286.155774:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942437952:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1715330286.155797:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.155807:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47e000 going to sleep for 11 seconds 00000100:00100000:0.0:1715330286.155851:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942437952 00000100:00100000:0.0:1715330286.155864:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942437952 00000100:00100000:0.0:1715330286.155885:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2525 00000100:00100000:0.0:1715330286.155889:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:7135:x1798653942437952:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330286.155901:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330286.155913:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f21c0/0xd895711d66d7e4a lrc: 2/0,0 mode: --/PW res: [0x240000401:0xc7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d7e43 expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.155927:0:9408:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f21c0/0xd895711d66d7e4a lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d7e43 expref: 12 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.155934:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f21c0/0xd895711d66d7e4a lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7e43 expref: 12 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.155941:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc7:0x0].0x0 (ffff88012bd8ba00) 00010000:00010000:0.0:1715330286.155943:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330286.155945:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f21c0, rc 0) 00000100:00100000:0.0:1715330286.155968:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:7135:x1798653942437952:12345-0@lo:101:mdt00_002.0 Request processed in 78us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.155973:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2525 00000100:00100000:1.0:1715330286.156153:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942437952:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330286.156164:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff3c0/0xd895711d66d7e43 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7e4a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.156171:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff3c0/0xd895711d66d7e43 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7e4a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330286.156184:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008d61c000 reply state ffff88011dbbf000 transno 4294983410 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d7e3c lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.156192:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d7e3c lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.156197:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xc7:0x0].0x0 (ffff88009ef25400) 00010000:00010000:1.0:1715330286.156199:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330286.156202:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1715330286.156206:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff3c0/0xd895711d66d7e43 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7e4a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.156212:0:7135:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff3c0/0xd895711d66d7e43 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7e4a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330286.156223:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0xc7:0x0] 00000004:00010000:1.0:1715330286.156227:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008d61c000 reply state ffff88011dbbf000 transno 4294983410 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d7e35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1512:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.156233:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d7e35 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1512:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.156237:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1512:0x0].0x0 (ffff88009ef25100) 00010000:00010000:1.0:1715330286.156239:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330286.156241:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1715330286.156245:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1512:0x0]: returning size 4096 00000004:00080000:1.0:1715330286.156251:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:1.0:1715330286.156255:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f3840/0xd895711d66d7e19 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7e20 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.156261:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f3840/0xd895711d66d7e19 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d7e20 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.156267:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f3840/0xd895711d66d7e19 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d7e20 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.156284:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1715330286.156288:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:1.0:1715330286.156291:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd680/0xd895711d66d7e27 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526f5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7e2e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.156297:0:7135:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd680/0xd895711d66d7e27 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526f5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7e2e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330286.156344:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d61c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+16:16884:x1798653938018816:12345-192.168.204.49@tcp:36:lfs.0 Request processed in 16499us (18055us total) trans 4294983410 rc 0/0 00000100:00100000:1.0:1715330286.156350:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23298 00000100:00100000:0.0:1715330286.165449:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938019008 00000100:00100000:0.0:1715330286.165457:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938019008 00000100:00100000:0.0:1715330286.165505:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23299 00000100:00100000:0.0:1715330286.165512:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+9:16885:x1798653938019008:12345-192.168.204.49@tcp:36:mkdir.0 00000100:00100000:0.0:1715330286.165902:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+9:16885:x1798653938019008:12345-192.168.204.49@tcp:36:mkdir.0 Request processed in 389us (631us total) trans 0 rc -17/-17 00000100:00100000:0.0:1715330286.165908:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23299 00000100:00100000:0.0:1715330286.172595:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330286.173912:0:10673:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942438144 00000100:00100000:0.0:1715330286.173915:0:10673:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942438144 00010000:00010000:0.0:1715330286.173926:0:10673:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0480/0xd895711d66d7e2e lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526f5 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd895711d66d7e27 expref: 11 pid: 9408 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330286.173941:0:10673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1486 00000100:00100000:0.0:1715330286.173944:0:10673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+11:3688:x1798653942438144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330286.173951:0:10673:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330286.175850:0:8267:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457cfc0/0xd895711d66d7dbe lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d7dc5 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330286.175859:0:8267:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457cfc0/0xd895711d66d7dbe lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d7dc5 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.175879:0:8267:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457cfc0/0xd895711d66d7dbe lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x814526f4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7dc5 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.175883:0:8267:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330286.175894:0:8267:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457cfc0/0xd895711d66d7dbe lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x814526f4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7dc5 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1715330286.175905:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968358 is committed 00000001:00080000:0.0:1715330286.175924:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968357 is committed 00000020:00080000:0.0:1715330286.175929:0:8267:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0001: 372 batchid updated 00000020:00080000:0.0:1715330286.175939:0:8267:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff880078ab3240 refcount 2 committed 0 result 0 batchid 373 00000020:00080000:0.0:1715330286.175942:0:8267:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009ef2cb00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880078ab3c00 00000020:00080000:0.0:1715330286.175945:0:8267:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].375 00000020:00080000:0.0:1715330286.175946:0:8267:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009ef2c300 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88009396ea00 00000020:00080000:0.0:1715330286.175948:0:8267:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].374 00010000:00010000:0.0:1715330286.175963:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64900/0xd895711d66d7d4e lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x182:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330286.175969:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64900/0xd895711d66d7d4e lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x182:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330286.175973:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64900/0xd895711d66d7d4e lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x182:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330286.175977:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64900 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330286.175981:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64900/0xd895711d66d7d4e lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x182:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330286.175985:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64900/0xd895711d66d7d4e lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x182:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330286.175994:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x182:0x0].0x0 (ffff88009ef2cd00) 00000020:00080000:1.0:1715330286.175996:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 373 committed batchid 372 00010000:00010000:0.0:1715330286.175997:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330286.175999:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64900/0xd895711d66d7d4e lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x182:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330286.176006:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64900/0xd895711d66d7d4e lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x182:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330286.176016:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65f80/0xd895711d66d7d55 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330286.176020:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65f80/0xd895711d66d7d55 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xc4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330286.176023:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65f80/0xd895711d66d7d55 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330286.176026:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db65f80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330286.176028:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65f80/0xd895711d66d7d55 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330286.176031:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65f80/0xd895711d66d7d55 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xc4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330286.176036:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc4:0x0].0x0 (ffff880092d89200) 00010000:00010000:0.0:1715330286.176038:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330286.176039:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65f80/0xd895711d66d7d55 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xc4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330286.176043:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65f80/0xd895711d66d7d55 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xc4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00000004:00080000:1.0:1715330286.176058:0:8285:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88012f47ee40 with version 719 00000020:00080000:1.0:1715330286.176064:0:8285:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 372 cancel update log [0x200000401:0x3:0x0].374: rc = 0 00010000:00010000:0.0:1715330286.176081:0:10673:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0480/0xd895711d66d7e2e lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x814526f5 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd895711d66d7e27 expref: 7 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.176088:0:10673:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x814526f5 (ffff88012bd8b400) 00010000:00010000:0.0:1715330286.176091:0:10673:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66400/0xd895711d66d7e5f lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x814526f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000020:00080000:1.0:1715330286.176092:0:8285:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 372 cancel update log [0x240000400:0x3:0x0].373: rc = 0 00000020:00080000:1.0:1715330286.176097:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 372 00010000:00010000:0.0:1715330286.176098:0:10673:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66400/0xd895711d66d7e5f lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x814526f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.176103:0:10673:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66400/0xd895711d66d7e5f lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x814526f5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT1 00000100:00100000:1.0:1715330286.176106:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942438208:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1715330286.176114:0:10673:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330286.176132:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330286.176136:0:10673:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+6:3688:x1798653942438144:12345-0@lo:103:ldlm_bl.0 Request processed in 2191us (2357us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.176142:0:10673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1486 00000100:00100000:1.0:1715330286.176151:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942438208 00000100:00100000:1.0:1715330286.176154:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942438208 00000004:00080000:0.0:1715330286.176156:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 719 rpc_version 719 00000020:00100000:0.0:1715330286.176170:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1715330286.176171:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1273 00000100:00100000:0.0:1715330286.176174:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008d4e9880 x1798653942438336/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1715330286.176175:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+7:3689:x1798653942438208:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1715330286.176181:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1715330286.176185:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e9880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942438336:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1715330286.176191:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db661c0/0xd895711d66d7dc5 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x814526f4 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d7dbe expref: 7 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.176201:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x814526f4 (ffff88009396d800) 00000100:00100000:0.0:1715330286.176204:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1715330286.176206:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330286.176213:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffc000 going to sleep for 11 seconds 00000100:00100000:1.0:1715330286.176221:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+6:3689:x1798653942438208:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 45us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.176224:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942438336 00000100:00100000:1.0:1715330286.176225:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1273 00000100:00100000:0.0:1715330286.176226:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942438336 00000100:00100000:0.0:1715330286.176240:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2526 00000100:00100000:0.0:1715330286.176243:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:8278:x1798653942438336:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1715330286.176244:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942438208:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1715330286.176562:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:8278:x1798653942438336:12345-0@lo:1000:osp_up0-1.0 Request processed in 316us (356us total) trans 4294983411 rc 0/0 00000100:00100000:0.0:1715330286.176568:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2526 00000100:00100000:0.0:1715330286.176577:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942438400 00000100:00100000:0.0:1715330286.176580:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942438400 00000100:00100000:0.0:1715330286.176591:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2527 00000100:00100000:0.0:1715330286.176594:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7135:x1798653942438400:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330286.176703:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e9880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942438336:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330286.176939:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7135:x1798653942438400:12345-0@lo:1000:mdt00_002.0 Request processed in 343us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.176945:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2527 00000100:00100000:0.0:1715330286.194074:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00010000:00010000:0.0:1715330286.195542:0:7124:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715330286.195562:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff3c0/0xd895711d66d7e43 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d7e4a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.195569:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bff3c0 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330286.195573:0:7124:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff3c0/0xd895711d66d7e43 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0xc7:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd895711d66d7e4a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330286.195581:0:7124:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff3c0/0xd895711d66d7e43 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0xc7:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd895711d66d7e4a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.195599:0:7124:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff3c0/0xd895711d66d7e43 lrc: 2/0,0 mode: --/PW res: [0x240000401:0xc7:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d7e4a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.195604:0:7124:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330286.196141:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff3c0/0xd895711d66d7e43 lrc: 1/0,0 mode: --/PW res: [0x240000401:0xc7:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d7e4a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.196149:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff3c0/0xd895711d66d7e43 lrc: 0/0,0 mode: --/PW res: [0x240000401:0xc7:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d7e4a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.196164:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330286.196165:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330286.196167:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330286.196176:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942438528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330286.196204:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330286.196227:0:10673:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942438528 00000100:00100000:0.0:1715330286.196231:0:10673:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942438528 00010000:00010000:0.0:1715330286.196243:0:10673:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f21c0/0xd895711d66d7e4a lrc: 4/0,0 mode: PW/PW res: [0x240000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd895711d66d7e43 expref: 6 pid: 9408 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330286.196257:0:10673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1487 00000100:00100000:0.0:1715330286.196261:0:10673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+6:3690:x1798653942438528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330286.196267:0:10673:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00080000:0.0:1715330286.198160:0:8267:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0001: 373 batchid updated 00010000:00010000:0.0:1715330286.198212:0:10673:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f21c0/0xd895711d66d7e4a lrc: 0/0,0 mode: --/PW res: [0x240000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd895711d66d7e43 expref: 6 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.198223:0:10673:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc7:0x0].0x0 (ffff88012bd8ba00) 00010000:00010000:0.0:1715330286.198227:0:10673:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e880/0xd895711d66d7e90 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330286.198234:0:10673:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e880/0xd895711d66d7e90 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330286.198239:0:10673:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e880/0xd895711d66d7e90 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330286.198252:0:10673:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330286.198286:0:10673:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942438528:12345-0@lo:103:ldlm_bl.0 Request processed in 2023us (2080us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.198293:0:10673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1487 00000100:00100000:0.0:1715330286.198323:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942438528:0@lo:103:ldlm_bl.0 00000004:00080000:0.0:1715330286.199249:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 720 rpc_version 720 00000020:00100000:0.0:1715330286.199270:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1715330286.199277:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008d4e9500 x1798653942438656/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715330286.199292:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e9500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942438656:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330286.199319:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330286.199343:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffc0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330286.199602:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e9500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942438656:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330286.204191:0:10673:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938019328 00000100:00100000:0.0:1715330286.204199:0:10673:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938019328 00000100:00100000:0.0:1715330286.204367:0:10673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1274 00000100:00100000:0.0:1715330286.204372:0:10673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:72de1896-1df4-4b3a-930a-9116d2c66168+8:2011:x1798653938019328:12345-192.168.204.49@tcp:103:rmdir.0 00010000:00010000:0.0:1715330286.204379:0:10673:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330286.204390:0:10673:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db673c0/0xd895711d66d7e66 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1512:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb4d3 expref: 8 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.204399:0:10673:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1512:0x0].0x0 (ffff88009396d100) 00010000:00010000:0.0:1715330286.204406:0:10673:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330286.204431:0:10673:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:72de1896-1df4-4b3a-930a-9116d2c66168+7:2011:x1798653938019328:12345-192.168.204.49@tcp:103:rmdir.0 Request processed in 59us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.204437:0:10673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1274 00000020:00080000:0.0:1715330286.204698:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 366 committed batchid 365 00000020:00080000:0.0:1715330286.204755:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 365 00000100:00100000:0.0:1715330286.206330:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942438848 00000100:00100000:0.0:1715330286.206338:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942438848 00000100:00100000:0.0:1715330286.206360:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2531 00000100:00100000:0.0:1715330286.206365:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013027a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7134:x1798653942438848:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330286.206410:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013027a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7134:x1798653942438848:12345-0@lo:1000:mdt00_001.0 Request processed in 45us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.206416:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2531 00000100:00100000:1.0:1715330286.217747:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938019520 00000100:00100000:1.0:1715330286.217752:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938019520 00010000:00010000:1.0:1715330286.217778:0:7122:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d7e82 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb4e1 expref: 18 pid: 7134 timeout: 360 lvb_type: 0 00000100:00100000:1.0:1715330286.217799:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1488 00000100:00100000:1.0:1715330286.217804:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d61f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72de1896-1df4-4b3a-930a-9116d2c66168+18:2012:x1798653938019520:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1715330286.217815:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330286.217820:0:7122:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d7e82 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb4e1 expref: 18 pid: 7134 timeout: 360 lvb_type: 0 00010000:00010000:1.0:1715330286.217829:0:7122:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d7e82 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb4e1 expref: 18 pid: 7134 timeout: 360 lvb_type: 0 00010000:00010000:1.0:1715330286.217847:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d7e82 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb4e1 expref: 18 pid: 7134 timeout: 360 lvb_type: 0 00010000:00010000:1.0:1715330286.217857:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xc7:0x0].0x0 (ffff88009ef25400) 00010000:00010000:1.0:1715330286.217861:0:7122:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d7ec8 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.217869:0:7122:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d7ec8 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.217874:0:7122:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d7ec8 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.217888:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330286.217918:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d61f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:2012:x1798653938019520:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 113us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.217925:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1488 00000100:00100000:0.0:1715330286.218306:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942439104 00000100:00100000:0.0:1715330286.218310:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942439104 00000100:00100000:0.0:1715330286.218330:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2534 00000100:00100000:0.0:1715330286.218335:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f4b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:7134:x1798653942439104:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330286.218346:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330286.218358:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1f80/0xd895711d66d7ed6 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xc7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d7ecf expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.218373:0:9408:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e880/0xd895711d66d7e90 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb4e8 expref: 6 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.218379:0:9408:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1f80/0xd895711d66d7ed6 lrc: 4/0,0 mode: --/EX res: [0x240000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d7ecf expref: 9 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.218395:0:9408:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e880/0xd895711d66d7e90 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb4e8 expref: 6 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.218404:0:9408:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e880/0xd895711d66d7e90 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb4e8 expref: 6 pid: 7134 timeout: 360 lvb_type: 0 00000100:00100000:0.0:1715330286.218412:0:9408:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:9408:1798653942439168:192.168.204.49@tcp:104: 00000100:00100000:0.0:1715330286.218436:0:9408:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffc0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330286.223383:0:10673:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938019584 00000100:00100000:0.0:1715330286.223390:0:10673:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938019584 00010000:00010000:0.0:1715330286.223409:0:10673:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e880/0xd895711d66d7e90 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb4e8 expref: 7 pid: 7134 timeout: 360 lvb_type: 0 00000100:00100000:0.0:1715330286.223431:0:10673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1489 00000100:00100000:0.0:1715330286.223436:0:10673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:72de1896-1df4-4b3a-930a-9116d2c66168+7:2012:x1798653938019584:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1715330286.223446:0:10673:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330286.223451:0:10673:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e880/0xd895711d66d7e90 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb4e8 expref: 7 pid: 7134 timeout: 360 lvb_type: 0 00010000:00010000:0.0:1715330286.223460:0:10673:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e880/0xd895711d66d7e90 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb4e8 expref: 7 pid: 7134 timeout: 360 lvb_type: 0 00010000:00010000:0.0:1715330286.223475:0:10673:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e880/0xd895711d66d7e90 lrc: 0/0,0 mode: --/PR res: [0x240000401:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb4e8 expref: 7 pid: 7134 timeout: 360 lvb_type: 0 00010000:00010000:0.0:1715330286.223484:0:10673:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc7:0x0].0x0 (ffff88012bd8ba00) 00010000:00010000:0.0:1715330286.223487:0:10673:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1f80/0xd895711d66d7ed6 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7ecf expref: 8 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.223494:0:10673:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1f80/0xd895711d66d7ed6 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d7ecf expref: 8 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.223499:0:10673:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1f80/0xd895711d66d7ed6 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d7ecf expref: 8 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.223522:0:10673:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1f80/0xd895711d66d7ed6 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7ecf expref: 8 pid: 9408 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330286.223533:0:10673:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4ebb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001_UUID:10673:1798653942439232:0@lo:105: 00000100:00100000:0.0:1715330286.223566:0:10673:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330286.223579:0:10673:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffce40 going to sleep for 11 seconds 00010000:00010000:0.0:1715330286.224796:0:7134:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457ef40/0xd895711d66d7ecf lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7ed6 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.224804:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457ef40/0xd895711d66d7ecf lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7ed6 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330286.224978:0:10673:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4ebb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001_UUID:10673:1798653942439232:0@lo:105: 00010000:00010000:1.0:1715330286.224988:0:10673:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330286.227412:0:10673:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:72de1896-1df4-4b3a-930a-9116d2c66168+6:2012:x1798653938019584:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 3970us (4800us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.227423:0:10673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1489 00000100:00100000:0.0:1715330286.228025:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942439296:0@lo:403:mdt00_001.0 00000100:00100000:0.0:1715330286.228069:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330286.228081:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffcd80 going to sleep for 11 seconds 00000100:00100000:0.0:1715330286.228271:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942439296 00000100:00100000:0.0:1715330286.228277:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942439296 00000100:00100000:0.0:1715330286.228309:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2535 00000100:00100000:0.0:1715330286.228313:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7134:x1798653942439296:12345-0@lo:403:mdt00_001.0 00000100:00100000:0.0:1715330286.230924:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7134:x1798653942439296:12345-0@lo:403:mdt00_001.0 Request processed in 2605us (2850us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.230933:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2535 00000100:00100000:1.0:1715330286.231059:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942439296:0@lo:403:mdt00_001.0 00000040:00080000:1.0:1715330286.231915:0:7134:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].353, 664 off541280 00000040:00080000:1.0:1715330286.232024:0:7134:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].352, 744 off581952 00000004:00080000:1.0:1715330286.232028:0:7134:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88012f47e900 with version 671 00000100:00100000:0.0:1715330286.232442:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942439424 00000100:00100000:0.0:1715330286.232449:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942439424 00000100:00100000:0.0:1715330286.233097:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2536 00000100:00100000:0.0:1715330286.233103:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:8587:x1798653942439424:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330286.236004:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:8587:x1798653942439424:12345-0@lo:1000:osp_up1-0.0 Request processed in 2898us (3595us total) trans 4294968359 rc 0/0 00000100:00100000:0.0:1715330286.236015:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2536 00000004:00200000:1.0:1715330286.236502:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1512:0x0]: returning size 4096 00010000:00010000:1.0:1715330286.236521:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d7ec8 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.236530:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d7ec8 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.236536:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d7ec8 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.236541:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457e1c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330286.236551:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d7ec8 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.236557:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d7ec8 lrc: 4/0,0 mode: EX/EX res: [0x200000400:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.236568:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xc7:0x0].0x0 (ffff88009ef25400) 00010000:00010000:1.0:1715330286.236571:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330286.236573:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d7ec8 lrc: 2/0,0 mode: --/EX res: [0x200000400:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.236578:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d7ec8 lrc: 0/0,0 mode: --/EX res: [0x200000400:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.236587:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457ef40/0xd895711d66d7ecf lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7ed6 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.236593:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457ef40/0xd895711d66d7ecf lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d7ed6 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.236598:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457ef40/0xd895711d66d7ecf lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d7ed6 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330286.238174:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942439488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330286.238213:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330286.238365:0:10673:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079f38c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+9:3691:x1798653942439488:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330286.238370:0:10673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1275 00000100:00100000:0.0:1715330286.238481:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942439488:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330286.241078:0:7134:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1715330286.241086:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457ef40/0xd895711d66d7ecf lrc: 0/0,0 mode: --/EX res: [0x240000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7ed6 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330286.241106:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0xc7:0x0] 00010000:00010000:1.0:1715330286.241114:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c000/0xd895711d66d7ec1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1512:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.241120:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c000/0xd895711d66d7ec1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1512:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.241125:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c000/0xd895711d66d7ec1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1512:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.241130:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457c000 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330286.241134:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c000/0xd895711d66d7ec1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1512:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.241140:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c000/0xd895711d66d7ec1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1512:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.241149:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1512:0x0].0x0 (ffff88009ef25100) 00010000:00010000:1.0:1715330286.241152:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330286.241156:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c000/0xd895711d66d7ec1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1512:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.241160:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c000/0xd895711d66d7ec1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1512:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.241168:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457dd40/0xd895711d66d7eb3 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1512:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7eba expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.241174:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457dd40/0xd895711d66d7eb3 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1512:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d7eba expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.241179:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457dd40/0xd895711d66d7eb3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1512:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d7eba expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.241189:0:7134:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1715330286.241358:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:1.0:1715330286.241362:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457eac0/0xd895711d66d7e97 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7e9e expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.241368:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457eac0/0xd895711d66d7e97 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d7e9e expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.241373:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457eac0/0xd895711d66d7e97 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d7e9e expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.241382:0:7134:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:1.0:1715330286.241384:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:1.0:1715330286.241388:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f180/0xd895711d66d7ea5 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526f5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7eac expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.241396:0:7134:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f180/0xd895711d66d7ea5 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526f5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7eac expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330286.241455:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+17:16886:x1798653938019456:12345-192.168.204.49@tcp:36:rmdir.0 Request processed in 37207us (37260us total) trans 4294983413 rc 0/0 00000100:00100000:1.0:1715330286.241462:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23304 00000100:00100000:1.0:1715330286.241982:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942439616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330286.242015:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.242967:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1715330286.242974:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942439552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330286.242993:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.244065:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942439552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330286.244072:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942439616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330286.258187:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938019648 00000100:00100000:0.0:1715330286.258196:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938019648 00000100:00100000:0.0:1715330286.258358:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23305 00000100:00100000:0.0:1715330286.258407:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+17:16896:x1798653938019648:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:0.0:1715330286.258426:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330286.258440:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d7edd lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb4ef expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.258487:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d7ee4 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.258498:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d7ee4 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.258507:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d7ee4 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.258516:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d7eeb lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x814526f6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.258521:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d7eeb lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.258526:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d7eeb lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.258569:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d7ee4 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.258574:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d7ee4 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.258579:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d7ee4 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.258585:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d7ee4 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.258589:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f2640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330286.258592:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d7ee4 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.258598:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d7ee4 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.258607:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88009ef25b00) 00010000:00010000:0.0:1715330286.258610:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330286.258613:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d7ee4 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.258618:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d7ee4 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.258626:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d7eeb lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.258630:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d7eeb lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.258634:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d7eeb lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.258637:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f2ac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330286.258640:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d7eeb lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.258643:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d7eeb lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.258652:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x814526f6 (ffff88012bd8b800) 00010000:00010000:0.0:1715330286.258654:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330286.258655:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d7eeb lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.258659:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d7eeb lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.258680:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d7edd lrc: 1/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb4ef expref: 18 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.258686:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d7edd lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb4ef expref: 18 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.258692:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f0000, rc 0) 00000100:00100000:0.0:1715330286.258747:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+17:16896:x1798653938019648:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 365us (589us total) trans 0 rc 301/301 00000100:00100000:0.0:1715330286.258753:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23305 00000100:00100000:0.0:1715330286.262629:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938019712 00000100:00100000:0.0:1715330286.262637:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938019712 00000100:00100000:0.0:1715330286.262673:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23306 00000100:00100000:0.0:1715330286.262680:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+6:16896:x1798653938019712:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:0.0:1715330286.262694:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330286.263759:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d7ef2 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb4f6 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.263807:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d7ef9 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.263820:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d7ef9 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330286.263828:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d7ef9 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00000004:00200000:0.0:1715330286.263867:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000401:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1715330286.263870:0:7134:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1715330286.263893:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d7ef2 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb4f6 expref: 8 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.263904:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d7ef9 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb4f6 expref: 7 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.263910:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88012bd8bf00) 00010000:00010000:0.0:1715330286.263913:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1715330286.263915:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f1d40, rc 0) 00000100:00100000:0.0:1715330286.263959:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+7:16896:x1798653938019712:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 1276us (1927us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.263965:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23306 00000100:00100000:0.0:1715330286.267706:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330286.267745:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938019840 00000100:00100000:0.0:1715330286.267753:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938019840 00000100:00100000:0.0:1715330286.267796:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23307 00000100:00100000:0.0:1715330286.267802:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+7:16896:x1798653938019840:12345-192.168.204.49@tcp:36:lfs.0 00000100:00100000:0.0:1715330286.267881:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942439680:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330286.267915:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330286.267928:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffc900 going to sleep for 11 seconds 00000100:00100000:0.0:1715330286.267941:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942439680 00000100:00100000:0.0:1715330286.267943:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942439680 00000100:00100000:0.0:1715330286.267959:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2537 00000100:00100000:0.0:1715330286.267963:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130278000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:7134:x1798653942439680:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330286.268012:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130278000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:7134:x1798653942439680:12345-0@lo:1000:mdt00_001.0 Request processed in 46us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.268017:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2537 00000100:00100000:0.0:1715330286.268044:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942439680:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330286.268092:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942439744:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330286.268107:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330286.268114:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffc900 going to sleep for 11 seconds 00000100:00100000:0.0:1715330286.268121:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942439744 00000100:00100000:0.0:1715330286.268124:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942439744 00000100:00100000:0.0:1715330286.268136:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2538 00000100:00100000:0.0:1715330286.268139:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:7134:x1798653942439744:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330286.268185:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:7134:x1798653942439744:12345-0@lo:1000:mdt00_001.0 Request processed in 44us (77us total) trans 0 rc -2/-2 00000100:00100000:0.0:1715330286.268189:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2538 00000100:00100000:0.0:1715330286.268204:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942439744:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1715330286.268233:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1f80/0xd895711d66d7f00 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.268241:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1f80/0xd895711d66d7f00 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330286.268248:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1f80/0xd895711d66d7f00 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT1 00000100:00100000:0.0:1715330286.268256:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942439808:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1715330286.268272:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330286.268280:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffc180 going to sleep for 11 seconds 00000100:00100000:0.0:1715330286.268288:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942439808 00000100:00100000:0.0:1715330286.268291:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942439808 00000100:00100000:0.0:1715330286.268303:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2539 00000100:00100000:0.0:1715330286.268306:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:7134:x1798653942439808:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330286.268313:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330286.268324:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d7f07 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d7f00 expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.268340:0:9408:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66d7e12 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb4cc expref: 16 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.268348:0:9408:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d7f07 lrc: 4/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d7f00 expref: 9 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.268364:0:9408:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66d7e12 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb4cc expref: 16 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.268375:0:9408:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66d7e12 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb4cc expref: 16 pid: 7135 timeout: 360 lvb_type: 0 00000100:00100000:0.0:1715330286.268383:0:9408:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3e300 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:9408:1798653942439872:192.168.204.49@tcp:104: 00000100:00100000:0.0:1715330286.268413:0:9408:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffc900 going to sleep for 11 seconds 00000100:00100000:1.0:1715330286.275723:0:9408:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091c3e300 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:9408:1798653942439872:192.168.204.49@tcp:104: 00010000:00010000:1.0:1715330286.275978:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d7f07 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7f00 expref: 9 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.275984:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88009ef25b00) 00010000:00010000:1.0:1715330286.275986:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330286.275988:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f21c0, rc 0) 00000100:00100000:1.0:1715330286.276024:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7134:x1798653942439808:12345-0@lo:101:mdt00_001.0 Request processed in 7717us (7751us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.276029:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2539 00000100:00100000:0.0:1715330286.276040:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091c3d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942439808:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330286.276054:0:7134:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1f80/0xd895711d66d7f00 lrc: 4/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7f07 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.276067:0:7134:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1f80/0xd895711d66d7f00 lrc: 4/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7f07 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.276139:0:7134:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1f80/0xd895711d66d7f00 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7f07 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.276146:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1f80/0xd895711d66d7f00 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7f07 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1715330286.276164:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:2.0:1715330286.276182:0:10673:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d54000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:10673:1798653942439936:0@lo:105: 00010000:00010000:0.0:1715330286.276183:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f0480/0xd895711d66d7f0e lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x814526f6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.276189:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f0480/0xd895711d66d7f0e lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT1 00010000:00010000:2.0:1715330286.276190:0:10673:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715330286.276196:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f0480/0xd895711d66d7f0e lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT1 00000100:00100000:0.0:1715330286.276207:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942440000:0@lo:101:mdt00_001.0 00000100:00100000:2.0:1715330286.276215:0:10673:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:72de1896-1df4-4b3a-930a-9116d2c66168+16:2011:x1798653938019904:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 349us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330286.276220:0:10673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1490 00000100:00100000:0.0:1715330286.276229:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330286.276239:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffc180 going to sleep for 11 seconds 00000100:00100000:1.0:1715330286.276469:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942440000 00000100:00100000:1.0:1715330286.276473:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942440000 00000100:00100000:1.0:1715330286.276488:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2540 00000100:00100000:1.0:1715330286.276492:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7134:x1798653942440000:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330286.276502:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330286.276512:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66d7f15 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x814526f6 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d7f0e expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.276524:0:9408:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66d7f15 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d7f0e expref: 10 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.276531:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66d7f15 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7f0e expref: 10 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.276536:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x814526f6 (ffff88009ef25900) 00010000:00010000:1.0:1715330286.276538:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330286.276540:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfd680, rc 0) 00000100:00100000:1.0:1715330286.276578:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:7134:x1798653942440000:12345-0@lo:101:mdt00_001.0 Request processed in 85us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.276583:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2540 00000100:00100000:0.0:1715330286.276588:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091c3d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942440000:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330286.276597:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f0480/0xd895711d66d7f0e lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7f15 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.276604:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f0480/0xd895711d66d7f0e lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7f15 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1715330286.276617:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:0.0:1715330286.276641:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942440064:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330286.276662:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330286.276670:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffca80 going to sleep for 11 seconds 00000100:00100000:2.0:1715330286.276676:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942440064 00000100:00100000:2.0:1715330286.276680:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942440064 00000100:00100000:2.0:1715330286.276692:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2541 00000100:00100000:2.0:1715330286.276696:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:7134:x1798653942440064:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1715330286.276755:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:7134:x1798653942440064:12345-0@lo:1000:mdt00_001.0 Request processed in 57us (91us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330286.276760:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2541 00000100:00100000:0.0:1715330286.276764:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091c3d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942440064:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330286.276794:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942440128:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330286.276812:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330286.276820:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffca80 going to sleep for 11 seconds 00000100:00100000:1.0:1715330286.276826:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942440128 00000100:00100000:1.0:1715330286.276829:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942440128 00000100:00100000:2.0:1715330286.276877:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2542 00000100:00100000:2.0:1715330286.276882:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:7134:x1798653942440128:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1715330286.276935:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:7134:x1798653942440128:12345-0@lo:1000:mdt00_001.0 Request processed in 52us (122us total) trans 0 rc -2/-2 00000100:00100000:2.0:1715330286.276940:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2542 00000100:00100000:1.0:1715330286.276945:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091c3d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942440128:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330286.276991:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942440192:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330286.277009:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.277042:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47e240 going to sleep for 11 seconds 00000100:00100000:2.0:1715330286.277072:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942440192 00000100:00100000:2.0:1715330286.277075:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942440192 00000100:00100000:2.0:1715330286.277087:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2543 00000100:00100000:2.0:1715330286.277090:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d644e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:7134:x1798653942440192:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1715330286.277122:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d644e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:7134:x1798653942440192:12345-0@lo:1000:mdt00_001.0 Request processed in 30us (111us total) trans 0 rc -2/-2 00000100:00100000:2.0:1715330286.277127:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2543 00000100:00100000:1.0:1715330286.277133:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942440192:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330286.277164:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d646a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942440256:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330286.277181:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.277187:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47e240 going to sleep for 11 seconds 00000100:00100000:2.0:1715330286.277193:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942440256 00000100:00100000:2.0:1715330286.277196:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942440256 00000100:00100000:2.0:1715330286.277206:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2544 00000100:00100000:2.0:1715330286.277209:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d647480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:7134:x1798653942440256:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1715330286.277241:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d647480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:7134:x1798653942440256:12345-0@lo:1000:mdt00_001.0 Request processed in 31us (59us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330286.277245:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2544 00000100:00100000:1.0:1715330286.277251:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d646a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942440256:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330286.277277:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d646a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942440320:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330286.277290:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.277297:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47e240 going to sleep for 11 seconds 00000100:00100000:2.0:1715330286.277303:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942440320 00000100:00100000:2.0:1715330286.277305:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942440320 00000100:00100000:2.0:1715330286.277315:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2545 00000100:00100000:2.0:1715330286.277318:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d646300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:7134:x1798653942440320:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1715330286.277345:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d646300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:7134:x1798653942440320:12345-0@lo:1000:mdt00_001.0 Request processed in 26us (53us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330286.277349:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2545 00000100:00100000:1.0:1715330286.277354:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d646a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942440320:0@lo:1000:mdt00_001.0 00000040:00080000:1.0:1715330286.277909:0:7134:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].376, 2168 off570840 00000040:00080000:1.0:1715330286.277955:0:7134:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].378, 2368 off624960 00000004:00080000:1.0:1715330286.277958:0:7134:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88012f47e780 with version 721 00000004:00080000:2.0:1715330286.277998:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 721 rpc_version 721 00000020:00100000:2.0:1715330286.278017:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1715330286.278022:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008b0c2d80 x1798653942440448/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1715330286.278032:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c2d80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942440448:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1715330286.278054:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330286.278072:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009d7e3180 going to sleep for 11 seconds 00000100:00100000:2.0:1715330286.278512:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c2d80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942440448:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1715330286.278606:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d7f1c lrc: 3/0,1 mode: --/PW res: [0x240000402:0x184:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.278615:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d7f1c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x184:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330286.278622:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d7f1c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x184:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330286.278633:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d7f23 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.278638:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d7f23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330286.278643:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d7f23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330286.278658:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfdf80/0xd895711d66d7f2a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.278663:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfdf80/0xd895711d66d7f2a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330286.278669:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfdf80/0xd895711d66d7f2a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT1 00000100:00100000:1.0:1715330286.278677:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d646a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942440512:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1715330286.278693:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.278711:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330286.278968:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d646a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942440512:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330286.278976:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfdf80/0xd895711d66d7f2a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7f31 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.278983:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfdf80/0xd895711d66d7f2a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7f31 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330286.278993:0:7134:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008d4eb480 reply state ffff88011dbbb000 transno 4294968360 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d7f23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330286.279000:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d7f23 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330286.279005:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc5:0x0].0x0 (ffff8800b1fd9b00) 00010000:00010000:1.0:1715330286.279006:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330286.279009:0:7134:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1715330286.279012:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfdf80/0xd895711d66d7f2a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7f31 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.279150:0:7134:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfdf80/0xd895711d66d7f2a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7f31 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330286.279157:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000401:0xc5:0x0] 00000004:00010000:1.0:1715330286.279161:0:7134:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008d4eb480 reply state ffff88011dbbb000 transno 4294968360 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d7f1c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x184:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330286.279169:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d7f1c lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x184:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330286.279173:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x184:0x0].0x0 (ffff8800b1fd9e00) 00010000:00010000:1.0:1715330286.279175:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330286.279176:0:7134:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1715330286.279180:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x184:0x0]: returning size 4096 00000004:00080000:1.0:1715330286.279184:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:1.0:1715330286.279188:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1f80/0xd895711d66d7f00 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7f07 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.279193:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1f80/0xd895711d66d7f00 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d7f07 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.279198:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1f80/0xd895711d66d7f00 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d7f07 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.279589:0:7134:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1715330286.279595:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:1.0:1715330286.279598:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f0480/0xd895711d66d7f0e lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7f15 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.279604:0:7134:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f0480/0xd895711d66d7f0e lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7f15 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330286.279661:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+9:16896:x1798653938019840:12345-192.168.204.49@tcp:36:lfs.0 Request processed in 11858us (11958us total) trans 4294968360 rc 0/0 00000100:00100000:1.0:1715330286.279667:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23307 00010000:00010000:2.0:1715330286.279778:0:7124:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1715330286.279784:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1f80/0xd895711d66d7f00 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d7f07 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.279790:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f1f80 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:2.0:1715330286.279795:0:7124:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1f80/0xd895711d66d7f00 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d7f07 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1715330286.279802:0:7124:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1f80/0xd895711d66d7f00 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d7f07 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.279819:0:7124:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1f80/0xd895711d66d7f00 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7f07 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.279823:0:7124:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1715330286.279899:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1f80/0xd895711d66d7f00 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7f07 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330286.279902:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1715330286.279905:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1f80/0xd895711d66d7f00 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7f07 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330286.279911:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b4c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942440576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330286.279936:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1715330286.280190:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330286.280367:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330286.280370:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330286.280378:0:10673:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942440576 00000100:00100000:2.0:1715330286.280382:0:10673:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942440576 00000100:00100000:2.0:1715330286.280401:0:10673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1278 00000100:00100000:2.0:1715330286.280405:0:10673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+12:3691:x1798653942440576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715330286.280411:0:10673:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330286.280421:0:10673:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d7f07 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d7f00 expref: 12 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.280429:0:10673:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88009ef25b00) 00010000:00010000:2.0:1715330286.280435:0:10673:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330286.280463:0:10673:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+11:3691:x1798653942440576:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330286.280468:0:10673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1278 00000100:00100000:0.0:1715330286.280473:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b4c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942440576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330286.290594:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330286.290644:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938020032 00000100:00100000:1.0:1715330286.290653:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938020032 00000100:00100000:1.0:1715330286.290699:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23308 00000100:00100000:1.0:1715330286.290705:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+16:16897:x1798653938020032:12345-192.168.204.49@tcp:36:mkdir.0 00000100:00100000:1.0:1715330286.290840:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+16:16897:x1798653938020032:12345-192.168.204.49@tcp:36:mkdir.0 Request processed in 134us (253us total) trans 0 rc -17/-17 00000100:00100000:1.0:1715330286.290846:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23308 00000100:00100000:0.0:1715330286.301971:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938020096 00000100:00100000:0.0:1715330286.301980:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938020096 00000100:00100000:0.0:1715330286.302049:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23309 00000100:00100000:0.0:1715330286.302056:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+16:16898:x1798653938020096:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:0.0:1715330286.302072:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330286.302089:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d7f38 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb4fd expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.302138:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d7f3f lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.302148:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d7f3f lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.302156:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d7f3f lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.302164:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d7f46 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x814526f6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.302171:0:7134:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66d7f15 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7f0e expref: 10 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.302177:0:7134:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d7f46 lrc: 4/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.302199:0:7134:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66d7f15 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd895711d66d7f0e expref: 10 pid: 9408 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330286.302212:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7134:1798653942440640:0@lo:104: 00000100:00100000:0.0:1715330286.302248:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330286.302275:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffc300 going to sleep for 11 seconds 00000100:00100000:2.0:1715330286.302282:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942440640 00000100:00100000:2.0:1715330286.302287:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942440640 00000100:00100000:2.0:1715330286.302305:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1134 00000100:00100000:2.0:1715330286.302309:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:7134:x1798653942440640:12345-0@lo:104: 00010000:00010000:2.0:1715330286.302318:0:7118:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f0480/0xd895711d66d7f0e lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d7f15 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.302352:0:7118:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1715330286.302356:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:7134:x1798653942440640:12345-0@lo:104: Request processed in 47us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330286.302362:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1134 00000100:00100000:0.0:1715330286.302366:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091c3d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7134:1798653942440640:0@lo:104: 00010000:00010000:2.0:1715330286.302375:0:7123:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715330286.302379:0:7134:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d7f46 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330286.302380:0:7123:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f0480/0xd895711d66d7f0e lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d7f15 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.302386:0:7123:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f0480 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:2.0:1715330286.302390:0:7123:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f0480/0xd895711d66d7f0e lrc: 4/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd895711d66d7f15 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1715330286.302397:0:7123:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f0480/0xd895711d66d7f0e lrc: 4/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd895711d66d7f15 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.302415:0:7123:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f0480/0xd895711d66d7f0e lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d7f15 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.302420:0:7123:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1715330286.302442:0:7123:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f0480/0xd895711d66d7f0e lrc: 1/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d7f15 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.302453:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f0480/0xd895711d66d7f0e lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d7f15 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.302464:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330286.302466:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330286.302467:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330286.302480:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b4c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942440704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330286.302527:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.302595:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942440704 00000100:00100000:1.0:1715330286.302599:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942440704 00010000:00010000:1.0:1715330286.302613:0:7120:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66d7f15 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd895711d66d7f0e expref: 11 pid: 9408 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330286.302629:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1491 00000100:00100000:1.0:1715330286.302634:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+11:3691:x1798653942440704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330286.302642:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330286.306825:0:7116:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f180/0xd895711d66d7ea5 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526f5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d7eac expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1715330286.306837:0:7116:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f180/0xd895711d66d7ea5 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526f5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d7eac expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.306863:0:7116:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f180/0xd895711d66d7ea5 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x814526f5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7eac expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.306868:0:7116:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1715330286.306882:0:7116:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f180/0xd895711d66d7ea5 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x814526f5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7eac expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1715330286.306893:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983414 is committed 00000001:00080000:2.0:1715330286.306910:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983413 is committed 00000020:00080000:2.0:1715330286.306916:0:7116:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 366 batchid updated 00000020:00080000:2.0:1715330286.306925:0:7116:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff880091ffa480 refcount 2 committed 0 result 0 batchid 367 00000020:00080000:2.0:1715330286.306927:0:7116:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009ef25500 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff880091ffa0c0 00000020:00080000:2.0:1715330286.306930:0:7116:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].351 00000020:00080000:2.0:1715330286.306932:0:7116:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009ef25300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88011da7f000 00000020:00080000:2.0:1715330286.306934:0:7116:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].352 00010000:00010000:2.0:1715330286.306951:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d7e35 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1512:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.306957:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d7e35 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1512:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.306962:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d7e35 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1512:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.306966:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfdb00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330286.306968:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d7e35 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1512:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.306972:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d7e35 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1512:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.306981:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1512:0x0].0x0 (ffff88009ef25100) 00010000:00010000:2.0:1715330286.306983:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330286.306985:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d7e35 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1512:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.306989:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d7e35 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1512:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.306999:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d7e3c lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.307003:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d7e3c lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.307007:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d7e3c lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.307010:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfd200 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330286.307012:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d7e3c lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.307019:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d7e3c lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.307023:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xc7:0x0].0x0 (ffff88009ef25400) 00010000:00010000:2.0:1715330286.307025:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330286.307026:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d7e3c lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.307030:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d7e3c lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00000020:00080000:0.0:1715330286.307099:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 367 committed batchid 366 00010000:00010000:1.0:1715330286.307119:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66d7f15 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd895711d66d7f0e expref: 7 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.307128:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x814526f6 (ffff88009ef25900) 00010000:00010000:1.0:1715330286.307131:0:7120:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d7f46 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.307137:0:7120:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d7f46 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.307142:0:7120:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d7f46 lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.307154:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:0.0:1715330286.307172:0:7163:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880091ffc300 with version 672 00000020:00080000:0.0:1715330286.307179:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 366 cancel update log [0x240000401:0x3:0x0].350: rc = 0 00000004:00080000:2.0:1715330286.307193:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 672 rpc_version 672 00000020:00100000:2.0:1715330286.307206:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000020:00080000:0.0:1715330286.307209:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 366 cancel update log [0x200000400:0x3:0x0].351: rc = 0 00000100:00100000:2.0:1715330286.307211:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008d61ca80 x1798653942440896/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000020:00080000:0.0:1715330286.307214:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 366 00000100:00100000:2.0:1715330286.307221:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d61ca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942440896:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330286.307424:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+6:3691:x1798653942440704:12345-0@lo:103:ldlm_bl.0 Request processed in 4788us (4896us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.307432:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1491 00000100:00100000:0.0:1715330286.307437:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b4c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942440704:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330286.307448:0:7134:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d7f46 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.307455:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d7f46 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000100:00100000:1.0:1715330286.307508:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d646a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942440960:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330286.307527:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.307535:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009396ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1715330286.307583:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330286.307590:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009d7e3180 going to sleep for 11 seconds 00000100:00100000:2.0:1715330286.307873:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d61ca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942440896:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330286.307926:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d646a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942440960:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1715330286.307951:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d7f4d lrc: 3/1,0 mode: --/PR res: [0x240000402:0x184:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.307958:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d7f4d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x184:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.307964:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d7f4d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x184:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000004:00010000:1.0:1715330286.307978:0:7134:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d7f4d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x184:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.307986:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d7f3f lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.307990:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d7f3f lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.307994:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d7f3f lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.307998:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d7f3f lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.308002:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f3cc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330286.308004:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d7f3f lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.308008:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d7f3f lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.308014:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88012bd8b000) 00010000:00010000:1.0:1715330286.308016:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330286.308018:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d7f3f lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.308022:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d7f3f lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.308029:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d7f46 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.308033:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d7f46 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.308037:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d7f46 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.308040:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f3a80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330286.308042:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d7f46 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.308045:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d7f46 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.308049:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x814526f6 (ffff88009ef25900) 00010000:00010000:1.0:1715330286.308051:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330286.308053:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d7f46 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.308057:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d7f46 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.308076:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d7f38 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb4fd expref: 15 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.308086:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d7f4d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x184:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb4fd expref: 14 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.308092:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x184:0x0].0x0 (ffff88008d5eee00) 00010000:00010000:1.0:1715330286.308093:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1715330286.308095:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfef40, rc 0) 00000100:00100000:1.0:1715330286.308122:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+14:16898:x1798653938020096:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 6067us (6229us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.308127:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23309 00000100:00100000:2.0:1715330286.310269:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330286.313403:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938020160 00000100:00100000:1.0:1715330286.313412:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938020160 00000100:00100000:1.0:1715330286.313676:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23310 00000100:00100000:1.0:1715330286.313683:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+9:16898:x1798653938020160:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:1.0:1715330286.313757:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330286.313771:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d7f54 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x184:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb504 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.313808:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d7f5b lrc: 3/1,0 mode: --/PR res: [0x240000402:0x184:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.313818:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d7f5b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x184:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330286.313827:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d7f5b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x184:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00000004:00200000:1.0:1715330286.313894:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x184:0x0]: returning size 4096 00000004:00200000:1.0:1715330286.313897:0:7134:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1715330286.313920:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d7f54 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x184:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb504 expref: 11 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.313932:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d7f5b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x184:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb504 expref: 10 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.313939:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x184:0x0].0x0 (ffff8800b1fd9e00) 00010000:00010000:1.0:1715330286.313942:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1715330286.313944:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfcb40, rc 0) 00000100:00100000:1.0:1715330286.313982:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+10:16898:x1798653938020160:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 299us (3716us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.313988:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23310 00000100:00100000:0.0:1715330286.317408:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330286.317483:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938020224 00000100:00100000:1.0:1715330286.317490:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938020224 00000100:00100000:1.0:1715330286.317528:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23311 00000100:00100000:1.0:1715330286.317535:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+10:16898:x1798653938020224:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:1.0:1715330286.317562:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330286.317574:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d7f62 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xc5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb50b expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.317610:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d7f69 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.317624:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d7f69 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330286.317632:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d7f69 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00000004:00200000:1.0:1715330286.317661:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000400:0xc5:0x0]: returning size 4096 00000004:00200000:1.0:1715330286.317664:0:7134:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1715330286.317681:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d7f62 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb50b expref: 12 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.317693:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d7f69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb50b expref: 11 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.317700:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc5:0x0].0x0 (ffff8800b1fd9b00) 00010000:00010000:1.0:1715330286.317702:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1715330286.317704:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfcd80, rc 0) 00000100:00100000:1.0:1715330286.317768:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+11:16898:x1798653938020224:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 233us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.317773:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23311 00000100:00100000:0.0:1715330286.319614:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330286.322080:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801345a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942441088:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330286.322110:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.322132:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942441088 00000100:00100000:1.0:1715330286.322135:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942441088 00010000:00010000:1.0:1715330286.322148:0:7120:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d200/0xd895711d66d7f31 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd895711d66d7f2a expref: 6 pid: 24873 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330286.322163:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1492 00000100:00100000:1.0:1715330286.322167:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079f38850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+6:3689:x1798653942441088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330286.322175:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00080000:0.0:1715330286.323448:0:7116:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 367 batchid updated 00000020:00080000:1.0:1715330286.323514:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 367 00000004:00080000:1.0:1715330286.323578:0:7163:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88009396c0c0 with version 673 00000020:00080000:1.0:1715330286.323594:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 367 cancel update log [0x240000401:0x3:0x0].351: rc = 0 00000020:00080000:1.0:1715330286.323647:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 367 cancel update log [0x200000400:0x3:0x0].352: rc = 0 00000020:00080000:1.0:1715330286.323652:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 367 00010000:00010000:1.0:1715330286.323684:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d200/0xd895711d66d7f31 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd895711d66d7f2a expref: 6 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.323694:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc5:0x0].0x0 (ffff880093b42700) 00010000:00010000:1.0:1715330286.323697:0:7120:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d7f77 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.323704:0:7120:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d7f77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.323710:0:7120:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d7f77 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xc5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.323722:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330286.323834:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942441216 00000100:00100000:0.0:1715330286.323838:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942441216 00000100:00100000:0.0:1715330286.323858:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2550 00000100:00100000:0.0:1715330286.323863:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:8587:x1798653942441216:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330286.324277:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079f38850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942441088:12345-0@lo:103:ldlm_bl.0 Request processed in 2108us (2165us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.324284:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1492 00000100:00100000:1.0:1715330286.324327:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801345a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942441088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330286.324458:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:8587:x1798653942441216:12345-0@lo:1000:osp_up1-0.0 Request processed in 593us (770us total) trans 4294968362 rc 0/0 00000100:00100000:0.0:1715330286.324464:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2550 00000100:00100000:2.0:1715330286.329846:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330286.329876:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330286.329975:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938020352 00000100:00100000:1.0:1715330286.329979:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938020352 00000100:00100000:1.0:1715330286.330006:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1280 00000100:00100000:1.0:1715330286.330010:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72de1896-1df4-4b3a-930a-9116d2c66168+15:2013:x1798653938020352:12345-192.168.204.49@tcp:103:rmdir.0 00010000:00010000:1.0:1715330286.330021:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330286.330037:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d7f4d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x184:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb4fd expref: 15 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.330052:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x184:0x0].0x0 (ffff88008d5eee00) 00010000:00010000:1.0:1715330286.330059:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330286.330090:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72de1896-1df4-4b3a-930a-9116d2c66168+14:2013:x1798653938020352:12345-192.168.204.49@tcp:103:rmdir.0 Request processed in 79us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.330096:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1280 00000100:00100000:0.0:1715330286.330160:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942441280 00000100:00100000:0.0:1715330286.330163:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942441280 00000100:00100000:0.0:1715330286.330180:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2551 00000100:00100000:0.0:1715330286.330184:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:7135:x1798653942441280:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330286.330192:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330286.330202:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d7f85 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d7f7e expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.330218:0:9407:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d7f85 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d7f7e expref: 6 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.330227:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d7f85 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7f7e expref: 6 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.330233:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88012bd8b200) 00010000:00010000:0.0:1715330286.330235:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330286.330237:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f2400, rc 0) 00000100:00100000:0.0:1715330286.330267:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:7135:x1798653942441280:12345-0@lo:101:mdt00_002.0 Request processed in 83us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.330272:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2551 00000100:00100000:1.0:1715330286.330517:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942441344 00000100:00100000:1.0:1715330286.330521:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942441344 00000100:00100000:0.0:1715330286.331510:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2552 00000100:00100000:0.0:1715330286.331514:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:7135:x1798653942441344:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330286.331520:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330286.331529:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d7f93 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x814526f6 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d7f8c expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.331539:0:9407:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d7f93 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d7f8c expref: 7 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.331556:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d7f93 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7f8c expref: 7 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.331561:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x814526f6 (ffff88012bd8b600) 00010000:00010000:0.0:1715330286.331563:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330286.331565:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f1680, rc 0) 00000100:00100000:0.0:1715330286.331592:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7135:x1798653942441344:12345-0@lo:101:mdt00_002.0 Request processed in 77us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.331596:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2552 00000100:00100000:1.0:1715330286.331776:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942441408 00000100:00100000:1.0:1715330286.331779:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942441408 00000100:00100000:1.0:1715330286.331801:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2553 00000100:00100000:1.0:1715330286.331805:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7135:x1798653942441408:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330286.331856:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7135:x1798653942441408:12345-0@lo:1000:mdt00_002.0 Request processed in 50us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.331868:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2553 00000100:00100000:1.0:1715330286.332088:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942441472 00000100:00100000:1.0:1715330286.332091:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942441472 00000100:00100000:1.0:1715330286.332107:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2554 00000100:00100000:1.0:1715330286.332111:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7135:x1798653942441472:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330286.332164:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7135:x1798653942441472:12345-0@lo:1000:mdt00_002.0 Request processed in 52us (185us total) trans 0 rc 1/1 00000100:00100000:1.0:1715330286.332169:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2554 00000100:00100000:1.0:1715330286.332401:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942441536 00000100:00100000:1.0:1715330286.332404:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942441536 00000100:00100000:1.0:1715330286.332423:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2555 00000100:00100000:1.0:1715330286.332426:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7135:x1798653942441536:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330286.332433:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330286.332441:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d7fa1 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x184:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d7f9a expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.332452:0:9408:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d7fa1 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x184:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d7f9a expref: 8 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.332460:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d7fa1 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x184:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7f9a expref: 8 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.332465:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x184:0x0].0x0 (ffff88008d5ee300) 00010000:00010000:1.0:1715330286.332468:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1715330286.332470:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfd200, rc 0) 00000100:00100000:1.0:1715330286.332656:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:7135:x1798653942441536:12345-0@lo:101:mdt00_002.0 Request processed in 228us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.332660:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2555 00000100:00100000:0.0:1715330286.335540:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330286.335600:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938020544 00000100:00100000:1.0:1715330286.335605:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938020544 00010000:00010000:1.0:1715330286.335624:0:7120:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d7f69 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb50b expref: 11 pid: 7134 timeout: 360 lvb_type: 0 00000100:00100000:1.0:1715330286.335650:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1493 00000100:00100000:1.0:1715330286.335656:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72de1896-1df4-4b3a-930a-9116d2c66168+11:2012:x1798653938020544:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1715330286.335665:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330286.335669:0:7120:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d7f69 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb50b expref: 11 pid: 7134 timeout: 360 lvb_type: 0 00010000:00010000:1.0:1715330286.335682:0:7120:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d7f69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb50b expref: 11 pid: 7134 timeout: 360 lvb_type: 0 00010000:00010000:1.0:1715330286.335697:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d7f69 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb50b expref: 11 pid: 7134 timeout: 360 lvb_type: 0 00010000:00010000:1.0:1715330286.336008:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc5:0x0].0x0 (ffff8800b1fd9b00) 00010000:00010000:1.0:1715330286.336012:0:7120:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88013457d8c0/0xd895711d66d7faf lrc: 3/0,1 mode: --/EX res: [0x240000400:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330286.336020:0:7120:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457d8c0/0xd895711d66d7faf lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330286.336025:0:7120:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457d8c0/0xd895711d66d7faf lrc: 4/0,1 mode: EX/EX res: [0x240000400:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330286.336047:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330286.336080:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72de1896-1df4-4b3a-930a-9116d2c66168+10:2012:x1798653938020544:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 423us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.336086:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1493 00000100:00100000:1.0:1715330286.336257:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942441664 00000100:00100000:1.0:1715330286.336260:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942441664 00000100:00100000:1.0:1715330286.336284:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2556 00000100:00100000:1.0:1715330286.336288:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:7135:x1798653942441664:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330286.336298:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330286.336308:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d7fbd lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d7fb6 expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.336322:0:9408:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d7f77 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb512 expref: 13 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.336329:0:9408:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d7fbd lrc: 4/0,0 mode: --/EX res: [0x200000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d7fb6 expref: 9 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.336343:0:9408:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d7f77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb512 expref: 13 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.336351:0:9408:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d7f77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb512 expref: 13 pid: 7135 timeout: 360 lvb_type: 0 00000100:00100000:1.0:1715330286.336360:0:9408:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d646a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:9408:1798653942441728:192.168.204.49@tcp:104: 00000100:00100000:1.0:1715330286.336383:0:9408:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009396c000 going to sleep for 11 seconds 00000100:00100000:0.0:1715330286.339510:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330286.339576:0:9408:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d646a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:9408:1798653942441728:192.168.204.49@tcp:104: 00010000:00010000:1.0:1715330286.339596:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d7fbd lrc: 3/0,0 mode: --/EX res: [0x200000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7fb6 expref: 9 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.339604:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc5:0x0].0x0 (ffff880093b42700) 00010000:00010000:1.0:1715330286.339607:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330286.339610:0:9408:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d7fbd lrc: 3/0,0 mode: --/EX res: [0x200000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7fb6 expref: 9 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.339617:0:9408:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d7fbd lrc: 3/0,0 mode: --/EX res: [0x200000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7fb6 expref: 9 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.339621:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfdb00, rc 0) 00000100:00100000:1.0:1715330286.339651:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7135:x1798653942441664:12345-0@lo:101:mdt00_002.0 Request processed in 3363us (3441us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.339658:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2556 00000100:00100000:2.0:1715330286.339721:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938020608 00000100:00100000:2.0:1715330286.339726:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938020608 00010000:00010000:2.0:1715330286.339764:0:7120:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d7f77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb512 expref: 14 pid: 7135 timeout: 360 lvb_type: 0 00000100:00100000:2.0:1715330286.339780:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1494 00000100:00100000:2.0:1715330286.339785:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72de1896-1df4-4b3a-930a-9116d2c66168+14:2011:x1798653938020608:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1715330286.339794:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330286.339798:0:7120:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d7f77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb512 expref: 14 pid: 7135 timeout: 360 lvb_type: 0 00010000:00010000:2.0:1715330286.339807:0:7120:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d7f77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb512 expref: 14 pid: 7135 timeout: 360 lvb_type: 0 00010000:00010000:2.0:1715330286.339821:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d7f77 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb512 expref: 14 pid: 7135 timeout: 360 lvb_type: 0 00010000:00010000:2.0:1715330286.339832:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc5:0x0].0x0 (ffff880093b42700) 00010000:00010000:2.0:1715330286.339836:0:7120:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d7fbd lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7fb6 expref: 8 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.339843:0:7120:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d7fbd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d7fb6 expref: 8 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.339849:0:7120:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d7fbd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d7fb6 expref: 8 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.339867:0:7120:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d7fbd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7fb6 expref: 8 pid: 9408 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330286.339876:0:7120:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:7120:1798653942441792:0@lo:105: 00000100:00100000:2.0:1715330286.339899:0:7120:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330286.339922:0:7120:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009d7e3180 going to sleep for 11 seconds 00000100:00100000:0.0:1715330286.340064:0:9413:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942441792 00000100:00100000:0.0:1715330286.340067:0:9413:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942441792 00000100:00100000:0.0:1715330286.340093:0:9413:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1136 00000100:00100000:0.0:1715330286.340097:0:9413:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:7120:x1798653942441792:12345-0@lo:105: 00010000:00010000:0.0:1715330286.340105:0:9413:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457df80/0xd895711d66d7fb6 lrc: 5/0,1 mode: --/EX res: [0x200000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7fbd expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.340113:0:9413:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457df80/0xd895711d66d7fb6 lrc: 5/0,1 mode: --/EX res: [0x200000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7fbd expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.340120:0:9413:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457df80/0xd895711d66d7fb6 lrc: 5/0,1 mode: --/EX res: [0x200000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7fbd expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.340125:0:9413:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457df80/0xd895711d66d7fb6 lrc: 5/0,1 mode: EX/EX res: [0x200000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d7fbd expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.340130:0:9413:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457df80/0xd895711d66d7fb6 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d7fbd expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.340136:0:9413:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457df80/0xd895711d66d7fb6 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d7fbd expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.340147:0:9413:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88013457df80) 00000100:00100000:0.0:1715330286.340175:0:9413:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:7120:x1798653942441792:12345-0@lo:105: Request processed in 77us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.340180:0:9413:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1136 00000100:00100000:2.0:1715330286.340776:0:7120:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:7120:1798653942441792:0@lo:105: 00010000:00010000:2.0:1715330286.340784:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330286.340807:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72de1896-1df4-4b3a-930a-9116d2c66168+13:2011:x1798653938020608:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 1021us (1301us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330286.340813:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1494 00000100:00100000:1.0:1715330286.340864:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942441856 00000100:00100000:1.0:1715330286.340867:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942441856 00000100:00100000:1.0:1715330286.340882:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2557 00000100:00100000:1.0:1715330286.340886:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7135:x1798653942441856:12345-0@lo:403:mdt00_002.0 00000100:00100000:1.0:1715330286.342389:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7135:x1798653942441856:12345-0@lo:403:mdt00_002.0 Request processed in 1499us (1690us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.342396:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2557 00000004:00080000:2.0:1715330286.343921:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 722 rpc_version 722 00000020:00100000:2.0:1715330286.343942:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1715330286.343949:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008d48e300 x1798653942441984/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1808/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1715330286.343964:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48e300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942441984:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1715330286.343991:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330286.344009:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009d7e3180 going to sleep for 11 seconds 00000100:00100000:0.0:1715330286.344390:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942441984 00000100:00100000:0.0:1715330286.344395:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942441984 00000100:00100000:0.0:1715330286.344425:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2558 00000100:00100000:0.0:1715330286.344430:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:8278:x1798653942441984:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330286.344702:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:8278:x1798653942441984:12345-0@lo:1000:osp_up0-1.0 Request processed in 271us (710us total) trans 4294983415 rc 0/0 00000100:00100000:0.0:1715330286.344709:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2558 00000100:00100000:2.0:1715330286.344783:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48e300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942441984:0@lo:1000:osp_up0-1.0 00000004:00200000:0.0:1715330286.344831:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x184:0x0]: returning size 4096 00010000:00010000:0.0:1715330286.344847:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457d8c0/0xd895711d66d7faf lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.344854:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013457d8c0/0xd895711d66d7faf lrc: 2/0,0 mode: EX/EX res: [0x240000400:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.344860:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013457d8c0/0xd895711d66d7faf lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.344865:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457d8c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330286.344868:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457d8c0/0xd895711d66d7faf lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.344873:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457d8c0/0xd895711d66d7faf lrc: 4/0,0 mode: EX/EX res: [0x240000400:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.344883:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc5:0x0].0x0 (ffff8800b1fd9b00) 00010000:00010000:0.0:1715330286.344886:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715330286.344888:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013457d8c0/0xd895711d66d7faf lrc: 2/0,0 mode: --/EX res: [0x240000400:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.344892:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457d8c0/0xd895711d66d7faf lrc: 0/0,0 mode: --/EX res: [0x240000400:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.344901:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457df80/0xd895711d66d7fb6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7fbd expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.344907:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457df80/0xd895711d66d7fb6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d7fbd expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.344912:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457df80/0xd895711d66d7fb6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d7fbd expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.344928:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1715330286.344933:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000401:0xc5:0x0] 00010000:00010000:0.0:1715330286.344937:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c480/0xd895711d66d7fa8 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x184:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.344942:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c480/0xd895711d66d7fa8 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x184:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.344946:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c480/0xd895711d66d7fa8 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x184:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.344949:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457c480 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330286.344952:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c480/0xd895711d66d7fa8 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x184:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.344956:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c480/0xd895711d66d7fa8 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x184:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.344961:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x184:0x0].0x0 (ffff8800b1fd9e00) 00010000:00010000:0.0:1715330286.344963:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330286.344965:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c480/0xd895711d66d7fa8 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x184:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.344969:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c480/0xd895711d66d7fa8 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x184:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.344975:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457dd40/0xd895711d66d7f9a lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x184:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7fa1 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.344980:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457dd40/0xd895711d66d7f9a lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x184:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d7fa1 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.344985:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457dd40/0xd895711d66d7f9a lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x184:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d7fa1 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.345270:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00000100:00100000:0.0:1715330286.345285:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942442112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330286.345307:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330286.345319:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1715330286.345323:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942442048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330286.345333:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.345348:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942442112 00000100:00100000:1.0:1715330286.345352:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942442112 00000100:00100000:1.0:1715330286.345368:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942442048 00000100:00100000:1.0:1715330286.345370:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942442048 00000100:00100000:1.0:1715330286.345381:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1281 00000100:00100000:1.0:1715330286.345386:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+11:3691:x1798653942442112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330286.345393:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330286.345403:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d7fa1 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x184:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d7f9a expref: 11 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.345414:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x184:0x0].0x0 (ffff88008d5ee300) 00010000:00010000:1.0:1715330286.345420:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:0.0:1715330286.345431:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:0.0:1715330286.345434:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457ed00/0xd895711d66d7f7e lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7f85 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.345441:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457ed00/0xd895711d66d7f7e lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d7f85 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.345447:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457ed00/0xd895711d66d7f7e lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d7f85 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330286.345449:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+10:3691:x1798653942442112:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.345454:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1281 00000100:00100000:0.0:1715330286.345462:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942442112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330286.345464:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1282 00000100:00100000:1.0:1715330286.345467:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+9:3691:x1798653942442048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330286.345472:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330286.345650:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d7fbd lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d7fb6 expref: 9 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.345667:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc5:0x0].0x0 (ffff880093b42700) 00010000:00010000:1.0:1715330286.345673:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715330286.345884:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1715330286.345887:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:1.0:1715330286.345895:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+8:3691:x1798653942442048:12345-0@lo:103:ldlm_bl.0 Request processed in 426us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.345898:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942442048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330286.345901:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1282 00010000:00010000:0.0:1715330286.345909:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f3c0/0xd895711d66d7f8c lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7f93 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.345914:0:7135:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f3c0/0xd895711d66d7f8c lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7f93 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330286.345966:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+10:16898:x1798653938020480:12345-192.168.204.49@tcp:36:rmdir.0 Request processed in 15971us (16088us total) trans 4294968363 rc 0/0 00000100:00100000:0.0:1715330286.345973:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23313 00010000:00010000:2.0:1715330286.346016:0:7124:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1715330286.346020:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457ed00/0xd895711d66d7f7e lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d7f85 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.346025:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457ed00 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:2.0:1715330286.346029:0:7124:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457ed00/0xd895711d66d7f7e lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d7f85 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1715330286.346034:0:7124:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457ed00/0xd895711d66d7f7e lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d7f85 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.346047:0:7124:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457ed00/0xd895711d66d7f7e lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7f85 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.346051:0:7124:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1715330286.346095:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457ed00/0xd895711d66d7f7e lrc: 1/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7f85 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.346105:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457ed00/0xd895711d66d7f7e lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7f85 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.346115:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330286.346116:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330286.346117:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330286.346120:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330286.346182:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1715330286.346190:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942442176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330286.346211:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.346228:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942442176 00000100:00100000:1.0:1715330286.346231:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942442176 00000100:00100000:1.0:1715330286.346245:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1283 00000100:00100000:1.0:1715330286.346249:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d646a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+8:3689:x1798653942442176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330286.346255:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330286.346567:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d7f85 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d7f7e expref: 8 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.346577:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88012bd8b200) 00010000:00010000:1.0:1715330286.346582:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330286.346609:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d646a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+7:3689:x1798653942442176:12345-0@lo:103:ldlm_bl.0 Request processed in 359us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.346614:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1283 00000100:00100000:0.0:1715330286.346631:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942442176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330286.356128:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330286.356175:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938020672 00000100:00100000:2.0:1715330286.356183:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938020672 00000100:00100000:2.0:1715330286.356220:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23314 00000100:00100000:2.0:1715330286.356226:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+10:16899:x1798653938020672:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:2.0:1715330286.356245:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330286.356259:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db673c0/0xd895711d66d7fc4 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb519 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.356302:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d7fcb lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.356312:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d7fcb lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.356320:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d7fcb lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.356330:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d7fd2 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x814526f7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.356335:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d7fd2 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x814526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.356339:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d7fd2 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x814526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.356369:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d7fcb lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.356374:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d7fcb lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.356378:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d7fcb lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.356383:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d7fcb lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.356387:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64d80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330286.356390:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d7fcb lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.356395:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d7fcb lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.356403:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88012bd8bf00) 00010000:00010000:2.0:1715330286.356405:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330286.356408:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d7fcb lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.356412:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d7fcb lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.356430:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d7fd2 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x814526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.356434:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d7fd2 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x814526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.356438:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d7fd2 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x814526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.356443:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db65d40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330286.356445:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d7fd2 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x814526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.356449:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d7fd2 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x814526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.356462:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x814526f7 (ffff8801345c6900) 00010000:00010000:2.0:1715330286.356463:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330286.356465:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d7fd2 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x814526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.356469:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d7fd2 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x814526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.356489:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db673c0/0xd895711d66d7fc4 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb519 expref: 11 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.356496:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db673c0/0xd895711d66d7fc4 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb519 expref: 11 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.356502:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db673c0, rc 0) 00000100:00100000:2.0:1715330286.356552:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+10:16899:x1798653938020672:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 315us (421us total) trans 0 rc 301/301 00000100:00100000:2.0:1715330286.356558:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23314 00000100:00100000:2.0:1715330286.360645:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938020736 00000100:00100000:2.0:1715330286.360652:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938020736 00000100:00100000:2.0:1715330286.360693:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23315 00000100:00100000:2.0:1715330286.360700:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+13:16899:x1798653938020736:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:2.0:1715330286.360717:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330286.360759:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d7fd9 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb520 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.360801:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d7fe0 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.360810:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d7fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.360819:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d7fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00200000:2.0:1715330286.360857:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1715330286.360860:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1715330286.360884:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d7fd9 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb520 expref: 15 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.360896:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d7fe0 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb520 expref: 14 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.360903:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff8801345c6d00) 00010000:00010000:2.0:1715330286.360906:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1715330286.360908:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db64fc0, rc 0) 00000100:00100000:2.0:1715330286.360947:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+14:16899:x1798653938020736:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 247us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330286.360953:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23315 00000100:00100000:0.0:1715330286.367955:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330286.368053:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938020864 00000100:00100000:1.0:1715330286.368062:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938020864 00000100:00100000:1.0:1715330286.368152:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23316 00000100:00100000:1.0:1715330286.368158:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+14:16899:x1798653938020864:12345-192.168.204.49@tcp:36:lfs.0 00000100:00100000:1.0:1715330286.368246:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d645f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942442240:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330286.368287:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.368603:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009396ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330286.368832:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d645f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942442240:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330286.369068:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d645f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942442304:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330286.369086:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.369104:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009396ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330286.369525:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d645f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942442304:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1715330286.369578:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7fe7 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.369586:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7fe7 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.369594:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7fe7 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT0 00000100:00100000:1.0:1715330286.369603:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d645f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942442368:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1715330286.369621:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.369629:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009396c000 going to sleep for 11 seconds 00000100:00100000:0.0:1715330286.373032:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330286.373191:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938020928 00000100:00100000:1.0:1715330286.373198:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938020928 00010000:00010000:1.0:1715330286.373223:0:10674:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d7ef9 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb4f6 expref: 10 pid: 7134 timeout: 360 lvb_type: 0 00000100:00100000:1.0:1715330286.373244:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1495 00000100:00100000:1.0:1715330286.373249:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880079f38450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:72de1896-1df4-4b3a-930a-9116d2c66168+10:2012:x1798653938020928:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1715330286.373258:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330286.373263:0:10674:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d7ef9 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb4f6 expref: 10 pid: 7134 timeout: 360 lvb_type: 0 00010000:00010000:1.0:1715330286.373393:0:10674:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d7ef9 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb4f6 expref: 10 pid: 7134 timeout: 360 lvb_type: 0 00010000:00010000:1.0:1715330286.373410:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d7ef9 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb4f6 expref: 10 pid: 7134 timeout: 360 lvb_type: 0 00010000:00010000:1.0:1715330286.373437:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88012bd8bf00) 00010000:00010000:1.0:1715330286.373442:0:10674:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c480/0xd895711d66d7fee lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7fe7 expref: 9 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.373450:0:10674:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c480/0xd895711d66d7fee lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d7fe7 expref: 9 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.373457:0:10674:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c480/0xd895711d66d7fee lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d7fe7 expref: 9 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.373480:0:10674:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c480/0xd895711d66d7fee lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7fe7 expref: 8 pid: 9407 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330286.373491:0:10674:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d645180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001_UUID:10674:1798653942442496:0@lo:105: 00000100:00100000:1.0:1715330286.373520:0:10674:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.373534:0:10674:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009396ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1715330286.373576:0:9413:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942442496 00000100:00100000:0.0:1715330286.373579:0:9413:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942442496 00000100:00100000:0.0:1715330286.373610:0:9413:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1137 00000100:00100000:0.0:1715330286.373618:0:9413:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d644700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:10674:x1798653942442496:12345-0@lo:105: 00010000:00010000:0.0:1715330286.373626:0:9413:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7fe7 lrc: 4/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7fee expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.373633:0:9413:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7fe7 lrc: 4/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7fee expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.373639:0:9413:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7fe7 lrc: 4/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7fee expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.373644:0:9413:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7fe7 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d7fee expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.373649:0:9413:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7fe7 lrc: 5/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d7fee expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330286.373687:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d645f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942442368:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330286.373715:0:9413:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7fe7 lrc: 6/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d7fee expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.373779:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7fe7 lrc: 6/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d7fee expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330286.373796:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:1.0:1715330286.373815:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfed00/0xd895711d66d7ff5 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x814526f7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.373820:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfed00/0xd895711d66d7ff5 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x814526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.373826:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfed00/0xd895711d66d7ff5 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x814526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT0 00000100:00100000:1.0:1715330286.373835:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d645f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942442560:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1715330286.373853:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1715330286.373907:0:9413:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff880093bfc6c0) 00000100:00100000:0.0:1715330286.373935:0:9413:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d644700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:10674:x1798653942442496:12345-0@lo:105: Request processed in 319us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.373941:0:9413:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1137 00000100:00100000:1.0:1715330286.374013:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009396c000 going to sleep for 11 seconds 00000100:00100000:1.0:1715330286.374027:0:10674:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d645180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001_UUID:10674:1798653942442496:0@lo:105: 00010000:00010000:1.0:1715330286.374035:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330286.374162:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880079f38450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:72de1896-1df4-4b3a-930a-9116d2c66168+9:2012:x1798653938020928:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 911us (1134us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.374168:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1495 00000100:00100000:1.0:1715330286.374672:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d645f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942442560:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330286.374682:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfed00/0xd895711d66d7ff5 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526f7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7ffc expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.374688:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfed00/0xd895711d66d7ff5 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526f7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7ffc expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330286.374697:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:1.0:1715330286.374718:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d645f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942442624:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330286.374755:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.374763:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009396cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1715330286.374815:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942442624 00000100:00100000:0.0:1715330286.374819:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942442624 00000100:00100000:0.0:1715330286.374847:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563 00000100:00100000:0.0:1715330286.374851:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d646a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7134:x1798653942442624:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330286.374911:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d646a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7134:x1798653942442624:12345-0@lo:1000:mdt00_001.0 Request processed in 58us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.374916:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563 00000100:00100000:1.0:1715330286.374945:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d645f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942442624:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330286.374974:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d645f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942442688:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330286.374988:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.375001:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009396cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1715330286.375024:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942442688 00000100:00100000:0.0:1715330286.375027:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942442688 00000100:00100000:0.0:1715330286.375047:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2564 00000100:00100000:0.0:1715330286.375050:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d645180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7134:x1798653942442688:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330286.375100:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d645180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7134:x1798653942442688:12345-0@lo:1000:mdt00_001.0 Request processed in 48us (111us total) trans 0 rc -2/-2 00000100:00100000:0.0:1715330286.375105:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2564 00000100:00100000:1.0:1715330286.375112:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d645f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942442688:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330286.375153:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d645f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942442752:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330286.375168:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.375174:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009396cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1715330286.375182:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942442752 00000100:00100000:0.0:1715330286.375185:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942442752 00000100:00100000:0.0:1715330286.375201:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2565 00000100:00100000:0.0:1715330286.375204:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7134:x1798653942442752:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330286.375361:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7134:x1798653942442752:12345-0@lo:1000:mdt00_001.0 Request processed in 155us (191us total) trans 0 rc -2/-2 00000100:00100000:0.0:1715330286.375366:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2565 00000100:00100000:1.0:1715330286.375415:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d645f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942442752:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330286.375446:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942442816:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330286.375461:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.375468:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009396cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1715330286.375510:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942442816 00000100:00100000:0.0:1715330286.375513:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942442816 00000100:00100000:0.0:1715330286.375656:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2566 00000100:00100000:0.0:1715330286.375660:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7134:x1798653942442816:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330286.375727:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091c3ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942442816:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330286.375774:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942442880:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330286.375790:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.375803:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009396cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1715330286.375826:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7134:x1798653942442816:12345-0@lo:1000:mdt00_001.0 Request processed in 36us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.375834:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2566 00000100:00100000:1.0:1715330286.375881:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091c3ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942442880:0@lo:1000:mdt00_001.0 00000040:00080000:1.0:1715330286.376307:0:7134:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].354, 2168 off543448 00000040:00080000:1.0:1715330286.376363:0:7134:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].353, 2368 off584320 00000004:00080000:1.0:1715330286.376367:0:7134:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88009396c000 with version 674 00000100:00100000:2.0:1715330286.376702:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942443008 00000100:00100000:2.0:1715330286.376705:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942443008 00000100:00100000:2.0:1715330286.376725:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2568 00000100:00100000:2.0:1715330286.376729:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:8587:x1798653942443008:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1715330286.377148:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:8587:x1798653942443008:12345-0@lo:1000:osp_up1-0.0 Request processed in 416us (534us total) trans 4294968364 rc 0/0 00000100:00100000:2.0:1715330286.377153:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2568 00000100:00100000:0.0:1715330286.377303:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d635180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942443008:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1715330286.377396:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d8003 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1514:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.377405:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d8003 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1514:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.377413:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d8003 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1514:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.377427:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d800a lrc: 3/0,1 mode: --/PW res: [0x200000400:0xc8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.377432:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d800a lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.377437:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d800a lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.377453:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff840/0xd895711d66d8011 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xc8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.377458:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff840/0xd895711d66d8011 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.377466:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff840/0xd895711d66d8011 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT0 00000100:00100000:1.0:1715330286.377475:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942443072:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1715330286.377494:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.377557:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009396c840 going to sleep for 11 seconds 00000100:00100000:2.0:1715330286.377563:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942443072 00000100:00100000:2.0:1715330286.377566:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942443072 00000100:00100000:2.0:1715330286.377588:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2569 00000100:00100000:2.0:1715330286.377592:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d645f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:7134:x1798653942443072:12345-0@lo:101:mdt00_001.0 00010000:00010000:2.0:1715330286.377600:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330286.377650:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66640/0xd895711d66d8018 lrc: 2/0,0 mode: --/PW res: [0x240000401:0xc8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d8011 expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.377665:0:23404:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66640/0xd895711d66d8018 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d8011 expref: 12 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.377673:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66640/0xd895711d66d8018 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8011 expref: 12 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.377679:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc8:0x0].0x0 (ffff8801345c6400) 00010000:00010000:2.0:1715330286.377681:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330286.377683:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db66640, rc 0) 00000100:00100000:2.0:1715330286.377714:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d645f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:7134:x1798653942443072:12345-0@lo:101:mdt00_001.0 Request processed in 121us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330286.377719:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2569 00000100:00100000:1.0:1715330286.377758:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091c3ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942443072:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330286.377769:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff840/0xd895711d66d8011 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8018 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.377775:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff840/0xd895711d66d8011 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8018 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330286.377787:0:7134:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012b55fb80 reply state ffff88008d561000 transno 4294983416 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d800a lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.377800:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d800a lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.377805:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xc8:0x0].0x0 (ffff88008d5ee700) 00010000:00010000:1.0:1715330286.377807:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330286.377809:0:7134:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1715330286.377813:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff840/0xd895711d66d8011 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8018 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.377819:0:7134:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff840/0xd895711d66d8011 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8018 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330286.377832:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0xc8:0x0] 00000004:00010000:1.0:1715330286.377836:0:7134:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012b55fb80 reply state ffff88008d561000 transno 4294983416 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d8003 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1514:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.377841:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d8003 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1514:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.377846:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1514:0x0].0x0 (ffff88008d5ee800) 00010000:00010000:1.0:1715330286.377848:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330286.377849:0:7134:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1715330286.377853:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1514:0x0]: returning size 4096 00000004:00080000:1.0:1715330286.377857:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:1.0:1715330286.377861:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7fe7 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d7fee expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.377867:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7fe7 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d7fee expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.377872:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc6c0/0xd895711d66d7fe7 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d7fee expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.377890:0:7134:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1715330286.377893:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:1.0:1715330286.377896:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfed00/0xd895711d66d7ff5 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526f7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7ffc expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.377902:0:7134:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfed00/0xd895711d66d7ff5 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526f7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d7ffc expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330286.377960:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+16:16899:x1798653938020864:12345-192.168.204.49@tcp:36:lfs.0 Request processed in 9801us (10011us total) trans 4294983416 rc 0/0 00000100:00100000:1.0:1715330286.377967:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23316 00000100:00100000:1.0:1715330286.378014:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1715330286.378022:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942443136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330286.378043:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.378061:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942443136 00000100:00100000:1.0:1715330286.378063:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942443136 00000100:00100000:1.0:1715330286.378079:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1284 00000100:00100000:1.0:1715330286.378083:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+12:3688:x1798653942443136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330286.378090:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330286.378099:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c480/0xd895711d66d7fee lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d7fe7 expref: 12 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.378107:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88012bd8bf00) 00010000:00010000:1.0:1715330286.378113:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330286.378130:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+11:3688:x1798653942443136:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.378135:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1284 00000100:00100000:2.0:1715330286.378172:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942443136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330286.393625:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330286.395680:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938021056 00000100:00100000:1.0:1715330286.395694:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938021056 00000100:00100000:1.0:1715330286.395769:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23317 00000100:00100000:1.0:1715330286.395776:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+9:16900:x1798653938021056:12345-192.168.204.49@tcp:36:mkdir.0 00000100:00100000:1.0:1715330286.395928:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+9:16900:x1798653938021056:12345-192.168.204.49@tcp:36:mkdir.0 Request processed in 152us (2315us total) trans 0 rc -17/-17 00000100:00100000:1.0:1715330286.395935:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23317 00000100:00100000:0.0:1715330286.403698:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330286.403885:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938021120 00000100:00100000:1.0:1715330286.403895:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938021120 00000100:00100000:1.0:1715330286.403943:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23318 00000100:00100000:1.0:1715330286.403950:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+9:16901:x1798653938021120:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:1.0:1715330286.403972:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330286.403994:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d801f lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb527 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.404053:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffcc0/0xd895711d66d8026 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.404065:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffcc0/0xd895711d66d8026 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330286.404076:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffcc0/0xd895711d66d8026 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330286.404084:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc900/0xd895711d66d802d lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x814526f7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330286.404092:0:7134:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457d8c0/0xd895711d66d7ffc lrc: 2/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526f7 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d7ff5 expref: 10 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.404098:0:7134:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc900/0xd895711d66d802d lrc: 4/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x814526f7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:1.0:1715330286.404130:0:7134:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88013457d8c0/0xd895711d66d7ffc lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526f7 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd895711d66d7ff5 expref: 10 pid: 9407 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330286.404146:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801345a7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7134:1798653942443200:0@lo:104: 00000100:00100000:1.0:1715330286.404191:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.404207:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009396c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330286.404297:0:9413:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942443200 00000100:00100000:0.0:1715330286.404301:0:9413:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942443200 00000100:00100000:0.0:1715330286.404332:0:9413:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1138 00000100:00100000:0.0:1715330286.404338:0:9413:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:7134:x1798653942443200:12345-0@lo:104: 00010000:00010000:0.0:1715330286.404348:0:9413:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfed00/0xd895711d66d7ff5 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526f7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d7ffc expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.404422:0:9413:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1715330286.404427:0:9413:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:7134:x1798653942443200:12345-0@lo:104: Request processed in 90us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.404434:0:9413:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1138 00000100:00100000:2.0:1715330286.404501:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801345a7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:7134:1798653942443200:0@lo:104: 00010000:00010000:2.0:1715330286.404518:0:7134:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc900/0xd895711d66d802d lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x814526f7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00000100:00100000:2.0:1715330286.404657:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942443264 00000100:00100000:2.0:1715330286.404661:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942443264 00010000:00010000:2.0:1715330286.404675:0:10674:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013457d8c0/0xd895711d66d7ffc lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526f7 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd895711d66d7ff5 expref: 11 pid: 9407 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330286.404699:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1496 00000100:00100000:2.0:1715330286.404772:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d635c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+11:3690:x1798653942443264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715330286.404781:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330286.406492:0:8267:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f3c0/0xd895711d66d7f8c lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d7f93 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330286.406504:0:8267:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f3c0/0xd895711d66d7f8c lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d7f93 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.406531:0:8267:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f3c0/0xd895711d66d7f8c lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7f93 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.406537:0:8267:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330286.406665:0:8267:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f3c0/0xd895711d66d7f8c lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d7f93 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1715330286.406679:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968364 is committed 00000001:00080000:0.0:1715330286.406702:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968363 is committed 00000020:00080000:0.0:1715330286.406710:0:8267:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0001: 374 batchid updated 00000020:00080000:0.0:1715330286.406743:0:8267:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff88012f47e240 refcount 2 committed 0 result 0 batchid 375 00000020:00080000:0.0:1715330286.406746:0:8267:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800b1fd9d00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff88012f47e780 00000020:00080000:0.0:1715330286.406749:0:8267:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].378 00000020:00080000:0.0:1715330286.406751:0:8267:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009ef25600 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88008d40a000 00000020:00080000:0.0:1715330286.406753:0:8267:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].376 00010000:00010000:0.0:1715330286.406771:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d7f1c lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x184:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330286.406777:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d7f1c lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x184:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330286.406782:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d7f1c lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x184:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330286.406787:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfe640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330286.406790:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d7f1c lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x184:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330286.406795:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d7f1c lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x184:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330286.406804:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x184:0x0].0x0 (ffff8800b1fd9e00) 00010000:00010000:0.0:1715330286.406807:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330286.406810:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d7f1c lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x184:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330286.406818:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d7f1c lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x184:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00000100:00100000:2.0:1715330286.406894:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1715330286.406908:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942443328:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1715330286.406950:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1715330286.407005:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457d8c0/0xd895711d66d7ffc lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x814526f7 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd895711d66d7ff5 expref: 7 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.407016:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x814526f7 (ffff880093b42500) 00010000:00010000:2.0:1715330286.407019:0:10674:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc900/0xd895711d66d802d lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x814526f7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:2.0:1715330286.407027:0:10674:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc900/0xd895711d66d802d lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x814526f7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT1 00010000:00010000:2.0:1715330286.407033:0:10674:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc900/0xd895711d66d802d lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x814526f7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT1 00010000:00010000:2.0:1715330286.407048:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330286.407074:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d635c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+6:3690:x1798653942443264:12345-0@lo:103:ldlm_bl.0 Request processed in 2302us (2467us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330286.407082:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1496 00000100:00100000:2.0:1715330286.407098:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942443328 00000100:00100000:2.0:1715330286.407103:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942443328 00000100:00100000:2.0:1715330286.407131:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1285 00000100:00100000:2.0:1715330286.407136:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+7:3690:x1798653942443328:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1715330286.407145:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330286.407157:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d7f93 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x814526f6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d7f8c expref: 7 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.407166:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x814526f6 (ffff88012bd8b600) 00010000:00010000:2.0:1715330286.407173:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330286.407188:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+6:3690:x1798653942443328:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 52us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330286.407193:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1285 00000004:00080000:2.0:1715330286.407205:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 723 rpc_version 723 00000020:00100000:2.0:1715330286.407223:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1715330286.407228:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008d48f100 x1798653942443456/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1715330286.407240:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48f100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942443456:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1715330286.407263:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330286.407274:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009d7e3780 going to sleep for 11 seconds 00010000:00010000:2.0:1715330286.407288:0:7134:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc900/0xd895711d66d802d lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x814526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:2.0:1715330286.407294:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc900/0xd895711d66d802d lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x814526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00000100:00100000:2.0:1715330286.407359:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942443520:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1715330286.407380:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330286.407397:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009d7e3a80 going to sleep for 11 seconds 00000100:00100000:2.0:1715330286.407408:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942443520 00000100:00100000:2.0:1715330286.407411:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942443520 00000100:00100000:2.0:1715330286.407426:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2570 00000100:00100000:2.0:1715330286.407430:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7134:x1798653942443520:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1715330286.407494:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7134:x1798653942443520:12345-0@lo:1000:mdt00_001.0 Request processed in 62us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330286.407499:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2570 00000100:00100000:2.0:1715330286.407527:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7134:1798653942443520:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1715330286.407585:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d7f23 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330286.407591:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d7f23 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330286.407595:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d7f23 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330286.407599:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfc240 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330286.407601:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d7f23 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330286.407605:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d7f23 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330286.407611:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc5:0x0].0x0 (ffff8800b1fd9b00) 00010000:00010000:0.0:1715330286.407613:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330286.407615:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d7f23 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330286.407619:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d7f23 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:2.0:1715330286.407890:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64480/0xd895711d66d8034 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1514:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330286.407899:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64480/0xd895711d66d8034 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1514:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:2.0:1715330286.407904:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64480/0xd895711d66d8034 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1514:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00000004:00010000:2.0:1715330286.407923:0:7134:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64480/0xd895711d66d8034 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1514:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:2.0:1715330286.407933:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffcc0/0xd895711d66d8026 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:2.0:1715330286.407939:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffcc0/0xd895711d66d8026 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:2.0:1715330286.407943:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffcc0/0xd895711d66d8026 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:2.0:1715330286.407948:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffcc0/0xd895711d66d8026 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:2.0:1715330286.407952:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bffcc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330286.407954:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffcc0/0xd895711d66d8026 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:2.0:1715330286.407959:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffcc0/0xd895711d66d8026 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:2.0:1715330286.407966:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88008d5ee200) 00010000:00010000:2.0:1715330286.407967:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330286.407970:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffcc0/0xd895711d66d8026 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:2.0:1715330286.407974:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffcc0/0xd895711d66d8026 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:2.0:1715330286.407982:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc900/0xd895711d66d802d lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x814526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT1 00010000:00010000:2.0:1715330286.407986:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc900/0xd895711d66d802d lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x814526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT1 00010000:00010000:2.0:1715330286.407990:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc900/0xd895711d66d802d lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x814526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:2.0:1715330286.407994:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfc900 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330286.407996:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc900/0xd895711d66d802d lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x814526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT1 00010000:00010000:2.0:1715330286.408001:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc900/0xd895711d66d802d lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x814526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT1 00010000:00010000:2.0:1715330286.408006:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x814526f7 (ffff880093b42500) 00010000:00010000:2.0:1715330286.408007:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330286.408009:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc900/0xd895711d66d802d lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x814526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:2.0:1715330286.408013:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc900/0xd895711d66d802d lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x814526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT1 00010000:00010000:2.0:1715330286.408043:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d801f lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb527 expref: 8 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.408057:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64480/0xd895711d66d8034 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1514:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb527 expref: 7 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.408063:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1514:0x0].0x0 (ffff8801345c6900) 00010000:00010000:2.0:1715330286.408065:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1715330286.408067:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db64480, rc 0) 00000100:00100000:2.0:1715330286.408110:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+7:16901:x1798653938021120:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 4160us (4419us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330286.408117:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23318 00000100:00100000:2.0:1715330286.408152:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48f100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942443456:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1715330286.408169:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942443328:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1715330286.408179:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942443264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1715330286.412039:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330286.417062:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330286.420917:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330286.421900:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942443584 00000100:00100000:1.0:1715330286.421903:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942443584 00000100:00100000:1.0:1715330286.421924:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1139 00000100:00100000:1.0:1715330286.421928:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134566680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7134:x1798653942443584:12345-0@lo:104: 00010000:00010000:1.0:1715330286.421937:0:7118:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff840/0xd895711d66d8011 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d8018 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.422035:0:7118:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1715330286.422040:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134566680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7134:x1798653942443584:12345-0@lo:104: Request processed in 111us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.422046:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1139 00010000:00010000:2.0:1715330286.422674:0:7124:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1715330286.422684:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff840/0xd895711d66d8011 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d8018 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.422695:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bff840 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:2.0:1715330286.422700:0:7124:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff840/0xd895711d66d8011 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0xc8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd895711d66d8018 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1715330286.422708:0:7124:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff840/0xd895711d66d8011 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0xc8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd895711d66d8018 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.422764:0:7124:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff840/0xd895711d66d8011 lrc: 2/0,0 mode: --/PW res: [0x240000401:0xc8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d8018 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.422770:0:7124:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1715330286.422985:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff840/0xd895711d66d8011 lrc: 1/0,0 mode: --/PW res: [0x240000401:0xc8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d8018 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.422993:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff840/0xd895711d66d8011 lrc: 0/0,0 mode: --/PW res: [0x240000401:0xc8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d8018 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.423012:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330286.423014:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330286.423015:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330286.423119:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942443648 00000100:00100000:0.0:1715330286.423125:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942443648 00010000:00010000:0.0:1715330286.423148:0:7122:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66640/0xd895711d66d8018 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd895711d66d8011 expref: 6 pid: 23404 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330286.423169:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1497 00000100:00100000:0.0:1715330286.423176:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134564e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+6:3688:x1798653942443648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330286.423188:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00080000:1.0:1715330286.425285:0:8267:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0001: 375 batchid updated 00010000:00010000:0.0:1715330286.425393:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66640/0xd895711d66d8018 lrc: 0/0,0 mode: --/PW res: [0x240000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd895711d66d8011 expref: 6 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.425410:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc8:0x0].0x0 (ffff8801345c6400) 00010000:00010000:0.0:1715330286.425414:0:7122:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c6c0/0xd895711d66d805e lrc: 3/1,0 mode: --/PR res: [0x240000401:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330286.425423:0:7122:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c6c0/0xd895711d66d805e lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330286.425429:0:7122:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c6c0/0xd895711d66d805e lrc: 4/1,0 mode: PR/PR res: [0x240000401:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT1 00010000:00010000:0.0:1715330286.425458:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330286.425519:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134564e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942443648:12345-0@lo:103:ldlm_bl.0 Request processed in 2342us (2612us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.425527:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1497 00000020:00080000:2.0:1715330286.425602:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 375 00000004:00080000:2.0:1715330286.425660:0:8285:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff880091ffa480 with version 724 00000020:00080000:2.0:1715330286.425668:0:8285:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 375 cancel update log [0x200000401:0x3:0x0].378: rc = 0 00000020:00080000:2.0:1715330286.425754:0:8285:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 375 cancel update log [0x240000400:0x3:0x0].376: rc = 0 00000020:00080000:2.0:1715330286.425762:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 375 00000004:00080000:0.0:1715330286.425816:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 724 rpc_version 724 00000020:00100000:0.0:1715330286.425845:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1715330286.425851:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008d4e9880 x1798653942443776/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715330286.425869:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e9880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942443776:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330286.425906:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330286.426458:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffc900 going to sleep for 11 seconds 00000100:00100000:1.0:1715330286.426535:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942443776 00000100:00100000:1.0:1715330286.426555:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942443776 00000100:00100000:1.0:1715330286.426586:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2572 00000100:00100000:1.0:1715330286.426591:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:8278:x1798653942443776:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1715330286.426698:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:8278:x1798653942443776:12345-0@lo:1000:osp_up0-1.0 Request processed in 106us (791us total) trans 4294983418 rc 0/0 00000100:00100000:1.0:1715330286.426704:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2572 00000100:00100000:0.0:1715330286.426798:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e9880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942443776:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330286.430489:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330286.430536:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330286.430577:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938021376 00000100:00100000:0.0:1715330286.430591:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938021376 00000100:00100000:0.0:1715330286.430639:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1286 00000100:00100000:0.0:1715330286.430646:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72de1896-1df4-4b3a-930a-9116d2c66168+8:2011:x1798653938021376:12345-192.168.204.49@tcp:103:rmdir.0 00010000:00010000:0.0:1715330286.430662:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330286.430696:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64480/0xd895711d66d8034 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1514:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb527 expref: 8 pid: 7134 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330286.430704:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938021504 00000100:00100000:2.0:1715330286.430709:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938021504 00010000:00010000:0.0:1715330286.430714:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1514:0x0].0x0 (ffff8801345c6900) 00010000:00010000:0.0:1715330286.430724:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330286.430750:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23322 00000100:00100000:2.0:1715330286.430755:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+18:16901:x1798653938021504:12345-192.168.204.49@tcp:36:rmdir.0 00000100:00100000:0.0:1715330286.430781:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72de1896-1df4-4b3a-930a-9116d2c66168+7:2011:x1798653938021376:12345-192.168.204.49@tcp:103:rmdir.0 Request processed in 134us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.430789:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1286 00010000:00010000:2.0:1715330286.430802:0:7134:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330286.430817:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f600/0xd895711d66d8042 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1514:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb52e expref: 18 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.430830:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1514:0x0].0x0 (ffff88008d5ee800) 00010000:00010000:2.0:1715330286.430833:0:7134:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330286.430879:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db65440/0xd895711d66d8065 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330286.430887:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db65440/0xd895711d66d8065 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330286.430896:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db65440/0xd895711d66d8065 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT0 00000100:00100000:2.0:1715330286.430919:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801345a7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942443840:0@lo:101:mdt00_001.0 00000100:00100000:2.0:1715330286.430961:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330286.430978:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330286.431171:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942443840 00000100:00100000:0.0:1715330286.431175:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942443840 00000100:00100000:0.0:1715330286.431209:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2573 00000100:00100000:0.0:1715330286.431213:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:7134:x1798653942443840:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330286.431223:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330286.431236:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d806c lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d8065 expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.431257:0:9408:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d806c lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d8065 expref: 6 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.431266:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d806c lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8065 expref: 6 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.431271:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88009d618e00) 00010000:00010000:0.0:1715330286.431274:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330286.431276:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f2d00, rc 0) 00000100:00100000:0.0:1715330286.431312:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7134:x1798653942443840:12345-0@lo:101:mdt00_001.0 Request processed in 98us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.431317:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2573 00000100:00100000:2.0:1715330286.431388:0:7134:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968364 gen 2 00000004:00080000:2.0:1715330286.431395:0:7134:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968359 committed transno 4294968364 00000020:00080000:2.0:1715330286.431400:0:7134:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88012f47ec00 refcount 2 committed 0 result 0 batchid 368 00000020:00080000:2.0:1715330286.431404:0:7134:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009ef25f00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88012f47e900 00000020:00080000:2.0:1715330286.431407:0:7134:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].352 00000020:00080000:2.0:1715330286.431409:0:7134:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009ef25d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88008d40ba00 00000020:00080000:2.0:1715330286.431411:0:7134:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].353 00000020:00080000:1.0:1715330286.431448:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 368 committed batchid 367 00000004:00080000:2.0:1715330286.431449:0:7134:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968361 committed transno 4294968364 00000004:00080000:2.0:1715330286.431465:0:7134:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968362 committed transno 4294968364 00000004:00080000:2.0:1715330286.431480:0:7134:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968364 committed transno 4294968364 00000100:00100000:2.0:1715330286.431502:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801345a7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942443840:0@lo:101:mdt00_001.0 00000020:00080000:1.0:1715330286.431505:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 367 00010000:00010000:2.0:1715330286.431513:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db65440/0xd895711d66d8065 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d806c expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.431523:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db65440/0xd895711d66d8065 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d806c expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715330286.431540:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:2.0:1715330286.431569:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67840/0xd895711d66d8073 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x814526f7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330286.431574:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67840/0xd895711d66d8073 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x814526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330286.431580:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67840/0xd895711d66d8073 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x814526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT0 00000100:00100000:2.0:1715330286.431589:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942443904:0@lo:101:mdt00_001.0 00000100:00100000:2.0:1715330286.431609:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330286.431984:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330286.432384:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942443904 00000100:00100000:1.0:1715330286.432389:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942443904 00000100:00100000:1.0:1715330286.432409:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2574 00000100:00100000:1.0:1715330286.432415:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801345a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7134:x1798653942443904:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1715330286.432423:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330286.432434:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d807a lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x814526f7 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d8073 expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.432449:0:9407:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d807a lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526f7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d8073 expref: 7 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.432457:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d807a lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526f7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8073 expref: 7 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.432464:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x814526f7 (ffff88008d5ee200) 00010000:00010000:1.0:1715330286.432466:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330286.432468:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfc6c0, rc 0) 00000100:00100000:1.0:1715330286.432505:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801345a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7134:x1798653942443904:12345-0@lo:101:mdt00_001.0 Request processed in 89us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.432510:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2574 00000100:00100000:2.0:1715330286.432674:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942443904:0@lo:101:mdt00_001.0 00010000:00010000:2.0:1715330286.432684:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67840/0xd895711d66d8073 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526f7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d807a expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.432692:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67840/0xd895711d66d8073 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526f7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d807a expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715330286.432704:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:2.0:1715330286.432769:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942443968:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1715330286.432794:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330286.432803:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa000 going to sleep for 11 seconds 00000100:00100000:0.0:1715330286.432813:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942443968 00000100:00100000:0.0:1715330286.432818:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942443968 00000100:00100000:0.0:1715330286.432843:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2575 00000100:00100000:0.0:1715330286.432847:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d61ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7134:x1798653942443968:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715330286.432916:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d61ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7134:x1798653942443968:12345-0@lo:1000:mdt00_001.0 Request processed in 68us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.432922:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2575 00000100:00100000:2.0:1715330286.432941:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942443968:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1715330286.432976:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942444032:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1715330286.432996:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330286.433005:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa000 going to sleep for 11 seconds 00000100:00100000:1.0:1715330286.433007:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942444032 00000100:00100000:1.0:1715330286.433010:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942444032 00000100:00100000:1.0:1715330286.433022:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2576 00000100:00100000:1.0:1715330286.433025:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ba1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7134:x1798653942444032:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1715330286.433087:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ba1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7134:x1798653942444032:12345-0@lo:1000:mdt00_001.0 Request processed in 60us (90us total) trans 0 rc 1/1 00000100:00100000:1.0:1715330286.433092:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2576 00000100:00100000:2.0:1715330286.433207:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942444032:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1715330286.433241:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67cc0/0xd895711d66d8081 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1514:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330286.433246:0:7134:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67cc0/0xd895711d66d8081 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1514:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330286.433251:0:7134:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67cc0/0xd895711d66d8081 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1514:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7134 initiator: MDT0 00000100:00100000:2.0:1715330286.433260:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942444096:0@lo:101:mdt00_001.0 00000100:00100000:2.0:1715330286.434300:0:7134:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330286.434338:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330286.434472:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942444096 00000100:00100000:0.0:1715330286.434479:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942444096 00000100:00100000:0.0:1715330286.434511:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2577 00000100:00100000:0.0:1715330286.434517:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7134:x1798653942444096:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330286.434531:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330286.434561:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f06c0/0xd895711d66d8088 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1514:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d8081 expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.434584:0:9407:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f06c0/0xd895711d66d8088 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1514:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d8081 expref: 8 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.434595:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f06c0/0xd895711d66d8088 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1514:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8081 expref: 8 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.434601:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1514:0x0].0x0 (ffff88009d618000) 00010000:00010000:0.0:1715330286.434604:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1715330286.434606:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f06c0, rc 0) 00000100:00100000:0.0:1715330286.434647:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:7134:x1798653942444096:12345-0@lo:101:mdt00_001.0 Request processed in 129us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.434652:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2577 00000100:00100000:2.0:1715330286.434719:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7134:1798653942444096:0@lo:101:mdt00_001.0 00010000:00010000:2.0:1715330286.434745:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67cc0/0xd895711d66d8081 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1514:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8088 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.434754:0:7134:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67cc0/0xd895711d66d8081 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1514:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8088 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.434776:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d808f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1514:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330286.434783:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d808f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1514:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330286.434789:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d808f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1514:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330286.434804:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d8096 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xc8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330286.434817:0:7134:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cd80/0xd895711d66d8050 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb535 expref: 17 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.434823:0:7134:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d8096 lrc: 4/0,1 mode: --/EX res: [0x200000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330286.434845:0:7134:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cd80/0xd895711d66d8050 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb535 expref: 17 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.434855:0:7134:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cd80/0xd895711d66d8050 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb535 expref: 17 pid: 7134 timeout: 360 lvb_type: 0 00000100:00100000:2.0:1715330286.434866:0:7134:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7134:1798653942444160:192.168.204.49@tcp:104: 00000100:00100000:2.0:1715330286.434907:0:7134:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715330286.436965:0:7134:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7134:1798653942444160:192.168.204.49@tcp:104: 00010000:00010000:2.0:1715330286.436979:0:7134:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d8096 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000100:00100000:1.0:1715330286.439421:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330286.439479:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938021568 00000100:00100000:0.0:1715330286.439486:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938021568 00010000:00010000:0.0:1715330286.439511:0:10674:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cd80/0xd895711d66d8050 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb535 expref: 18 pid: 7134 timeout: 360 lvb_type: 0 00000100:00100000:0.0:1715330286.439533:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1498 00000100:00100000:0.0:1715330286.439539:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:72de1896-1df4-4b3a-930a-9116d2c66168+18:2011:x1798653938021568:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1715330286.439560:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330286.439565:0:10674:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cd80/0xd895711d66d8050 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb535 expref: 18 pid: 7134 timeout: 360 lvb_type: 0 00010000:00010000:0.0:1715330286.439575:0:10674:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cd80/0xd895711d66d8050 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb535 expref: 18 pid: 7134 timeout: 360 lvb_type: 0 00010000:00010000:0.0:1715330286.439592:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cd80/0xd895711d66d8050 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb535 expref: 18 pid: 7134 timeout: 360 lvb_type: 0 00010000:00010000:0.0:1715330286.439603:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xc8:0x0].0x0 (ffff88008d5ee700) 00010000:00010000:0.0:1715330286.439608:0:10674:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d8096 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.439615:0:10674:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d8096 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.439621:0:10674:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d8096 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.439653:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330286.439685:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:72de1896-1df4-4b3a-930a-9116d2c66168+17:2011:x1798653938021568:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 145us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.439692:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1498 00000100:00100000:0.0:1715330286.441133:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942444224 00000100:00100000:0.0:1715330286.441137:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942444224 00000100:00100000:0.0:1715330286.441157:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2578 00000100:00100000:0.0:1715330286.441162:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134565f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:7134:x1798653942444224:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715330286.441175:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330286.441187:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1b00/0xd895711d66d80a4 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xc8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d809d expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.441203:0:9407:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c6c0/0xd895711d66d805e lrc: 2/0,0 mode: PR/PR res: [0x240000401:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb53c expref: 6 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.441209:0:9407:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1b00/0xd895711d66d80a4 lrc: 4/0,0 mode: --/EX res: [0x240000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d809d expref: 9 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.441226:0:9407:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c6c0/0xd895711d66d805e lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb53c expref: 6 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.441236:0:9407:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c6c0/0xd895711d66d805e lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb53c expref: 6 pid: 7134 timeout: 360 lvb_type: 0 00000100:00100000:0.0:1715330286.441245:0:9407:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4ead80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:9407:1798653942444288:192.168.204.49@tcp:104: 00000100:00100000:0.0:1715330286.441269:0:9407:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715330286.446315:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00010000:00010000:0.0:1715330286.446554:0:9407:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c6c0/0xd895711d66d805e lrc: 0/0,0 mode: --/PR res: [0x240000401:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb53c expref: 7 pid: 7134 timeout: 360 lvb_type: 0 00000100:00100000:0.0:1715330286.446568:0:9407:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4ead80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:9407:1798653942444288:192.168.204.49@tcp:104: 00010000:00010000:0.0:1715330286.446588:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1b00/0xd895711d66d80a4 lrc: 4/0,0 mode: EX/EX res: [0x240000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d809d expref: 9 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.446596:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc8:0x0].0x0 (ffff8801345c6400) 00010000:00010000:0.0:1715330286.446598:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715330286.446600:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f1b00, rc 0) 00000100:00100000:0.0:1715330286.446636:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134565f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7134:x1798653942444224:12345-0@lo:101:mdt00_001.0 Request processed in 5473us (6851us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.446642:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2578 00000100:00100000:2.0:1715330286.447007:0:7118:0:(service.c:168:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1715330286.447017:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942444352 00000100:00100000:2.0:1715330286.447020:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942444352 00000100:00100000:2.0:1715330286.447039:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1140 00000100:00100000:2.0:1715330286.447043:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa96c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7122:x1798653942444352:12345-0@lo:105: 00010000:00010000:2.0:1715330286.447052:0:7118:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e640/0xd895711d66d809d lrc: 4/0,1 mode: --/EX res: [0x240000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d80a4 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.447060:0:7118:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e640/0xd895711d66d809d lrc: 4/0,1 mode: --/EX res: [0x240000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d80a4 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.447067:0:7118:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e640/0xd895711d66d809d lrc: 4/0,1 mode: --/EX res: [0x240000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d80a4 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.447072:0:7118:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e640/0xd895711d66d809d lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d80a4 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.447078:0:7118:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e640/0xd895711d66d809d lrc: 5/0,1 mode: EX/EX res: [0x240000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d80a4 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.447084:0:7118:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e640/0xd895711d66d809d lrc: 5/0,1 mode: EX/EX res: [0x240000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d80a4 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.447093:0:7118:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88013457e640) 00000100:00100000:2.0:1715330286.447115:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa96c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7122:x1798653942444352:12345-0@lo:105: Request processed in 71us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330286.447119:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1140 00000100:00100000:0.0:1715330286.449933:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942444416 00000100:00100000:0.0:1715330286.449939:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942444416 00000100:00100000:0.0:1715330286.449960:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2579 00000100:00100000:0.0:1715330286.449965:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134565180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7134:x1798653942444416:12345-0@lo:403:mdt00_001.0 00000100:00100000:0.0:1715330286.453886:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134565180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7134:x1798653942444416:12345-0@lo:403:mdt00_001.0 Request processed in 3917us (4173us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.453897:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2579 00000004:00080000:1.0:1715330286.456263:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 675 rpc_version 675 00000020:00100000:1.0:1715330286.456288:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1715330286.456294:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880091d57800 x1798653942444544/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1808/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1715330286.456312:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d57800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942444544:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330286.456349:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.456363:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009396c600 going to sleep for 11 seconds 00000100:00100000:1.0:1715330286.457578:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d57800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942444544:0@lo:1000:osp_up1-0.0 00000004:00200000:2.0:1715330286.457634:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1514:0x0]: returning size 4096 00010000:00010000:2.0:1715330286.457653:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d8096 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330286.457661:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d8096 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330286.457667:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d8096 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330286.457672:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db67600 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330286.457676:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d8096 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330286.457685:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d8096 lrc: 4/0,0 mode: EX/EX res: [0x200000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330286.457697:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xc8:0x0].0x0 (ffff88008d5ee700) 00010000:00010000:2.0:1715330286.457699:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330286.457702:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d8096 lrc: 2/0,0 mode: --/EX res: [0x200000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330286.457706:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d8096 lrc: 0/0,0 mode: --/EX res: [0x200000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330286.457716:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e640/0xd895711d66d809d lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d80a4 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.457723:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e640/0xd895711d66d809d lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d80a4 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.458347:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e640/0xd895711d66d809d lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d80a4 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.458372:0:7134:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1715330286.458380:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0xc8:0x0] 00010000:00010000:2.0:1715330286.458387:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d808f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1514:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330286.458393:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d808f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1514:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330286.458397:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d808f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1514:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330286.458400:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64000 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330286.458403:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d808f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1514:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330286.458407:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d808f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1514:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330286.458414:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1514:0x0].0x0 (ffff88008d5ee800) 00010000:00010000:2.0:1715330286.458417:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330286.458419:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d808f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1514:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330286.458423:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d808f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1514:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330286.458431:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67cc0/0xd895711d66d8081 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1514:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8088 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.458436:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67cc0/0xd895711d66d8081 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1514:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8088 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.458441:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67cc0/0xd895711d66d8081 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1514:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8088 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.458450:0:7134:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1715330286.458558:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134564700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942444608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330286.458585:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330286.458608:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942444608 00000100:00100000:0.0:1715330286.458612:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942444608 00000100:00100000:0.0:1715330286.458631:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1287 00000100:00100000:0.0:1715330286.458635:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+10:3689:x1798653942444608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330286.458644:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330286.458655:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1b00/0xd895711d66d80a4 lrc: 0/0,0 mode: --/EX res: [0x240000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d809d expref: 10 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.458666:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xc8:0x0].0x0 (ffff8801345c6400) 00010000:00010000:0.0:1715330286.458672:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330286.458688:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+9:3689:x1798653942444608:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.458693:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1287 00000100:00100000:0.0:1715330286.458710:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880134564700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942444608:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1715330286.459575:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134564e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942444672:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1715330286.459598:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330286.459855:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942444672 00000100:00100000:0.0:1715330286.459860:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942444672 00000100:00100000:0.0:1715330286.459879:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1288 00000100:00100000:0.0:1715330286.459883:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+9:3690:x1798653942444672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330286.459891:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330286.459900:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f06c0/0xd895711d66d8088 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1514:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d8081 expref: 9 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.459909:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1514:0x0].0x0 (ffff88009d618000) 00010000:00010000:0.0:1715330286.459913:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330286.459940:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+8:3690:x1798653942444672:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.459946:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1288 00000100:00100000:2.0:1715330286.459985:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880134564e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942444672:0@lo:103:ldlm_bl.0 00000004:00080000:2.0:1715330286.460015:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:2.0:1715330286.460019:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db65440/0xd895711d66d8065 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d806c expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.460028:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db65440/0xd895711d66d8065 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d806c expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.460033:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db65440/0xd895711d66d8065 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d806c expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.460042:0:7134:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1715330286.460044:0:7134:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:2.0:1715330286.460047:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67840/0xd895711d66d8073 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526f7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d807a expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.460052:0:7134:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67840/0xd895711d66d8073 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526f7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d807a expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330286.460096:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+17:16901:x1798653938021504:12345-192.168.204.49@tcp:36:rmdir.0 Request processed in 29340us (29558us total) trans 4294983419 rc 0/0 00000100:00100000:2.0:1715330286.460102:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23322 00000100:00100000:2.0:1715330286.460123:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1715330286.460128:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134564a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942444736:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1715330286.460146:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330286.460264:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942444736 00000100:00100000:0.0:1715330286.460268:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942444736 00000100:00100000:0.0:1715330286.460283:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1289 00000100:00100000:0.0:1715330286.460286:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+8:3690:x1798653942444736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330286.460292:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330286.460300:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2d00/0xd895711d66d806c lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d8065 expref: 8 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.460313:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88009d618e00) 00010000:00010000:0.0:1715330286.460318:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330286.460349:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+7:3690:x1798653942444736:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.460354:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1289 00000100:00100000:2.0:1715330286.460559:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880134564a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942444736:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1715330286.473639:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330286.474045:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938021696 00000100:00100000:0.0:1715330286.474053:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938021696 00000100:00100000:0.0:1715330286.474102:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23323 00000100:00100000:0.0:1715330286.474109:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+17:16903:x1798653938021696:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:0.0:1715330286.474611:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330286.474627:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66d80ab lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb543 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.474681:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66d80b2 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.474691:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66d80b2 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.474699:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66d80b2 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.474709:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d80b9 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x814526f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.474714:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d80b9 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.474718:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d80b9 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.474770:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66d80b2 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.474775:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66d80b2 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.474780:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66d80b2 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.474785:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66d80b2 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.474789:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f18c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330286.474792:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66d80b2 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.474798:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66d80b2 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.474806:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff8801345c6d00) 00010000:00010000:0.0:1715330286.474809:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330286.474812:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66d80b2 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.474817:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66d80b2 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.474826:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d80b9 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.474830:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d80b9 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.474833:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d80b9 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.474838:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f1680 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330286.474840:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d80b9 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.474844:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d80b9 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x814526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.474850:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x814526f8 (ffff88009d618600) 00010000:00010000:0.0:1715330286.474851:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330286.474853:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d80b9 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x814526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.474857:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d80b9 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x814526f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330286.474878:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66d80ab lrc: 1/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb543 expref: 18 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.474884:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66d80ab lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb543 expref: 18 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.474890:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f2880, rc 0) 00000100:00100000:0.0:1715330286.474933:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+17:16903:x1798653938021696:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 824us (1299us total) trans 0 rc 301/301 00000100:00100000:0.0:1715330286.474939:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23323 00000100:00100000:0.0:1715330286.479598:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330286.487295:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330286.487772:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942444800 00000100:00100000:2.0:1715330286.487775:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942444800 00000100:00100000:2.0:1715330286.487804:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2581 00000100:00100000:2.0:1715330286.487809:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134566a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:7135:x1798653942444800:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1715330286.487886:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134566a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:7135:x1798653942444800:12345-0@lo:1000:mdt00_002.0 Request processed in 75us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330286.487892:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2581 00000100:00100000:0.0:1715330286.488357:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942444864 00000100:00100000:0.0:1715330286.488361:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942444864 00000100:00100000:0.0:1715330286.488497:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2582 00000100:00100000:0.0:1715330286.488502:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134565c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:7135:x1798653942444864:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1715330286.488592:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134565c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:7135:x1798653942444864:12345-0@lo:1000:mdt00_002.0 Request processed in 90us (345us total) trans 0 rc -2/-2 00000100:00100000:0.0:1715330286.488598:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2582 00000100:00100000:2.0:1715330286.488819:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942444928 00000100:00100000:2.0:1715330286.488822:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942444928 00000100:00100000:2.0:1715330286.488837:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2583 00000100:00100000:2.0:1715330286.488840:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134564a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:7135:x1798653942444928:12345-0@lo:101:mdt00_002.0 00010000:00010000:2.0:1715330286.488849:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330286.488864:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d80d5 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d80ce expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.488885:0:9408:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d7fe0 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb520 expref: 16 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.488893:0:9408:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d80d5 lrc: 4/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d80ce expref: 9 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.488914:0:9408:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d7fe0 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb520 expref: 16 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.488925:0:9408:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d7fe0 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb520 expref: 16 pid: 7135 timeout: 360 lvb_type: 0 00000100:00100000:2.0:1715330286.488935:0:9408:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba65500 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:9408:1798653942444992:192.168.204.49@tcp:104: 00000100:00100000:2.0:1715330286.488984:0:9408:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715330286.491356:0:9408:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba65500 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:9408:1798653942444992:192.168.204.49@tcp:104: 00010000:00010000:2.0:1715330286.491382:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d80d5 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d80ce expref: 9 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.491393:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff8801345c6d00) 00010000:00010000:2.0:1715330286.491396:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330286.491399:0:9408:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d80d5 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d80ce expref: 9 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.491406:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db65440, rc 0) 00000100:00100000:2.0:1715330286.491455:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134564a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7135:x1798653942444928:12345-0@lo:101:mdt00_002.0 Request processed in 2612us (2687us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330286.491462:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2583 00000100:00100000:2.0:1715330286.492501:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330286.492568:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938021952 00000100:00100000:0.0:1715330286.492573:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938021952 00010000:00010000:0.0:1715330286.492596:0:10674:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d7fe0 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb520 expref: 17 pid: 7135 timeout: 360 lvb_type: 0 00000100:00100000:0.0:1715330286.492627:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1500 00000100:00100000:0.0:1715330286.492633:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:72de1896-1df4-4b3a-930a-9116d2c66168+17:2012:x1798653938021952:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1715330286.492644:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330286.492649:0:10674:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d7fe0 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb520 expref: 17 pid: 7135 timeout: 360 lvb_type: 0 00010000:00010000:0.0:1715330286.492658:0:10674:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d7fe0 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb520 expref: 17 pid: 7135 timeout: 360 lvb_type: 0 00010000:00010000:0.0:1715330286.492676:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d7fe0 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb520 expref: 17 pid: 7135 timeout: 360 lvb_type: 0 00010000:00010000:0.0:1715330286.492697:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff8801345c6d00) 00010000:00010000:0.0:1715330286.492702:0:10674:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d80d5 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d80ce expref: 8 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.492709:0:10674:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d80d5 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d80ce expref: 8 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.492715:0:10674:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d80d5 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d80ce expref: 8 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.492763:0:10674:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d80d5 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d80ce expref: 8 pid: 9408 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330286.492775:0:10674:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4eb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:10674:1798653942445056:0@lo:105: 00000100:00100000:0.0:1715330286.492803:0:10674:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330286.493348:0:10674:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffc540 going to sleep for 11 seconds 00000100:00100000:1.0:1715330286.493406:0:9413:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942445056 00000100:00100000:1.0:1715330286.493409:0:9413:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942445056 00000100:00100000:1.0:1715330286.493440:0:9413:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1141 00000100:00100000:1.0:1715330286.493445:0:9413:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:10674:x1798653942445056:12345-0@lo:105: 00010000:00010000:1.0:1715330286.493453:0:9413:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c6c0/0xd895711d66d80ce lrc: 5/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d80d5 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.493459:0:9413:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c6c0/0xd895711d66d80ce lrc: 5/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d80d5 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.493466:0:9413:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c6c0/0xd895711d66d80ce lrc: 5/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d80d5 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.493472:0:9413:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c6c0/0xd895711d66d80ce lrc: 5/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d80d5 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.493477:0:9413:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c6c0/0xd895711d66d80ce lrc: 6/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d80d5 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.493484:0:9413:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c6c0/0xd895711d66d80ce lrc: 6/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d80d5 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.493506:0:9413:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88013457c6c0) 00000100:00100000:1.0:1715330286.493555:0:9413:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:10674:x1798653942445056:12345-0@lo:105: Request processed in 109us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.493561:0:9413:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1141 00000100:00100000:0.0:1715330286.493775:0:10674:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4eb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:10674:1798653942445056:0@lo:105: 00010000:00010000:0.0:1715330286.493787:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330286.493832:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:72de1896-1df4-4b3a-930a-9116d2c66168+16:2012:x1798653938021952:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 1198us (1332us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.493839:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1500 00000100:00100000:2.0:1715330286.493890:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942445120 00000100:00100000:2.0:1715330286.493893:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942445120 00000100:00100000:2.0:1715330286.493910:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2584 00000100:00100000:2.0:1715330286.493914:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134564e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7135:x1798653942445120:12345-0@lo:101:mdt00_002.0 00010000:00010000:2.0:1715330286.493928:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330286.493941:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d80e3 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x814526f8 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d80dc expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.493955:0:9408:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d80e3 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d80dc expref: 10 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.493964:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d80e3 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d80dc expref: 10 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.493969:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x814526f8 (ffff8800b1fd9b00) 00010000:00010000:2.0:1715330286.493971:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330286.493973:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db67cc0, rc 0) 00000100:00100000:2.0:1715330286.494000:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134564e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:7135:x1798653942445120:12345-0@lo:101:mdt00_002.0 Request processed in 85us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330286.494005:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2584 00000100:00100000:0.0:1715330286.494323:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942445184 00000100:00100000:0.0:1715330286.494328:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942445184 00000100:00100000:0.0:1715330286.494354:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2585 00000100:00100000:0.0:1715330286.494358:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134564700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:7135:x1798653942445184:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1715330286.494416:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134564700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:7135:x1798653942445184:12345-0@lo:1000:mdt00_002.0 Request processed in 57us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.494421:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2585 00000100:00100000:1.0:1715330286.494561:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942445248 00000100:00100000:1.0:1715330286.494567:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942445248 00000100:00100000:1.0:1715330286.494583:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2586 00000100:00100000:1.0:1715330286.494587:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134566680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:7135:x1798653942445248:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330286.494696:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134566680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:7135:x1798653942445248:12345-0@lo:1000:mdt00_002.0 Request processed in 107us (177us total) trans 0 rc -2/-2 00000100:00100000:1.0:1715330286.494702:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2586 00000100:00100000:1.0:1715330286.494981:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942445312 00000100:00100000:1.0:1715330286.494984:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942445312 00000100:00100000:1.0:1715330286.495063:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2587 00000100:00100000:1.0:1715330286.495066:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:7135:x1798653942445312:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330286.495108:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:7135:x1798653942445312:12345-0@lo:1000:mdt00_002.0 Request processed in 41us (238us total) trans 0 rc -2/-2 00000100:00100000:1.0:1715330286.495113:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2587 00000100:00100000:1.0:1715330286.495251:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942445376 00000100:00100000:1.0:1715330286.495253:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942445376 00000100:00100000:2.0:1715330286.495316:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2588 00000100:00100000:2.0:1715330286.495321:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:7135:x1798653942445376:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1715330286.495362:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:7135:x1798653942445376:12345-0@lo:1000:mdt00_002.0 Request processed in 41us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.495442:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942445440 00000100:00100000:1.0:1715330286.495445:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942445440 00000100:00100000:2.0:1715330286.495484:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2588 00000100:00100000:2.0:1715330286.495494:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2589 00000100:00100000:2.0:1715330286.495497:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:7135:x1798653942445440:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1715330286.495526:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:7135:x1798653942445440:12345-0@lo:1000:mdt00_002.0 Request processed in 28us (96us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330286.495531:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2589 00000040:00080000:2.0:1715330286.496206:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].378, 2168 off573672 00000040:00080000:2.0:1715330286.496268:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].380, 2368 off628072 00000004:00080000:2.0:1715330286.496272:0:7135:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88012f47ed80 with version 725 00000004:00080000:0.0:1715330286.496341:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 725 rpc_version 725 00000020:00100000:0.0:1715330286.496362:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1715330286.496369:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008d4eb800 x1798653942445568/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715330286.496380:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4eb800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942445568:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330286.496406:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330286.496416:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffc540 going to sleep for 11 seconds 00000100:00100000:2.0:1715330286.496460:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942445568 00000100:00100000:2.0:1715330286.496463:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942445568 00000100:00100000:2.0:1715330286.496518:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2590 00000100:00100000:2.0:1715330286.496523:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:8278:x1798653942445568:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1715330286.496893:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:8278:x1798653942445568:12345-0@lo:1000:osp_up0-1.0 Request processed in 369us (485us total) trans 4294983420 rc 0/0 00000100:00100000:2.0:1715330286.496898:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2590 00000100:00100000:1.0:1715330286.496926:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4eb800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942445568:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1715330286.497016:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64480/0xd895711d66d80ea lrc: 3/0,1 mode: --/PW res: [0x240000402:0x186:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.497026:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64480/0xd895711d66d80ea lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x186:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.497033:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64480/0xd895711d66d80ea lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x186:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.497046:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66640/0xd895711d66d80f1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.497050:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66640/0xd895711d66d80f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.497054:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66640/0xd895711d66d80f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.497069:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db67a80/0xd895711d66d80f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.497073:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db67a80/0xd895711d66d80f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.497080:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db67a80/0xd895711d66d80f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT1 00000100:00100000:2.0:1715330286.497094:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba66300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942445632:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1715330286.497113:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330286.497132:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330286.497432:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942445632 00000100:00100000:0.0:1715330286.497436:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942445632 00000100:00100000:0.0:1715330286.497490:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2591 00000100:00100000:0.0:1715330286.497495:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d619180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:7135:x1798653942445632:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330286.497505:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330286.497516:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d80ff lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d80f8 expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.497528:0:23404:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d80ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d80f8 expref: 12 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.497536:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d80ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d80f8 expref: 12 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.497561:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc6:0x0].0x0 (ffff88009d618c00) 00010000:00010000:0.0:1715330286.497563:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330286.497565:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f1d40, rc 0) 00000100:00100000:0.0:1715330286.497750:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d619180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:7135:x1798653942445632:12345-0@lo:101:mdt00_002.0 Request processed in 253us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.497755:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2591 00000100:00100000:2.0:1715330286.497781:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba66300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942445632:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1715330286.497790:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db67a80/0xd895711d66d80f8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d80ff expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.497797:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db67a80/0xd895711d66d80f8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d80ff expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1715330286.497808:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009ba65c00 reply state ffff880093ada000 transno 4294968366 ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66640/0xd895711d66d80f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.497816:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66640/0xd895711d66d80f1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.497821:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc6:0x0].0x0 (ffff8800b1fd9e00) 00010000:00010000:2.0:1715330286.497823:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330286.497825:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1715330286.497829:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db67a80/0xd895711d66d80f8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d80ff expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.497835:0:7135:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db67a80/0xd895711d66d80f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d80ff expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715330286.497842:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000401:0xc6:0x0] 00000004:00010000:2.0:1715330286.497845:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009ba65c00 reply state ffff880093ada000 transno 4294968366 ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64480/0xd895711d66d80ea lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x186:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.497851:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64480/0xd895711d66d80ea lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x186:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.497855:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x186:0x0].0x0 (ffff8800b1fd9d00) 00010000:00010000:2.0:1715330286.497856:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330286.497857:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00200000:2.0:1715330286.497861:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x186:0x0]: returning size 4096 00000004:00080000:2.0:1715330286.497865:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:2.0:1715330286.497868:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c6c0/0xd895711d66d80ce lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d80d5 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.497873:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c6c0/0xd895711d66d80ce lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d80d5 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.497878:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c6c0/0xd895711d66d80ce lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d80d5 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.497900:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1715330286.497904:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:2.0:1715330286.497907:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457cd80/0xd895711d66d80dc lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d80e3 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.497913:0:7135:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457cd80/0xd895711d66d80dc lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d80e3 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330286.497968:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+9:16903:x1798653938021888:12345-192.168.204.49@tcp:36:lfs.0 Request processed in 10491us (10682us total) trans 4294968366 rc 0/0 00000100:00100000:2.0:1715330286.497975:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23325 00000100:00100000:1.0:1715330286.498219:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942445696 00000100:00100000:1.0:1715330286.498223:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942445696 00000100:00100000:1.0:1715330286.498240:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1290 00000100:00100000:1.0:1715330286.498245:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134567480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942445696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330286.498253:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330286.498262:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d80d5 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d80ce expref: 12 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.498272:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff8801345c6d00) 00010000:00010000:1.0:1715330286.498277:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330286.498297:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134567480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+11:3688:x1798653942445696:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.498302:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1290 00000100:00100000:2.0:1715330286.507065:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330286.507162:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938022080 00000100:00100000:0.0:1715330286.507171:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938022080 00000100:00100000:0.0:1715330286.507214:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23326 00000100:00100000:0.0:1715330286.507221:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d61ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+16:16904:x1798653938022080:12345-192.168.204.49@tcp:36:mkdir.0 00000100:00100000:0.0:1715330286.507802:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d61ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+16:16904:x1798653938022080:12345-192.168.204.49@tcp:36:mkdir.0 Request processed in 580us (743us total) trans 0 rc -17/-17 00000100:00100000:0.0:1715330286.507809:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23326 00000100:00100000:0.0:1715330286.516800:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330286.516931:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938022144 00000100:00100000:2.0:1715330286.516940:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938022144 00000100:00100000:2.0:1715330286.516973:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23327 00000100:00100000:2.0:1715330286.516979:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+16:16905:x1798653938022144:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:2.0:1715330286.516995:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330286.517011:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d8106 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb551 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.517059:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db646c0/0xd895711d66d810d lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.517068:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db646c0/0xd895711d66d810d lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.517077:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db646c0/0xd895711d66d810d lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.517088:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d8114 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x814526f8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.517095:0:7135:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d80e3 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d80dc expref: 10 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.517101:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d8114 lrc: 4/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x814526f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.517130:0:7135:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d80e3 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd895711d66d80dc expref: 10 pid: 9408 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330286.517143:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d61aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7135:1798653942445760:0@lo:104: 00000100:00100000:2.0:1715330286.517684:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330286.517706:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffaf00 going to sleep for 11 seconds 00000100:00100000:0.0:1715330286.517749:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942445760 00000100:00100000:0.0:1715330286.517755:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942445760 00000100:00100000:0.0:1715330286.517780:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1142 00000100:00100000:0.0:1715330286.517785:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d61bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:7135:x1798653942445760:12345-0@lo:104: 00010000:00010000:0.0:1715330286.517793:0:7118:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457cd80/0xd895711d66d80dc lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d80e3 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.517836:0:7118:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1715330286.517840:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d61bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:7135:x1798653942445760:12345-0@lo:104: Request processed in 56us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330286.517902:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d61aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7135:1798653942445760:0@lo:104: 00010000:00010000:2.0:1715330286.517914:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d8114 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x814526f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000100:00100000:1.0:1715330286.517951:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942445824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330286.517975:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330286.518021:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1142 00010000:00010000:0.0:1715330286.520343:0:7116:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67840/0xd895711d66d8073 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526f7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d807a expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330286.520353:0:7116:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67840/0xd895711d66d8073 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x814526f7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d807a expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.520373:0:7116:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67840/0xd895711d66d8073 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x814526f7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d807a expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.520378:0:7116:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330286.520400:0:7116:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67840/0xd895711d66d8073 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x814526f7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d807a expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1715330286.520417:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983420 is committed 00000001:00080000:0.0:1715330286.520439:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983419 is committed 00000020:00080000:0.0:1715330286.520446:0:7116:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 368 batchid updated 00010000:00010000:2.0:1715330286.520449:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d8003 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1514:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00000020:00080000:0.0:1715330286.520454:0:7116:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88009396cb40 refcount 2 committed 0 result 0 batchid 369 00000020:00080000:0.0:1715330286.520457:0:7116:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008d5eef00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88009396c000 00010000:00010000:2.0:1715330286.520458:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d8003 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1514:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00000020:00080000:0.0:1715330286.520460:0:7116:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].353 00000020:00080000:0.0:1715330286.520462:0:7116:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008d5eee00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88008d40b800 00010000:00010000:2.0:1715330286.520463:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d8003 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1514:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00000020:00080000:0.0:1715330286.520464:0:7116:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].354 00010000:00010000:2.0:1715330286.520468:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfc480 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330286.520471:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d8003 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1514:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00000020:00080000:1.0:1715330286.520484:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 369 committed batchid 368 00000004:00080000:1.0:1715330286.520565:0:7163:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88009396c0c0 with version 676 00000020:00080000:1.0:1715330286.520581:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 368 cancel update log [0x240000401:0x3:0x0].352: rc = 0 00000020:00080000:1.0:1715330286.520610:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 368 cancel update log [0x200000400:0x3:0x0].353: rc = 0 00000020:00080000:1.0:1715330286.520615:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 368 00000004:00080000:0.0:1715330286.520633:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 676 rpc_version 676 00000100:00100000:1.0:1715330286.520634:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942445824:0@lo:103:ldlm_bl.0 00000020:00100000:0.0:1715330286.520649:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1715330286.520655:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008d4e9500 x1798653942446016/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715330286.520667:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e9500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942446016:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1715330286.520671:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d8003 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1514:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330286.520679:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1514:0x0].0x0 (ffff88008d5ee800) 00010000:00010000:2.0:1715330286.520681:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330286.520684:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d8003 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1514:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330286.520689:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d8003 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1514:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00000100:00100000:0.0:1715330286.520692:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330286.520703:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffc300 going to sleep for 11 seconds 00010000:00010000:2.0:1715330286.520704:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d800a lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330286.520709:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d800a lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330286.520714:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d800a lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330286.520718:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfd440 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330286.520720:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d800a lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330286.520725:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d800a lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330286.520745:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xc8:0x0].0x0 (ffff88008d5ee700) 00010000:00010000:2.0:1715330286.520747:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330286.520749:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d800a lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330286.520754:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d800a lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00000100:00100000:1.0:1715330286.520810:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942446016 00000100:00100000:1.0:1715330286.520813:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942446016 00000100:00100000:1.0:1715330286.520830:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2592 00000100:00100000:1.0:1715330286.520834:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:8587:x1798653942446016:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330286.520849:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942446080 00000100:00100000:0.0:1715330286.520852:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942446080 00000100:00100000:0.0:1715330286.520871:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2593 00000100:00100000:0.0:1715330286.520875:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7135:x1798653942446080:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330286.520915:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:8587:x1798653942446016:12345-0@lo:1000:osp_up1-0.0 Request processed in 80us (222us total) trans 4294968367 rc 0/0 00000100:00100000:1.0:1715330286.520922:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2592 00000100:00100000:0.0:1715330286.520922:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:7135:x1798653942446080:12345-0@lo:1000:mdt00_002.0 Request processed in 45us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.520927:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2593 00000100:00100000:0.0:1715330286.520951:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e9500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942446016:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330286.525649:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330286.528847:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330286.530712:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330286.530798:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938022336 00000100:00100000:2.0:1715330286.530803:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938022336 00000100:00100000:2.0:1715330286.530821:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23330 00000100:00100000:2.0:1715330286.530826:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f4b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+14:16905:x1798653938022336:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:2.0:1715330286.530835:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330286.530845:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d813e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb566 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.530870:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d8145 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00000100:00100000:1.0:1715330286.530909:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3691:1798653942446144:0@lo:400:kworker.0 00000100:00100000:1.0:1715330286.530941:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.530959:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942446400:0@lo:400:kworker.0 00000100:00100000:0.0:1715330286.530960:0:7130:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942446144 00000100:00100000:0.0:1715330286.530964:0:7130:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942446144 00000100:00100000:1.0:1715330286.530977:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.530987:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942446656:0@lo:400:kworker.0 00000100:00100000:0.0:1715330286.530990:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1715330286.530995:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3691:x1798653942446144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330286.531002:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.531031:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942446912:0@lo:400:kworker.0 00000100:00100000:0.0:1715330286.531032:0:7130:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3691:x1798653942446144:12345-0@lo:400:kworker.0 Request processed in 37us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.531037:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00080000:0.0:1715330286.531058:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330256 00000100:00100000:0.0:1715330286.531067:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942446400 00000100:00100000:0.0:1715330286.531070:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942446400 00000100:00100000:0.0:1715330286.531086:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2594 00000100:00100000:0.0:1715330286.531089:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013027b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:3691:x1798653942446400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330286.531113:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013027b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:3691:x1798653942446400:12345-0@lo:400:kworker.0 Request processed in 24us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.531118:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2594 00000100:00100000:0.0:1715330286.531134:0:9399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1715330286.531138:0:9399:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942446592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330286.531158:0:9399:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942446592:12345-0@lo:400:kworker.0 Request processed in 20us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.531162:0:9399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:0.0:1715330286.531173:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330256 00000100:00100000:0.0:1715330286.531193:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942446592:0@lo:400:kworker.0 00000100:00100000:0.0:1715330286.531201:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942446848:0@lo:400:kworker.0 00000100:00100000:1.0:1715330286.531202:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330286.531216:0:9399:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942446912 00000100:00100000:1.0:1715330286.531217:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3691:1798653942446144:0@lo:400:kworker.0 00000100:00100000:0.0:1715330286.531218:0:9399:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942446912 00000100:00100000:1.0:1715330286.531230:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942446400:0@lo:400:kworker.0 00000100:00100000:0.0:1715330286.531233:0:9399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1715330286.531237:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942446656:0@lo:400:kworker.0 00000100:00100000:0.0:1715330286.531237:0:9399:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013027a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942446912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330286.531258:0:9399:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013027a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942446912:12345-0@lo:400:kworker.0 Request processed in 21us (57us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.531263:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942446912:0@lo:400:kworker.0 00000100:00100000:0.0:1715330286.531263:0:9399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:0.0:1715330286.531274:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330256 00000100:00100000:1.0:1715330286.531278:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134567480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942446272:0@lo:400:kworker.0 00000100:00100000:1.0:1715330286.531294:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.531302:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3689:1798653942446528:0@lo:400:kworker.0 00000100:00100000:0.0:1715330286.531307:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942446272 00000100:00100000:0.0:1715330286.531310:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942446272 00000100:00100000:1.0:1715330286.531312:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.531320:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3689:1798653942446784:0@lo:400:kworker.0 00000100:00100000:0.0:1715330286.531322:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2595 00000100:00100000:0.0:1715330286.531326:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013027b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3689:x1798653942446272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330286.531337:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330286.531350:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013027b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3689:x1798653942446272:12345-0@lo:400:kworker.0 Request processed in 23us (55us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.531351:0:3689:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983420 gen 2 00000100:00100000:0.0:1715330286.531354:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2595 00000004:00080000:1.0:1715330286.531355:0:3689:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983415 committed transno 4294983420 00000020:00080000:1.0:1715330286.531359:0:3689:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff880134435f00 refcount 2 committed 0 result 0 batchid 376 00000020:00080000:1.0:1715330286.531362:0:3689:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880093b42f00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880134435600 00000020:00080000:1.0:1715330286.531366:0:3689:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].379 00000020:00080000:1.0:1715330286.531368:0:3689:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880093b42b00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88011dad1800 00000020:00080000:1.0:1715330286.531371:0:3689:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].377 00000004:00080000:1.0:1715330286.531385:0:3689:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983417 committed transno 4294983420 00000004:00080000:1.0:1715330286.531394:0:3689:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983418 committed transno 4294983420 00000004:00080000:1.0:1715330286.531404:0:3689:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983420 committed transno 4294983420 00000100:00100000:1.0:1715330286.531419:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880134567480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942446272:0@lo:400:kworker.0 00000100:00100000:1.0:1715330286.531424:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1715330286.531428:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3689:1798653942446208:0@lo:400:kworker.0 00000100:00100000:1.0:1715330286.531441:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.531450:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3689:1798653942446464:0@lo:400:kworker.0 00000100:00100000:0.0:1715330286.531456:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942446336 00000100:00100000:0.0:1715330286.531459:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942446336 00000100:00100000:1.0:1715330286.531471:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1715330286.531495:0:7135:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d80ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d80f8 expref: 5 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.531503:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d8145 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.531520:0:7135:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d80ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd895711d66d80f8 expref: 5 pid: 23404 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330286.531529:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d618e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7135:1798653942446976:0@lo:104: 00000100:00100000:2.0:1715330286.531564:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330286.531575:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffaf00 going to sleep for 11 seconds 00000100:00100000:1.0:1715330286.531664:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3689:1798653942446720:0@lo:400:kworker.0 00000100:00100000:1.0:1715330286.531679:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330286.531725:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942446784 00000100:00100000:0.0:1715330286.531725:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942446528 00000100:00100000:2.0:1715330286.531728:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942446784 00000100:00100000:0.0:1715330286.531728:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942446528 00000100:00100000:2.0:1715330286.531756:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942446208 00000100:00100000:2.0:1715330286.531758:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942446208 00000100:00100000:0.0:1715330286.531759:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942446464 00000100:00100000:0.0:1715330286.531761:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942446464 00000100:00100000:2.0:1715330286.531767:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1715330286.531771:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3690:x1798653942446336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330286.531776:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1715330286.531780:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130278000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3689:x1798653942446784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330286.531796:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3690:x1798653942446336:12345-0@lo:400:kworker.0 Request processed in 24us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330286.531801:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1715330286.531807:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942446720 00000100:00100000:2.0:1715330286.531809:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942446720 00000100:00100000:0.0:1715330286.531810:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130278000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3689:x1798653942446784:12345-0@lo:400:kworker.0 Request processed in 29us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.531812:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1715330286.531816:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1715330286.531817:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1798653942446528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330286.531820:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1715330286.531823:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1798653942446208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330286.531825:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1715330286.531828:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1798653942446464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330286.531843:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1798653942446528:12345-0@lo:400:kworker.0 Request processed in 26us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330286.531844:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1798653942446208:12345-0@lo:400:kworker.0 Request processed in 20us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.531848:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1798653942446464:12345-0@lo:400:kworker.0 Request processed in 20us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.531849:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1715330286.531852:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1715330286.531855:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1715330286.531859:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1715330286.531862:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3689:x1798653942446720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330286.531870:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942446976 00000100:00100000:0.0:1715330286.531872:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942446976 00000100:00100000:2.0:1715330286.531884:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3689:x1798653942446720:12345-0@lo:400:kworker.0 Request processed in 20us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.531887:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1143 00000100:00100000:0.0:1715330286.531890:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d61b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:7135:x1798653942446976:12345-0@lo:104: 00010000:00010000:0.0:1715330286.531898:0:7118:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db67a80/0xd895711d66d80f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d80ff expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330286.532010:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000020:00080000:2.0:1715330286.532020:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 376 committed batchid 375 00000100:00100000:1.0:1715330286.532031:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3689:1798653942446208:0@lo:400:kworker.0 00000100:00100000:1.0:1715330286.532038:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3689:1798653942446464:0@lo:400:kworker.0 00000100:00100000:1.0:1715330286.532044:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3689:1798653942446720:0@lo:400:kworker.0 00000020:00080000:2.0:1715330286.532056:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 375 00000100:00100000:1.0:1715330286.532073:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3689:1798653942446528:0@lo:400:kworker.0 00000100:00100000:2.0:1715330286.532079:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d618e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7135:1798653942446976:0@lo:104: 00000100:00100000:1.0:1715330286.532084:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3689:1798653942446784:0@lo:400:kworker.0 00010000:00010000:2.0:1715330286.532088:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d8145 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.532172:0:7118:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1715330286.532178:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d61b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:7135:x1798653942446976:12345-0@lo:104: Request processed in 286us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.532186:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1143 00000100:00080000:0.0:1715330286.532198:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330256 00000100:00080000:0.0:1715330286.532200:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330256 00000100:00100000:0.0:1715330286.532214:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3690:1798653942446336:0@lo:400:kworker.0 00000100:00100000:2.0:1715330286.532262:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942447040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1715330286.532281:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330286.532299:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942447040 00000100:00100000:0.0:1715330286.532302:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942447040 00010000:00010000:0.0:1715330286.532314:0:7120:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d80ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd895711d66d80f8 expref: 6 pid: 23404 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330286.532330:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1502 00000100:00100000:0.0:1715330286.532333:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d618e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+6:3688:x1798653942447040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330286.532341:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00080000:0.0:1715330286.535870:0:7116:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 369 batchid updated 00000020:00080000:2.0:1715330286.535901:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 369 00010000:00010000:0.0:1715330286.535931:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d80ff lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd895711d66d80f8 expref: 6 pid: 23404 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715330286.535941:0:7163:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880091ffaf00 with version 677 00010000:00010000:0.0:1715330286.535944:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc6:0x0].0x0 (ffff88009d618c00) 00000020:00080000:2.0:1715330286.535947:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 369 cancel update log [0x240000401:0x3:0x0].353: rc = 0 00010000:00010000:0.0:1715330286.535948:0:7120:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d8145 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.535954:0:7120:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d8145 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.535959:0:7120:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d8145 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.535983:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00080000:2.0:1715330286.535989:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 369 cancel update log [0x200000400:0x3:0x0].354: rc = 0 00000020:00080000:2.0:1715330286.535995:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 369 00000100:00100000:0.0:1715330286.536022:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d618e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942447040:12345-0@lo:103:ldlm_bl.0 Request processed in 3688us (3740us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.536033:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1502 00000004:00080000:0.0:1715330286.536049:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 677 rpc_version 677 00000020:00100000:0.0:1715330286.536067:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1715330286.536071:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008d4eb800 x1798653942447168/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715330286.536084:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4eb800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942447168:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330286.536107:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330286.536115:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffca80 going to sleep for 11 seconds 00000100:00100000:0.0:1715330286.536127:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942447168 00000100:00100000:0.0:1715330286.536131:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942447168 00000100:00100000:0.0:1715330286.536146:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2596 00000100:00100000:0.0:1715330286.536151:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:8587:x1798653942447168:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330286.536231:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:8587:x1798653942447168:12345-0@lo:1000:osp_up1-0.0 Request processed in 80us (124us total) trans 4294968368 rc 0/0 00000100:00100000:2.0:1715330286.536237:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942447040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330286.536237:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2596 00000100:00100000:0.0:1715330286.536262:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4eb800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942447168:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1715330286.539982:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330286.540024:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330286.540087:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938022400 00000100:00100000:0.0:1715330286.540094:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938022400 00000100:00100000:0.0:1715330286.540124:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1292 00000100:00100000:0.0:1715330286.540130:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d619f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72de1896-1df4-4b3a-930a-9116d2c66168+15:2011:x1798653938022400:12345-192.168.204.49@tcp:103:rmdir.0 00010000:00010000:0.0:1715330286.540140:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330286.540157:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d811b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x186:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb551 expref: 15 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.540168:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x186:0x0].0x0 (ffff880093b42200) 00010000:00010000:0.0:1715330286.540176:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330286.540529:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d619f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72de1896-1df4-4b3a-930a-9116d2c66168+14:2011:x1798653938022400:12345-192.168.204.49@tcp:103:rmdir.0 Request processed in 80us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.540536:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1292 00000100:00100000:0.0:1715330286.540622:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942447232 00000100:00100000:0.0:1715330286.540626:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942447232 00000100:00100000:0.0:1715330286.540902:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2597 00000100:00100000:0.0:1715330286.540907:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:7135:x1798653942447232:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330286.540916:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330286.540927:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d8153 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d814c expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.540943:0:23404:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d8153 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d814c expref: 6 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.540952:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d8153 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d814c expref: 6 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.540958:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88008d4e1300) 00010000:00010000:0.0:1715330286.540960:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330286.540962:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f2400, rc 0) 00000100:00100000:0.0:1715330286.540984:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:7135:x1798653942447232:12345-0@lo:101:mdt00_002.0 Request processed in 76us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.540989:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2597 00000100:00100000:0.0:1715330286.541207:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942447296 00000100:00100000:0.0:1715330286.541210:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942447296 00000100:00100000:0.0:1715330286.541224:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2598 00000100:00100000:0.0:1715330286.541232:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:7135:x1798653942447296:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330286.541240:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330286.541248:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0480/0xd895711d66d8161 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x814526f8 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d815a expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.541259:0:23404:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0480/0xd895711d66d8161 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d815a expref: 7 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.541266:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0480/0xd895711d66d8161 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d815a expref: 7 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.541271:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x814526f8 (ffff88008d4e1400) 00010000:00010000:0.0:1715330286.541273:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330286.541274:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f0480, rc 0) 00000100:00100000:0.0:1715330286.541294:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7135:x1798653942447296:12345-0@lo:101:mdt00_002.0 Request processed in 65us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.541299:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2598 00000100:00100000:2.0:1715330286.542037:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942447424 00000100:00100000:2.0:1715330286.542040:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942447424 00000100:00100000:2.0:1715330286.542062:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2600 00000100:00100000:2.0:1715330286.542066:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7135:x1798653942447424:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1715330286.542123:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7135:x1798653942447424:12345-0@lo:1000:mdt00_002.0 Request processed in 56us (129us total) trans 0 rc 1/1 00000100:00100000:2.0:1715330286.542128:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2600 00000100:00100000:0.0:1715330286.542305:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942447488 00000100:00100000:0.0:1715330286.542308:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942447488 00000100:00100000:0.0:1715330286.542321:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2601 00000100:00100000:0.0:1715330286.542324:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:7135:x1798653942447488:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330286.542330:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330286.542339:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d816f lrc: 2/0,0 mode: --/EX res: [0x240000402:0x186:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d8168 expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.542351:0:23404:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d816f lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x186:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d8168 expref: 8 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.542358:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d816f lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x186:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8168 expref: 8 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.542367:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x186:0x0].0x0 (ffff88008d4e1900) 00010000:00010000:0.0:1715330286.542369:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1715330286.542371:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f3840, rc 0) 00000100:00100000:0.0:1715330286.542390:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:7135:x1798653942447488:12345-0@lo:101:mdt00_002.0 Request processed in 64us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.542395:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2601 00000100:00100000:2.0:1715330286.545249:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc79880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7135:1798653942447552:192.168.204.49@tcp:104: 00010000:00010000:2.0:1715330286.545263:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88013457dd40/0xd895711d66d817d lrc: 3/0,1 mode: --/EX res: [0x240000400:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000100:00100000:0.0:1715330286.545410:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330286.545446:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938022592 00000100:00100000:2.0:1715330286.545450:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938022592 00010000:00010000:2.0:1715330286.545468:0:7122:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e400/0xd895711d66d8137 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb55f expref: 11 pid: 7135 timeout: 361 lvb_type: 0 00000100:00100000:2.0:1715330286.545490:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1503 00000100:00100000:2.0:1715330286.545495:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72de1896-1df4-4b3a-930a-9116d2c66168+11:2011:x1798653938022592:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1715330286.545503:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330286.545507:0:7122:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e400/0xd895711d66d8137 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb55f expref: 11 pid: 7135 timeout: 361 lvb_type: 0 00010000:00010000:2.0:1715330286.545515:0:7122:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e400/0xd895711d66d8137 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb55f expref: 11 pid: 7135 timeout: 361 lvb_type: 0 00010000:00010000:2.0:1715330286.545529:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e400/0xd895711d66d8137 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb55f expref: 11 pid: 7135 timeout: 361 lvb_type: 0 00010000:00010000:2.0:1715330286.545537:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc6:0x0].0x0 (ffff8800b1fd9e00) 00010000:00010000:2.0:1715330286.545555:0:7122:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88013457dd40/0xd895711d66d817d lrc: 3/0,1 mode: --/EX res: [0x240000400:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.545562:0:7122:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457dd40/0xd895711d66d817d lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.545566:0:7122:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457dd40/0xd895711d66d817d lrc: 4/0,1 mode: EX/EX res: [0x240000400:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.545583:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715330286.545602:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88013457dd40/0xd895711d66d817d lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.545609:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013457dd40/0xd895711d66d817d lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000100:00100000:2.0:1715330286.545613:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72de1896-1df4-4b3a-930a-9116d2c66168+10:2011:x1798653938022592:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 117us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330286.545619:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1503 00010000:00010000:0.0:1715330286.545630:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f3a80/0xd895711d66d8184 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.545635:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f3a80/0xd895711d66d8184 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.545642:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f3a80/0xd895711d66d8184 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT1 00000100:00100000:0.0:1715330286.545657:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942447616:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1715330286.545679:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330286.545688:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffca80 going to sleep for 11 seconds 00000100:00100000:2.0:1715330286.545746:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942447616 00000100:00100000:2.0:1715330286.545749:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942447616 00000100:00100000:2.0:1715330286.545763:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2602 00000100:00100000:2.0:1715330286.545766:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:7135:x1798653942447616:12345-0@lo:101:mdt00_002.0 00010000:00010000:2.0:1715330286.545775:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330286.545783:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d818b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d8184 expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.545795:0:9407:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d8145 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb566 expref: 13 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.545802:0:9407:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d818b lrc: 4/0,0 mode: --/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d8184 expref: 9 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.545816:0:9407:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d8145 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb566 expref: 13 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.545824:0:9407:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d8145 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb566 expref: 13 pid: 7135 timeout: 361 lvb_type: 0 00000100:00100000:2.0:1715330286.545831:0:9407:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba66d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:9407:1798653942447680:192.168.204.49@tcp:104: 00000100:00100000:2.0:1715330286.545852:0:9407:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa480 going to sleep for 11 seconds 00000100:00100000:2.0:1715330286.547328:0:9407:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba66d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:9407:1798653942447680:192.168.204.49@tcp:104: 00010000:00010000:2.0:1715330286.547340:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d818b lrc: 3/0,0 mode: --/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8184 expref: 9 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.547348:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc6:0x0].0x0 (ffff88009d618c00) 00010000:00010000:2.0:1715330286.547350:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330286.547353:0:9407:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d818b lrc: 3/0,0 mode: --/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8184 expref: 9 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.547360:0:9407:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d818b lrc: 3/0,0 mode: --/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8184 expref: 9 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.547365:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db64fc0, rc 0) 00000100:00100000:2.0:1715330286.547383:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7135:x1798653942447616:12345-0@lo:101:mdt00_002.0 Request processed in 1616us (1703us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330286.547389:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2602 00000100:00100000:0.0:1715330286.547445:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942447616:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330286.547454:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f3a80/0xd895711d66d8184 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d818b expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.547461:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f3a80/0xd895711d66d8184 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d818b expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330286.548477:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330286.548519:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938022656 00000100:00100000:2.0:1715330286.548524:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938022656 00010000:00010000:2.0:1715330286.548536:0:7122:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d8145 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb566 expref: 14 pid: 7135 timeout: 361 lvb_type: 0 00000100:00100000:2.0:1715330286.548580:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1504 00000100:00100000:2.0:1715330286.548585:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72de1896-1df4-4b3a-930a-9116d2c66168+14:2012:x1798653938022656:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1715330286.548593:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330286.548598:0:7122:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d8145 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb566 expref: 14 pid: 7135 timeout: 361 lvb_type: 0 00010000:00010000:2.0:1715330286.548606:0:7122:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d8145 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb566 expref: 14 pid: 7135 timeout: 361 lvb_type: 0 00010000:00010000:2.0:1715330286.548619:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d8145 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb566 expref: 14 pid: 7135 timeout: 361 lvb_type: 0 00010000:00010000:2.0:1715330286.548627:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc6:0x0].0x0 (ffff88009d618c00) 00010000:00010000:2.0:1715330286.548632:0:7122:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d818b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8184 expref: 8 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.548638:0:7122:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d818b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d8184 expref: 8 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.548644:0:7122:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d818b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d8184 expref: 8 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.548659:0:7122:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d818b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8184 expref: 8 pid: 9407 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330286.548670:0:7122:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba66d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:7122:1798653942447744:0@lo:105: 00000100:00100000:2.0:1715330286.548688:0:7122:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330286.548710:0:7122:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa480 going to sleep for 11 seconds 00000100:00100000:1.0:1715330286.548789:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942447744 00000100:00100000:1.0:1715330286.548792:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942447744 00000100:00100000:1.0:1715330286.548811:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1144 00000100:00100000:1.0:1715330286.548816:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:7122:x1798653942447744:12345-0@lo:105: 00010000:00010000:1.0:1715330286.548823:0:7118:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f3a80/0xd895711d66d8184 lrc: 5/0,1 mode: --/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d818b expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.548830:0:7118:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f3a80/0xd895711d66d8184 lrc: 5/0,1 mode: --/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d818b expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.548837:0:7118:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f3a80/0xd895711d66d8184 lrc: 5/0,1 mode: --/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d818b expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.548842:0:7118:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f3a80/0xd895711d66d8184 lrc: 5/0,1 mode: EX/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d818b expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.548848:0:7118:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f3a80/0xd895711d66d8184 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d818b expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.548854:0:7118:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f3a80/0xd895711d66d8184 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d818b expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.548867:0:7118:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8800ad9f3a80) 00000100:00100000:1.0:1715330286.548889:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:7122:x1798653942447744:12345-0@lo:105: Request processed in 72us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.548894:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1144 00010000:00010000:0.0:1715330286.548949:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f3a80/0xd895711d66d8184 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d818b expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.548956:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f3a80/0xd895711d66d8184 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d818b expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330286.549400:0:7122:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba66d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:7122:1798653942447744:0@lo:105: 00010000:00010000:2.0:1715330286.549409:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330286.549427:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72de1896-1df4-4b3a-930a-9116d2c66168+13:2012:x1798653938022656:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 841us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330286.549433:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1504 00000100:00100000:0.0:1715330286.549446:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942447808:0@lo:403:mdt00_002.0 00000100:00100000:0.0:1715330286.549474:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330286.549483:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffca80 going to sleep for 11 seconds 00000100:00100000:2.0:1715330286.549571:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942447808 00000100:00100000:2.0:1715330286.549575:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942447808 00000100:00100000:2.0:1715330286.549589:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2603 00000100:00100000:2.0:1715330286.549593:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7135:x1798653942447808:12345-0@lo:403:mdt00_002.0 00000100:00100000:2.0:1715330286.550845:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7135:x1798653942447808:12345-0@lo:403:mdt00_002.0 Request processed in 1249us (1368us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330286.550851:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2603 00000100:00100000:0.0:1715330286.550870:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942447808:0@lo:403:mdt00_002.0 00000040:00080000:0.0:1715330286.551563:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].379, 664 off574336 00000040:00080000:0.0:1715330286.551753:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].381, 744 off628816 00000004:00080000:0.0:1715330286.551758:0:7135:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff880091ffca80 with version 726 00000004:00080000:1.0:1715330286.551790:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 726 rpc_version 726 00000020:00100000:1.0:1715330286.551807:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1715330286.551811:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88013027bb80 x1798653942447936/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1808/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1715330286.551822:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013027bb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942447936:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1715330286.551846:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.551864:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009396c840 going to sleep for 11 seconds 00000100:00100000:2.0:1715330286.551887:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942447936 00000100:00100000:2.0:1715330286.551891:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942447936 00000100:00100000:2.0:1715330286.551916:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2604 00000100:00100000:2.0:1715330286.551921:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130279500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:8278:x1798653942447936:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1715330286.552151:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130279500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:8278:x1798653942447936:12345-0@lo:1000:osp_up0-1.0 Request processed in 229us (304us total) trans 4294983421 rc 0/0 00000100:00100000:2.0:1715330286.552157:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2604 00000100:00100000:1.0:1715330286.552191:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88013027bb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942447936:0@lo:1000:osp_up0-1.0 00000004:00200000:0.0:1715330286.552229:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x186:0x0]: returning size 4096 00010000:00010000:0.0:1715330286.552244:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457dd40/0xd895711d66d817d lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.552250:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013457dd40/0xd895711d66d817d lrc: 2/0,0 mode: EX/EX res: [0x240000400:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.552256:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013457dd40/0xd895711d66d817d lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.552260:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457dd40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330286.552264:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457dd40/0xd895711d66d817d lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.552269:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457dd40/0xd895711d66d817d lrc: 4/0,0 mode: EX/EX res: [0x240000400:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.552278:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc6:0x0].0x0 (ffff8800b1fd9e00) 00010000:00010000:0.0:1715330286.552281:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715330286.552284:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013457dd40/0xd895711d66d817d lrc: 2/0,0 mode: --/EX res: [0x240000400:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.552288:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457dd40/0xd895711d66d817d lrc: 0/0,0 mode: --/EX res: [0x240000400:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.552297:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f3a80/0xd895711d66d8184 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d818b expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.552303:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f3a80/0xd895711d66d8184 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d818b expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.552307:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f3a80/0xd895711d66d8184 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d818b expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.552329:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1715330286.552334:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000401:0xc6:0x0] 00010000:00010000:0.0:1715330286.552338:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c480/0xd895711d66d8176 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x186:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.552343:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c480/0xd895711d66d8176 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x186:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.552347:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c480/0xd895711d66d8176 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x186:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.552348:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715330286.552351:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457c480 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330286.552354:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f3a80/0xd895711d66d8184 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d818b expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.552354:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c480/0xd895711d66d8176 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x186:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.552361:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c480/0xd895711d66d8176 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x186:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.552365:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f3a80 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330286.552367:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x186:0x0].0x0 (ffff8800b1fd9d00) 00010000:00010000:2.0:1715330286.552369:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f3a80/0xd895711d66d8184 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d818b expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.552369:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330286.552371:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c480/0xd895711d66d8176 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x186:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00000004:00010000:2.0:1715330286.552375:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f3a80/0xd895711d66d8184 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d818b expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.552375:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c480/0xd895711d66d8176 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x186:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.552381:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f3c0/0xd895711d66d8168 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x186:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d816f expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.552386:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f3c0/0xd895711d66d8168 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x186:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d816f expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.552390:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f3c0/0xd895711d66d8168 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x186:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d816f expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.552391:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f3a80/0xd895711d66d8184 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d818b expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.552395:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330286.552405:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1715330286.552407:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f3a80/0xd895711d66d8184 lrc: 1/0,0 mode: --/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d818b expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.552413:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f3a80/0xd895711d66d8184 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d818b expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.552424:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330286.552425:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330286.552427:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330286.552432:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1715330286.552439:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942448000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1715330286.552457:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330286.552471:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942448000 00000100:00100000:2.0:1715330286.552474:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942448000 00000100:00100000:2.0:1715330286.552488:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1293 00000100:00100000:2.0:1715330286.552491:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+10:3688:x1798653942448000:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330286.552491:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1715330286.552497:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1715330286.552499:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942448064:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715330286.552507:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d818b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d8184 expref: 10 pid: 9407 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330286.552518:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.552533:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942448064 00000100:00100000:1.0:1715330286.552536:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942448064 00000100:00100000:1.0:1715330286.552573:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1294 00000100:00100000:1.0:1715330286.552577:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+11:3691:x1798653942448064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330286.552582:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330286.552590:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d816f lrc: 0/0,0 mode: --/EX res: [0x240000402:0x186:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d8168 expref: 11 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.552598:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x186:0x0].0x0 (ffff88008d4e1900) 00010000:00010000:1.0:1715330286.552602:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330286.552619:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+10:3691:x1798653942448064:12345-0@lo:103:ldlm_bl.0 Request processed in 41us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.552623:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1294 00000100:00100000:1.0:1715330286.552640:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942448064:0@lo:103:ldlm_bl.0 00000004:00080000:0.0:1715330286.552726:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:0.0:1715330286.552794:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f600/0xd895711d66d814c lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8153 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.552801:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f600/0xd895711d66d814c lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8153 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.552806:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f600/0xd895711d66d814c lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8153 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.552829:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1715330286.552833:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:0.0:1715330286.552836:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457d8c0/0xd895711d66d815a lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8161 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.552842:0:7135:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457d8c0/0xd895711d66d815a lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8161 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.552843:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc6:0x0].0x0 (ffff88009d618c00) 00010000:00010000:2.0:1715330286.552849:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330286.552905:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942448128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330286.553023:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+10:16905:x1798653938022528:12345-192.168.204.49@tcp:36:rmdir.0 Request processed in 12682us (12997us total) trans 4294968369 rc 0/0 00000100:00100000:0.0:1715330286.553029:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23331 00000100:00100000:2.0:1715330286.553091:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+8:3688:x1798653942448000:12345-0@lo:103:ldlm_bl.0 Request processed in 598us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.553096:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330286.553097:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1293 00000100:00100000:2.0:1715330286.553105:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942448128 00000100:00100000:2.0:1715330286.553108:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942448128 00000100:00100000:2.0:1715330286.553120:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1295 00000100:00100000:2.0:1715330286.553123:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+8:3691:x1798653942448128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715330286.553128:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330286.553136:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d8153 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d814c expref: 8 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.553144:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88008d4e1300) 00010000:00010000:2.0:1715330286.553148:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330286.553164:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+7:3691:x1798653942448128:12345-0@lo:103:ldlm_bl.0 Request processed in 40us (68us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330286.553168:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1295 00000100:00100000:0.0:1715330286.553177:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942448128:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1715330286.553199:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942448000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330286.562816:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1715330286.562832:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942448192:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1715330286.562883:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.563756:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942448192:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1715330286.563837:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330286.563885:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938022720 00000100:00100000:1.0:1715330286.563889:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938022720 00000100:00100000:1.0:1715330286.563911:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23332 00000100:00100000:1.0:1715330286.563915:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+13:16906:x1798653938022720:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:1.0:1715330286.563925:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330286.563941:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d8192 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb56d expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.563983:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff840/0xd895711d66d8199 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.563992:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff840/0xd895711d66d8199 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.564000:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff840/0xd895711d66d8199 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.564008:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d81a0 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.564013:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d81a0 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.564017:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d81a0 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.564046:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff840/0xd895711d66d8199 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.564053:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff840/0xd895711d66d8199 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.564057:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff840/0xd895711d66d8199 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.564062:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff840/0xd895711d66d8199 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.564067:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bff840 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330286.564070:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff840/0xd895711d66d8199 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.564075:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff840/0xd895711d66d8199 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.564083:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88008d5ee400) 00010000:00010000:1.0:1715330286.564086:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330286.564089:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff840/0xd895711d66d8199 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.564093:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff840/0xd895711d66d8199 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.564101:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d81a0 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.564105:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d81a0 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.564108:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d81a0 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.564112:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfc900 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330286.564114:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d81a0 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.564118:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d81a0 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.564123:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x8a4526ef (ffff88008d5ee100) 00010000:00010000:1.0:1715330286.564125:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330286.564127:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d81a0 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.564130:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d81a0 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.564152:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d8192 lrc: 1/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb56d expref: 14 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.564158:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d8192 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb56d expref: 14 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.564166:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfc480, rc 0) 00000100:00100000:1.0:1715330286.564201:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+13:16906:x1798653938022720:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 285us (365us total) trans 0 rc 301/301 00000100:00100000:1.0:1715330286.564207:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23332 00000100:00100000:1.0:1715330286.566309:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330286.566402:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938022784 00000100:00100000:2.0:1715330286.566407:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938022784 00000100:00100000:2.0:1715330286.566436:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23333 00000100:00100000:2.0:1715330286.566441:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+13:16906:x1798653938022784:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:2.0:1715330286.566451:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330286.566460:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d81a7 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb574 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.566489:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d81ae lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330286.566497:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d81ae lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330286.566503:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d81ae lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330286.566510:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d81b5 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330286.566515:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d81b5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330286.566519:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d81b5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330286.566551:0:9622:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d81ae lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330286.566595:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d81ae lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330286.566600:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d81ae lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330286.566604:0:9622:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d81ae lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330286.566609:0:9622:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db67600 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330286.566611:0:9622:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d81ae lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330286.566616:0:9622:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d81ae lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330286.566623:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88009d678900) 00010000:00010000:2.0:1715330286.566625:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330286.566628:0:9622:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d81ae lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330286.566632:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d81ae lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330286.566640:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d81b5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330286.566644:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d81b5 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330286.566648:0:9622:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d81b5 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330286.566652:0:9622:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64240 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330286.566654:0:9622:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d81b5 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330286.566658:0:9622:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d81b5 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330286.566662:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x8a4526ef (ffff88009d678600) 00010000:00010000:2.0:1715330286.566664:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330286.566666:0:9622:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d81b5 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330286.566669:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d81b5 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330286.566689:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d81a7 lrc: 1/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb574 expref: 14 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.566694:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d81a7 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb574 expref: 14 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.566701:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db64000, rc 0) 00000100:00100000:2.0:1715330286.566723:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+13:16906:x1798653938022784:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 281us (416us total) trans 0 rc 301/301 00000100:00100000:2.0:1715330286.566728:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23333 00000100:00100000:2.0:1715330286.568425:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330286.568494:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938022848 00000100:00100000:0.0:1715330286.568498:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938022848 00000100:00100000:0.0:1715330286.568593:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23334 00000100:00100000:0.0:1715330286.568598:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+13:16906:x1798653938022848:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:0.0:1715330286.568606:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330286.568615:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d81bc lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb57b expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.568639:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d81c3 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330286.568645:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d81c3 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330286.568651:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d81c3 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00000004:00200000:0.0:1715330286.568684:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1715330286.568688:0:9622:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1715330286.568708:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66d81bc lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb57b expref: 15 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.568719:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d81c3 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb57b expref: 14 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.568724:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88008d4e1a00) 00010000:00010000:0.0:1715330286.568726:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1715330286.568728:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f3cc0, rc 0) 00000100:00100000:0.0:1715330286.569156:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+14:16906:x1798653938022848:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 556us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.569162:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23334 00000100:00100000:2.0:1715330286.577481:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330286.577561:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938022976 00000100:00100000:0.0:1715330286.577570:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938022976 00000100:00100000:0.0:1715330286.577616:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23335 00000100:00100000:0.0:1715330286.577623:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d618e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+14:16906:x1798653938022976:12345-192.168.204.49@tcp:36:lfs.0 00010000:00010000:0.0:1715330286.577663:0:9622:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330286.577683:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d81c3 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb57b expref: 14 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.577696:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88008d4e1a00) 00010000:00010000:0.0:1715330286.577703:0:9622:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715330286.577780:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d81ca lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330286.577789:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d81ca lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330286.577797:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d81ca lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330286.577806:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d81d1 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330286.577811:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d81d1 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330286.577815:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d81d1 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00080000:02000000:0.0:1715330286.577969:0:9622:0:(osd_handler.c:2105:osd_trans_start()) *** cfs_fail_loc=19a, val=0*** 00000004:00080000:0.0:1715330286.577981:0:9622:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880091ffc000 with version 0 00000020:00080000:0.0:1715330286.577985:0:9622:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff880091ffc0c0 refcount 3 committed 0 result -5 batchid 371 00000020:00080000:0.0:1715330286.577988:0:9622:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008d4e1300 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result -5 sub_th ffff880091ffc000 00000020:00080000:0.0:1715330286.577991:0:9622:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008d4e1900 obd lustre-MDT0000-osd committed 1 started 0 stopped 1 result 0 sub_th ffff88012f5cb200 00010000:00010000:0.0:1715330286.578027:0:9622:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d81ca lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330286.578032:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d81ca lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330286.578038:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d81ca lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330286.578042:0:9622:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d81ca lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330286.578047:0:9622:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f21c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330286.578050:0:9622:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d81ca lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330286.578056:0:9622:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d81ca lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330286.578063:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88008d4e1d00) 00010000:00010000:0.0:1715330286.578065:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330286.578084:0:9622:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d81ca lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330286.578088:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d81ca lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330286.578097:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d81d1 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330286.578102:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d81d1 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330286.578106:0:9622:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d81d1 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330286.578109:0:9622:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f1f80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330286.578111:0:9622:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d81d1 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330286.578115:0:9622:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d81d1 lrc: 4/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330286.578120:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x8a4526ef (ffff88008d4e1200) 00010000:00010000:0.0:1715330286.578122:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330286.578124:0:9622:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d81d1 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330286.578127:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d81d1 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00000100:00100000:0.0:1715330286.578176:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d618e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+13:16906:x1798653938022976:12345-192.168.204.49@tcp:36:lfs.0 Request processed in 553us (701us total) trans 0 rc -5/-5 00000100:00100000:0.0:1715330286.578181:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23335 00000020:00080000:2.0:1715330286.578270:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 369 00000100:00100000:1.0:1715330286.579797:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942448256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1715330286.579827:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.580791:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942448256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1715330286.590004:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330286.590029:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938023104 00000100:00100000:1.0:1715330286.590036:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938023104 00000100:00100000:1.0:1715330286.590067:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23336 00000100:00100000:1.0:1715330286.590073:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+13:16908:x1798653938023104:12345-192.168.204.49@tcp:36:mkdir.0 00010000:00010000:1.0:1715330286.590159:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d81d8 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.590172:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d81d8 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.590181:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d81d8 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.590190:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d81df lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.590195:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d81df lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.590200:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d81df lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.590489:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff840/0xd895711d66d81e6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1517:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.590496:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff840/0xd895711d66d81e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1517:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.590501:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff840/0xd895711d66d81e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1517:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00010000:1.0:1715330286.590510:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012fa85f80 reply state ffff88008d563000 transno 4294983422 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff840/0xd895711d66d81e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1517:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.590517:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff840/0xd895711d66d81e6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1517:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.590522:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1517:0x0].0x0 (ffff88008d5ee600) 00010000:00010000:1.0:1715330286.590524:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330286.590527:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1715330286.590530:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1517:0x0]: returning size 4096 00010000:00010000:1.0:1715330286.590535:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d81d8 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.590554:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d81d8 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.590560:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d81d8 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.590565:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d81d8 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.590570:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfc480 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330286.590573:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d81d8 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.590579:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d81d8 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.590587:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88008d5eed00) 00010000:00010000:1.0:1715330286.590588:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330286.590591:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d81d8 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.590595:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d81d8 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00000004:00010000:1.0:1715330286.590606:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012fa85f80 reply state ffff88008d563000 transno 4294983422 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d81df lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.590616:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d81df lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.590620:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x8a4526ef (ffff88008d5ee000) 00010000:00010000:1.0:1715330286.590622:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330286.590623:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1715330286.590671:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+15:16908:x1798653938023104:12345-192.168.204.49@tcp:36:mkdir.0 Request processed in 597us (672us total) trans 4294983422 rc 0/0 00000100:00100000:1.0:1715330286.590678:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23336 00000100:00100000:1.0:1715330286.618024:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938023168 00000100:00100000:1.0:1715330286.618033:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938023168 00000100:00100000:1.0:1715330286.618078:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23337 00000100:00100000:1.0:1715330286.618085:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+15:16911:x1798653938023168:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:1.0:1715330286.618105:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330286.618123:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d81ed lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb582 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.618171:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfed00/0xd895711d66d81f4 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.618182:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfed00/0xd895711d66d81f4 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.618191:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfed00/0xd895711d66d81f4 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.618198:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc000/0xd895711d66d81fb lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.618203:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc000/0xd895711d66d81fb lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.618208:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc000/0xd895711d66d81fb lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.618263:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66d8202 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1517:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.618269:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66d8202 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1517:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.618274:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66d8202 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1517:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00200000:1.0:1715330286.618302:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1517:0x0]: returning size 4096 00000004:00200000:1.0:1715330286.618305:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1715330286.618320:0:7135:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66d8202 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1517:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.618328:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfed00/0xd895711d66d81f4 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.618332:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfed00/0xd895711d66d81f4 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.618337:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfed00/0xd895711d66d81f4 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.618342:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfed00/0xd895711d66d81f4 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.618347:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfed00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330286.618351:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfed00/0xd895711d66d81f4 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.618356:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfed00/0xd895711d66d81f4 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.618365:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88008d5ee900) 00010000:00010000:1.0:1715330286.618367:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330286.618370:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfed00/0xd895711d66d81f4 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.618375:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfed00/0xd895711d66d81f4 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.618383:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc000/0xd895711d66d81fb lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.618387:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc000/0xd895711d66d81fb lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.618391:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc000/0xd895711d66d81fb lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.618395:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfc000 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330286.618397:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc000/0xd895711d66d81fb lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.618401:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc000/0xd895711d66d81fb lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.618406:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x8a4526ef (ffff88008d5ee000) 00010000:00010000:1.0:1715330286.618408:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330286.618410:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc000/0xd895711d66d81fb lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.618413:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc000/0xd895711d66d81fb lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.618441:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d81ed lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb582 expref: 17 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.618455:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66d8202 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1517:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb582 expref: 16 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.618461:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1517:0x0].0x0 (ffff88008d5ee600) 00010000:00010000:1.0:1715330286.618463:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1715330286.618464:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bff180, rc 0) 00000100:00100000:1.0:1715330286.618513:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+16:16911:x1798653938023168:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 427us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.618519:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23337 00000100:00100000:2.0:1715330286.627863:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330286.628264:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938023296 00000100:00100000:1.0:1715330286.628272:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938023296 00000100:00100000:1.0:1715330286.628303:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23338 00000100:00100000:1.0:1715330286.628308:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d619f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+16:16911:x1798653938023296:12345-192.168.204.49@tcp:36:rmdir.0 00010000:00010000:1.0:1715330286.628344:0:7135:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330286.628360:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66d8202 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1517:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb582 expref: 16 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.628373:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1517:0x0].0x0 (ffff88008d5ee600) 00010000:00010000:1.0:1715330286.628377:0:7135:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330286.628398:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe400/0xd895711d66d8209 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.628406:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe400/0xd895711d66d8209 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.628413:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe400/0xd895711d66d8209 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.628423:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe880/0xd895711d66d8210 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.628428:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe880/0xd895711d66d8210 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.628432:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe880/0xd895711d66d8210 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.628478:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66d8217 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1517:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.628483:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66d8217 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1517:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.628487:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66d8217 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1517:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00200000:1.0:1715330286.628637:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1517:0x0]: returning size 4096 00010000:00010000:1.0:1715330286.628648:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66d8217 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1517:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.628654:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66d8217 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1517:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.628658:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66d8217 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1517:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.628662:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bff600 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330286.628665:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66d8217 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1517:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.628670:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66d8217 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1517:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.628676:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1517:0x0].0x0 (ffff88008d5ee600) 00010000:00010000:1.0:1715330286.628678:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330286.628681:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66d8217 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1517:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.628685:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66d8217 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1517:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.628705:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe400/0xd895711d66d8209 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.628710:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe400/0xd895711d66d8209 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.628714:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe400/0xd895711d66d8209 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.628718:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe400/0xd895711d66d8209 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.628722:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfe400 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330286.628724:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe400/0xd895711d66d8209 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.628742:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe400/0xd895711d66d8209 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.628748:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88008d5ee800) 00010000:00010000:1.0:1715330286.628750:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330286.628752:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe400/0xd895711d66d8209 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.628756:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe400/0xd895711d66d8209 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00000004:00010000:1.0:1715330286.628765:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008d619f80 reply state ffff88008d560000 transno 4294983423 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe880/0xd895711d66d8210 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.628772:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe880/0xd895711d66d8210 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.628777:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x8a4526ef (ffff88008d5ee000) 00010000:00010000:1.0:1715330286.628779:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330286.628781:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1715330286.629902:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d619f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:16911:x1798653938023296:12345-192.168.204.49@tcp:36:rmdir.0 Request processed in 1591us (2041us total) trans 4294983423 rc 0/0 00000100:00100000:1.0:1715330286.629908:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23338 00000100:00100000:2.0:1715330286.646898:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330286.647095:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938023360 00000100:00100000:1.0:1715330286.647103:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938023360 00000100:00100000:1.0:1715330286.647146:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23339 00000100:00100000:1.0:1715330286.647152:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+10:16918:x1798653938023360:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:1.0:1715330286.647169:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330286.647184:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d821e lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb589 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.647227:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe400/0xd895711d66d8225 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.647237:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe400/0xd895711d66d8225 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330286.647243:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe400/0xd895711d66d8225 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330286.647252:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d822c lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x8a4526f0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.647257:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d822c lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8a4526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330286.647261:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d822c lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8a4526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330286.647293:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe400/0xd895711d66d8225 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330286.647297:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe400/0xd895711d66d8225 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330286.647301:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe400/0xd895711d66d8225 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330286.647305:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe400/0xd895711d66d8225 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330286.647310:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfe400 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330286.647313:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe400/0xd895711d66d8225 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330286.647318:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe400/0xd895711d66d8225 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330286.647325:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff880093b42000) 00010000:00010000:1.0:1715330286.647328:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330286.647330:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe400/0xd895711d66d8225 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330286.647334:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe400/0xd895711d66d8225 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330286.647353:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d822c lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8a4526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330286.647358:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d822c lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8a4526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330286.647361:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d822c lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8a4526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330286.647364:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bff600 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330286.647366:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d822c lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8a4526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330286.647370:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d822c lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8a4526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330286.647374:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x8a4526f0 (ffff88008d5eef00) 00010000:00010000:1.0:1715330286.647375:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330286.647377:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d822c lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x8a4526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330286.647380:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d822c lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x8a4526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330286.647398:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d821e lrc: 1/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb589 expref: 11 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.647404:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d821e lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb589 expref: 11 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.647410:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfdd40, rc 0) 00000100:00100000:1.0:1715330286.647443:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+10:16918:x1798653938023360:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 291us (551us total) trans 0 rc 301/301 00000100:00100000:1.0:1715330286.647448:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23339 00000100:00100000:0.0:1715330286.651129:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330286.666035:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330286.666258:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938023552 00000100:00100000:1.0:1715330286.666267:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938023552 00000100:00100000:1.0:1715330286.666301:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23341 00000100:00100000:1.0:1715330286.666308:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+10:16918:x1798653938023552:12345-192.168.204.49@tcp:36:lfs.0 00010000:00010000:1.0:1715330286.666349:0:7135:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330286.666368:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e640/0xd895711d66d80c7 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb54a expref: 10 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.666381:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff880093b42000) 00010000:00010000:1.0:1715330286.666388:0:7135:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330286.666432:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d8241 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.666442:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d8241 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330286.666449:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d8241 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330286.666459:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d8248 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x8a4526f0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.666463:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d8248 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x8a4526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330286.666468:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d8248 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x8a4526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000040:00080000:1.0:1715330286.671442:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].380, 2168 off576504 00000040:00080000:1.0:1715330286.671510:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].382, 2368 off631184 00000004:00080000:1.0:1715330286.671515:0:7135:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88009396c840 with version 727 00000004:00080000:1.0:1715330286.671531:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 727 rpc_version 727 00000020:00100000:1.0:1715330286.671572:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1715330286.671580:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88009b4c0000 x1798653942448384/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 3976/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1715330286.671599:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b4c0000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942448384:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1715330286.671650:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.671679:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009396c480 going to sleep for 11 seconds 00000100:00100000:1.0:1715330286.672567:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b4c0000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942448384:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1715330286.672670:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d824f lrc: 3/0,1 mode: --/PW res: [0x240000402:0x187:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.672682:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d824f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x187:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.672692:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d824f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x187:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.672705:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d8256 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.672710:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d8256 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.672714:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d8256 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.672746:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f0000/0xd895711d66d825d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.672751:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f0000/0xd895711d66d825d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.672759:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f0000/0xd895711d66d825d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT1 00000100:00100000:0.0:1715330286.672768:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012faec000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942448448:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1715330286.672789:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330286.672798:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffcc00 going to sleep for 11 seconds 00000100:00100000:0.0:1715330286.672818:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942448448 00000100:00100000:0.0:1715330286.672820:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942448448 00000100:00100000:0.0:1715330286.672848:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2606 00000100:00100000:0.0:1715330286.672852:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:7135:x1798653942448448:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330286.672862:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330286.672874:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d8264 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d825d expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.672888:0:23404:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d8264 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d825d expref: 9 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.672896:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d8264 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d825d expref: 9 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.672902:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc7:0x0].0x0 (ffff88008d4e1600) 00010000:00010000:0.0:1715330286.672904:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330286.672906:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f2ac0, rc 0) 00000100:00100000:0.0:1715330286.672925:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7135:x1798653942448448:12345-0@lo:101:mdt00_002.0 Request processed in 72us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.672930:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2606 00000100:00100000:0.0:1715330286.672950:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012faec000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942448448:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330286.672959:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f0000/0xd895711d66d825d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8264 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.672966:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f0000/0xd895711d66d825d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8264 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330286.672979:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008d799500 reply state ffff880093ad2000 transno 4294968370 ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d8256 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.673041:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d8256 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.673046:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc7:0x0].0x0 (ffff88008d4e1a00) 00010000:00010000:0.0:1715330286.673048:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330286.673050:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1715330286.673054:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f0000/0xd895711d66d825d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8264 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.673060:0:7135:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f0000/0xd895711d66d825d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8264 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1715330286.673067:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000401:0xc7:0x0] 00000004:00010000:0.0:1715330286.673071:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008d799500 reply state ffff880093ad2000 transno 4294968370 ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d824f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x187:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.673076:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d824f lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x187:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.673081:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x187:0x0].0x0 (ffff88008d4e1d00) 00010000:00010000:0.0:1715330286.673082:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330286.673084:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1715330286.673087:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x187:0x0]: returning size 4096 00010000:00010000:0.0:1715330286.673092:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d8241 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.673097:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d8241 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.673101:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d8241 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.673106:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d8241 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.673111:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfdd40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330286.673114:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d8241 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.673119:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d8241 lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.673126:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88008d5eef00) 00010000:00010000:0.0:1715330286.673128:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330286.673131:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d8241 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.673135:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d8241 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00000004:00010000:0.0:1715330286.673146:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008d799500 reply state ffff880093ad2000 transno 4294968370 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d8248 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x8a4526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.673151:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d8248 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x8a4526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.673156:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x8a4526f0 (ffff88008d5ee300) 00010000:00010000:0.0:1715330286.673158:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330286.673159:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00000100:00100000:0.0:1715330286.673489:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+11:16918:x1798653938023552:12345-192.168.204.49@tcp:36:lfs.0 Request processed in 7180us (7457us total) trans 4294968370 rc 0/0 00000100:00100000:0.0:1715330286.673495:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23341 00000100:00100000:0.0:1715330286.681844:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938023680 00000100:00100000:0.0:1715330286.681852:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938023680 00000100:00100000:0.0:1715330286.681887:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23342 00000100:00100000:0.0:1715330286.681893:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+11:16919:x1798653938023680:12345-192.168.204.49@tcp:36:mkdir.0 00000100:00100000:0.0:1715330286.682033:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+11:16919:x1798653938023680:12345-192.168.204.49@tcp:36:mkdir.0 Request processed in 138us (251us total) trans 0 rc -17/-17 00000100:00100000:0.0:1715330286.682038:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23342 00000100:00100000:1.0:1715330286.704353:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330286.709830:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330286.717195:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330286.718349:0:9413:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942448512 00000100:00100000:1.0:1715330286.718360:0:9413:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942448512 00000100:00100000:1.0:1715330286.718407:0:9413:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1145 00000100:00100000:1.0:1715330286.718414:0:9413:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:9622:x1798653942448512:12345-0@lo:104: 00010000:00010000:1.0:1715330286.718426:0:9413:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f0000/0xd895711d66d825d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d8264 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.718500:0:9413:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1715330286.718504:0:9413:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:9622:x1798653942448512:12345-0@lo:104: Request processed in 91us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.718509:0:9413:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1145 00010000:00010000:2.0:1715330286.718564:0:9415:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1715330286.718570:0:9415:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f0000/0xd895711d66d825d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d8264 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.718578:0:9415:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f0000 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:2.0:1715330286.718582:0:9415:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f0000/0xd895711d66d825d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc7:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd895711d66d8264 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1715330286.718590:0:9415:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f0000/0xd895711d66d825d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc7:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd895711d66d8264 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.718619:0:9415:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f0000/0xd895711d66d825d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc7:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d8264 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.718624:0:9415:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1715330286.718646:0:9415:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f0000/0xd895711d66d825d lrc: 1/0,0 mode: --/PW res: [0x200000401:0xc7:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d8264 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.718651:0:9415:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f0000/0xd895711d66d825d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc7:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d8264 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.718670:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330286.718670:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1715330286.718671:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330286.718673:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330286.718680:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d41b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942448576:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330286.718712:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330286.718760:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942448576 00000100:00100000:2.0:1715330286.718763:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942448576 00010000:00010000:2.0:1715330286.718779:0:7122:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d8264 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd895711d66d825d expref: 9 pid: 23404 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330286.718806:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1505 00000100:00100000:2.0:1715330286.718810:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+9:3691:x1798653942448576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715330286.718819:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1715330286.721461:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983424 is committed 00000001:00080000:0.0:1715330286.721512:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983423 is committed 00010000:00010000:2.0:1715330286.721610:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d81df lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.721619:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d81df lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.721625:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d81df lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.721637:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfc900 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330286.721641:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d81df lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.721647:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d81df lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.721665:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x8a4526ef (ffff88008d5ee000) 00010000:00010000:2.0:1715330286.721668:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330286.721671:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d81df lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.721675:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d81df lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.721691:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff840/0xd895711d66d81e6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1517:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.721697:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff840/0xd895711d66d81e6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1517:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.721701:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff840/0xd895711d66d81e6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1517:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.721705:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bff840 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330286.721711:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff840/0xd895711d66d81e6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1517:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.721715:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff840/0xd895711d66d81e6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1517:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.721721:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1517:0x0].0x0 (ffff88008d5ee600) 00010000:00010000:2.0:1715330286.721723:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330286.721726:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff840/0xd895711d66d81e6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1517:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.721747:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff840/0xd895711d66d81e6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1517:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.721769:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe880/0xd895711d66d8210 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.721774:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe880/0xd895711d66d8210 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.721778:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe880/0xd895711d66d8210 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.721782:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfe880 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330286.721784:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe880/0xd895711d66d8210 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.721793:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe880/0xd895711d66d8210 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.721799:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x8a4526ef (ffff88008d5ee000) 00010000:00010000:2.0:1715330286.721800:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330286.721802:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe880/0xd895711d66d8210 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.721807:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe880/0xd895711d66d8210 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x8a4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00000100:00100000:0.0:1715330286.722329:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d41b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942448576:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715330286.722498:0:9622:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d829c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330286.722504:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d829c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00000004:00200000:2.0:1715330286.722579:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc7:0x0]: returning size 4096 00000004:00200000:2.0:1715330286.722583:0:9622:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1715330286.722623:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c000/0xd895711d66d8295 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5a5 expref: 16 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.722636:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d829c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5a5 expref: 15 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.722642:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc7:0x0].0x0 (ffff88008d4e1600) 00010000:00010000:2.0:1715330286.722644:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1715330286.722646:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013457ef40, rc 0) 00000100:00100000:2.0:1715330286.722914:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+15:16920:x1798653938023872:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 4872us (5730us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330286.722922:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23345 00000100:00100000:1.0:1715330286.728883:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330286.729011:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938024000 00000100:00100000:2.0:1715330286.729019:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938024000 00000100:00100000:2.0:1715330286.729058:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23346 00000100:00100000:2.0:1715330286.729065:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ad93ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+13:16920:x1798653938024000:12345-192.168.204.49@tcp:36:rmdir.0 00010000:00010000:2.0:1715330286.729104:0:9622:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330286.729123:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457eac0/0xd895711d66d8280 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x187:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb597 expref: 13 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.729135:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x187:0x0].0x0 (ffff88008d4e1d00) 00010000:00010000:2.0:1715330286.729139:0:9622:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330286.729162:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64000/0xd895711d66d82a3 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330286.729171:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64000/0xd895711d66d82a3 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330286.729179:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64000/0xd895711d66d82a3 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330286.729187:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64240/0xd895711d66d82aa lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x8a4526f0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330286.729193:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64240/0xd895711d66d82aa lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x8a4526f0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330286.729197:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64240/0xd895711d66d82aa lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x8a4526f0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330286.729253:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d82b1 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x187:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330286.729258:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d82b1 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x187:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330286.729264:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d82b1 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x187:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330286.729275:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db673c0/0xd895711d66d82b8 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xc7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330286.729282:0:9622:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f180/0xd895711d66d828e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb59e expref: 12 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.729288:0:9622:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db673c0/0xd895711d66d82b8 lrc: 4/0,1 mode: --/EX res: [0x240000400:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330286.729317:0:9622:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f180/0xd895711d66d828e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb59e expref: 12 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.729327:0:9622:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f180/0xd895711d66d828e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb59e expref: 12 pid: 9622 timeout: 361 lvb_type: 0 00000100:00100000:2.0:1715330286.729339:0:9622:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d419180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:9622:1798653942448640:192.168.204.49@tcp:104: 00000100:00100000:2.0:1715330286.729390:0:9622:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa540 going to sleep for 11 seconds 00000100:00100000:2.0:1715330286.732188:0:9622:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d419180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:9622:1798653942448640:192.168.204.49@tcp:104: 00010000:00010000:2.0:1715330286.732206:0:9622:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88011db673c0/0xd895711d66d82b8 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT1 00000100:00100000:2.0:1715330286.733919:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00010000:00010000:2.0:1715330286.735946:0:9622:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88011db673c0/0xd895711d66d82b8 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330286.735952:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db673c0/0xd895711d66d82b8 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330286.735980:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65d40/0xd895711d66d82bf lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330286.735984:0:9622:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65d40/0xd895711d66d82bf lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330286.735989:0:9622:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65d40/0xd895711d66d82bf lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 9622 initiator: MDT1 00000100:00100000:2.0:1715330286.736001:0:9622:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d41a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9622:1798653942448704:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1715330286.736029:0:9622:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330286.736049:0:9622:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa540 going to sleep for 11 seconds 00000100:00100000:1.0:1715330286.736063:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942448704 00000100:00100000:1.0:1715330286.736067:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942448704 00000100:00100000:1.0:1715330286.736098:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2607 00000100:00100000:1.0:1715330286.736102:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d41b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:9622:x1798653942448704:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1715330286.736118:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330286.736131:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe400/0xd895711d66d82c6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d82bf expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.736146:0:23404:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d829c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5a5 expref: 14 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.736152:0:23404:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe400/0xd895711d66d82c6 lrc: 4/0,0 mode: --/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d82bf expref: 7 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.737503:0:23404:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d829c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5a5 expref: 14 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.737515:0:23404:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d829c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5a5 expref: 14 pid: 9622 timeout: 361 lvb_type: 0 00000100:00100000:1.0:1715330286.737524:0:23404:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55c700 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:23404:1798653942448768:192.168.204.49@tcp:104: 00000100:00100000:1.0:1715330286.737562:0:23404:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009396c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715330286.742119:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330286.742144:0:23404:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55c700 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:23404:1798653942448768:192.168.204.49@tcp:104: 00010000:00010000:1.0:1715330286.742169:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe400/0xd895711d66d82c6 lrc: 3/0,0 mode: --/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d82bf expref: 7 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.742180:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc7:0x0].0x0 (ffff88008d4e1600) 00010000:00010000:1.0:1715330286.742182:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330286.742186:0:23404:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe400/0xd895711d66d82c6 lrc: 3/0,0 mode: --/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d82bf expref: 7 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.742193:0:23404:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe400/0xd895711d66d82c6 lrc: 3/0,0 mode: --/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d82bf expref: 7 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.742199:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfe400, rc 0) 00000100:00100000:1.0:1715330286.742234:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d41b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:9622:x1798653942448704:12345-0@lo:101:mdt00_003.0 Request processed in 6131us (6203us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.742241:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2607 00000100:00100000:2.0:1715330286.742315:0:9622:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983424 gen 2 00000004:00080000:2.0:1715330286.742320:0:9622:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983421 committed transno 4294983424 00000004:00080000:2.0:1715330286.742339:0:9622:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983424 committed transno 4294983424 00000100:00100000:2.0:1715330286.742351:0:9622:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d41a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9622:1798653942448704:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1715330286.742362:0:9622:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65d40/0xd895711d66d82bf lrc: 4/0,1 mode: --/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d82c6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.742369:0:9622:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65d40/0xd895711d66d82bf lrc: 4/0,1 mode: --/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d82c6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330286.742586:0:9413:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942448832 00000100:00100000:1.0:1715330286.742590:0:9413:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942448832 00000100:00100000:1.0:1715330286.742607:0:9413:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1146 00000100:00100000:1.0:1715330286.742612:0:9413:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:7122:x1798653942448832:12345-0@lo:105: 00010000:00010000:1.0:1715330286.742619:0:9413:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65d40/0xd895711d66d82bf lrc: 5/0,1 mode: --/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d82c6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.742626:0:9413:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65d40/0xd895711d66d82bf lrc: 5/0,1 mode: --/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d82c6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.742632:0:9413:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65d40/0xd895711d66d82bf lrc: 5/0,1 mode: --/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d82c6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.742637:0:9413:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65d40/0xd895711d66d82bf lrc: 5/0,1 mode: EX/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d82c6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.742642:0:9413:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65d40/0xd895711d66d82bf lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d82c6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.742648:0:9413:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65d40/0xd895711d66d82bf lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d82c6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.742659:0:9413:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88011db65d40) 00010000:00010000:2.0:1715330286.742667:0:9622:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65d40/0xd895711d66d82bf lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d82c6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.742677:0:9622:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65d40/0xd895711d66d82bf lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d82c6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330286.742691:0:9413:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:7122:x1798653942448832:12345-0@lo:105: Request processed in 78us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.742697:0:9413:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1146 00000100:00100000:2.0:1715330286.743196:0:9622:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9622:1798653942448896:0@lo:403:mdt00_003.0 00000100:00100000:2.0:1715330286.743223:0:9622:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330286.743242:0:9622:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa540 going to sleep for 11 seconds 00000100:00100000:1.0:1715330286.743469:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942448896 00000100:00100000:1.0:1715330286.743472:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942448896 00000100:00100000:1.0:1715330286.743496:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2608 00000100:00100000:1.0:1715330286.743500:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:9622:x1798653942448896:12345-0@lo:403:mdt00_003.0 00000100:00100000:1.0:1715330286.744977:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:9622:x1798653942448896:12345-0@lo:403:mdt00_003.0 Request processed in 1473us (1751us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.744984:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2608 00000100:00100000:2.0:1715330286.745079:0:9622:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9622:1798653942448896:0@lo:403:mdt00_003.0 00000040:00080000:2.0:1715330286.745803:0:9622:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].381, 664 off577168 00000040:00080000:2.0:1715330286.745928:0:9622:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].383, 744 off631928 00000004:00080000:2.0:1715330286.745932:0:9622:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff880091ffa540 with version 728 00000004:00080000:1.0:1715330286.746100:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 728 rpc_version 728 00000020:00100000:1.0:1715330286.746119:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1715330286.746125:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012b55c700 x1798653942449024/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1448/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1715330286.746139:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55c700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942449024:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1715330286.746164:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.746315:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009396c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715330286.746359:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942449024 00000100:00100000:2.0:1715330286.746363:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942449024 00000100:00100000:2.0:1715330286.746395:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2609 00000100:00100000:2.0:1715330286.746399:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:8278:x1798653942449024:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1715330286.746619:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:8278:x1798653942449024:12345-0@lo:1000:osp_up0-1.0 Request processed in 218us (454us total) trans 4294983425 rc 0/0 00000100:00100000:2.0:1715330286.746625:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2609 00000100:00100000:1.0:1715330286.747374:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55c700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942449024:0@lo:1000:osp_up0-1.0 00000004:00200000:2.0:1715330286.747470:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x187:0x0]: returning size 4096 00010000:00010000:2.0:1715330286.747488:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db673c0/0xd895711d66d82b8 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330286.747495:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db673c0/0xd895711d66d82b8 lrc: 2/0,0 mode: EX/EX res: [0x240000400:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330286.747500:0:9622:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011db673c0/0xd895711d66d82b8 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330286.747504:0:9622:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db673c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330286.747507:0:9622:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db673c0/0xd895711d66d82b8 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330286.747512:0:9622:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db673c0/0xd895711d66d82b8 lrc: 4/0,0 mode: EX/EX res: [0x240000400:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330286.747521:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc7:0x0].0x0 (ffff88008d4e1a00) 00010000:00010000:2.0:1715330286.747523:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330286.747526:0:9622:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011db673c0/0xd895711d66d82b8 lrc: 2/0,0 mode: --/EX res: [0x240000400:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330286.747529:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db673c0/0xd895711d66d82b8 lrc: 0/0,0 mode: --/EX res: [0x240000400:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330286.747545:0:9622:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65d40/0xd895711d66d82bf lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d82c6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.747551:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65d40/0xd895711d66d82bf lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d82c6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.747556:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65d40/0xd895711d66d82bf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d82c6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.747612:0:9622:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1715330286.747618:0:9622:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000401:0xc7:0x0] 00010000:00010000:2.0:1715330286.747623:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d82b1 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x187:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330286.747627:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d82b1 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x187:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330286.747631:0:9622:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d82b1 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x187:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330286.747634:0:9622:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db67600 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330286.747636:0:9622:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d82b1 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x187:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330286.747640:0:9622:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d82b1 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x187:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330286.747645:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x187:0x0].0x0 (ffff88008d4e1d00) 00010000:00010000:2.0:1715330286.747647:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330286.747649:0:9622:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d82b1 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x187:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330286.747652:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d82b1 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x187:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330286.747825:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715330286.747831:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65d40/0xd895711d66d82bf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d82c6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.747837:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db65d40 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330286.747841:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65d40/0xd895711d66d82bf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d82c6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330286.747848:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65d40/0xd895711d66d82bf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d82c6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.747867:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65d40/0xd895711d66d82bf lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d82c6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.747872:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330286.747891:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65d40/0xd895711d66d82bf lrc: 1/0,0 mode: --/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d82c6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.747896:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65d40/0xd895711d66d82bf lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d82c6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330286.747942:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012faeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942449088:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330286.747971:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1715330286.748277:0:9622:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64000/0xd895711d66d82a3 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330286.748283:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64000/0xd895711d66d82a3 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330286.748287:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64000/0xd895711d66d82a3 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330286.748291:0:9622:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64000/0xd895711d66d82a3 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330286.748295:0:9622:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64000 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330286.748298:0:9622:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64000/0xd895711d66d82a3 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330286.748302:0:9622:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64000/0xd895711d66d82a3 lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330286.748309:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88009d678a00) 00010000:00010000:2.0:1715330286.748311:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330286.748313:0:9622:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64000/0xd895711d66d82a3 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330286.748318:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64000/0xd895711d66d82a3 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT1 00000004:00010000:2.0:1715330286.748329:0:9622:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800ad93ac50 reply state ffff8800939eb000 transno 4294968371 ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64240/0xd895711d66d82aa lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x8a4526f0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330286.748337:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64240/0xd895711d66d82aa lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x8a4526f0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330286.748342:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x8a4526f0 (ffff88008d5ee300) 00010000:00010000:2.0:1715330286.748344:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330286.748346:0:9622:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1715330286.748389:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ad93ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+13:16920:x1798653938024000:12345-192.168.204.49@tcp:36:rmdir.0 Request processed in 19324us (19513us total) trans 4294968371 rc 0/0 00000100:00100000:2.0:1715330286.748397:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23346 00010000:00010000:0.0:1715330286.749599:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330286.749602:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330286.749604:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330286.749954:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012faeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942449088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1715330286.764333:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330286.765046:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938024192 00000100:00100000:0.0:1715330286.765054:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938024192 00000100:00100000:1.0:1715330286.765152:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23347 00000100:00100000:1.0:1715330286.765160:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+14:16921:x1798653938024192:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:1.0:1715330286.765177:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330286.765192:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66d82cd lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb5ac expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.765248:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d82d4 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:1.0:1715330286.765258:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d82d4 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:1.0:1715330286.765266:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d82d4 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:1.0:1715330286.765277:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc000/0xd895711d66d82db lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x8a4526f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:1.0:1715330286.765281:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc000/0xd895711d66d82db lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:1.0:1715330286.765286:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc000/0xd895711d66d82db lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:1.0:1715330286.765373:0:9622:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d82d4 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:1.0:1715330286.765379:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d82d4 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT0 00010000:00010000:1.0:1715330286.765383:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d82d4 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT0 00010000:00010000:1.0:1715330286.765388:0:9622:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d82d4 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:1.0:1715330286.765392:0:9622:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bffcc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330286.765396:0:9622:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d82d4 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:1.0:1715330286.765405:0:9622:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d82d4 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9622 initiator: MDT0 00010000:00010000:1.0:1715330286.765413:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88006eff5400) 00010000:00010000:1.0:1715330286.765416:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330286.765419:0:9622:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d82d4 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:1.0:1715330286.765423:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d82d4 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:1.0:1715330286.765447:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc000/0xd895711d66d82db lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:1.0:1715330286.765453:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc000/0xd895711d66d82db lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT0 00010000:00010000:1.0:1715330286.765457:0:9622:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc000/0xd895711d66d82db lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:1.0:1715330286.765568:0:9622:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfc000 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330286.765570:0:9622:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc000/0xd895711d66d82db lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:1.0:1715330286.765575:0:9622:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc000/0xd895711d66d82db lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9622 initiator: MDT0 00010000:00010000:1.0:1715330286.765580:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x8a4526f1 (ffff88008d5ee100) 00010000:00010000:1.0:1715330286.765581:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330286.765583:0:9622:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc000/0xd895711d66d82db lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x8a4526f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:1.0:1715330286.765586:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc000/0xd895711d66d82db lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x8a4526f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:1.0:1715330286.765607:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66d82cd lrc: 1/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5ac expref: 15 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.765611:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66d82cd lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5ac expref: 15 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.765616:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bff180, rc 0) 00000100:00100000:1.0:1715330286.765657:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+14:16921:x1798653938024192:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 498us (1332us total) trans 0 rc 301/301 00000100:00100000:1.0:1715330286.765665:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23347 00000100:00100000:2.0:1715330286.770142:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330286.770193:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938024256 00000100:00100000:1.0:1715330286.770201:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938024256 00000100:00100000:1.0:1715330286.770243:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23348 00000100:00100000:1.0:1715330286.770251:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+13:16921:x1798653938024256:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:1.0:1715330286.770270:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330286.770286:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d82e2 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb5b3 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.770435:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc480/0xd895711d66d82e9 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:1.0:1715330286.770445:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc480/0xd895711d66d82e9 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330286.770452:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc480/0xd895711d66d82e9 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT1 00000004:00200000:1.0:1715330286.770484:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000401:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1715330286.770488:0:9622:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1715330286.770513:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d82e2 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5b3 expref: 15 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.770525:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc480/0xd895711d66d82e9 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5b3 expref: 14 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.770531:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88008d5ee800) 00010000:00010000:1.0:1715330286.770534:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1715330286.770544:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfc480, rc 0) 00000100:00100000:1.0:1715330286.770586:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+14:16921:x1798653938024256:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 336us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.770592:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23348 00000100:00100000:0.0:1715330286.774386:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330286.774494:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938024384 00000100:00100000:1.0:1715330286.774504:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938024384 00000100:00100000:1.0:1715330286.774560:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23349 00000100:00100000:1.0:1715330286.774567:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+14:16921:x1798653938024384:12345-192.168.204.49@tcp:36:lfs.0 00010000:00010000:1.0:1715330286.774605:0:7135:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330286.774624:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cd80/0xd895711d66d823a lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb590 expref: 14 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.774637:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88006eff5400) 00010000:00010000:1.0:1715330286.774645:0:7135:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330286.774822:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d82f0 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.774924:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d82f0 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.774934:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d82f0 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.774947:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66d82f7 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x8a4526f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.774952:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66d82f7 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x8a4526f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.774956:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66d82f7 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x8a4526f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000040:00080000:1.0:1715330286.775590:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].356, 2168 off546280 00000040:00080000:1.0:1715330286.775662:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].355, 2368 off587432 00000004:00080000:1.0:1715330286.775666:0:7135:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88009396cc00 with version 678 00000004:00080000:0.0:1715330286.775751:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 678 rpc_version 678 00000020:00100000:0.0:1715330286.775789:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1715330286.775798:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012faef100 x1798653942449216/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3976/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715330286.775820:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012faef100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942449216:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330286.775872:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330286.775905:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffc540 going to sleep for 11 seconds 00000100:00100000:1.0:1715330286.777324:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012faef100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942449216:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1715330286.777401:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d82fe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1518:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.777409:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d82fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1518:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.777416:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d82fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1518:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.777428:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66d8305 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.777433:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66d8305 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.777437:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66d8305 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.777459:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfdb00/0xd895711d66d830c lrc: 3/0,1 mode: --/PW res: [0x240000401:0xca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.777464:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfdb00/0xd895711d66d830c lrc: 3/0,1 mode: --/PW res: [0x240000401:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.777471:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfdb00/0xd895711d66d830c lrc: 3/0,1 mode: --/PW res: [0x240000401:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT0 00000100:00100000:1.0:1715330286.777485:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942449280:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1715330286.778045:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.779270:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009396c180 going to sleep for 11 seconds 00000100:00100000:1.0:1715330286.779584:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942449280:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330286.779594:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfdb00/0xd895711d66d830c lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8313 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.779602:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfdb00/0xd895711d66d830c lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8313 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330286.779617:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012faed180 reply state ffff88009aebc000 transno 4294983426 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66d8305 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.779625:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66d8305 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.779630:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xca:0x0].0x0 (ffff88008d5ee200) 00010000:00010000:1.0:1715330286.779632:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330286.779634:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1715330286.779638:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfdb00/0xd895711d66d830c lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8313 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.779645:0:7135:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfdb00/0xd895711d66d830c lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8313 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330286.779656:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0xca:0x0] 00000004:00010000:1.0:1715330286.779660:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012faed180 reply state ffff88009aebc000 transno 4294983426 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d82fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1518:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.779666:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d82fe lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1518:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.779671:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1518:0x0].0x0 (ffff88008d5ee400) 00010000:00010000:1.0:1715330286.779673:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330286.779674:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1715330286.779677:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1518:0x0]: returning size 4096 00010000:00010000:1.0:1715330286.779684:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d82f0 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.779688:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d82f0 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.779693:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d82f0 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.779698:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d82f0 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.779702:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfd440 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330286.779705:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d82f0 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.779709:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d82f0 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.779716:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88008d5eee00) 00010000:00010000:1.0:1715330286.779717:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330286.779720:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d82f0 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.779724:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d82f0 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00000004:00010000:1.0:1715330286.779758:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012faed180 reply state ffff88009aebc000 transno 4294983426 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66d82f7 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x8a4526f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.779765:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66d82f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8a4526f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.779770:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x8a4526f1 (ffff88008d5eed00) 00010000:00010000:1.0:1715330286.779772:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330286.779773:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00000100:00100000:1.0:1715330286.779830:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+15:16921:x1798653938024384:12345-192.168.204.49@tcp:36:lfs.0 Request processed in 5261us (5452us total) trans 4294983426 rc 0/0 00000100:00100000:1.0:1715330286.779837:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23349 00000100:00100000:2.0:1715330286.792645:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330286.792795:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938024512 00000100:00100000:1.0:1715330286.792802:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938024512 00000100:00100000:1.0:1715330286.792976:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23350 00000100:00100000:1.0:1715330286.792983:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+15:16922:x1798653938024512:12345-192.168.204.49@tcp:36:mkdir.0 00000100:00100000:1.0:1715330286.794848:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+15:16922:x1798653938024512:12345-192.168.204.49@tcp:36:mkdir.0 Request processed in 1861us (2206us total) trans 0 rc -17/-17 00000100:00100000:1.0:1715330286.794857:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23350 00000100:00100000:2.0:1715330286.810927:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330286.811037:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938024576 00000100:00100000:1.0:1715330286.811045:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938024576 00000100:00100000:1.0:1715330286.811076:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23351 00000100:00100000:1.0:1715330286.811082:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+15:16923:x1798653938024576:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:1.0:1715330286.811098:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330286.811115:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d831a lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb5ba expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.811164:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d8321 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.811173:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d8321 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.811181:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d8321 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.811187:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcb40/0xd895711d66d8328 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x8a4526f1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.811192:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcb40/0xd895711d66d8328 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526f1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.811196:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcb40/0xd895711d66d8328 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526f1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.811247:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d832f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1518:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.811251:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d832f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1518:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.811255:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d832f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1518:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00200000:1.0:1715330286.811340:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1518:0x0]: returning size 4096 00000004:00200000:1.0:1715330286.811344:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1715330286.811358:0:7135:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d832f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1518:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.811367:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d8321 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.811371:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d8321 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.811376:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d8321 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.811380:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d8321 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.811384:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfcd80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330286.811388:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d8321 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.811393:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d8321 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.811402:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88008d5ee100) 00010000:00010000:1.0:1715330286.811404:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330286.811408:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d8321 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.811412:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d8321 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.811420:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcb40/0xd895711d66d8328 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526f1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.811424:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcb40/0xd895711d66d8328 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526f1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.811428:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcb40/0xd895711d66d8328 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526f1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.811431:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfcb40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330286.811433:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcb40/0xd895711d66d8328 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526f1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.811436:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcb40/0xd895711d66d8328 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526f1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.811441:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x8a4526f1 (ffff88008d5eed00) 00010000:00010000:1.0:1715330286.811442:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330286.811445:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcb40/0xd895711d66d8328 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x8a4526f1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.811448:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcb40/0xd895711d66d8328 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x8a4526f1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.811462:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d831a lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5ba expref: 17 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.811474:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d832f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1518:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5ba expref: 16 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.811479:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1518:0x0].0x0 (ffff88008d5ee400) 00010000:00010000:1.0:1715330286.811481:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1715330286.811483:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfef40, rc 0) 00000100:00100000:1.0:1715330286.811516:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+16:16923:x1798653938024576:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 433us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.811521:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23351 00000100:00100000:1.0:1715330286.814547:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330286.814595:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938024640 00000100:00100000:2.0:1715330286.814603:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938024640 00000100:00100000:2.0:1715330286.814642:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23352 00000100:00100000:2.0:1715330286.814648:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+16:16923:x1798653938024640:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:2.0:1715330286.814663:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330286.814679:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d8336 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb5c1 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.814716:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d833d lrc: 3/1,0 mode: --/PR res: [0x200000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330286.814726:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d833d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xca:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330286.814749:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d833d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xca:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00000004:00200000:2.0:1715330286.814783:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0xca:0x0]: returning size 4096 00000004:00200000:2.0:1715330286.814787:0:9622:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1715330286.814812:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d8336 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5c1 expref: 18 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.814836:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d833d lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xca:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5c1 expref: 17 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.814844:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xca:0x0].0x0 (ffff88008d5ee200) 00010000:00010000:2.0:1715330286.814846:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1715330286.814848:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db64d80, rc 0) 00000100:00100000:2.0:1715330286.814881:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+17:16923:x1798653938024640:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 233us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330286.814890:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23352 00000100:00100000:2.0:1715330286.817726:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330286.817802:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938024704 00000100:00100000:1.0:1715330286.817809:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938024704 00000100:00100000:1.0:1715330286.817848:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23353 00000100:00100000:1.0:1715330286.817854:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+14:16923:x1798653938024704:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:1.0:1715330286.817870:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330286.817884:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdf80/0xd895711d66d8344 lrc: 2/0,0 mode: --/CR res: [0x240000401:0xca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb5c8 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.817923:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d834b lrc: 3/1,0 mode: --/PR res: [0x240000401:0xca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.817933:0:7135:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457eac0/0xd895711d66d8313 lrc: 2/0,0 mode: PW/PW res: [0x240000401:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d830c expref: 9 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.817939:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d834b lrc: 4/1,0 mode: --/PR res: [0x240000401:0xca:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330286.817962:0:7135:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88013457eac0/0xd895711d66d8313 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd895711d66d830c expref: 9 pid: 23404 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330286.817975:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7135:1798653942449344:0@lo:104: 00000100:00100000:1.0:1715330286.818009:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.818022:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009396c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330286.818039:0:9413:0:(service.c:168:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1715330286.818046:0:9413:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942449344 00000100:00100000:1.0:1715330286.818048:0:9413:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942449344 00000100:00100000:1.0:1715330286.818080:0:9413:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1147 00000100:00100000:1.0:1715330286.818085:0:9413:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca77450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:7135:x1798653942449344:12345-0@lo:104: 00010000:00010000:1.0:1715330286.818093:0:9413:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfdb00/0xd895711d66d830c lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d8313 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.818124:0:9413:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1715330286.818128:0:9413:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca77450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:7135:x1798653942449344:12345-0@lo:104: Request processed in 43us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.818137:0:9413:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1147 00000100:00100000:1.0:1715330286.818183:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7135:1798653942449344:0@lo:104: 00010000:00010000:1.0:1715330286.818195:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d834b lrc: 3/1,0 mode: --/PR res: [0x240000401:0xca:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000100:00100000:0.0:1715330286.818349:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1715330286.818358:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942449408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330286.818382:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.818616:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942449408 00000100:00100000:1.0:1715330286.818620:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942449408 00010000:00010000:1.0:1715330286.818631:0:7120:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013457eac0/0xd895711d66d8313 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd895711d66d830c expref: 10 pid: 23404 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330286.818644:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1508 00000100:00100000:1.0:1715330286.818647:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+10:3689:x1798653942449408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330286.818653:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330286.821066:0:8267:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457d8c0/0xd895711d66d815a lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d8161 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330286.821080:0:8267:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457d8c0/0xd895711d66d815a lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x814526f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d8161 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.821105:0:8267:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457d8c0/0xd895711d66d815a lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x814526f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8161 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.821110:0:8267:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1715330286.821167:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942449472:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1715330286.821203:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1715330286.821604:0:8267:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457d8c0/0xd895711d66d815a lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x814526f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8161 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1715330286.821618:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968372 is committed 00000001:00080000:1.0:1715330286.821643:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968371 is committed 00010000:00010000:2.0:1715330286.821661:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64480/0xd895711d66d80ea lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x186:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.821668:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64480/0xd895711d66d80ea lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x186:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.821674:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64480/0xd895711d66d80ea lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x186:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.821678:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64480 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330286.821682:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64480/0xd895711d66d80ea lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x186:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.821687:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64480/0xd895711d66d80ea lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x186:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.821697:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x186:0x0].0x0 (ffff8800b1fd9d00) 00010000:00010000:2.0:1715330286.821699:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330286.821702:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64480/0xd895711d66d80ea lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x186:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.821706:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64480/0xd895711d66d80ea lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x186:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.821718:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66640/0xd895711d66d80f1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.821722:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66640/0xd895711d66d80f1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.821726:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66640/0xd895711d66d80f1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.821746:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330286.821748:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66640/0xd895711d66d80f1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.821753:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66640/0xd895711d66d80f1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.821759:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc6:0x0].0x0 (ffff8800b1fd9e00) 00010000:00010000:2.0:1715330286.821761:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330286.821763:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66640/0xd895711d66d80f1 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.821767:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66640/0xd895711d66d80f1 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.821794:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d8248 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x8a4526f0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.821799:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d8248 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x8a4526f0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.821804:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d8248 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x8a4526f0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.821808:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bff600 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330286.821810:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d8248 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x8a4526f0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.821815:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d8248 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x8a4526f0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.821822:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x8a4526f0 (ffff88008d5ee300) 00010000:00010000:2.0:1715330286.821824:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330286.821827:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d8248 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x8a4526f0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.821831:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d8248 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x8a4526f0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.821839:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d824f lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x187:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.821844:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d824f lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x187:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.821849:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d824f lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x187:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.821852:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f1d40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330286.821855:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d824f lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x187:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.821859:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d824f lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x187:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.821865:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x187:0x0].0x0 (ffff88008d4e1d00) 00010000:00010000:2.0:1715330286.821867:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330286.821869:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d824f lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x187:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.821873:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d824f lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x187:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.821883:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d8256 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.821887:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d8256 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.821892:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d8256 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.821896:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f1440 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330286.821898:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d8256 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.821903:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d8256 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.821908:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc7:0x0].0x0 (ffff88008d4e1a00) 00010000:00010000:2.0:1715330286.821909:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330286.821912:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d8256 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.821915:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d8256 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.821932:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64240/0xd895711d66d82aa lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x8a4526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330286.821937:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64240/0xd895711d66d82aa lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x8a4526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330286.821942:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64240/0xd895711d66d82aa lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x8a4526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330286.821946:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64240 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330286.821948:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64240/0xd895711d66d82aa lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x8a4526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330286.821952:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64240/0xd895711d66d82aa lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x8a4526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330286.821963:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x8a4526f0 (ffff88008d5ee300) 00010000:00010000:2.0:1715330286.821964:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330286.821966:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64240/0xd895711d66d82aa lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x8a4526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330286.821970:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64240/0xd895711d66d82aa lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x8a4526f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT1 00000020:00080000:1.0:1715330286.822037:0:8267:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff88009396c600 refcount 2 committed 0 result 0 batchid 379 00000020:00080000:1.0:1715330286.822041:0:8267:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008d5ee700 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff88009396c840 00000020:00080000:1.0:1715330286.822044:0:8267:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].382 00000020:00080000:1.0:1715330286.822046:0:8267:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008d5eeb00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88008d40aa00 00000020:00080000:1.0:1715330286.822048:0:8267:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].380 00000020:00080000:1.0:1715330286.822065:0:8267:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff880091ffc780 refcount 2 committed 0 result 0 batchid 378 00000020:00080000:1.0:1715330286.822067:0:8267:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008d4e1000 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880091ffca80 00000020:00080000:1.0:1715330286.822069:0:8267:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].381 00000020:00080000:1.0:1715330286.822071:0:8267:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008d4e1100 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88012f5cac00 00000020:00080000:1.0:1715330286.822073:0:8267:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].379 00000020:00080000:1.0:1715330286.822078:0:8267:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0001: 376 batchid updated 00000020:00080000:2.0:1715330286.822083:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 376 00000020:00080000:1.0:1715330286.822083:0:8267:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff88012f47e180 refcount 2 committed 0 result 0 batchid 377 00000020:00080000:1.0:1715330286.822086:0:8267:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880093b42900 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff88012f47ed80 00000020:00080000:1.0:1715330286.822088:0:8267:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].380 00000020:00080000:1.0:1715330286.822089:0:8267:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880093b42e00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff880091f46400 00000020:00080000:1.0:1715330286.822091:0:8267:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].378 00000004:00080000:2.0:1715330286.822122:0:8285:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff880091ffa0c0 with version 729 00000020:00080000:2.0:1715330286.822128:0:8285:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 376 cancel update log [0x200000401:0x3:0x0].379: rc = 0 00010000:00010000:1.0:1715330286.822135:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457eac0/0xd895711d66d8313 lrc: 0/0,0 mode: --/PW res: [0x240000401:0xca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd895711d66d830c expref: 6 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.822143:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xca:0x0].0x0 (ffff88006eff5700) 00010000:00010000:1.0:1715330286.822146:0:7120:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d834b lrc: 3/1,0 mode: --/PR res: [0x240000401:0xca:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330286.822153:0:7120:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d834b lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xca:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330286.822158:0:7120:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d834b lrc: 4/1,0 mode: PR/PR res: [0x240000401:0xca:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330286.822175:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330286.822204:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942449408:12345-0@lo:103:ldlm_bl.0 Request processed in 3555us (3820us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.822212:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1508 00000100:00100000:0.0:1715330286.822323:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942449408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330286.822474:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942449472 00000100:00100000:1.0:1715330286.822479:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942449472 00000020:00080000:2.0:1715330286.822661:0:8285:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 376 cancel update log [0x240000400:0x3:0x0].377: rc = 0 00000020:00080000:2.0:1715330286.822667:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 379 committed batchid 376 00000020:00080000:2.0:1715330286.822676:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 376 00000100:00100000:1.0:1715330286.822744:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1297 00000100:00100000:1.0:1715330286.822751:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+7:3689:x1798653942449472:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1715330286.822765:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330286.822775:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0480/0xd895711d66d8161 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x814526f8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d815a expref: 7 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.822784:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x814526f8 (ffff88008d4e1400) 00010000:00010000:1.0:1715330286.822789:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330286.822972:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+6:3689:x1798653942449472:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 221us (1768us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.822978:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1297 00000004:00080000:1.0:1715330286.822991:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 729 rpc_version 729 00000020:00100000:1.0:1715330286.823007:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1715330286.823012:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012b55f800 x1798653942449600/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1715330286.823025:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55f800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942449600:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1715330286.823049:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.823072:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008b04c600 going to sleep for 11 seconds 00010000:00010000:1.0:1715330286.823084:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d834b lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xca:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330286.823090:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d834b lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xca:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000004:00200000:1.0:1715330286.823129:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000401:0xca:0x0]: returning size 4096 00000004:00200000:1.0:1715330286.823132:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1715330286.823165:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdf80/0xd895711d66d8344 lrc: 0/0,0 mode: --/CR res: [0x240000401:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5c8 expref: 9 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.823175:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d834b lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xca:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5c8 expref: 8 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.823181:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xca:0x0].0x0 (ffff88006eff5700) 00010000:00010000:1.0:1715330286.823183:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1715330286.823185:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfe1c0, rc 0) 00000100:00100000:1.0:1715330286.823217:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+8:16923:x1798653938024704:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 5363us (5496us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.823223:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23353 00000100:00100000:0.0:1715330286.823351:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942449472:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1715330286.823404:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942449600 00000100:00100000:2.0:1715330286.823407:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942449600 00000100:00100000:2.0:1715330286.823430:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2612 00000100:00100000:2.0:1715330286.823435:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:8278:x1798653942449600:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1715330286.823519:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:8278:x1798653942449600:12345-0@lo:1000:osp_up0-1.0 Request processed in 83us (468us total) trans 4294983427 rc 0/0 00000100:00100000:2.0:1715330286.823524:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2612 00000100:00100000:2.0:1715330286.823947:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55f800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942449600:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1715330286.826451:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330286.826513:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938024832 00000100:00100000:0.0:1715330286.826520:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938024832 00000100:00100000:0.0:1715330286.826569:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23354 00000100:00100000:0.0:1715330286.826617:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:16923:x1798653938024832:12345-192.168.204.49@tcp:36:rmdir.0 00010000:00010000:0.0:1715330286.826653:0:7135:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330286.826837:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d832f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1518:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5ba expref: 17 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.826854:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1518:0x0].0x0 (ffff88008d5ee400) 00010000:00010000:0.0:1715330286.826857:0:7135:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715330286.826879:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d8352 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.826889:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d8352 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.826895:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d8352 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.826903:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d8359 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x8a4526f1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.826908:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d8359 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x8a4526f1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.826913:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d8359 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x8a4526f1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.826968:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d8360 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1518:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.826975:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d8360 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1518:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.826981:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d8360 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1518:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.826993:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d8367 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.827000:0:7135:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d833d lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xca:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5c1 expref: 16 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.827006:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d8367 lrc: 4/0,1 mode: --/EX res: [0x200000400:0xca:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.827028:0:7135:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d833d lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xca:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5c1 expref: 16 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.827038:0:7135:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d833d lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xca:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5c1 expref: 16 pid: 9622 timeout: 361 lvb_type: 0 00000100:00100000:0.0:1715330286.827050:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012faed880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7135:1798653942449664:192.168.204.49@tcp:104: 00000100:00100000:0.0:1715330286.827126:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffc000 going to sleep for 11 seconds 00000100:00100000:2.0:1715330286.831034:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330286.831097:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938024896 00000100:00100000:1.0:1715330286.831104:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938024896 00010000:00010000:1.0:1715330286.831130:0:7120:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d833d lrc: 5/0,0 mode: PR/PR res: [0x200000400:0xca:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5c1 expref: 17 pid: 9622 timeout: 361 lvb_type: 0 00000100:00100000:1.0:1715330286.831998:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1509 00000100:00100000:1.0:1715330286.832005:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72de1896-1df4-4b3a-930a-9116d2c66168+17:2012:x1798653938024896:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1715330286.832016:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330286.832021:0:7120:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d833d lrc: 5/0,0 mode: PR/PR res: [0x200000400:0xca:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5c1 expref: 17 pid: 9622 timeout: 361 lvb_type: 0 00010000:00010000:1.0:1715330286.832032:0:7120:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d833d lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xca:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5c1 expref: 17 pid: 9622 timeout: 361 lvb_type: 0 00010000:00010000:1.0:1715330286.832053:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xca:0x0].0x0 (ffff88008d5ee200) 00010000:00010000:1.0:1715330286.832057:0:7120:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d8367 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xca:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.832065:0:7120:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d8367 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xca:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.832071:0:7120:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d8367 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xca:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.832085:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330286.832127:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72de1896-1df4-4b3a-930a-9116d2c66168+17:2012:x1798653938024896:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 121us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.832133:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1509 00010000:00010000:1.0:1715330286.832191:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d833d lrc: 0/0,0 mode: --/PR res: [0x200000400:0xca:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5c1 expref: 16 pid: 9622 timeout: 361 lvb_type: 0 00000100:00100000:1.0:1715330286.832201:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012faed880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7135:1798653942449664:192.168.204.49@tcp:104: 00010000:00010000:1.0:1715330286.832213:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d8367 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.832221:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d8367 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.832225:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d8367 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.832252:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcfc0/0xd895711d66d836e lrc: 3/0,1 mode: --/EX res: [0x240000401:0xca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.832257:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcfc0/0xd895711d66d836e lrc: 3/0,1 mode: --/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.832266:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcfc0/0xd895711d66d836e lrc: 3/0,1 mode: --/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT0 00000100:00100000:1.0:1715330286.832280:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942449728:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1715330286.832309:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.832334:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008b04cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1715330286.832446:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942449728 00000100:00100000:0.0:1715330286.832450:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942449728 00000100:00100000:0.0:1715330286.832477:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2613 00000100:00100000:0.0:1715330286.832482:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:7135:x1798653942449728:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330286.832494:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330286.832552:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f21c0/0xd895711d66d8375 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d836e expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.832567:0:9407:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d834b lrc: 2/0,0 mode: PR/PR res: [0x240000401:0xca:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5c8 expref: 7 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.832574:0:9407:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f21c0/0xd895711d66d8375 lrc: 4/0,0 mode: --/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d836e expref: 6 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.832589:0:9407:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d834b lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xca:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5c8 expref: 7 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.832601:0:9407:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d834b lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xca:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5c8 expref: 7 pid: 7135 timeout: 361 lvb_type: 0 00000100:00100000:0.0:1715330286.832609:0:9407:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012faed880 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:9407:1798653942449792:192.168.204.49@tcp:104: 00000100:00100000:0.0:1715330286.832843:0:9407:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffc6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330286.835821:0:9407:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012faed880 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:9407:1798653942449792:192.168.204.49@tcp:104: 00010000:00010000:1.0:1715330286.835841:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f21c0/0xd895711d66d8375 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d836e expref: 6 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.835850:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xca:0x0].0x0 (ffff88006eff5700) 00010000:00010000:1.0:1715330286.835852:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330286.835855:0:9407:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f21c0/0xd895711d66d8375 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d836e expref: 6 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.835860:0:9407:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f21c0/0xd895711d66d8375 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d836e expref: 6 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.835864:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f21c0, rc 0) 00000100:00100000:1.0:1715330286.835894:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7135:x1798653942449728:12345-0@lo:101:mdt00_002.0 Request processed in 3412us (3585us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.835901:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2613 00000100:00100000:1.0:1715330286.836079:0:7135:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968372 gen 2 00000004:00080000:1.0:1715330286.836084:0:7135:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968365 committed transno 4294968372 00000020:00080000:1.0:1715330286.836088:0:7135:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88012f47e600 refcount 2 committed 0 result 0 batchid 370 00000020:00080000:1.0:1715330286.836091:0:7135:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880093b42600 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88012f47e900 00000020:00080000:1.0:1715330286.836094:0:7135:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].354 00000020:00080000:1.0:1715330286.836159:0:7135:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880093b42100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff880091f46800 00000020:00080000:1.0:1715330286.836162:0:7135:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].355 00000004:00080000:1.0:1715330286.836253:0:7135:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968367 committed transno 4294968372 00000004:00080000:1.0:1715330286.836267:0:7135:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968368 committed transno 4294968372 00000004:00080000:1.0:1715330286.836277:0:7135:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968372 committed transno 4294968372 00000100:00100000:1.0:1715330286.836289:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942449728:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330286.836302:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcfc0/0xd895711d66d836e lrc: 4/0,1 mode: --/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8375 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.836309:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcfc0/0xd895711d66d836e lrc: 4/0,1 mode: --/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8375 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330286.837067:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330286.837439:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942449856 00000100:00100000:2.0:1715330286.837442:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942449856 00000100:00100000:2.0:1715330286.837460:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1148 00000100:00100000:2.0:1715330286.837464:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:10674:x1798653942449856:12345-0@lo:105: 00010000:00010000:2.0:1715330286.837471:0:7118:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcfc0/0xd895711d66d836e lrc: 5/0,1 mode: --/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8375 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.837478:0:7118:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcfc0/0xd895711d66d836e lrc: 5/0,1 mode: --/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8375 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.837484:0:7118:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcfc0/0xd895711d66d836e lrc: 5/0,1 mode: --/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8375 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.837489:0:7118:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcfc0/0xd895711d66d836e lrc: 5/0,1 mode: EX/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d8375 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.837495:0:7118:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcfc0/0xd895711d66d836e lrc: 6/0,1 mode: EX/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d8375 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.837501:0:7118:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcfc0/0xd895711d66d836e lrc: 6/0,1 mode: EX/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d8375 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.837511:0:7118:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff880093bfcfc0) 00000100:00100000:2.0:1715330286.837533:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:10674:x1798653942449856:12345-0@lo:105: Request processed in 68us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330286.837548:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1148 00010000:00010000:1.0:1715330286.837593:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcfc0/0xd895711d66d836e lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8375 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.837600:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcfc0/0xd895711d66d836e lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8375 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330286.838467:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942449920:0@lo:403:mdt00_002.0 00000100:00100000:1.0:1715330286.838495:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.838504:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008b04cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1715330286.838574:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942449920 00000100:00100000:2.0:1715330286.838579:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942449920 00000100:00100000:2.0:1715330286.838788:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2614 00000100:00100000:2.0:1715330286.838793:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7135:x1798653942449920:12345-0@lo:403:mdt00_002.0 00000100:00100000:2.0:1715330286.840124:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7135:x1798653942449920:12345-0@lo:403:mdt00_002.0 Request processed in 1329us (1626us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330286.840131:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2614 00000100:00100000:1.0:1715330286.840295:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942449920:0@lo:403:mdt00_002.0 00000040:00080000:1.0:1715330286.841039:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].357, 952 off547232 00000040:00080000:1.0:1715330286.841158:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].356, 1032 off588464 00000004:00080000:1.0:1715330286.841162:0:7135:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88008b04cd80 with version 679 00000004:00080000:2.0:1715330286.841758:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 679 rpc_version 679 00000020:00100000:2.0:1715330286.841780:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1715330286.841786:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012fa4fb80 x1798653942450048/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1992/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1715330286.841801:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4fb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942450048:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1715330286.841841:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330286.842678:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009d7e3600 going to sleep for 11 seconds 00000100:00100000:2.0:1715330286.842789:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942450048 00000100:00100000:2.0:1715330286.842795:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942450048 00000100:00100000:2.0:1715330286.842817:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2615 00000100:00100000:2.0:1715330286.842821:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:8587:x1798653942450048:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1715330286.843016:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:8587:x1798653942450048:12345-0@lo:1000:osp_up1-0.0 Request processed in 193us (1173us total) trans 4294968373 rc 0/0 00000100:00100000:2.0:1715330286.843023:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2615 00000100:00100000:2.0:1715330286.843067:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4fb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942450048:0@lo:1000:osp_up1-0.0 00000004:00200000:0.0:1715330286.843206:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1518:0x0]: returning size 4096 00010000:00010000:0.0:1715330286.843226:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d8367 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.843233:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d8367 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0xca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.843240:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d8367 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.843245:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f1f80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330286.843248:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d8367 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.843253:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d8367 lrc: 4/0,0 mode: EX/EX res: [0x200000400:0xca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.843265:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xca:0x0].0x0 (ffff88008d5ee200) 00010000:00010000:0.0:1715330286.843267:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715330286.843271:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d8367 lrc: 2/0,0 mode: --/EX res: [0x200000400:0xca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.843275:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1f80/0xd895711d66d8367 lrc: 0/0,0 mode: --/EX res: [0x200000400:0xca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.843285:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcfc0/0xd895711d66d836e lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8375 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.843292:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcfc0/0xd895711d66d836e lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8375 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.843297:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcfc0/0xd895711d66d836e lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8375 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.843309:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1715330286.843315:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0xca:0x0] 00010000:00010000:0.0:1715330286.843319:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d8360 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1518:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.843324:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d8360 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1518:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.843328:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d8360 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1518:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.843331:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f0000 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330286.843333:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d8360 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1518:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.843337:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d8360 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1518:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.843344:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1518:0x0].0x0 (ffff88008d5ee400) 00010000:00010000:0.0:1715330286.843346:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715330286.843348:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d8360 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1518:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.843352:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d8360 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1518:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.843742:0:7123:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1715330286.843748:0:7123:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcfc0/0xd895711d66d836e lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d8375 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.843755:0:7123:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfcfc0 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:2.0:1715330286.843758:0:7123:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcfc0/0xd895711d66d836e lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d8375 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1715330286.843764:0:7123:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcfc0/0xd895711d66d836e lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d8375 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.843786:0:7123:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcfc0/0xd895711d66d836e lrc: 2/0,0 mode: --/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8375 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.843791:0:7123:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1715330286.843817:0:7123:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcfc0/0xd895711d66d836e lrc: 1/0,0 mode: --/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8375 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330286.843817:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1715330286.843822:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfcfc0/0xd895711d66d836e lrc: 0/0,0 mode: --/EX res: [0x240000401:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8375 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330286.843826:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942450112:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715330286.843835:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330286.843836:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330286.843837:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330286.843848:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.844795:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942450112:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330286.844797:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d8352 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.844804:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d8352 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.844808:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d8352 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.844813:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d8352 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.844817:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f2640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330286.844819:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d8352 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.844824:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d8352 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.844831:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88009d618c00) 00010000:00010000:0.0:1715330286.844833:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330286.844836:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d8352 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.844840:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2640/0xd895711d66d8352 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00000004:00010000:0.0:1715330286.844849:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012fa4ea00 reply state ffff88012f53b000 transno 4294983428 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d8359 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x8a4526f1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.844857:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d8359 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8a4526f1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.845013:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x8a4526f1 (ffff88008d5eed00) 00010000:00010000:0.0:1715330286.845015:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330286.845018:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1715330286.845075:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:16923:x1798653938024832:12345-192.168.204.49@tcp:36:rmdir.0 Request processed in 18458us (18624us total) trans 4294983428 rc 0/0 00000100:00100000:0.0:1715330286.845081:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23354 00000100:00100000:2.0:1715330286.861991:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330286.862019:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938025024 00000100:00100000:2.0:1715330286.862027:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938025024 00000100:00100000:2.0:1715330286.862063:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23355 00000100:00100000:2.0:1715330286.862069:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+7:16924:x1798653938025024:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:2.0:1715330286.862085:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330286.862101:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64b40/0xd895711d66d837c lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb5cf expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.862152:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66880/0xd895711d66d8383 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.862163:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66880/0xd895711d66d8383 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.862171:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66880/0xd895711d66d8383 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.862186:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db661c0/0xd895711d66d838a lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x8a4526f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.862191:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db661c0/0xd895711d66d838a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8a4526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.862196:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db661c0/0xd895711d66d838a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8a4526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.862231:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66880/0xd895711d66d8383 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.862237:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66880/0xd895711d66d8383 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.862242:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66880/0xd895711d66d8383 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.862247:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66880/0xd895711d66d8383 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.862251:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66880 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330286.862255:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66880/0xd895711d66d8383 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.862348:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66880/0xd895711d66d8383 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.862359:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88008d5ee800) 00010000:00010000:2.0:1715330286.862362:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330286.862365:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66880/0xd895711d66d8383 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.862370:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66880/0xd895711d66d8383 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.862381:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db661c0/0xd895711d66d838a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8a4526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.862389:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db661c0/0xd895711d66d838a lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8a4526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.862393:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011db661c0/0xd895711d66d838a lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8a4526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.862397:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db661c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330286.862399:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db661c0/0xd895711d66d838a lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8a4526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.862403:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db661c0/0xd895711d66d838a lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8a4526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.862408:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x8a4526f2 (ffff88009d678700) 00010000:00010000:2.0:1715330286.862410:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330286.862412:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011db661c0/0xd895711d66d838a lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x8a4526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.862416:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db661c0/0xd895711d66d838a lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x8a4526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.862442:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64b40/0xd895711d66d837c lrc: 1/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5cf expref: 8 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.862448:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64b40/0xd895711d66d837c lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5cf expref: 8 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.862454:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db64b40, rc 0) 00000100:00100000:2.0:1715330286.862503:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+7:16924:x1798653938025024:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 433us (518us total) trans 0 rc 301/301 00000100:00100000:2.0:1715330286.862510:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23355 00000100:00100000:2.0:1715330286.865665:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938025088 00000100:00100000:2.0:1715330286.865673:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938025088 00000100:00100000:2.0:1715330286.865717:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23356 00000100:00100000:2.0:1715330286.865724:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+17:16924:x1798653938025088:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:2.0:1715330286.865759:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330286.865776:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66d8391 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb5d6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.865820:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d8398 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330286.865831:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d8398 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330286.865840:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d8398 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00000004:00200000:2.0:1715330286.865876:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1715330286.865879:0:9622:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1715330286.865903:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66d8391 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5d6 expref: 19 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.865916:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d8398 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5d6 expref: 18 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.865923:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88009d678100) 00010000:00010000:2.0:1715330286.865925:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1715330286.865928:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db66ac0, rc 0) 00000100:00100000:2.0:1715330286.865962:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+18:16924:x1798653938025088:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 238us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330286.865968:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23356 00000100:00100000:0.0:1715330286.871655:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330286.871770:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938025216 00000100:00100000:2.0:1715330286.871778:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938025216 00000100:00100000:2.0:1715330286.871817:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23357 00000100:00100000:2.0:1715330286.871824:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+7:16924:x1798653938025216:12345-192.168.204.49@tcp:36:lfs.0 00010000:00010000:2.0:1715330286.871873:0:7135:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330286.871892:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc480/0xd895711d66d82e9 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5b3 expref: 7 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.871905:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88008d5ee800) 00010000:00010000:2.0:1715330286.871912:0:7135:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330286.871960:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64b40/0xd895711d66d839f lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.871970:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64b40/0xd895711d66d839f lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.871977:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64b40/0xd895711d66d839f lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.871985:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db661c0/0xd895711d66d83a6 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x8a4526f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.871990:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db661c0/0xd895711d66d83a6 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x8a4526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.871995:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db661c0/0xd895711d66d83a6 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x8a4526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000040:00080000:2.0:1715330286.872553:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].382, 2168 off579336 00000040:00080000:2.0:1715330286.872609:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].384, 2368 off634296 00000004:00080000:2.0:1715330286.872613:0:7135:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88009d7e3180 with version 730 00000100:00100000:2.0:1715330286.872831:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942450240 00000100:00100000:2.0:1715330286.872834:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942450240 00000100:00100000:2.0:1715330286.872864:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2616 00000100:00100000:2.0:1715330286.872870:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:8278:x1798653942450240:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1715330286.873086:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:8278:x1798653942450240:12345-0@lo:1000:osp_up0-1.0 Request processed in 215us (317us total) trans 4294983429 rc 0/0 00000100:00100000:2.0:1715330286.873092:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2616 00010000:00010000:2.0:1715330286.873482:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66880/0xd895711d66d83ad lrc: 3/0,1 mode: --/PW res: [0x240000402:0x189:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.873490:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66880/0xd895711d66d83ad lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x189:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.873498:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66880/0xd895711d66d83ad lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x189:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.873508:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66400/0xd895711d66d83b4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.873513:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66400/0xd895711d66d83b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.873518:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66400/0xd895711d66d83b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.873547:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d83bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.873553:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d83bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.873560:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d83bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT1 00000100:00100000:2.0:1715330286.873570:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942450304:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1715330286.873589:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330286.873810:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa180 going to sleep for 11 seconds 00000100:00100000:0.0:1715330286.874079:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942450304 00000100:00100000:0.0:1715330286.874083:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942450304 00000100:00100000:0.0:1715330286.874101:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2617 00000100:00100000:0.0:1715330286.874106:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:7135:x1798653942450304:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330286.874115:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330286.874127:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d83c2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d83bb expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.874141:0:23404:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d83c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d83bb expref: 9 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.874150:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d83c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d83bb expref: 9 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.874156:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc8:0x0].0x0 (ffff88009d618d00) 00010000:00010000:0.0:1715330286.874158:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330286.874160:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f21c0, rc 0) 00000100:00100000:0.0:1715330286.874193:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:7135:x1798653942450304:12345-0@lo:101:mdt00_002.0 Request processed in 87us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.874198:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2617 00000100:00100000:0.0:1715330286.885343:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938025344 00000100:00100000:0.0:1715330286.885352:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938025344 00000100:00100000:0.0:1715330286.885394:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23358 00000100:00100000:0.0:1715330286.885401:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+8:16925:x1798653938025344:12345-192.168.204.49@tcp:36:mkdir.0 00000100:00100000:0.0:1715330286.885530:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+8:16925:x1798653938025344:12345-192.168.204.49@tcp:36:mkdir.0 Request processed in 130us (303us total) trans 0 rc -17/-17 00000100:00100000:0.0:1715330286.885547:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23358 00000100:00100000:2.0:1715330286.896026:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330286.896099:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938025408 00000100:00100000:0.0:1715330286.896107:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938025408 00000100:00100000:0.0:1715330286.896138:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23359 00000100:00100000:0.0:1715330286.896144:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+8:16926:x1798653938025408:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:0.0:1715330286.896161:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330286.896176:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d83c9 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb5dd expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.896223:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3840/0xd895711d66d83d0 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.896233:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3840/0xd895711d66d83d0 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.896242:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3840/0xd895711d66d83d0 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.896252:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2400/0xd895711d66d83d7 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x8a4526f2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.896257:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2400/0xd895711d66d83d7 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8a4526f2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.896263:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2400/0xd895711d66d83d7 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8a4526f2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.896314:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d83de lrc: 3/1,0 mode: --/PR res: [0x240000402:0x189:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.896320:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d83de lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x189:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.896326:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d83de lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x189:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000004:00200000:0.0:1715330286.896435:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x189:0x0]: returning size 4096 00000004:00200000:0.0:1715330286.896439:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1715330286.896453:0:7135:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d83de lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x189:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.896463:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3840/0xd895711d66d83d0 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.896468:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3840/0xd895711d66d83d0 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.896472:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3840/0xd895711d66d83d0 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.896477:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3840/0xd895711d66d83d0 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.896482:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f3840 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330286.896485:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3840/0xd895711d66d83d0 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.896491:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3840/0xd895711d66d83d0 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.896500:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88009d618e00) 00010000:00010000:0.0:1715330286.896502:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330286.896506:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3840/0xd895711d66d83d0 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.896511:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3840/0xd895711d66d83d0 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.896707:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2400/0xd895711d66d83d7 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8a4526f2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.896714:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2400/0xd895711d66d83d7 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8a4526f2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.896718:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2400/0xd895711d66d83d7 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8a4526f2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.896722:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f2400 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330286.896724:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2400/0xd895711d66d83d7 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8a4526f2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.896812:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2400/0xd895711d66d83d7 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8a4526f2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.896821:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x8a4526f2 (ffff88009d678000) 00010000:00010000:0.0:1715330286.896823:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330286.896826:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2400/0xd895711d66d83d7 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x8a4526f2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.896831:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2400/0xd895711d66d83d7 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x8a4526f2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.896849:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d83c9 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5dd expref: 10 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.896862:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d83de lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x189:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5dd expref: 9 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.896872:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x189:0x0].0x0 (ffff88009d678900) 00010000:00010000:0.0:1715330286.896874:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1715330286.896876:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f3a80, rc 0) 00000100:00100000:1.0:1715330286.897228:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+9:16926:x1798653938025408:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 1082us (1208us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.897234:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23359 00000100:00100000:2.0:1715330286.899704:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330286.899769:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938025472 00000100:00100000:1.0:1715330286.899775:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938025472 00000100:00100000:1.0:1715330286.899809:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23360 00000100:00100000:1.0:1715330286.899814:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+9:16926:x1798653938025472:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:1.0:1715330286.899827:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330286.899839:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d83e5 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xc8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb5e4 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.899876:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd680/0xd895711d66d83ec lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.899885:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd680/0xd895711d66d83ec lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330286.899892:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd680/0xd895711d66d83ec lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000004:00200000:1.0:1715330286.899928:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000400:0xc8:0x0]: returning size 4096 00000004:00200000:1.0:1715330286.899932:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1715330286.899954:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d83e5 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5e4 expref: 11 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.899987:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd680/0xd895711d66d83ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5e4 expref: 10 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.899993:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc8:0x0].0x0 (ffff88009d678400) 00010000:00010000:1.0:1715330286.899996:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1715330286.899998:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfd680, rc 0) 00000100:00100000:1.0:1715330286.900031:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+10:16926:x1798653938025472:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 216us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.900036:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23360 00000100:00100000:2.0:1715330286.902425:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330286.902515:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938025536 00000100:00100000:1.0:1715330286.902520:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938025536 00000100:00100000:1.0:1715330286.902572:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23361 00000100:00100000:1.0:1715330286.902578:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+18:16926:x1798653938025536:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:1.0:1715330286.902589:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330286.902607:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66d83f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb5eb expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.902644:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66d83fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.902657:0:7135:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d83c2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d83bb expref: 8 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.902663:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66d83fa lrc: 4/1,0 mode: --/PR res: [0x200000401:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.902689:0:7135:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d83c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd895711d66d83bb expref: 8 pid: 23404 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330286.902702:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7135:1798653942450368:0@lo:104: 00000100:00100000:1.0:1715330286.902758:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.902778:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008b04c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330286.902792:0:9413:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942450368 00000100:00100000:0.0:1715330286.902797:0:9413:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942450368 00000100:00100000:0.0:1715330286.902824:0:9413:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1149 00000100:00100000:0.0:1715330286.902829:0:9413:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:7135:x1798653942450368:12345-0@lo:104: 00010000:00010000:0.0:1715330286.902838:0:9413:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d83bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d83c2 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.902873:0:9413:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1715330286.902878:0:9413:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:7135:x1798653942450368:12345-0@lo:104: Request processed in 49us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.902883:0:9413:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1149 00000100:00100000:1.0:1715330286.902887:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7135:1798653942450368:0@lo:104: 00010000:00010000:1.0:1715330286.902902:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66d83fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.902948:0:9415:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1715330286.902953:0:9415:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d83bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d83c2 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.902960:0:9415:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66f40 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:2.0:1715330286.902964:0:9415:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d83bb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd895711d66d83c2 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1715330286.902972:0:9415:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d83bb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd895711d66d83c2 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.903015:0:9415:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d83bb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d83c2 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.903020:0:9415:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1715330286.903043:0:9415:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d83bb lrc: 1/0,0 mode: --/PW res: [0x200000401:0xc8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d83c2 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.903049:0:9415:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d83bb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d83c2 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330286.903061:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942450432:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715330286.903072:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330286.903074:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330286.903076:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330286.903083:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330286.903113:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942450432 00000100:00100000:0.0:1715330286.903116:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942450432 00010000:00010000:0.0:1715330286.903127:0:7120:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d83c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd895711d66d83bb expref: 9 pid: 23404 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330286.903141:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1511 00000100:00100000:0.0:1715330286.903145:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+9:3691:x1798653942450432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330286.903152:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:1.0:1715330286.904447:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983429 is committed 00000001:00080000:1.0:1715330286.904762:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983428 is committed 00000020:00080000:1.0:1715330286.904769:0:7116:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 371 batchid updated 00000020:00080000:1.0:1715330286.904784:0:7116:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88009396c3c0 refcount 2 committed 0 result 0 batchid 372 00000020:00080000:1.0:1715330286.904788:0:7116:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008d5ee900 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88009396cc00 00000020:00080000:1.0:1715330286.904791:0:7116:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].355 00000020:00080000:1.0:1715330286.904793:0:7116:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008d5eea00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88008d40ae00 00000020:00080000:1.0:1715330286.904795:0:7116:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].356 00010000:00010000:2.0:1715330286.904846:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66d82f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8a4526f1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.904937:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66d82f7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8a4526f1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.904943:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66d82f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8a4526f1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.904947:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfc6c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330286.904950:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66d82f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8a4526f1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.904955:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66d82f7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8a4526f1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.904965:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x8a4526f1 (ffff88008d5eed00) 00010000:00010000:2.0:1715330286.904967:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330286.904969:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66d82f7 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x8a4526f1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.904974:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66d82f7 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x8a4526f1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.904983:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d82fe lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1518:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.904988:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d82fe lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1518:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.904992:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d82fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1518:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.904996:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfc240 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330286.904999:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d82fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1518:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.905004:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d82fe lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1518:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.905009:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1518:0x0].0x0 (ffff88008d5ee400) 00010000:00010000:2.0:1715330286.905011:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330286.905013:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d82fe lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1518:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.905017:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d82fe lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1518:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.905026:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66d8305 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.905030:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66d8305 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.905034:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66d8305 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.905038:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfe640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330286.905040:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66d8305 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.905045:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66d8305 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.905050:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xca:0x0].0x0 (ffff88008d5ee200) 00010000:00010000:2.0:1715330286.905052:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330286.905054:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66d8305 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.905062:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66d8305 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.905073:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d8359 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8a4526f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.905077:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d8359 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8a4526f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.905081:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d8359 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8a4526f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.905085:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f2ac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330286.905087:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d8359 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8a4526f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.905092:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d8359 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8a4526f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.905096:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x8a4526f1 (ffff88008d5eed00) 00010000:00010000:2.0:1715330286.905098:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330286.905100:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d8359 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x8a4526f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.905104:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d8359 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x8a4526f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.905194:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d83c2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd895711d66d83bb expref: 6 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.905205:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc8:0x0].0x0 (ffff88009d618d00) 00010000:00010000:0.0:1715330286.905208:0:7120:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66d83fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.905216:0:7120:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66d83fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.905222:0:7120:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66d83fa lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.905240:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330286.905255:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66d83fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.905261:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66d83fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000100:00100000:0.0:1715330286.905274:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942450432:12345-0@lo:103:ldlm_bl.0 Request processed in 2128us (2190us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.905281:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1511 00000100:00100000:1.0:1715330286.905295:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942450432:0@lo:103:ldlm_bl.0 00000004:00200000:1.0:1715330286.905325:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc8:0x0]: returning size 4096 00000004:00200000:1.0:1715330286.905328:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1715330286.905352:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66d83f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5eb expref: 16 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.905363:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66d83fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5eb expref: 15 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.905368:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc8:0x0].0x0 (ffff88009d618d00) 00010000:00010000:1.0:1715330286.905371:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1715330286.905373:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bff3c0, rc 0) 00000100:00100000:1.0:1715330286.905409:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+15:16926:x1798653938025536:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 2830us (2987us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.905414:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23361 00000004:00080000:2.0:1715330286.906026:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 680 rpc_version 680 00000020:00100000:2.0:1715330286.906045:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1715330286.906050:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012fa4d180 x1798653942450560/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1715330286.906259:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4d180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942450560:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1715330286.906291:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330286.906310:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330286.906545:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942450560 00000100:00100000:0.0:1715330286.906550:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942450560 00000100:00100000:0.0:1715330286.906581:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2618 00000100:00100000:0.0:1715330286.906586:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:8587:x1798653942450560:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330286.907054:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:8587:x1798653942450560:12345-0@lo:1000:osp_up1-0.0 Request processed in 467us (761us total) trans 4294968375 rc 0/0 00000100:00100000:0.0:1715330286.907060:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2618 00000100:00100000:2.0:1715330286.907069:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4d180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942450560:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1715330286.908630:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330286.908706:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938025664 00000100:00100000:1.0:1715330286.908712:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938025664 00000100:00100000:1.0:1715330286.908760:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23362 00000100:00100000:1.0:1715330286.908766:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+10:16926:x1798653938025664:12345-192.168.204.49@tcp:36:rmdir.0 00010000:00010000:1.0:1715330286.908900:0:7135:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330286.908918:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d83de lrc: 0/0,0 mode: --/PR res: [0x240000402:0x189:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5dd expref: 10 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.908930:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x189:0x0].0x0 (ffff88009d678900) 00010000:00010000:1.0:1715330286.908933:0:7135:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330286.908953:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d8401 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.908961:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d8401 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330286.908968:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d8401 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330286.908976:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d8408 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x8a4526f2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.908982:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d8408 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x8a4526f2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330286.908986:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d8408 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x8a4526f2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330286.909037:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc480/0xd895711d66d840f lrc: 3/0,1 mode: --/EX res: [0x240000402:0x189:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.909043:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc480/0xd895711d66d840f lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x189:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330286.909048:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc480/0xd895711d66d840f lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x189:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330286.909060:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d8416 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xc8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.909067:0:7135:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd680/0xd895711d66d83ec lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5e4 expref: 9 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.909085:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d8416 lrc: 4/0,1 mode: --/EX res: [0x240000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330286.909104:0:7135:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd680/0xd895711d66d83ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5e4 expref: 9 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.909115:0:7135:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd680/0xd895711d66d83ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5e4 expref: 9 pid: 7135 timeout: 361 lvb_type: 0 00000100:00100000:1.0:1715330286.909126:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7135:1798653942450624:192.168.204.49@tcp:104: 00000100:00100000:1.0:1715330286.909169:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008b04c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330286.913293:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7135:1798653942450624:192.168.204.49@tcp:104: 00010000:00010000:0.0:1715330286.913311:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d8416 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000100:00100000:0.0:1715330286.913754:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938025728 00000100:00100000:0.0:1715330286.913760:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938025728 00010000:00010000:0.0:1715330286.913779:0:7120:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd680/0xd895711d66d83ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5e4 expref: 10 pid: 7135 timeout: 361 lvb_type: 0 00000100:00100000:0.0:1715330286.913797:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1512 00000100:00100000:0.0:1715330286.913803:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72de1896-1df4-4b3a-930a-9116d2c66168+10:2012:x1798653938025728:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1715330286.914692:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330286.914719:0:7120:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd680/0xd895711d66d83ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5e4 expref: 10 pid: 7135 timeout: 361 lvb_type: 0 00010000:00010000:0.0:1715330286.914743:0:7120:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd680/0xd895711d66d83ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5e4 expref: 10 pid: 7135 timeout: 361 lvb_type: 0 00010000:00010000:0.0:1715330286.914759:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd680/0xd895711d66d83ec lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5e4 expref: 10 pid: 7135 timeout: 361 lvb_type: 0 00010000:00010000:0.0:1715330286.914769:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc8:0x0].0x0 (ffff88009d678400) 00010000:00010000:0.0:1715330286.915370:0:7120:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d8416 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.915379:0:7120:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d8416 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.915384:0:7120:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d8416 lrc: 4/0,1 mode: EX/EX res: [0x240000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.915400:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330286.915440:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72de1896-1df4-4b3a-930a-9116d2c66168+9:2012:x1798653938025728:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 1636us (1751us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.915446:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1512 00010000:00010000:2.0:1715330286.917002:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d8416 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.917012:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d8416 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.917049:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d841d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330286.917055:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d841d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.917064:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d841d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT1 00000100:00100000:2.0:1715330286.917079:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942450688:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1715330286.917114:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330286.917132:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330286.917187:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942450688 00000100:00100000:0.0:1715330286.917191:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942450688 00000100:00100000:0.0:1715330286.917213:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2619 00000100:00100000:0.0:1715330286.917217:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:7135:x1798653942450688:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330286.917231:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330286.917245:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d8424 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d841d expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.917264:0:9407:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66d83fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5eb expref: 14 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.917271:0:9407:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d8424 lrc: 4/0,0 mode: --/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d841d expref: 6 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.917287:0:9407:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66d83fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5eb expref: 14 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.917296:0:9407:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66d83fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5eb expref: 14 pid: 7135 timeout: 361 lvb_type: 0 00000100:00100000:0.0:1715330286.917306:0:9407:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012faee300 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:9407:1798653942450752:192.168.204.49@tcp:104: 00000100:00100000:0.0:1715330286.917333:0:9407:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffc000 going to sleep for 11 seconds 00000100:00100000:1.0:1715330286.919020:0:9407:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012faee300 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:9407:1798653942450752:192.168.204.49@tcp:104: 00010000:00010000:1.0:1715330286.919039:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d8424 lrc: 3/0,0 mode: --/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d841d expref: 6 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.919051:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc8:0x0].0x0 (ffff88009d618d00) 00010000:00010000:1.0:1715330286.919053:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330286.919056:0:9407:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d8424 lrc: 3/0,0 mode: --/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d841d expref: 6 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.919062:0:9407:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d8424 lrc: 3/0,0 mode: --/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d841d expref: 6 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.919068:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f21c0, rc 0) 00000100:00100000:1.0:1715330286.919110:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:7135:x1798653942450688:12345-0@lo:101:mdt00_002.0 Request processed in 1890us (1994us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.919116:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2619 00000100:00100000:2.0:1715330286.919133:0:7135:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983429 gen 2 00000004:00080000:2.0:1715330286.919137:0:7135:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983425 committed transno 4294983429 00000020:00080000:2.0:1715330286.919141:0:7135:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff880091ffa000 refcount 2 committed 0 result 0 batchid 380 00000020:00080000:2.0:1715330286.919145:0:7135:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009d678600 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880091ffa540 00000020:00080000:2.0:1715330286.919147:0:7135:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].383 00000020:00080000:2.0:1715330286.919149:0:7135:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009d678f00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88009396fa00 00000020:00080000:2.0:1715330286.919151:0:7135:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].381 00000004:00080000:2.0:1715330286.919168:0:7135:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983427 committed transno 4294983429 00000004:00080000:2.0:1715330286.919178:0:7135:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983429 committed transno 4294983429 00000020:00080000:0.0:1715330286.919182:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 380 committed batchid 376 00000100:00100000:2.0:1715330286.919192:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942450688:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1715330286.919201:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d841d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8424 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.919208:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d841d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8424 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000020:00080000:0.0:1715330286.919221:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 376 00000100:00100000:2.0:1715330286.920137:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330286.920261:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938025792 00000100:00100000:0.0:1715330286.920266:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938025792 00010000:00010000:0.0:1715330286.920284:0:7120:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66d83fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5eb expref: 15 pid: 7135 timeout: 361 lvb_type: 0 00000100:00100000:0.0:1715330286.920312:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1513 00000100:00100000:0.0:1715330286.920317:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72de1896-1df4-4b3a-930a-9116d2c66168+15:2012:x1798653938025792:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1715330286.920327:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330286.920331:0:7120:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66d83fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5eb expref: 15 pid: 7135 timeout: 361 lvb_type: 0 00010000:00010000:0.0:1715330286.920344:0:7120:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66d83fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5eb expref: 15 pid: 7135 timeout: 361 lvb_type: 0 00010000:00010000:0.0:1715330286.920358:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66d83fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5eb expref: 15 pid: 7135 timeout: 361 lvb_type: 0 00010000:00010000:0.0:1715330286.920367:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc8:0x0].0x0 (ffff88009d618d00) 00010000:00010000:0.0:1715330286.920371:0:7120:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d8424 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d841d expref: 5 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.920377:0:7120:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d8424 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d841d expref: 5 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.920383:0:7120:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d8424 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d841d expref: 5 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.920400:0:7120:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d8424 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d841d expref: 5 pid: 9407 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330286.920407:0:7120:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012faeea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:7120:1798653942450816:0@lo:105: 00000100:00100000:0.0:1715330286.920427:0:7120:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330286.920447:0:7120:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffc540 going to sleep for 11 seconds 00000100:00100000:1.0:1715330286.920571:0:9413:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942450816 00000100:00100000:1.0:1715330286.920575:0:9413:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942450816 00000100:00100000:1.0:1715330286.920619:0:9413:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1150 00000100:00100000:1.0:1715330286.920624:0:9413:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:7120:x1798653942450816:12345-0@lo:105: 00010000:00010000:1.0:1715330286.920631:0:9413:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d841d lrc: 5/0,1 mode: --/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8424 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.920638:0:9413:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d841d lrc: 5/0,1 mode: --/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8424 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.920644:0:9413:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d841d lrc: 5/0,1 mode: --/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8424 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.920649:0:9413:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d841d lrc: 5/0,1 mode: EX/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d8424 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.920660:0:9413:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d841d lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d8424 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.920666:0:9413:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d841d lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d8424 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.920680:0:9413:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88011db66d00) 00000100:00100000:1.0:1715330286.920702:0:9413:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:7120:x1798653942450816:12345-0@lo:105: Request processed in 78us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.920708:0:9413:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1150 00000100:00100000:0.0:1715330286.920839:0:7120:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012faeea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:7120:1798653942450816:0@lo:105: 00010000:00010000:0.0:1715330286.920847:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330286.920876:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72de1896-1df4-4b3a-930a-9116d2c66168+14:2012:x1798653938025792:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 558us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.920881:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1513 00000100:00100000:1.0:1715330286.924791:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942450880 00000100:00100000:1.0:1715330286.924798:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942450880 00000100:00100000:1.0:1715330286.924865:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2620 00000100:00100000:1.0:1715330286.924873:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:7135:x1798653942450880:12345-0@lo:403:mdt00_002.0 00000100:00100000:1.0:1715330286.926413:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:7135:x1798653942450880:12345-0@lo:403:mdt00_002.0 Request processed in 1540us (4107us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.926421:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2620 00000100:00100000:0.0:1715330286.927659:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942451008 00000100:00100000:0.0:1715330286.927664:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942451008 00000100:00100000:0.0:1715330286.927685:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2621 00000100:00100000:0.0:1715330286.927690:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:8278:x1798653942451008:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330286.927954:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:8278:x1798653942451008:12345-0@lo:1000:osp_up0-1.0 Request processed in 262us (362us total) trans 4294983430 rc 0/0 00000100:00100000:0.0:1715330286.927960:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2621 00000004:00200000:0.0:1715330286.928306:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x189:0x0]: returning size 4096 00010000:00010000:0.0:1715330286.928323:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d8416 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.928329:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d8416 lrc: 2/0,0 mode: EX/EX res: [0x240000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.928334:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d8416 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.928338:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfe1c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330286.928342:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d8416 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.928348:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d8416 lrc: 4/0,0 mode: EX/EX res: [0x240000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.928359:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc8:0x0].0x0 (ffff88009d678400) 00010000:00010000:0.0:1715330286.928361:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715330286.928364:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d8416 lrc: 2/0,0 mode: --/EX res: [0x240000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.928369:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d8416 lrc: 0/0,0 mode: --/EX res: [0x240000400:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.928379:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d841d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8424 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.928385:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d841d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8424 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.928391:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d841d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8424 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.928409:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1715330286.928415:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000401:0xc8:0x0] 00010000:00010000:0.0:1715330286.928421:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc480/0xd895711d66d840f lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x189:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.928426:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc480/0xd895711d66d840f lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x189:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.928430:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc480/0xd895711d66d840f lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x189:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.928433:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfc480 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330286.928435:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc480/0xd895711d66d840f lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x189:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.928439:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc480/0xd895711d66d840f lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x189:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.928444:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x189:0x0].0x0 (ffff88009d678900) 00010000:00010000:0.0:1715330286.928446:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715330286.928448:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc480/0xd895711d66d840f lrc: 2/0,0 mode: --/EX res: [0x240000402:0x189:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.928452:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc480/0xd895711d66d840f lrc: 0/0,0 mode: --/EX res: [0x240000402:0x189:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.928565:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d8401 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330286.928567:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715330286.928570:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d8401 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330286.928572:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d841d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d8424 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.928574:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d8401 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.928578:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d8401 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330286.928579:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66d00 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330286.928582:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d841d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d8424 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.928582:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bffa80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330286.928585:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d8401 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00000004:00010000:1.0:1715330286.928589:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d841d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d8424 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.928589:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d8401 lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.928596:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88008b091100) 00010000:00010000:0.0:1715330286.928598:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330286.928600:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d8401 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.928605:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d8401 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330286.928610:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d841d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8424 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.928615:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000004:00010000:0.0:1715330286.928616:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012fa4e300 reply state ffff88009ac9b000 transno 4294968376 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d8408 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x8a4526f2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.928624:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d8408 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x8a4526f2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.928630:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x8a4526f2 (ffff88009d678000) 00010000:00010000:0.0:1715330286.928632:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330286.928634:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1715330286.928639:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d841d lrc: 1/0,0 mode: --/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8424 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.928644:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d841d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8424 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.928657:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330286.928658:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330286.928659:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330286.928676:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+10:16926:x1798653938025664:12345-192.168.204.49@tcp:36:rmdir.0 Request processed in 19909us (20046us total) trans 4294968376 rc 0/0 00000100:00100000:0.0:1715330286.928683:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23362 00000100:00100000:0.0:1715330286.928705:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942451072 00000100:00100000:0.0:1715330286.928708:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942451072 00000100:00100000:0.0:1715330286.929724:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1299 00000100:00100000:0.0:1715330286.929755:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+7:3688:x1798653942451072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330286.929764:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330286.929777:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d8424 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d841d expref: 7 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.929786:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc8:0x0].0x0 (ffff88009d618d00) 00010000:00010000:0.0:1715330286.929792:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330286.929813:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+6:3688:x1798653942451072:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (1130us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330286.929818:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1299 00000100:00100000:2.0:1715330286.929828:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942451072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1715330286.937165:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330286.937347:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938025856 00000100:00100000:0.0:1715330286.937355:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938025856 00000100:00100000:0.0:1715330286.937386:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23363 00000100:00100000:0.0:1715330286.937393:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+14:16927:x1798653938025856:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:0.0:1715330286.937406:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330286.937421:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66d842b lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb5f2 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.937465:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d8432 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.937478:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d8432 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.937486:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d8432 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.937494:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66d8439 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x8a4526f3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.937499:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66d8439 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.937503:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66d8439 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.937546:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d8432 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.937551:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d8432 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.937556:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d8432 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.937560:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d8432 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.937565:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f1680 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330286.937568:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d8432 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.937573:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d8432 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.937582:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88009d678100) 00010000:00010000:0.0:1715330286.937585:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330286.937588:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d8432 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.937592:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d8432 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.937599:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66d8439 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.937603:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66d8439 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.937607:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66d8439 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.937610:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f18c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330286.937612:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66d8439 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.937615:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66d8439 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.937620:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x8a4526f3 (ffff88012cc48400) 00010000:00010000:0.0:1715330286.937621:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330286.937623:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66d8439 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x8a4526f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.937626:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66d8439 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x8a4526f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.937647:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66d842b lrc: 1/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5f2 expref: 15 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.937657:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66d842b lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5f2 expref: 15 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.937668:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f2880, rc 0) 00000100:00100000:0.0:1715330286.937702:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+14:16927:x1798653938025856:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 309us (543us total) trans 0 rc 301/301 00000100:00100000:0.0:1715330286.937708:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23363 00000100:00100000:1.0:1715330286.941018:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330286.941183:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938025920 00000100:00100000:2.0:1715330286.941189:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938025920 00000100:00100000:2.0:1715330286.941223:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23364 00000100:00100000:2.0:1715330286.941228:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+10:16927:x1798653938025920:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:2.0:1715330286.941241:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330286.941253:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65f80/0xd895711d66d8440 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb5f9 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.941286:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64900/0xd895711d66d8447 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330286.941295:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64900/0xd895711d66d8447 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330286.941302:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64900/0xd895711d66d8447 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT1 00000004:00200000:2.0:1715330286.941335:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000401:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1715330286.941339:0:9622:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1715330286.941359:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65f80/0xd895711d66d8440 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5f9 expref: 12 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.941371:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64900/0xd895711d66d8447 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5f9 expref: 11 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330286.941377:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88009d678200) 00010000:00010000:2.0:1715330286.941379:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1715330286.941381:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db64900, rc 0) 00000100:00100000:2.0:1715330286.941407:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+11:16927:x1798653938025920:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 178us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330286.941412:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23364 00000100:00100000:0.0:1715330286.947096:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330286.947757:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938026048 00000100:00100000:1.0:1715330286.947765:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938026048 00000100:00100000:1.0:1715330286.947807:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23365 00000100:00100000:1.0:1715330286.947814:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+14:16927:x1798653938026048:12345-192.168.204.49@tcp:36:lfs.0 00010000:00010000:1.0:1715330286.947853:0:7135:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330286.947871:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d8398 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5d6 expref: 14 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.947884:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88009d678100) 00010000:00010000:1.0:1715330286.947892:0:7135:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330286.947939:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d844e lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.947949:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d844e lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.947959:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d844e lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.947968:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d8455 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x8a4526f3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.947972:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d8455 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x8a4526f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.947977:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d8455 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x8a4526f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000040:00080000:1.0:1715330286.948545:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].358, 2168 off549400 00000040:00080000:1.0:1715330286.948608:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].358, 2368 off592192 00000004:00080000:1.0:1715330286.948612:0:7135:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88009396c840 with version 681 00000004:00080000:2.0:1715330286.948746:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 681 rpc_version 681 00000020:00100000:2.0:1715330286.948771:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1715330286.948778:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008d7f3b80 x1798653942451200/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1715330286.948795:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f3b80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942451200:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1715330286.948835:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330286.948857:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa780 going to sleep for 11 seconds 00000100:00100000:0.0:1715330286.948909:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942451200 00000100:00100000:0.0:1715330286.948913:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942451200 00000100:00100000:0.0:1715330286.949061:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2622 00000100:00100000:0.0:1715330286.949066:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:8587:x1798653942451200:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330286.949356:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:8587:x1798653942451200:12345-0@lo:1000:osp_up1-0.0 Request processed in 288us (519us total) trans 4294968377 rc 0/0 00000100:00100000:0.0:1715330286.949362:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2622 00000100:00100000:2.0:1715330286.951461:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f3b80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942451200:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1715330286.951620:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d845c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x151a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.951630:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d845c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x151a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.951639:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d845c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x151a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.951652:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d8463 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.951658:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d8463 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.951663:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d8463 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.951684:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f1b00/0xd895711d66d846a lrc: 3/0,1 mode: --/PW res: [0x240000401:0xcb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.951688:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f1b00/0xd895711d66d846a lrc: 3/0,1 mode: --/PW res: [0x240000401:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.951696:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f1b00/0xd895711d66d846a lrc: 3/0,1 mode: --/PW res: [0x240000401:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT0 00000100:00100000:0.0:1715330286.951707:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012faece00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942451264:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1715330286.951751:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330286.951772:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffca80 going to sleep for 11 seconds 00000100:00100000:0.0:1715330286.952272:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012faece00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942451264:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330286.952281:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f1b00/0xd895711d66d846a lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8471 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.952288:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f1b00/0xd895711d66d846a lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8471 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330286.952304:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012faeea00 reply state ffff88009ac9d000 transno 4294983431 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d8463 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.952311:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d8463 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.952316:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcb:0x0].0x0 (ffff88012cc48700) 00010000:00010000:0.0:1715330286.952318:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330286.952321:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1715330286.952326:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f1b00/0xd895711d66d846a lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8471 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.952332:0:7135:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f1b00/0xd895711d66d846a lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8471 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1715330286.952339:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0xcb:0x0] 00000004:00010000:0.0:1715330286.952343:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012faeea00 reply state ffff88009ac9d000 transno 4294983431 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d845c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x151a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.952347:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d845c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x151a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.952351:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151a:0x0].0x0 (ffff88012cc48500) 00010000:00010000:0.0:1715330286.952353:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330286.952354:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1715330286.952357:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x151a:0x0]: returning size 4096 00010000:00010000:0.0:1715330286.952363:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d844e lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.952366:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d844e lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.952370:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d844e lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.952374:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d844e lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.952379:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bffa80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330286.952382:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d844e lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.952387:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d844e lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.952395:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88008b091100) 00010000:00010000:0.0:1715330286.952397:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330286.952399:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d844e lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.952403:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d844e lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00000004:00010000:0.0:1715330286.952414:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012faeea00 reply state ffff88009ac9d000 transno 4294983431 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d8455 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x8a4526f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.952420:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d8455 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8a4526f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.952424:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x8a4526f3 (ffff88008b091b00) 00010000:00010000:0.0:1715330286.952426:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330286.952427:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00000100:00100000:0.0:1715330286.952484:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+15:16927:x1798653938026048:12345-192.168.204.49@tcp:36:lfs.0 Request processed in 4668us (5391us total) trans 4294983431 rc 0/0 00000100:00100000:0.0:1715330286.952490:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23365 00000100:00100000:0.0:1715330286.961847:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330286.961915:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938026176 00000100:00100000:0.0:1715330286.962023:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938026176 00000100:00100000:0.0:1715330286.963353:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23366 00000100:00100000:0.0:1715330286.963361:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+15:16928:x1798653938026176:12345-192.168.204.49@tcp:36:mkdir.0 00000100:00100000:0.0:1715330286.963503:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+15:16928:x1798653938026176:12345-192.168.204.49@tcp:36:mkdir.0 Request processed in 142us (1662us total) trans 0 rc -17/-17 00000100:00100000:0.0:1715330286.963510:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23366 00000100:00100000:0.0:1715330286.969991:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330286.970209:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938026240 00000100:00100000:1.0:1715330286.970217:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938026240 00000100:00100000:1.0:1715330286.970254:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23367 00000100:00100000:1.0:1715330286.970260:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+15:16929:x1798653938026240:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:1.0:1715330286.970274:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330286.970290:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66d8478 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb600 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.970330:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d847f lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.970339:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d847f lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.970347:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d847f lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.970356:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d8486 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x8a4526f3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.970361:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d8486 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.970365:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d8486 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.970413:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d848d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x151a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.970418:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d848d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x151a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.970422:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d848d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x151a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00200000:1.0:1715330286.970495:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x151a:0x0]: returning size 4096 00000004:00200000:1.0:1715330286.970499:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1715330286.970513:0:7135:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d848d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x151a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.970520:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d847f lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.970524:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d847f lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.970528:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d847f lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.970542:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d847f lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.970550:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfcfc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330286.970554:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d847f lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.970559:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d847f lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.970567:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88008b091500) 00010000:00010000:1.0:1715330286.970569:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330286.970572:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d847f lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.970576:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d847f lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.970584:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d8486 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.970587:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d8486 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.970591:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d8486 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.970594:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfdf80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330286.970597:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d8486 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.970601:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d8486 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.970605:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x8a4526f3 (ffff88008b091b00) 00010000:00010000:1.0:1715330286.970606:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330286.970608:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d8486 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x8a4526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.970612:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d8486 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x8a4526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330286.970627:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66d8478 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb600 expref: 17 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.970638:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d848d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x151a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb600 expref: 16 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.970643:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151a:0x0].0x0 (ffff88012cc48500) 00010000:00010000:1.0:1715330286.970645:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1715330286.970646:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfef40, rc 0) 00000100:00100000:1.0:1715330286.972196:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+16:16929:x1798653938026240:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 1934us (2206us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.972202:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23367 00000100:00100000:0.0:1715330286.975801:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330286.976152:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938026304 00000100:00100000:1.0:1715330286.976160:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938026304 00000100:00100000:1.0:1715330286.976192:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23368 00000100:00100000:1.0:1715330286.976198:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+16:16929:x1798653938026304:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:1.0:1715330286.976213:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330286.976228:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d8494 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb607 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.976268:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d849b lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:1.0:1715330286.976278:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d849b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:1.0:1715330286.976286:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d849b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00000004:00200000:1.0:1715330286.976318:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0xcb:0x0]: returning size 4096 00000004:00200000:1.0:1715330286.976322:0:9622:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1715330286.976346:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d8494 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb607 expref: 18 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.976358:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d849b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb607 expref: 17 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.976364:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcb:0x0].0x0 (ffff88012cc48700) 00010000:00010000:1.0:1715330286.976366:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1715330286.976369:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfd200, rc 0) 00000100:00100000:1.0:1715330286.976402:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+17:16929:x1798653938026304:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 204us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.976408:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23368 00000100:00100000:1.0:1715330286.983556:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330286.983615:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938026368 00000100:00100000:0.0:1715330286.983623:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938026368 00000100:00100000:0.0:1715330286.983652:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23369 00000100:00100000:0.0:1715330286.983657:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+11:16929:x1798653938026368:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:0.0:1715330286.983672:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330286.983686:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2880/0xd895711d66d84a2 lrc: 2/0,0 mode: --/CR res: [0x240000401:0xcb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb60e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.983724:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d84a9 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xcb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330286.983749:0:7135:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457eac0/0xd895711d66d8471 lrc: 2/0,0 mode: PW/PW res: [0x240000401:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d846a expref: 8 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330286.983755:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d84a9 lrc: 4/1,0 mode: --/PR res: [0x240000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330286.983776:0:7135:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88013457eac0/0xd895711d66d8471 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd895711d66d846a expref: 8 pid: 23404 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330286.983787:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012faeed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7135:1798653942451328:0@lo:104: 00000100:00100000:0.0:1715330286.983817:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330286.983839:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffca80 going to sleep for 11 seconds 00000100:00100000:2.0:1715330286.983893:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942451328 00000100:00100000:2.0:1715330286.983897:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942451328 00000100:00100000:2.0:1715330286.983928:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1151 00000100:00100000:2.0:1715330286.983932:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7135:x1798653942451328:12345-0@lo:104: 00010000:00010000:2.0:1715330286.983941:0:7118:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8800ad9f1b00/0xd895711d66d846a lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d8471 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330286.984015:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012faeed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7135:1798653942451328:0@lo:104: 00010000:00010000:0.0:1715330286.984034:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d84a9 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.984144:0:7118:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1715330286.984150:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7135:x1798653942451328:12345-0@lo:104: Request processed in 217us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330286.984156:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1151 00000100:00100000:0.0:1715330286.984851:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942451392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330286.984876:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330286.985469:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942451392 00000100:00100000:1.0:1715330286.985473:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942451392 00010000:00010000:1.0:1715330286.985489:0:7120:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013457eac0/0xd895711d66d8471 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd895711d66d846a expref: 9 pid: 23404 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330286.985512:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1514 00000100:00100000:1.0:1715330286.985517:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+9:3689:x1798653942451392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330286.985525:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:1.0:1715330286.993418:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968377 is committed 00000001:00080000:1.0:1715330286.993450:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968376 is committed 00000020:00080000:1.0:1715330286.993457:0:8267:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0001: 380 batchid updated 00000020:00080000:1.0:1715330286.993463:0:8267:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff88009d7e3780 refcount 2 committed 0 result 0 batchid 381 00000020:00080000:1.0:1715330286.993466:0:8267:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009d678300 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff88009d7e3180 00000020:00080000:1.0:1715330286.993469:0:8267:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].384 00000020:00080000:1.0:1715330286.993471:0:8267:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009d678a00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88009396fe00 00000020:00080000:1.0:1715330286.993473:0:8267:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].382 00000020:00080000:1.0:1715330286.993480:0:8267:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0001: 379 batchid updated 00000020:00080000:1.0:1715330286.993489:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 381 committed batchid 380 00080000:02000000:1.0:1715330286.993502:0:8285:0:(osd_handler.c:2105:osd_trans_start()) *** cfs_fail_loc=19a, val=0*** 00000004:00080000:1.0:1715330286.993553:0:8285:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88009396c0c0 with version 732 00000020:00080000:1.0:1715330286.993559:0:8285:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 377 cancel update log [0x200000401:0x3:0x0].380: rc = 0 00000020:00080000:1.0:1715330286.993601:0:8285:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 377 cancel update log [0x240000400:0x3:0x0].378: rc = 0 00000004:00080000:1.0:1715330286.993615:0:8285:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88009396c180 with version 733 00000020:00080000:1.0:1715330286.993617:0:8285:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 378 cancel update log [0x200000401:0x3:0x0].381: rc = 0 00000020:00080000:1.0:1715330286.993628:0:8285:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 378 cancel update log [0x240000400:0x3:0x0].379: rc = 0 00000004:00080000:1.0:1715330286.993638:0:8285:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88009396c000 with version 734 00000020:00080000:1.0:1715330286.993639:0:8285:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 379 cancel update log [0x200000401:0x3:0x0].382: rc = 0 00000020:00080000:1.0:1715330286.993648:0:8285:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 379 cancel update log [0x240000400:0x3:0x0].380: rc = 0 00000004:00080000:1.0:1715330286.993658:0:8285:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88009396c600 with version 735 00000020:00080000:1.0:1715330286.993660:0:8285:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 380 cancel update log [0x200000401:0x3:0x0].383: rc = 0 00000020:00080000:1.0:1715330286.993671:0:8285:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 380 cancel update log [0x240000400:0x3:0x0].381: rc = 0 00000020:00080000:1.0:1715330286.993676:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 381 committed batchid 380 00010000:00010000:1.0:1715330286.993727:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457eac0/0xd895711d66d8471 lrc: 0/0,0 mode: --/PW res: [0x240000401:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd895711d66d846a expref: 6 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.993754:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xcb:0x0].0x0 (ffff88009bbb0300) 00010000:00010000:1.0:1715330286.993759:0:7120:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d84a9 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330286.993766:0:7120:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d84a9 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330286.993772:0:7120:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d84a9 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330286.993787:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330286.993839:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942451392:12345-0@lo:103:ldlm_bl.0 Request processed in 8320us (8961us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.993848:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1514 00010000:00010000:1.0:1715330286.993902:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d84a9 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330286.993908:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d84a9 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000004:00200000:1.0:1715330286.993945:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000401:0xcb:0x0]: returning size 4096 00000004:00200000:1.0:1715330286.993948:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1715330286.993980:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2880/0xd895711d66d84a2 lrc: 0/0,0 mode: --/CR res: [0x240000401:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb60e expref: 11 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.993991:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d84a9 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb60e expref: 10 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330286.993996:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xcb:0x0].0x0 (ffff88009bbb0300) 00010000:00010000:1.0:1715330286.993998:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1715330286.994000:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f18c0, rc 0) 00000100:00100000:1.0:1715330286.994032:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+10:16929:x1798653938026368:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 10374us (10481us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330286.994040:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23369 00010000:00010000:2.0:1715330286.994094:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db661c0/0xd895711d66d83a6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x8a4526f2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.994101:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db661c0/0xd895711d66d83a6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x8a4526f2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.994107:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011db661c0/0xd895711d66d83a6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x8a4526f2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.994111:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db661c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330286.994115:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db661c0/0xd895711d66d83a6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x8a4526f2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.994120:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db661c0/0xd895711d66d83a6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x8a4526f2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.994128:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x8a4526f2 (ffff88009d678000) 00010000:00010000:2.0:1715330286.994130:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330286.994132:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011db661c0/0xd895711d66d83a6 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x8a4526f2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.994137:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db661c0/0xd895711d66d83a6 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x8a4526f2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.994145:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66880/0xd895711d66d83ad lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x189:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.994150:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66880/0xd895711d66d83ad lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x189:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.994154:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66880/0xd895711d66d83ad lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x189:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.994159:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66880 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330286.994160:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66880/0xd895711d66d83ad lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x189:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.994165:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66880/0xd895711d66d83ad lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x189:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.994169:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x189:0x0].0x0 (ffff88009d678900) 00010000:00010000:2.0:1715330286.994171:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330286.994172:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66880/0xd895711d66d83ad lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x189:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.994176:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66880/0xd895711d66d83ad lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x189:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.994185:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66400/0xd895711d66d83b4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.994189:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66400/0xd895711d66d83b4 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.994193:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66400/0xd895711d66d83b4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.994198:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66400 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330286.994199:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66400/0xd895711d66d83b4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.994203:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66400/0xd895711d66d83b4 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.994208:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc8:0x0].0x0 (ffff88009d678400) 00010000:00010000:2.0:1715330286.994210:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330286.994212:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66400/0xd895711d66d83b4 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.994215:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66400/0xd895711d66d83b4 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.994225:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d8408 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x8a4526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.994228:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d8408 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x8a4526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.994232:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d8408 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x8a4526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.994236:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bff600 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330286.994237:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d8408 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x8a4526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.994241:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d8408 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x8a4526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.994246:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x8a4526f2 (ffff88009d678000) 00010000:00010000:2.0:1715330286.994248:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330286.994250:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d8408 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x8a4526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330286.994254:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d8408 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x8a4526f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00000100:00100000:1.0:1715330286.994376:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942451392:0@lo:103:ldlm_bl.0 00000004:00080000:2.0:1715330286.994440:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 732 rpc_version 732 00000020:00100000:2.0:1715330286.994461:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1715330286.994467:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008d7f1f80 x1798653942451520/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1715330286.994487:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942451520:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1715330286.994516:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330286.994527:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715330286.996075:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f1f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942451520:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1715330286.996082:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 733 rpc_version 733 00000020:00100000:2.0:1715330286.996091:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1715330286.996094:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008d7f0e00 x1798653942451648/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1715330286.996105:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f0e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942451648:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1715330286.996124:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330286.996142:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715330286.996922:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f0e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942451648:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1715330286.996927:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 734 rpc_version 734 00000020:00100000:2.0:1715330286.996935:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1715330286.996940:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008d7f2680 x1798653942451776/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1715330286.996949:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f2680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942451776:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1715330286.996968:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330286.996975:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715330286.997118:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f2680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942451776:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1715330286.997123:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 735 rpc_version 735 00000020:00100000:2.0:1715330286.997131:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1715330286.997134:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008d7f0a80 x1798653942451904/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1715330286.997144:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f0a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942451904:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1715330286.997161:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330286.997169:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715330286.997319:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f0a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942451904:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1715330287.008796:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330287.009314:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938026496 00000100:00100000:0.0:1715330287.009323:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938026496 00000100:00100000:0.0:1715330287.009371:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23370 00000100:00100000:0.0:1715330287.009378:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:16929:x1798653938026496:12345-192.168.204.49@tcp:36:rmdir.0 00010000:00010000:0.0:1715330287.009420:0:7135:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330287.009440:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d848d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x151a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb600 expref: 17 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330287.009452:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151a:0x0].0x0 (ffff88012cc48500) 00010000:00010000:0.0:1715330287.009456:0:7135:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715330287.009478:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d84b0 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330287.009487:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d84b0 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330287.009495:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d84b0 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330287.009502:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1b00/0xd895711d66d84b7 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x8a4526f3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330287.009508:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1b00/0xd895711d66d84b7 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x8a4526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330287.009513:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1b00/0xd895711d66d84b7 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x8a4526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330287.009581:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66d84be lrc: 3/0,1 mode: --/EX res: [0x200000402:0x151a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330287.009587:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66d84be lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x151a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330287.009596:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66d84be lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x151a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330287.009608:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d84c5 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xcb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330287.009615:0:7135:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d849b lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb607 expref: 16 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330287.009621:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d84c5 lrc: 4/0,1 mode: --/EX res: [0x200000400:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330287.009643:0:7135:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d849b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb607 expref: 16 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330287.009653:0:7135:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d849b lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb607 expref: 16 pid: 9622 timeout: 361 lvb_type: 0 00000100:00100000:0.0:1715330287.009664:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012faeed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7135:1798653942451968:192.168.204.49@tcp:104: 00000100:00100000:0.0:1715330287.009704:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffca80 going to sleep for 11 seconds 00000100:00080000:1.0:1715330287.009751:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330257 00000100:00100000:2.0:1715330287.017163:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012faeed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7135:1798653942451968:192.168.204.49@tcp:104: 00010000:00010000:2.0:1715330287.017185:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d84c5 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000100:00100000:2.0:1715330287.024846:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330287.025313:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938026560 00000100:00100000:0.0:1715330287.025323:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938026560 00010000:00010000:0.0:1715330287.025692:0:7120:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d849b lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb607 expref: 17 pid: 9622 timeout: 361 lvb_type: 0 00000100:00100000:0.0:1715330287.025726:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1515 00000100:00100000:0.0:1715330287.025752:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72de1896-1df4-4b3a-930a-9116d2c66168+17:2011:x1798653938026560:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1715330287.025764:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330287.025770:0:7120:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d849b lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb607 expref: 17 pid: 9622 timeout: 361 lvb_type: 0 00010000:00010000:0.0:1715330287.025782:0:7120:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d849b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb607 expref: 17 pid: 9622 timeout: 361 lvb_type: 0 00010000:00010000:0.0:1715330287.025802:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d849b lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb607 expref: 17 pid: 9622 timeout: 361 lvb_type: 0 00010000:00010000:0.0:1715330287.025814:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcb:0x0].0x0 (ffff88012cc48700) 00010000:00010000:0.0:1715330287.025818:0:7120:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d84c5 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330287.025826:0:7120:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d84c5 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330287.025832:0:7120:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d84c5 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330287.025848:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330287.025887:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72de1896-1df4-4b3a-930a-9116d2c66168+16:2011:x1798653938026560:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 154us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330287.025893:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1515 00010000:00010000:2.0:1715330287.026098:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d84c5 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330287.026105:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d84c5 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330287.026138:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66400/0xd895711d66d84cc lrc: 3/0,1 mode: --/EX res: [0x240000401:0xcb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330287.026144:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66400/0xd895711d66d84cc lrc: 3/0,1 mode: --/EX res: [0x240000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330287.026152:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66400/0xd895711d66d84cc lrc: 3/0,1 mode: --/EX res: [0x240000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT0 00000100:00100000:2.0:1715330287.026168:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942452032:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1715330287.026199:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330287.026213:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715330287.026225:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942452032 00000100:00100000:2.0:1715330287.026227:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942452032 00000100:00100000:2.0:1715330287.026246:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2628 00000100:00100000:2.0:1715330287.026250:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:7135:x1798653942452032:12345-0@lo:101:mdt00_002.0 00010000:00010000:2.0:1715330287.026262:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330287.026273:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66880/0xd895711d66d84d3 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xcb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d84cc expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330287.026290:0:9407:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d84a9 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb60e expref: 7 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330287.026297:0:9407:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66880/0xd895711d66d84d3 lrc: 4/0,0 mode: --/EX res: [0x240000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d84cc expref: 6 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330287.026313:0:9407:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d84a9 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb60e expref: 7 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330287.026322:0:9407:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d84a9 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb60e expref: 7 pid: 7135 timeout: 361 lvb_type: 0 00000100:00100000:2.0:1715330287.026331:0:9407:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:9407:1798653942452096:192.168.204.49@tcp:104: 00000100:00100000:2.0:1715330287.026353:0:9407:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffaa80 going to sleep for 11 seconds 00000100:00100000:0.0:1715330287.035473:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330287.035592:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938026624 00000100:00100000:2.0:1715330287.035598:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938026624 00010000:00010000:2.0:1715330287.035634:0:10674:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d84a9 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb60e expref: 8 pid: 7135 timeout: 361 lvb_type: 0 00000100:00100000:2.0:1715330287.035651:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1516 00000100:00100000:2.0:1715330287.035657:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:72de1896-1df4-4b3a-930a-9116d2c66168+8:2012:x1798653938026624:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1715330287.035666:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330287.035670:0:10674:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d84a9 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb60e expref: 8 pid: 7135 timeout: 361 lvb_type: 0 00010000:00010000:2.0:1715330287.035682:0:10674:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d84a9 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb60e expref: 8 pid: 7135 timeout: 361 lvb_type: 0 00010000:00010000:2.0:1715330287.035698:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f18c0/0xd895711d66d84a9 lrc: 0/0,0 mode: --/PR res: [0x240000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb60e expref: 8 pid: 7135 timeout: 361 lvb_type: 0 00010000:00010000:2.0:1715330287.035707:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xcb:0x0].0x0 (ffff88009bbb0300) 00010000:00010000:2.0:1715330287.035711:0:10674:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66880/0xd895711d66d84d3 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d84cc expref: 5 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330287.035717:0:10674:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66880/0xd895711d66d84d3 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d84cc expref: 5 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330287.035724:0:10674:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66880/0xd895711d66d84d3 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d84cc expref: 5 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330287.035760:0:10674:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66880/0xd895711d66d84d3 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d84cc expref: 5 pid: 9407 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330287.035771:0:10674:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001_UUID:10674:1798653942452160:0@lo:105: 00000100:00100000:2.0:1715330287.035797:0:10674:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330287.035809:0:10674:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa900 going to sleep for 11 seconds 00000100:00100000:2.0:1715330287.035821:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942452160 00000100:00100000:2.0:1715330287.035824:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942452160 00000100:00100000:2.0:1715330287.035842:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1152 00000100:00100000:2.0:1715330287.035845:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:10674:x1798653942452160:12345-0@lo:105: 00000100:00080000:1.0:1715330287.035883:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001-osp-MDT0000 older than 1715330257 00000100:00080000:1.0:1715330287.035886:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330257 00010000:00010000:2.0:1715330287.036087:0:7118:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66400/0xd895711d66d84cc lrc: 5/0,1 mode: --/EX res: [0x240000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d84d3 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330287.036094:0:7118:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66400/0xd895711d66d84cc lrc: 5/0,1 mode: --/EX res: [0x240000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d84d3 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330287.036101:0:7118:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66400/0xd895711d66d84cc lrc: 5/0,1 mode: --/EX res: [0x240000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d84d3 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330287.036106:0:7118:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66400/0xd895711d66d84cc lrc: 5/0,1 mode: EX/EX res: [0x240000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d84d3 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330287.036110:0:7118:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66400/0xd895711d66d84cc lrc: 6/0,1 mode: EX/EX res: [0x240000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d84d3 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330287.036115:0:7118:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66400/0xd895711d66d84cc lrc: 6/0,1 mode: EX/EX res: [0x240000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d84d3 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330287.036135:0:7118:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88011db66400) 00010000:00010000:0.0:1715330287.036154:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66400/0xd895711d66d84cc lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d84d3 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330287.036157:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:10674:x1798653942452160:12345-0@lo:105: Request processed in 311us (361us total) trans 0 rc 0/0 00010000:00010000:0.0:1715330287.036160:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66400/0xd895711d66d84cc lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d84d3 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330287.036163:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1152 00000100:00100000:2.0:1715330287.036180:0:10674:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001_UUID:10674:1798653942452160:0@lo:105: 00010000:00010000:2.0:1715330287.036186:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330287.036209:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:72de1896-1df4-4b3a-930a-9116d2c66168+7:2012:x1798653938026624:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 551us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330287.036214:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1516 00000100:00100000:0.0:1715330287.036743:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012faec000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942452224:0@lo:403:mdt00_002.0 00000100:00100000:0.0:1715330287.036773:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330287.036783:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffcf00 going to sleep for 11 seconds 00000100:00100000:0.0:1715330287.039648:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012faec000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942452224:0@lo:403:mdt00_002.0 00000040:00080000:0.0:1715330287.040599:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].359, 664 off550064 00000040:00080000:0.0:1715330287.040721:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].359, 744 off592936 00000004:00080000:0.0:1715330287.040725:0:7135:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880091ffcf00 with version 682 00000004:00200000:0.0:1715330287.042613:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x151a:0x0]: returning size 4096 00010000:00010000:0.0:1715330287.042630:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d84c5 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330287.042637:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d84c5 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330287.042643:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d84c5 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330287.042648:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f21c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330287.042652:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d84c5 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330287.042658:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d84c5 lrc: 4/0,0 mode: EX/EX res: [0x200000400:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330287.042669:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcb:0x0].0x0 (ffff88012cc48700) 00010000:00010000:0.0:1715330287.042672:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715330287.042675:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d84c5 lrc: 2/0,0 mode: --/EX res: [0x200000400:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330287.042680:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d84c5 lrc: 0/0,0 mode: --/EX res: [0x200000400:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330287.042690:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66400/0xd895711d66d84cc lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d84d3 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330287.042700:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66400/0xd895711d66d84cc lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d84d3 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330287.042706:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66400/0xd895711d66d84cc lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d84d3 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330287.042717:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1715330287.042723:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0xcb:0x0] 00010000:00010000:0.0:1715330287.042728:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66d84be lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x151a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330287.042750:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66d84be lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x151a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330287.042754:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66d84be lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x151a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330287.042757:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f2880 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330287.042760:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66d84be lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x151a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330287.042764:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66d84be lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x151a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330287.042771:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151a:0x0].0x0 (ffff88012cc48500) 00010000:00010000:0.0:1715330287.042772:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715330287.042775:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66d84be lrc: 2/0,0 mode: --/EX res: [0x200000402:0x151a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330287.042779:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66d84be lrc: 0/0,0 mode: --/EX res: [0x200000402:0x151a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330287.043184:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d84b0 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330287.043191:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d84b0 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330287.043195:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d84b0 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330287.043199:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d84b0 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330287.043203:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f1680 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330287.043206:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d84b0 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330287.043210:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d84b0 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330287.043217:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88012cc48f00) 00010000:00010000:0.0:1715330287.043219:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330287.043222:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d84b0 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330287.043226:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d84b0 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00000004:00010000:0.0:1715330287.043239:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008d7f2a00 reply state ffff88012f538000 transno 4294983436 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1b00/0xd895711d66d84b7 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x8a4526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330287.043248:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1b00/0xd895711d66d84b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8a4526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330287.043254:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x8a4526f3 (ffff88008b091b00) 00010000:00010000:0.0:1715330287.043256:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330287.043258:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1715330287.043303:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:16929:x1798653938026496:12345-192.168.204.49@tcp:36:rmdir.0 Request processed in 33923us (34511us total) trans 4294983436 rc 0/0 00000100:00100000:0.0:1715330287.043310:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23370 00000100:00100000:1.0:1715330287.043965:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1715330287.043974:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942452416:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330287.044000:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330287.044326:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942452416:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715330287.144923:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330287.933792:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330287.933862:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938026752 00000100:00100000:1.0:1715330287.933871:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938026752 00000100:00100000:1.0:1715330287.937615:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23371 00000100:00100000:1.0:1715330287.937628:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+7:16949:x1798653938026752:12345-192.168.204.49@tcp:36:mkdir.0 00010000:00010000:1.0:1715330287.937678:0:7135:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330287.937701:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64900/0xd895711d66d8447 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb5f9 expref: 7 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330287.937717:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88009d678200) 00010000:00010000:1.0:1715330287.937725:0:7135:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330287.937794:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d84da lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330287.937805:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d84da lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330287.937812:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d84da lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330287.937826:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d84e1 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x77656e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330287.937831:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d84e1 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x77656e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330287.937836:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d84e1 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x77656e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330287.938179:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d84e8 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330287.938186:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d84e8 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330287.938192:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d84e8 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000004:00010000:1.0:1715330287.938204:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012faec000 reply state ffff88009aea2000 transno 4294968379 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d84e8 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330287.938211:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d84e8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330287.938216:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18b:0x0].0x0 (ffff88009bbf0f00) 00010000:00010000:1.0:1715330287.938218:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330287.938220:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1715330287.938224:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x18b:0x0]: returning size 4096 00010000:00010000:1.0:1715330287.938230:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d84da lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330287.938235:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d84da lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330287.938243:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d84da lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330287.938248:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d84da lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330287.938253:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfdb00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330287.938256:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d84da lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330287.938262:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d84da lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330287.938268:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88009bbf0800) 00010000:00010000:1.0:1715330287.938270:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330287.938273:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d84da lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330287.938277:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d84da lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00000004:00010000:1.0:1715330287.938289:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012faec000 reply state ffff88009aea2000 transno 4294968379 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d84e1 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x77656e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330287.938295:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d84e1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x77656e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330287.938300:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x77656e (ffff88009bbf0b00) 00010000:00010000:1.0:1715330287.938301:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330287.938303:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1715330287.938367:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+8:16949:x1798653938026752:12345-192.168.204.49@tcp:36:mkdir.0 Request processed in 742us (4579us total) trans 4294968379 rc 0/0 00000100:00100000:1.0:1715330287.938374:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23371 00000100:00100000:0.0:1715330287.952287:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938026816 00000100:00100000:0.0:1715330287.952295:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938026816 00000100:00100000:0.0:1715330287.952964:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23372 00000100:00100000:0.0:1715330287.952972:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+8:16950:x1798653938026816:12345-192.168.204.49@tcp:101:rmdir.0 00010000:00010000:0.0:1715330287.952991:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330287.953008:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d84ef lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb615 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330287.953059:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d84f6 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330287.953070:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d84f6 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330287.953079:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d84f6 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330287.953087:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d84fd lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x77656e bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330287.953093:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d84fd lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x77656e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330287.953098:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d84fd lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x77656e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330287.953160:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2400/0xd895711d66d8504 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330287.953166:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2400/0xd895711d66d8504 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330287.953172:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2400/0xd895711d66d8504 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT1 00000004:00200000:0.0:1715330287.953203:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x18b:0x0]: returning size 4096 00000004:00200000:0.0:1715330287.953206:0:9622:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1715330287.953222:0:9622:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2400/0xd895711d66d8504 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330287.953231:0:9622:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d84f6 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330287.953236:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d84f6 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330287.953241:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d84f6 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330287.953246:0:9622:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d84f6 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330287.953251:0:9622:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f2ac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330287.953254:0:9622:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d84f6 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330287.953260:0:9622:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d84f6 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330287.953269:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88012ca48d00) 00010000:00010000:0.0:1715330287.953272:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330287.953275:0:9622:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d84f6 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330287.953280:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d84f6 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330287.953289:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d84fd lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x77656e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330287.953294:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d84fd lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x77656e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330287.953298:0:9622:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d84fd lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x77656e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330287.953302:0:9622:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f3cc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330287.953304:0:9622:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d84fd lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x77656e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330287.953308:0:9622:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d84fd lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x77656e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330287.953313:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x77656e (ffff88009bbf0b00) 00010000:00010000:0.0:1715330287.953315:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330287.953317:0:9622:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d84fd lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x77656e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330287.953321:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d84fd lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x77656e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330287.953338:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3a80/0xd895711d66d84ef lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb615 expref: 10 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330287.953350:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2400/0xd895711d66d8504 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb615 expref: 9 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330287.953356:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18b:0x0].0x0 (ffff88009bbf0f00) 00010000:00010000:0.0:1715330287.953358:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1715330287.953360:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f2400, rc 0) 00000100:00100000:0.0:1715330287.953400:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+9:16950:x1798653938026816:12345-192.168.204.49@tcp:101:rmdir.0 Request processed in 428us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330287.953406:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23372 00000100:00100000:0.0:1715330287.957234:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330287.957383:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938026944 00000100:00100000:1.0:1715330287.957392:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938026944 00000100:00100000:1.0:1715330287.957648:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23373 00000100:00100000:1.0:1715330287.957656:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+9:16950:x1798653938026944:12345-192.168.204.49@tcp:36:rmdir.0 00010000:00010000:1.0:1715330287.957697:0:7135:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330287.957717:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2400/0xd895711d66d8504 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb615 expref: 9 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330287.957748:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18b:0x0].0x0 (ffff88009bbf0f00) 00010000:00010000:1.0:1715330287.957752:0:7135:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330287.957775:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd440/0xd895711d66d850b lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330287.957785:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd440/0xd895711d66d850b lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330287.957793:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd440/0xd895711d66d850b lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330287.957801:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d8512 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x77656e bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330287.957807:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d8512 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x77656e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330287.957812:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d8512 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x77656e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330287.959785:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d8519 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330287.959797:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d8519 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330287.959808:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d8519 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000004:00200000:1.0:1715330287.959980:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x18b:0x0]: returning size 4096 00010000:00010000:1.0:1715330287.959992:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d8519 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330287.959997:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d8519 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330287.960002:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d8519 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330287.960006:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bff180 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330287.960009:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d8519 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330287.960014:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d8519 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330287.960022:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18b:0x0].0x0 (ffff88009bbf0f00) 00010000:00010000:1.0:1715330287.960024:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330287.960026:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d8519 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330287.960031:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d8519 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x18b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330287.960053:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd440/0xd895711d66d850b lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330287.960057:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd440/0xd895711d66d850b lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330287.960064:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd440/0xd895711d66d850b lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330287.960068:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd440/0xd895711d66d850b lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330287.960071:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfd440 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330287.960073:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd440/0xd895711d66d850b lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330287.960076:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd440/0xd895711d66d850b lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330287.960081:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88009bbf0a00) 00010000:00010000:1.0:1715330287.960082:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330287.960084:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd440/0xd895711d66d850b lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330287.960087:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd440/0xd895711d66d850b lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00000004:00010000:1.0:1715330287.960095:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012faee300 reply state ffff88009aea0000 transno 4294968380 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d8512 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x77656e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330287.960101:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d8512 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x77656e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330287.960105:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x77656e (ffff88009bbf0b00) 00010000:00010000:1.0:1715330287.960107:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330287.960109:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1715330287.960193:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+10:16950:x1798653938026944:12345-192.168.204.49@tcp:36:rmdir.0 Request processed in 2534us (2962us total) trans 4294968380 rc 0/0 00000100:00100000:1.0:1715330287.960200:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23373 00000100:00100000:0.0:1715330287.971094:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1715330287.971111:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012faef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942452480:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1715330287.971166:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330287.971197:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942452480 00000100:00100000:0.0:1715330287.971203:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942452480 00000100:00100000:0.0:1715330287.971691:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631 00000100:00100000:0.0:1715330287.971698:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3690:x1798653942452480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1715330287.971727:0:23404:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443954688 avail 1314492416 00000100:00100000:0.0:1715330287.972085:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3690:x1798653942452480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 386us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330287.972091:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631 00000100:00100000:1.0:1715330287.972251:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012faef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942452480:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1715330288.147706:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330288.449163:0:26632:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d8520 lrc: 3/0,1 mode: --/CW res: [0x200000002:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 26632 initiator: MDT0 00010000:00010000:0.0:1715330288.449176:0:26632:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d8520 lrc: 3/0,1 mode: CW/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26632 initiator: MDT0 00010000:00010000:0.0:1715330288.449186:0:26632:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d8520 lrc: 3/0,1 mode: CW/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 26632 initiator: MDT0 00010000:00010000:0.0:1715330288.449195:0:26632:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d8527 lrc: 3/0,1 mode: --/PW res: [0x200000002:0x3:0x0].0x3084747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 26632 initiator: MDT0 00010000:00010000:0.0:1715330288.449201:0:26632:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d8527 lrc: 3/0,1 mode: PW/PW res: [0x200000002:0x3:0x0].0x3084747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26632 initiator: MDT0 00010000:00010000:0.0:1715330288.449206:0:26632:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d8527 lrc: 3/0,1 mode: PW/PW res: [0x200000002:0x3:0x0].0x3084747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 26632 initiator: MDT0 00010000:00010000:0.0:1715330288.449457:0:26632:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d8527 lrc: 3/0,1 mode: PW/PW res: [0x200000002:0x3:0x0].0x3084747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26632 initiator: MDT0 00010000:00010000:0.0:1715330288.449464:0:26632:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d8527 lrc: 2/0,0 mode: PW/PW res: [0x200000002:0x3:0x0].0x3084747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 26632 initiator: MDT0 00010000:00010000:0.0:1715330288.449469:0:26632:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d8527 lrc: 3/0,0 mode: PW/PW res: [0x200000002:0x3:0x0].0x3084747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 26632 initiator: MDT0 00010000:00010000:0.0:1715330288.449474:0:26632:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f3840 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330288.449477:0:26632:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d8527 lrc: 3/0,0 mode: PW/PW res: [0x200000002:0x3:0x0].0x3084747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 26632 initiator: MDT0 00010000:00010000:0.0:1715330288.449483:0:26632:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d8527 lrc: 4/0,0 mode: PW/PW res: [0x200000002:0x3:0x0].0x3084747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 26632 initiator: MDT0 00010000:00010000:0.0:1715330288.449492:0:26632:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x3:0x0].0x3084747d (ffff88012ca48800) 00010000:00010000:0.0:1715330288.449495:0:26632:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330288.449498:0:26632:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d8527 lrc: 2/0,0 mode: --/PW res: [0x200000002:0x3:0x0].0x3084747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 26632 initiator: MDT0 00010000:00010000:0.0:1715330288.449503:0:26632:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d8527 lrc: 0/0,0 mode: --/PW res: [0x200000002:0x3:0x0].0x3084747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 26632 initiator: MDT0 00010000:00010000:0.0:1715330288.449527:0:26632:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d8520 lrc: 3/0,1 mode: CW/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26632 initiator: MDT0 00010000:00010000:0.0:1715330288.449535:0:26632:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d8520 lrc: 2/0,0 mode: CW/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 26632 initiator: MDT0 00010000:00010000:0.0:1715330288.449540:0:26632:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d8520 lrc: 3/0,0 mode: CW/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 26632 initiator: MDT0 00010000:00010000:0.0:1715330288.449543:0:26632:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f2400 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330288.449545:0:26632:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d8520 lrc: 3/0,0 mode: CW/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 26632 initiator: MDT0 00010000:00010000:0.0:1715330288.449549:0:26632:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d8520 lrc: 4/0,0 mode: CW/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 26632 initiator: MDT0 00010000:00010000:0.0:1715330288.449555:0:26632:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x3:0x0].0x0 (ffff88012ca48900) 00010000:00010000:0.0:1715330288.449556:0:26632:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330288.449559:0:26632:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d8520 lrc: 2/0,0 mode: --/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 26632 initiator: MDT0 00010000:00010000:0.0:1715330288.449562:0:26632:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d8520 lrc: 0/0,0 mode: --/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 26632 initiator: MDT0 00100000:10000000:2.0:1715330288.452001:0:26634:0:(lfsck_engine.c:1602:lfsck_assistant_engine()) lustre-MDT0000-osd: lfsck_namespace LFSCK assistant thread start 00100000:10000000:0.0:1715330288.452048:0:26632:0:(lfsck_namespace.c:4589:lfsck_namespace_prep()) lustre-MDT0000-osd: namespace LFSCK prep done, start pos [1, [0x0:0x0:0x0], 0x0]: rc = 0 00100000:10000000:0.0:1715330288.452535:0:26632:0:(lfsck_namespace.c:4487:lfsck_namespace_checkpoint()) lustre-MDT0000-osd: namespace LFSCK checkpoint at the pos [78, [0x0:0x0:0x0], 0x0], status = 1: rc = 0 00100000:10000000:0.0:1715330288.452539:0:26632:0:(lfsck_engine.c:1079:lfsck_master_engine()) LFSCK entry: oit_flags = 0x40000, dir_flags = 0x8006, oit_cookie = 78, dir_cookie = 0x0, parent = [0x0:0x0:0x0], pid = 26632 00000100:00100000:2.0:1715330288.452623:0:26631:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job lctl:lustre-MDT0000-mdtlov_UUID:26631:1798653942452544:0@lo:1101:lctl.0 00000100:00100000:2.0:1715330288.452677:0:26631:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330288.452692:0:26631:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa780 going to sleep for 11 seconds 00000100:00100000:0.0:1715330288.452759:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942452544 00000100:00100000:0.0:1715330288.452766:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942452544 00000100:00100000:0.0:1715330288.452806:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632 00000100:00100000:0.0:1715330288.452813:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:26631:x1798653942452544:12345-0@lo:1101:lctl.0 00000100:00100000:0.0:1715330288.455292:0:26635:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012faedf80 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0000-lwp-MDT0001_UUID:26635:1798653942452608:0@lo:900:lfsck.0 00000100:00100000:0.0:1715330288.455331:0:26635:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330288.455353:0:26635:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffcd80 going to sleep for 11 seconds 00000100:00100000:1.0:1715330288.455492:0:10806:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942452608 00000100:00100000:1.0:1715330288.455498:0:10806:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942452608 00000100:00100000:1.0:1715330288.455532:0:10806:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1715330288.455537:0:10806:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:lustre-MDT0000-lwp-MDT0001_UUID+5:26635:x1798653942452608:12345-0@lo:900:lfsck.0 00000100:00100000:1.0:1715330288.455577:0:10806:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:lustre-MDT0000-lwp-MDT0001_UUID+5:26635:x1798653942452608:12345-0@lo:900:lfsck.0 Request processed in 40us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330288.455583:0:10806:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1715330288.455679:0:26635:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012faedf80 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0000-lwp-MDT0001_UUID:26635:1798653942452608:0@lo:900:lfsck.0 00000100:00100000:0.0:1715330288.455716:0:26635:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012faedf80 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:26635:1798653942452672:0@lo:1000:lfsck.0 00000100:00100000:0.0:1715330288.455764:0:26635:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330288.455859:0:26635:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffc3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715330288.455894:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942452672 00000100:00100000:2.0:1715330288.455898:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942452672 00000100:00100000:2.0:1715330288.455922:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2633 00000100:00100000:2.0:1715330288.455927:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:26635:x1798653942452672:12345-0@lo:1000:lfsck.0 00000100:00100000:2.0:1715330288.455967:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:26635:x1798653942452672:12345-0@lo:1000:lfsck.0 Request processed in 40us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330288.455972:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2633 00000100:00100000:0.0:1715330288.456094:0:26635:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012faedf80 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:26635:1798653942452672:0@lo:1000:lfsck.0 00000100:00100000:0.0:1715330288.456124:0:26635:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012faedf80 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:26635:1798653942452736:0@lo:1000:lfsck.0 00000100:00100000:0.0:1715330288.456139:0:26635:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330288.456296:0:26635:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffc3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330288.456520:0:26635:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012faedf80 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:26635:1798653942452736:0@lo:1000:lfsck.0 00010000:00010000:0.0:1715330288.456553:0:26635:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2640/0xd895711d66d852e lrc: 3/0,1 mode: --/CW res: [0x200000002:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 26635 initiator: MDT0 00010000:00010000:0.0:1715330288.456561:0:26635:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2640/0xd895711d66d852e lrc: 3/0,1 mode: --/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 26635 initiator: MDT1 00010000:00010000:0.0:1715330288.456569:0:26635:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2640/0xd895711d66d852e lrc: 3/0,1 mode: --/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 26635 initiator: MDT1 00000100:00100000:0.0:1715330288.456577:0:26635:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012faedf80 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:26635:1798653942452800:0@lo:101:lfsck.0 00000100:00100000:0.0:1715330288.456595:0:26635:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330288.456603:0:26635:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffcd80 going to sleep for 11 seconds 00000100:00100000:2.0:1715330288.456634:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942452800 00000100:00100000:2.0:1715330288.456637:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942452800 00000100:00100000:2.0:1715330288.456650:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2635 00000100:00100000:2.0:1715330288.456654:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:26635:x1798653942452800:12345-0@lo:101:lfsck.0 00010000:00010000:2.0:1715330288.456661:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330288.456672:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66880/0xd895711d66d8535 lrc: 2/0,0 mode: --/CW res: [0x200000002:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d852e expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330288.456690:0:23404:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66880/0xd895711d66d8535 lrc: 3/0,0 mode: CW/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d852e expref: 11 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330288.456700:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66880/0xd895711d66d8535 lrc: 3/0,0 mode: CW/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d852e expref: 11 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330288.456707:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x3:0x0].0x0 (ffff88009d678200) 00010000:00010000:2.0:1715330288.456709:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330288.456712:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db66880, rc 0) 00000100:00100000:2.0:1715330288.456753:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:26635:x1798653942452800:12345-0@lo:101:lfsck.0 Request processed in 98us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330288.456761:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2635 00000100:00100000:1.0:1715330288.456804:0:26635:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012faedf80 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:26635:1798653942452800:0@lo:101:lfsck.0 00010000:00010000:1.0:1715330288.456814:0:26635:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2640/0xd895711d66d852e lrc: 4/0,1 mode: CW/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8535 expref: -99 pid: 26635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330288.456821:0:26635:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2640/0xd895711d66d852e lrc: 4/0,1 mode: CW/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8535 expref: -99 pid: 26635 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330288.456832:0:26635:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000002:0x3:0x0] 00010000:00010000:1.0:1715330288.456844:0:26635:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc000/0xd895711d66d853c lrc: 3/0,1 mode: --/PW res: [0x200000002:0x3:0x0].0x3085747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 26635 initiator: MDT0 00010000:00010000:1.0:1715330288.456850:0:26635:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc000/0xd895711d66d853c lrc: 3/0,1 mode: --/PW res: [0x200000002:0x3:0x0].0x3085747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 26635 initiator: MDT1 00010000:00010000:1.0:1715330288.456855:0:26635:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc000/0xd895711d66d853c lrc: 3/0,1 mode: --/PW res: [0x200000002:0x3:0x0].0x3085747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 26635 initiator: MDT1 00000100:00100000:1.0:1715330288.456864:0:26635:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:26635:1798653942452864:0@lo:101:lfsck.0 00000100:00100000:1.0:1715330288.456880:0:26635:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.456887:0:26635:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1715330288.457311:0:26635:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:26635:1798653942452864:0@lo:101:lfsck.0 00010000:00010000:1.0:1715330288.457320:0:26635:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc000/0xd895711d66d853c lrc: 4/0,1 mode: PW/PW res: [0x200000002:0x3:0x0].0x3085747d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8543 expref: -99 pid: 26635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330288.457326:0:26635:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc000/0xd895711d66d853c lrc: 4/0,1 mode: PW/PW res: [0x200000002:0x3:0x0].0x3085747d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8543 expref: -99 pid: 26635 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330288.457335:0:26635:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000002:0x3:0x0] 00000100:00100000:1.0:1715330288.457349:0:26635:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:26635:1798653942452928:0@lo:1000:lfsck.0 00000100:00100000:1.0:1715330288.457366:0:26635:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.457373:0:26635:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f540 going to sleep for 11 seconds 00000100:00100000:2.0:1715330288.457404:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942452928 00000100:00100000:2.0:1715330288.457407:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942452928 00000100:00100000:2.0:1715330288.457449:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2637 00000100:00100000:2.0:1715330288.457453:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:26635:x1798653942452928:12345-0@lo:1000:lfsck.0 00000100:00100000:2.0:1715330288.457503:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:26635:x1798653942452928:12345-0@lo:1000:lfsck.0 Request processed in 50us (136us total) trans 0 rc -2/-2 00000100:00100000:2.0:1715330288.457516:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2637 00000100:00100000:1.0:1715330288.457606:0:26635:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:26635:1798653942452928:0@lo:1000:lfsck.0 00000004:00080000:1.0:1715330288.457892:0:26635:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88012f49f540 with version 0 00000020:00100000:1.0:1715330288.457904:0:26635:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1715330288.457909:0:26635:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012b55ea00 x1798653942453056/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 400/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1715330288.457920:0:26635:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:26635:1798653942453056:0@lo:1000:lfsck.0 00000100:00100000:1.0:1715330288.457937:0:26635:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.457958:0:26635:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f840 going to sleep for 11 seconds 00000100:00100000:0.0:1715330288.458455:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942453056 00000100:00100000:0.0:1715330288.458459:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942453056 00000100:00100000:0.0:1715330288.458475:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2638 00000100:00100000:0.0:1715330288.458479:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:26635:x1798653942453056:12345-0@lo:1000:lfsck.0 00000001:00080000:0.0:1715330288.461172:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983437 is committed 00000001:00080000:0.0:1715330288.461235:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983436 is committed 00000020:00080000:0.0:1715330288.461243:0:7116:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 373 batchid updated 00000020:00080000:0.0:1715330288.461253:0:7116:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88009396c480 refcount 2 committed 0 result 0 batchid 374 00000020:00080000:0.0:1715330288.461257:0:7116:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008b091300 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88009396c840 00000020:00080000:0.0:1715330288.461260:0:7116:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].358 00000020:00080000:0.0:1715330288.461262:0:7116:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008b091900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88008d40b400 00000020:00080000:0.0:1715330288.461265:0:7116:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].358 00010000:00010000:2.0:1715330288.461311:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d8455 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8a4526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330288.461319:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d8455 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8a4526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330288.461325:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d8455 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8a4526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330288.461330:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfc480 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330288.461333:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d8455 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8a4526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330288.461339:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d8455 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8a4526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330288.461351:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x8a4526f3 (ffff88008b091b00) 00010000:00010000:2.0:1715330288.461354:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330288.461356:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d8455 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x8a4526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330288.461361:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d8455 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x8a4526f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330288.461388:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d845c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x151a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330288.461393:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d845c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x151a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330288.461397:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d845c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x151a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330288.461401:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f2d00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330288.461403:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d845c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x151a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330288.461408:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d845c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x151a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330288.461414:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151a:0x0].0x0 (ffff88012cc48500) 00010000:00010000:2.0:1715330288.461416:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330288.461418:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d845c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x151a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330288.461422:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2d00/0xd895711d66d845c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x151a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330288.461434:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d8463 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330288.461438:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d8463 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330288.461442:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d8463 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330288.461445:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f06c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330288.461448:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d8463 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330288.461452:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d8463 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330288.461457:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcb:0x0].0x0 (ffff88012cc48700) 00010000:00010000:2.0:1715330288.461459:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330288.461461:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d8463 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330288.461466:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f06c0/0xd895711d66d8463 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330288.461478:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1b00/0xd895711d66d84b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8a4526f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330288.461482:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1b00/0xd895711d66d84b7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8a4526f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330288.461486:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1b00/0xd895711d66d84b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8a4526f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330288.461491:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f1b00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330288.461493:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1b00/0xd895711d66d84b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8a4526f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330288.461497:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1b00/0xd895711d66d84b7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x8a4526f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330288.461502:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x8a4526f3 (ffff88008b091b00) 00010000:00010000:2.0:1715330288.461515:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330288.461517:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1b00/0xd895711d66d84b7 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x8a4526f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330288.461525:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1b00/0xd895711d66d84b7 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x8a4526f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00000020:00080000:0.0:1715330288.461565:0:7116:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 372 batchid updated 00000100:00100000:0.0:1715330288.461635:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26635:x1798653942453056:12345-0@lo:1000:lfsck.0 Request processed in 3154us (3695us total) trans 4294983437 rc 0/0 00000100:00100000:0.0:1715330288.461644:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2638 00000004:00080000:1.0:1715330288.461726:0:26635:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983437 committed transno 4294983437 00000100:00100000:1.0:1715330288.461751:0:26635:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983437 gen 2 00000004:00080000:1.0:1715330288.461755:0:26635:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983430 committed transno 4294983437 00000020:00080000:1.0:1715330288.461758:0:26635:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8801344356c0 refcount 2 committed 0 result 0 batchid 382 00000020:00080000:1.0:1715330288.461761:0:26635:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009bbb0100 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880134435f00 00000020:00080000:1.0:1715330288.461763:0:26635:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].385 00000020:00080000:1.0:1715330288.461765:0:26635:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009bbb0700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff880091f47600 00000020:00080000:1.0:1715330288.461768:0:26635:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].383 00000004:00080000:1.0:1715330288.461791:0:26635:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983432 committed transno 4294983437 00000004:00080000:1.0:1715330288.461802:0:26635:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983433 committed transno 4294983437 00000004:00080000:1.0:1715330288.461812:0:26635:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983434 committed transno 4294983437 00000004:00080000:1.0:1715330288.461836:0:26635:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983435 committed transno 4294983437 00000100:00100000:1.0:1715330288.461849:0:26635:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:26635:1798653942453056:0@lo:1000:lfsck.0 00010000:00010000:1.0:1715330288.461865:0:26635:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc000/0xd895711d66d853c lrc: 3/0,1 mode: PW/PW res: [0x200000002:0x3:0x0].0x3085747d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8543 expref: -99 pid: 26635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330288.461872:0:26635:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc000/0xd895711d66d853c lrc: 2/0,0 mode: PW/PW res: [0x200000002:0x3:0x0].0x3085747d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8543 expref: -99 pid: 26635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330288.461878:0:26635:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2640/0xd895711d66d852e lrc: 3/0,1 mode: CW/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8535 expref: -99 pid: 26635 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330288.461884:0:26635:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2640/0xd895711d66d852e lrc: 2/0,0 mode: CW/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8535 expref: -99 pid: 26635 timeout: 0 lvb_type: 0 00000020:00080000:0.0:1715330288.462292:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 382 committed batchid 380 00000020:00080000:0.0:1715330288.462310:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 380 00100000:10000000:2.0:1715330288.462581:0:26637:0:(lfsck_engine.c:1602:lfsck_assistant_engine()) lustre-MDT0001-osd: lfsck_namespace LFSCK assistant thread start 00100000:10000000:0.0:1715330288.462684:0:26635:0:(lfsck_namespace.c:4589:lfsck_namespace_prep()) lustre-MDT0001-osd: namespace LFSCK prep done, start pos [1, [0x0:0x0:0x0], 0x0]: rc = 0 00000100:00100000:1.0:1715330288.462756:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942453184 00000100:00100000:1.0:1715330288.462761:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942453184 00000100:00100000:1.0:1715330288.462992:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2639 00000100:00100000:1.0:1715330288.462998:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:8587:x1798653942453184:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330288.463078:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:8587:x1798653942453184:12345-0@lo:1000:osp_up1-0.0 Request processed in 80us (845us total) trans 4294968381 rc 0/0 00000100:00100000:1.0:1715330288.463084:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2639 00100000:10000000:0.0:1715330288.463303:0:26635:0:(lfsck_namespace.c:4487:lfsck_namespace_checkpoint()) lustre-MDT0001-osd: namespace LFSCK checkpoint at the pos [78, [0x0:0x0:0x0], 0x0], status = 1: rc = 0 00100000:10000000:0.0:1715330288.463308:0:26635:0:(lfsck_engine.c:1079:lfsck_master_engine()) LFSCK entry: oit_flags = 0x40003, dir_flags = 0x8006, oit_cookie = 78, dir_cookie = 0x0, parent = [0x0:0x0:0x0], pid = 26635 00000100:00100000:2.0:1715330288.463492:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942453312 00000100:00100000:2.0:1715330288.463495:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942453312 00000100:00100000:2.0:1715330288.463529:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2640 00000100:00100000:2.0:1715330288.463533:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:8587:x1798653942453312:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1715330288.463592:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:8587:x1798653942453312:12345-0@lo:1000:osp_up1-0.0 Request processed in 58us (147us total) trans 4294968382 rc 0/0 00000100:00100000:2.0:1715330288.463597:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2640 00000100:00100000:1.0:1715330288.463765:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:26631:x1798653942452544:12345-0@lo:1101:lctl.0 Request processed in 10952us (11088us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330288.463771:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632 00000100:00100000:2.0:1715330288.463830:0:26631:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job lctl:lustre-MDT0000-mdtlov_UUID:26631:1798653942452544:0@lo:1101:lctl.0 00100000:10000000:0.0:1715330288.466350:0:26633:0:(scrub.c:386:scrub_thread_post()) lustre-MDT0000: OI scrub post with result = 1 00100000:10000000:0.0:1715330288.466380:0:26633:0:(scrub.c:247:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1715330288.466383:0:26633:0:(osd_scrub.c:1267:osd_scrub_main()) lustre-MDT0000: OI scrub: stop, pos = 1024001: rc = 1 00000100:00100000:0.0:1715330288.466837:0:26635:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e9500 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:26635:1798653942453440:0@lo:1000:lfsck.0 00000100:00100000:0.0:1715330288.466861:0:26635:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330288.466869:0:26635:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffc0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330288.466879:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942453376 00000100:00100000:0.0:1715330288.466883:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942453376 00000100:00100000:0.0:1715330288.466905:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942453440 00000100:00100000:0.0:1715330288.466907:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942453440 00000100:00100000:0.0:1715330288.466927:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2641 00000100:00100000:0.0:1715330288.466932:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:26634:x1798653942453376:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1715330288.466986:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:26634:x1798653942453376:12345-0@lo:1000:lfsck_namespace.0 Request processed in 54us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330288.466991:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2641 00000100:00100000:0.0:1715330288.467191:0:26632:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4eaa00 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0000-mdtlov_UUID:26632:1798653942453568:0@lo:1000:lfsck.0 00000100:00100000:0.0:1715330288.467211:0:26632:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330288.467219:0:26632:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009396cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1715330288.467231:0:26635:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e9500 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:26635:1798653942453440:0@lo:1000:lfsck.0 00000100:00100000:0.0:1715330288.467255:0:26635:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e9500 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:26635:1798653942453696:0@lo:1000:lfsck.0 00000100:00100000:0.0:1715330288.467269:0:26635:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330288.467273:0:26635:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009396c000 going to sleep for 11 seconds 00000100:00100000:0.0:1715330288.467327:0:26632:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4eaa00 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0000-mdtlov_UUID:26632:1798653942453568:0@lo:1000:lfsck.0 00000100:00100000:0.0:1715330288.471298:0:26635:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e9500 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:26635:1798653942453696:0@lo:1000:lfsck.0 00000100:00100000:2.0:1715330288.471316:0:26634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942454080:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1715330288.471359:0:26634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330288.471373:0:26634:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa000 going to sleep for 11 seconds 00000100:00100000:2.0:1715330288.471386:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942454080 00000100:00100000:2.0:1715330288.471390:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942454080 00000100:00100000:2.0:1715330288.471416:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2652 00000100:00100000:2.0:1715330288.471422:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:26634:x1798653942454080:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1715330288.471475:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:26634:x1798653942454080:12345-0@lo:1000:lfsck_namespace.0 Request processed in 53us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330288.471482:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2652 00000100:00100000:2.0:1715330288.471514:0:26634:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942454080:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1715330288.471696:0:26635:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e9500 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:26635:1798653942454144:0@lo:1000:lfsck.0 00000100:00100000:0.0:1715330288.471714:0:26635:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330288.471722:0:26635:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009396cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1715330288.472000:0:26632:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4ea680 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0000-mdtlov_UUID:26632:1798653942454208:0@lo:1000:lfsck.0 00000100:00100000:0.0:1715330288.472021:0:26632:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330288.472030:0:26632:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435d80 going to sleep for 11 seconds 00000100:00100000:2.0:1715330288.472123:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942454144 00000100:00100000:2.0:1715330288.472126:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942454144 00000100:00100000:2.0:1715330288.472139:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942454208 00000100:00100000:2.0:1715330288.472141:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942454208 00000100:00100000:2.0:1715330288.472147:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2653 00000100:00100000:2.0:1715330288.472150:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26635:x1798653942454144:12345-0@lo:1000:lfsck.0 00000100:00100000:2.0:1715330288.472185:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26635:x1798653942454144:12345-0@lo:1000:lfsck.0 Request processed in 34us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330288.472190:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2653 00000100:00100000:2.0:1715330288.472198:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2654 00000100:00100000:0.0:1715330288.472198:0:26635:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e9500 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:26635:1798653942454144:0@lo:1000:lfsck.0 00000100:00100000:2.0:1715330288.472202:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:26632:x1798653942454208:12345-0@lo:1000:lfsck.0 00000100:00100000:2.0:1715330288.472235:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:26632:x1798653942454208:12345-0@lo:1000:lfsck.0 Request processed in 32us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330288.472240:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2654 00000100:00100000:2.0:1715330288.472283:0:26634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942454272:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1715330288.472283:0:26635:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e9500 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:26635:1798653942454336:0@lo:1000:lfsck.0 00000100:00100000:0.0:1715330288.472299:0:26635:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330288.472307:0:26635:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435900 going to sleep for 11 seconds 00000100:00100000:2.0:1715330288.472316:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942454336 00000100:00100000:2.0:1715330288.472320:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942454336 00000100:00100000:2.0:1715330288.472329:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2655 00000100:00100000:0.0:1715330288.472331:0:26632:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4ea680 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0000-mdtlov_UUID:26632:1798653942454208:0@lo:1000:lfsck.0 00000100:00100000:2.0:1715330288.472333:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26635:x1798653942454336:12345-0@lo:1000:lfsck.0 00000100:00100000:2.0:1715330288.472368:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26635:x1798653942454336:12345-0@lo:1000:lfsck.0 Request processed in 34us (67us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330288.472374:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2655 00000100:00100000:0.0:1715330288.472380:0:26635:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e9500 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:26635:1798653942454336:0@lo:1000:lfsck.0 00000100:00100000:2.0:1715330288.472385:0:26634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330288.472392:0:26634:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa000 going to sleep for 11 seconds 00000100:00100000:2.0:1715330288.472398:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942454272 00000100:00100000:2.0:1715330288.472400:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942454272 00000100:00100000:2.0:1715330288.472409:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2656 00000100:00100000:2.0:1715330288.472412:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:26634:x1798653942454272:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1715330288.472445:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:26634:x1798653942454272:12345-0@lo:1000:lfsck_namespace.0 Request processed in 31us (58us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330288.472450:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2656 00000100:00100000:0.0:1715330288.472457:0:26635:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e9500 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:26635:1798653942454400:0@lo:1000:lfsck.0 00000100:00100000:2.0:1715330288.472467:0:26634:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942454272:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1715330288.472473:0:26635:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330288.472479:0:26635:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435e40 going to sleep for 11 seconds 00000100:00100000:2.0:1715330288.472498:0:26634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942454464:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1715330288.472526:0:26634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330288.472531:0:26634:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa000 going to sleep for 11 seconds 00000100:00100000:2.0:1715330288.472539:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942454400 00000100:00100000:2.0:1715330288.472541:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942454400 00000100:00100000:2.0:1715330288.472550:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942454464 00000100:00100000:2.0:1715330288.472551:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942454464 00000100:00100000:2.0:1715330288.472558:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2657 00000100:00100000:2.0:1715330288.472561:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26635:x1798653942454400:12345-0@lo:1000:lfsck.0 00000100:00100000:2.0:1715330288.472610:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26635:x1798653942454400:12345-0@lo:1000:lfsck.0 Request processed in 47us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330288.472615:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2657 00000100:00100000:2.0:1715330288.472623:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2658 00000100:00100000:2.0:1715330288.472626:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:26634:x1798653942454464:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1715330288.472654:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:26634:x1798653942454464:12345-0@lo:1000:lfsck_namespace.0 Request processed in 26us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330288.472659:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2658 00000100:00100000:2.0:1715330288.472675:0:26634:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942454464:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1715330288.472676:0:26635:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e9500 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:26635:1798653942454400:0@lo:1000:lfsck.0 00000100:00100000:2.0:1715330288.472712:0:26634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942454528:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1715330288.472746:0:26634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330288.472755:0:26634:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa000 going to sleep for 11 seconds 00000100:00100000:2.0:1715330288.472762:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942454528 00000100:00100000:2.0:1715330288.472765:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942454528 00000100:00100000:0.0:1715330288.472768:0:26635:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e9500 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:26635:1798653942454592:0@lo:1000:lfsck.0 00000100:00100000:2.0:1715330288.472774:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2659 00000100:00100000:2.0:1715330288.472777:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:26634:x1798653942454528:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1715330288.472786:0:26635:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330288.472790:0:26635:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009396c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715330288.472809:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:26634:x1798653942454528:12345-0@lo:1000:lfsck_namespace.0 Request processed in 30us (78us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330288.472814:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2659 00000100:00100000:2.0:1715330288.472822:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942454592 00000100:00100000:2.0:1715330288.472824:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942454592 00000100:00100000:2.0:1715330288.472831:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2660 00000100:00100000:2.0:1715330288.472834:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ba0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26635:x1798653942454592:12345-0@lo:1000:lfsck.0 00000100:00100000:2.0:1715330288.472865:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ba0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26635:x1798653942454592:12345-0@lo:1000:lfsck.0 Request processed in 29us (78us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330288.472870:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2660 00000100:00100000:0.0:1715330288.472895:0:26635:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e9500 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:26635:1798653942454592:0@lo:1000:lfsck.0 00000100:00100000:2.0:1715330288.473012:0:26634:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942454528:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1715330288.473042:0:26637:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e9500 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942454656:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1715330288.473054:0:26634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942454720:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1715330288.473083:0:26634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330288.473093:0:26634:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa000 going to sleep for 11 seconds 00000100:00100000:2.0:1715330288.473100:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942454720 00000100:00100000:2.0:1715330288.473103:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942454720 00000100:00100000:2.0:1715330288.473112:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2661 00000100:00100000:2.0:1715330288.473116:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:26634:x1798653942454720:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1715330288.473133:0:26637:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330288.473139:0:26637:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009d7e3600 going to sleep for 11 seconds 00000100:00100000:2.0:1715330288.473146:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:26634:x1798653942454720:12345-0@lo:1000:lfsck_namespace.0 Request processed in 29us (62us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330288.473151:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2661 00000100:00100000:2.0:1715330288.473158:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942454656 00000100:00100000:2.0:1715330288.473160:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942454656 00000100:00100000:2.0:1715330288.473168:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2662 00000100:00100000:2.0:1715330288.473171:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26637:x1798653942454656:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1715330288.473204:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26637:x1798653942454656:12345-0@lo:1000:lfsck_namespace.0 Request processed in 32us (70us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330288.473209:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2662 00000100:00100000:2.0:1715330288.473225:0:26634:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942454720:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1715330288.473225:0:26637:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e9500 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942454656:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1715330288.473254:0:26637:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e9500 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942454784:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1715330288.473264:0:26634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942454848:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1715330288.473269:0:26637:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330288.473277:0:26637:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009d7e3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1715330288.473278:0:26634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330288.473282:0:26634:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa000 going to sleep for 11 seconds 00000100:00100000:2.0:1715330288.473288:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942454784 00000100:00100000:2.0:1715330288.473290:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942454784 00000100:00100000:2.0:1715330288.473299:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942454848 00000100:00100000:2.0:1715330288.473300:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942454848 00000100:00100000:2.0:1715330288.473306:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2663 00000100:00100000:2.0:1715330288.473309:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26637:x1798653942454784:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1715330288.473341:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26637:x1798653942454784:12345-0@lo:1000:lfsck_namespace.0 Request processed in 31us (71us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330288.473347:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2663 00000100:00100000:2.0:1715330288.473356:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2664 00000100:00100000:2.0:1715330288.473360:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:26634:x1798653942454848:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1715330288.473389:0:26637:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e9500 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942454784:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1715330288.473392:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:26634:x1798653942454848:12345-0@lo:1000:lfsck_namespace.0 Request processed in 31us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330288.473397:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2664 00000100:00100000:2.0:1715330288.473414:0:26634:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942454848:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1715330288.473450:0:26634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942454912:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1715330288.473466:0:26634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330288.473473:0:26634:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa000 going to sleep for 11 seconds 00000100:00100000:2.0:1715330288.473481:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942454912 00000100:00100000:2.0:1715330288.473483:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942454912 00000100:00100000:2.0:1715330288.473493:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2665 00000100:00100000:2.0:1715330288.473496:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:26634:x1798653942454912:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1715330288.473540:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:26634:x1798653942454912:12345-0@lo:1000:lfsck_namespace.0 Request processed in 43us (72us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330288.473544:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2665 00000100:00100000:2.0:1715330288.473561:0:26634:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942454912:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1715330288.473609:0:26634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942454976:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1715330288.473626:0:26634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330288.473633:0:26634:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa000 going to sleep for 11 seconds 00000100:00100000:2.0:1715330288.473641:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942454976 00000100:00100000:2.0:1715330288.473643:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942454976 00000100:00100000:2.0:1715330288.473652:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2666 00000100:00100000:2.0:1715330288.473655:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:26634:x1798653942454976:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1715330288.473709:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:26634:x1798653942454976:12345-0@lo:1000:lfsck_namespace.0 Request processed in 53us (82us total) trans 0 rc -2/-2 00000100:00100000:2.0:1715330288.473714:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2666 00000100:00100000:2.0:1715330288.473747:0:26634:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942454976:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1715330288.473802:0:26634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942455040:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1715330288.473818:0:26634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330288.473825:0:26634:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa000 going to sleep for 11 seconds 00000100:00100000:2.0:1715330288.473833:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942455040 00000100:00100000:2.0:1715330288.473835:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942455040 00000100:00100000:2.0:1715330288.473845:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2667 00000100:00100000:2.0:1715330288.473848:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:26634:x1798653942455040:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1715330288.473890:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:26634:x1798653942455040:12345-0@lo:1000:lfsck_namespace.0 Request processed in 41us (71us total) trans 0 rc -2/-2 00000100:00100000:2.0:1715330288.473895:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2667 00000100:00100000:2.0:1715330288.473910:0:26634:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942455040:0@lo:1000:lfsck_namespace.0 00010000:00010000:2.0:1715330288.473982:0:26634:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d854a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1474:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 26634 initiator: MDT0 00010000:00010000:2.0:1715330288.473995:0:26634:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d854a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1474:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26634 initiator: MDT0 00010000:00010000:2.0:1715330288.474005:0:26634:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d854a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1474:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 26634 initiator: MDT0 00010000:00010000:2.0:1715330288.474013:0:26634:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db661c0/0xd895711d66d8551 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1474:0x0].0x382100c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 26634 initiator: MDT0 00010000:00010000:2.0:1715330288.474017:0:26634:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db661c0/0xd895711d66d8551 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1474:0x0].0x382100c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26634 initiator: MDT0 00010000:00010000:2.0:1715330288.474022:0:26634:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db661c0/0xd895711d66d8551 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1474:0x0].0x382100c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 26634 initiator: MDT0 00010000:00010000:2.0:1715330288.474030:0:26634:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db661c0/0xd895711d66d8551 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1474:0x0].0x382100c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26634 initiator: MDT0 00010000:00010000:2.0:1715330288.474036:0:26634:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db661c0/0xd895711d66d8551 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1474:0x0].0x382100c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 26634 initiator: MDT0 00010000:00010000:2.0:1715330288.474041:0:26634:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db661c0/0xd895711d66d8551 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1474:0x0].0x382100c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 26634 initiator: MDT0 00010000:00010000:2.0:1715330288.474047:0:26634:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db661c0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330288.474049:0:26634:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db661c0/0xd895711d66d8551 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1474:0x0].0x382100c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 26634 initiator: MDT0 00010000:00010000:2.0:1715330288.474055:0:26634:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db661c0/0xd895711d66d8551 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1474:0x0].0x382100c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 26634 initiator: MDT0 00010000:00010000:2.0:1715330288.474063:0:26634:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1474:0x0].0x382100c (ffff88009d678700) 00010000:00010000:2.0:1715330288.474065:0:26634:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330288.474068:0:26634:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db661c0/0xd895711d66d8551 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1474:0x0].0x382100c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 26634 initiator: MDT0 00010000:00010000:2.0:1715330288.474072:0:26634:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db661c0/0xd895711d66d8551 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1474:0x0].0x382100c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 26634 initiator: MDT0 00010000:00010000:2.0:1715330288.474082:0:26634:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d854a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1474:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26634 initiator: MDT0 00010000:00010000:2.0:1715330288.474087:0:26634:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d854a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1474:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 26634 initiator: MDT0 00010000:00010000:2.0:1715330288.474091:0:26634:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d854a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1474:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 26634 initiator: MDT0 00010000:00010000:2.0:1715330288.474095:0:26634:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66400 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330288.474096:0:26634:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d854a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1474:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 26634 initiator: MDT0 00010000:00010000:2.0:1715330288.474100:0:26634:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d854a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1474:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 26634 initiator: MDT0 00010000:00010000:2.0:1715330288.474105:0:26634:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1474:0x0].0x0 (ffff88009d678c00) 00010000:00010000:2.0:1715330288.474107:0:26634:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330288.474109:0:26634:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d854a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1474:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 26634 initiator: MDT0 00010000:00010000:2.0:1715330288.474113:0:26634:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d854a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1474:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 26634 initiator: MDT0 00100000:10000000:2.0:1715330288.474120:0:26634:0:(lfsck_namespace.c:5611:lfsck_namespace_repair_dangling()) lustre-MDT0000-osd: namespace LFSCK assistant found dangling reference for: parent [0x200000402:0x1474:0x0], child [0x240000401:0x78:0x0], type 16877, name [0x240000401:0x78:0x0]:1. Create the lost MDT-object as required: rc = -19 00100000:10000000:2.0:1715330288.474125:0:26634:0:(lfsck_striped_dir.c:2259:lfsck_namespace_striped_dir_rescan()) lustre-MDT0000-osd: namespace LFSCK repair the shard 1 [0x240000401:0x78:0x0] of the striped directory [0x200000402:0x1474:0x0] with dangling yes/no, rename no/no, llinkea no/no, repair_lmvea no/no: rc = -19 00000100:00100000:2.0:1715330288.474166:0:26634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942455104:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1715330288.474183:0:26634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330288.474193:0:26634:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa000 going to sleep for 11 seconds 00000100:00100000:2.0:1715330288.474201:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942455104 00000100:00100000:2.0:1715330288.474203:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942455104 00000100:00100000:2.0:1715330288.474213:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2668 00000100:00100000:2.0:1715330288.474217:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:26634:x1798653942455104:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1715330288.474253:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:26634:x1798653942455104:12345-0@lo:1000:lfsck_namespace.0 Request processed in 36us (69us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330288.474258:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2668 00000100:00100000:2.0:1715330288.474272:0:26634:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942455104:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1715330288.474304:0:26634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942455168:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1715330288.474320:0:26634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330288.474328:0:26634:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa000 going to sleep for 11 seconds 00000100:00100000:2.0:1715330288.474336:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942455168 00000100:00100000:2.0:1715330288.474338:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942455168 00000100:00100000:2.0:1715330288.474347:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2669 00000100:00100000:2.0:1715330288.474350:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:26634:x1798653942455168:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1715330288.474380:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:26634:x1798653942455168:12345-0@lo:1000:lfsck_namespace.0 Request processed in 29us (58us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330288.474385:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2669 00000100:00100000:2.0:1715330288.474400:0:26634:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942455168:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1715330288.474439:0:26634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942455232:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1715330288.474455:0:26634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330288.474462:0:26634:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa000 going to sleep for 11 seconds 00000100:00100000:2.0:1715330288.474469:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942455232 00000100:00100000:2.0:1715330288.474471:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942455232 00000100:00100000:2.0:1715330288.474481:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2670 00000100:00100000:2.0:1715330288.474484:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:26634:x1798653942455232:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1715330288.474530:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:26634:x1798653942455232:12345-0@lo:1000:lfsck_namespace.0 Request processed in 44us (73us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330288.474535:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2670 00000100:00100000:2.0:1715330288.474553:0:26634:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942455232:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1715330288.474588:0:26634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942455296:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1715330288.474604:0:26634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330288.474611:0:26634:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa000 going to sleep for 11 seconds 00000100:00100000:2.0:1715330288.474620:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942455296 00000100:00100000:2.0:1715330288.474622:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942455296 00000100:00100000:2.0:1715330288.474630:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2671 00000100:00100000:2.0:1715330288.474633:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:26634:x1798653942455296:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1715330288.474664:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:26634:x1798653942455296:12345-0@lo:1000:lfsck_namespace.0 Request processed in 29us (58us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330288.474669:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2671 00000100:00100000:2.0:1715330288.474683:0:26634:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942455296:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1715330288.474747:0:26634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942455360:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1715330288.474764:0:26634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330288.474771:0:26634:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa000 going to sleep for 11 seconds 00000100:00100000:2.0:1715330288.474779:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942455360 00000100:00100000:2.0:1715330288.474781:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942455360 00000100:00100000:2.0:1715330288.474791:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2672 00000100:00100000:2.0:1715330288.474794:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:26634:x1798653942455360:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1715330288.474823:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:26634:x1798653942455360:12345-0@lo:1000:lfsck_namespace.0 Request processed in 28us (59us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330288.474827:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2672 00000100:00100000:2.0:1715330288.474842:0:26634:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942455360:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1715330288.474870:0:26634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942455424:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1715330288.474886:0:26634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330288.474893:0:26634:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa000 going to sleep for 11 seconds 00000100:00100000:2.0:1715330288.474900:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942455424 00000100:00100000:2.0:1715330288.474902:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942455424 00000100:00100000:2.0:1715330288.474912:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2673 00000100:00100000:2.0:1715330288.474915:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:26634:x1798653942455424:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1715330288.474946:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:26634:x1798653942455424:12345-0@lo:1000:lfsck_namespace.0 Request processed in 29us (59us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330288.474951:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2673 00000100:00100000:2.0:1715330288.474966:0:26634:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942455424:0@lo:1000:lfsck_namespace.0 00100000:10000000:2.0:1715330288.475232:0:26636:0:(scrub.c:386:scrub_thread_post()) lustre-MDT0001: OI scrub post with result = 1 00100000:10000000:2.0:1715330288.475255:0:26636:0:(scrub.c:247:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:2.0:1715330288.475257:0:26636:0:(osd_scrub.c:1267:osd_scrub_main()) lustre-MDT0001: OI scrub: stop, pos = 1024001: rc = 1 00000100:00100000:2.0:1715330288.475540:0:26635:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:26635:1798653942455488:0@lo:1000:lfsck.0 00000100:00100000:2.0:1715330288.475559:0:26635:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330288.475566:0:26635:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715330288.475573:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942455488 00000100:00100000:2.0:1715330288.475575:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942455488 00000100:00100000:2.0:1715330288.475585:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2674 00000100:00100000:2.0:1715330288.475588:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26635:x1798653942455488:12345-0@lo:1000:lfsck.0 00000100:00100000:2.0:1715330288.475616:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26635:x1798653942455488:12345-0@lo:1000:lfsck.0 Request processed in 27us (56us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330288.475621:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2674 00000100:00100000:2.0:1715330288.475636:0:26635:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:26635:1798653942455488:0@lo:1000:lfsck.0 00000100:00100000:2.0:1715330288.475661:0:26635:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:26635:1798653942455552:0@lo:1000:lfsck.0 00000100:00100000:2.0:1715330288.475676:0:26635:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330288.475684:0:26635:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715330288.475690:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942455552 00000100:00100000:2.0:1715330288.475692:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942455552 00000100:00100000:2.0:1715330288.475701:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2675 00000100:00100000:2.0:1715330288.475705:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26635:x1798653942455552:12345-0@lo:1000:lfsck.0 00000100:00100000:2.0:1715330288.475751:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26635:x1798653942455552:12345-0@lo:1000:lfsck.0 Request processed in 45us (73us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330288.475756:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2675 00000100:00100000:2.0:1715330288.475771:0:26635:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:26635:1798653942455552:0@lo:1000:lfsck.0 00000100:00100000:2.0:1715330288.475863:0:26635:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:26635:1798653942455616:0@lo:1000:lfsck.0 00000100:00100000:2.0:1715330288.475882:0:26635:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330288.475890:0:26635:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffab40 going to sleep for 11 seconds 00000100:00100000:2.0:1715330288.475897:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942455616 00000100:00100000:2.0:1715330288.475899:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942455616 00000100:00100000:2.0:1715330288.475910:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2676 00000100:00100000:2.0:1715330288.475913:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26635:x1798653942455616:12345-0@lo:1000:lfsck.0 00000100:00100000:2.0:1715330288.475943:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26635:x1798653942455616:12345-0@lo:1000:lfsck.0 Request processed in 29us (59us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330288.475947:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2676 00000100:00100000:2.0:1715330288.475963:0:26635:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:26635:1798653942455616:0@lo:1000:lfsck.0 00000100:00100000:2.0:1715330288.475986:0:26635:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344c8000 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:26635:1798653942455680:0@lo:1000:lfsck.0 00000100:00100000:2.0:1715330288.475999:0:26635:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330288.476006:0:26635:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffab40 going to sleep for 11 seconds 00000100:00100000:2.0:1715330288.476011:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942455680 00000100:00100000:2.0:1715330288.476012:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942455680 00000100:00100000:2.0:1715330288.476021:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2677 00000100:00100000:2.0:1715330288.476024:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26635:x1798653942455680:12345-0@lo:1000:lfsck.0 00000100:00100000:2.0:1715330288.476052:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26635:x1798653942455680:12345-0@lo:1000:lfsck.0 Request processed in 27us (51us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330288.476056:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2677 00000100:00100000:2.0:1715330288.476071:0:26635:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344c8000 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:26635:1798653942455680:0@lo:1000:lfsck.0 00000100:00100000:2.0:1715330288.476186:0:26635:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344c8000 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:26635:1798653942455744:0@lo:1000:lfsck.0 00000100:00100000:2.0:1715330288.476203:0:26635:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330288.476211:0:26635:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715330288.476217:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942455744 00000100:00100000:2.0:1715330288.476219:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942455744 00000100:00100000:2.0:1715330288.476230:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2678 00000100:00100000:2.0:1715330288.476233:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26635:x1798653942455744:12345-0@lo:1000:lfsck.0 00000100:00100000:2.0:1715330288.476283:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26635:x1798653942455744:12345-0@lo:1000:lfsck.0 Request processed in 49us (79us total) trans 0 rc -2/-2 00000100:00100000:2.0:1715330288.476288:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2678 00000100:00100000:2.0:1715330288.476303:0:26635:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344c8000 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:26635:1798653942455744:0@lo:1000:lfsck.0 00000100:00100000:2.0:1715330288.476481:0:26635:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344c8000 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:26635:1798653942455808:0@lo:1000:lfsck.0 00000100:00100000:2.0:1715330288.476498:0:26635:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330288.476518:0:26635:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009396cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1715330288.476525:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942455808 00000100:00100000:2.0:1715330288.476527:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942455808 00000100:00100000:2.0:1715330288.476537:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2679 00000100:00100000:2.0:1715330288.476540:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26635:x1798653942455808:12345-0@lo:1000:lfsck.0 00000100:00100000:2.0:1715330288.476573:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26635:x1798653942455808:12345-0@lo:1000:lfsck.0 Request processed in 32us (74us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330288.476578:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2679 00000100:00100000:2.0:1715330288.476594:0:26635:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344c8000 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:26635:1798653942455808:0@lo:1000:lfsck.0 00000100:00100000:2.0:1715330288.476616:0:26635:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344c8000 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:26635:1798653942455872:0@lo:1000:lfsck.0 00000100:00100000:2.0:1715330288.476633:0:26635:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330288.476642:0:26635:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009396cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1715330288.476647:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942455872 00000100:00100000:2.0:1715330288.476649:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942455872 00000100:00100000:2.0:1715330288.476658:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2680 00000100:00100000:2.0:1715330288.476662:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26635:x1798653942455872:12345-0@lo:1000:lfsck.0 00000100:00100000:2.0:1715330288.476692:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26635:x1798653942455872:12345-0@lo:1000:lfsck.0 Request processed in 29us (57us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330288.476699:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2680 00000100:00100000:2.0:1715330288.476714:0:26635:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344c8000 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:26635:1798653942455872:0@lo:1000:lfsck.0 00000100:00100000:2.0:1715330288.476812:0:26635:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344c8000 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:26635:1798653942455936:0@lo:1000:lfsck.0 00000100:00100000:2.0:1715330288.476830:0:26635:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330288.476838:0:26635:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009396c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330288.476840:0:26637:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e9500 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942456000:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1715330288.476844:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942455936 00000100:00100000:2.0:1715330288.476846:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942455936 00000100:00100000:2.0:1715330288.476856:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2681 00000100:00100000:2.0:1715330288.476859:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26635:x1798653942455936:12345-0@lo:1000:lfsck.0 00000100:00100000:0.0:1715330288.476865:0:26637:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330288.476872:0:26637:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091cb2180 going to sleep for 11 seconds 00000100:00100000:2.0:1715330288.476892:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26635:x1798653942455936:12345-0@lo:1000:lfsck.0 Request processed in 32us (61us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330288.476897:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2681 00000100:00100000:2.0:1715330288.476904:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942456000 00000100:00100000:2.0:1715330288.476906:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942456000 00000100:00100000:2.0:1715330288.476913:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2682 00000100:00100000:2.0:1715330288.476916:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26637:x1798653942456000:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1715330288.476946:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26637:x1798653942456000:12345-0@lo:1000:lfsck_namespace.0 Request processed in 29us (81us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330288.476951:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2682 00000100:00100000:2.0:1715330288.476964:0:26635:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344c8000 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:26635:1798653942455936:0@lo:1000:lfsck.0 00000100:00100000:2.0:1715330288.477042:0:26635:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344c8000 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:26635:1798653942456128:0@lo:1000:lfsck.0 00000100:00100000:2.0:1715330288.477057:0:26635:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330288.477064:0:26635:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009396c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715330288.477070:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942456128 00000100:00100000:2.0:1715330288.477071:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942456128 00000100:00100000:2.0:1715330288.477080:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2683 00000100:00100000:2.0:1715330288.477083:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26635:x1798653942456128:12345-0@lo:1000:lfsck.0 00000100:00100000:2.0:1715330288.477114:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26635:x1798653942456128:12345-0@lo:1000:lfsck.0 Request processed in 29us (56us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330288.477118:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2683 00000100:00100000:2.0:1715330288.477133:0:26635:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344c8000 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:26635:1798653942456128:0@lo:1000:lfsck.0 00000100:00100000:2.0:1715330288.477296:0:26635:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344c8000 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:26635:1798653942456192:0@lo:1000:lfsck.0 00000100:00100000:2.0:1715330288.477314:0:26635:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330288.477321:0:26635:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435600 going to sleep for 11 seconds 00000100:00100000:2.0:1715330288.477326:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942456192 00000100:00100000:2.0:1715330288.477328:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942456192 00000100:00100000:2.0:1715330288.477337:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2684 00000100:00100000:2.0:1715330288.477340:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26635:x1798653942456192:12345-0@lo:1000:lfsck.0 00000100:00100000:2.0:1715330288.477369:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26635:x1798653942456192:12345-0@lo:1000:lfsck.0 Request processed in 28us (54us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330288.477373:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2684 00000100:00100000:2.0:1715330288.477389:0:26635:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344c8000 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:26635:1798653942456192:0@lo:1000:lfsck.0 00100000:10000000:2.0:1715330288.477460:0:26635:0:(lfsck_engine.c:1110:lfsck_master_engine()) LFSCK exit: oit_flags = 0x40003, dir_flags = 0x8006, oit_cookie = 512126, dir_cookie = 0x416ee692757a4237, parent = [0x240000403:0x1:0x0], pid = 26635: rc = 1 00100000:10000000:2.0:1715330288.477468:0:26635:0:(lfsck_lib.c:2606:lfsck_post_generic()) lustre-MDT0001-osd: waiting for assistant to do lfsck_namespace post, rc = 1 00000100:00100000:0.0:1715330288.477583:0:26634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e8a80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942456064:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1715330288.477607:0:26634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330288.477616:0:26634:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091cb2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1715330288.477766:0:26637:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e9500 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942456000:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1715330288.477904:0:26637:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e9500 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942456256:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1715330288.477920:0:26637:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330288.477927:0:26637:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091cb2180 going to sleep for 11 seconds 00000100:00100000:0.0:1715330288.478019:0:26632:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e8700 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0000-mdtlov_UUID:26632:1798653942456320:0@lo:1000:lfsck.0 00000100:00100000:0.0:1715330288.478037:0:26632:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330288.478042:0:26632:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009d7e3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330288.478272:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942456064 00000100:00100000:1.0:1715330288.478276:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942456064 00000100:00100000:1.0:1715330288.478289:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942456256 00000100:00100000:1.0:1715330288.478290:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942456256 00000100:00100000:1.0:1715330288.478295:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942456320 00000100:00100000:1.0:1715330288.478297:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942456320 00000100:00100000:1.0:1715330288.478304:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2685 00000100:00100000:1.0:1715330288.478315:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:26634:x1798653942456064:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.478364:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:26634:x1798653942456064:12345-0@lo:1000:lfsck_namespace.0 Request processed in 49us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330288.478370:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2685 00000100:00100000:0.0:1715330288.478373:0:26634:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e8a80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942456064:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.478382:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2686 00000100:00100000:1.0:1715330288.478385:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26637:x1798653942456256:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1715330288.478404:0:26634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e8a80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942456384:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1715330288.478419:0:26634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330288.478423:0:26634:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009d7e3000 going to sleep for 11 seconds 00000100:00100000:1.0:1715330288.478424:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26637:x1798653942456256:12345-0@lo:1000:lfsck_namespace.0 Request processed in 38us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330288.478429:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2686 00000100:00100000:0.0:1715330288.478432:0:26637:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e9500 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942456256:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.478436:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942456384 00000100:00100000:1.0:1715330288.478438:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942456384 00000100:00100000:1.0:1715330288.478446:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2687 00000100:00100000:1.0:1715330288.478449:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:26632:x1798653942456320:12345-0@lo:1000:lfsck.0 00000100:00100000:0.0:1715330288.478450:0:26637:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e9500 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942456448:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1715330288.478460:0:26637:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330288.478462:0:26637:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091cb2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1715330288.478482:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:26632:x1798653942456320:12345-0@lo:1000:lfsck.0 Request processed in 32us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330288.478486:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2687 00000100:00100000:0.0:1715330288.478491:0:26632:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e8700 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0000-mdtlov_UUID:26632:1798653942456320:0@lo:1000:lfsck.0 00000100:00100000:1.0:1715330288.478492:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942456448 00000100:00100000:1.0:1715330288.478494:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942456448 00000100:00100000:1.0:1715330288.478500:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2688 00000100:00100000:1.0:1715330288.478502:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:26634:x1798653942456384:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.478548:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:26634:x1798653942456384:12345-0@lo:1000:lfsck_namespace.0 Request processed in 44us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330288.478555:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2688 00000100:00100000:1.0:1715330288.478564:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2689 00000100:00100000:1.0:1715330288.478567:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26637:x1798653942456448:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.478601:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26637:x1798653942456448:12345-0@lo:1000:lfsck_namespace.0 Request processed in 33us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330288.478605:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2689 00000100:00100000:0.0:1715330288.478796:0:26634:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e8a80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942456384:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1715330288.478840:0:26634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e8a80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942456512:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1715330288.478856:0:26634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330288.478864:0:26634:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091cb2c00 going to sleep for 11 seconds 00100000:10000000:0.0:1715330288.478918:0:26632:0:(lfsck_engine.c:1110:lfsck_master_engine()) LFSCK exit: oit_flags = 0x40000, dir_flags = 0x8006, oit_cookie = 512149, dir_cookie = 0x7019e76e49767dd6, parent = [0x200000403:0x1:0x0], pid = 26632: rc = 1 00100000:10000000:0.0:1715330288.478925:0:26632:0:(lfsck_lib.c:2606:lfsck_post_generic()) lustre-MDT0000-osd: waiting for assistant to do lfsck_namespace post, rc = 1 00000100:00100000:0.0:1715330288.478947:0:26637:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e9500 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942456448:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1715330288.478975:0:26637:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e9500 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942456576:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1715330288.478990:0:26637:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330288.478995:0:26637:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091cb2180 going to sleep for 11 seconds 00000100:00100000:0.0:1715330288.482573:0:26634:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e8a80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942456512:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1715330288.482666:0:26634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e8a80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942456640:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1715330288.482699:0:26634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330288.482710:0:26634:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091cb2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1715330288.482748:0:26637:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e9500 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942456576:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.482981:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942456640 00000100:00100000:1.0:1715330288.482986:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942456640 00000100:00100000:1.0:1715330288.483009:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2692 00000100:00100000:1.0:1715330288.483015:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:26634:x1798653942456640:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.483065:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:26634:x1798653942456640:12345-0@lo:1000:lfsck_namespace.0 Request processed in 50us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330288.483070:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2692 00000100:00100000:1.0:1715330288.487946:0:26634:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e8a80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942456640:0@lo:1000:lfsck_namespace.0 00100000:10000000:1.0:1715330288.488028:0:26634:0:(lfsck_engine.c:1677:lfsck_assistant_engine()) lustre-MDT0000-osd: lfsck_namespace LFSCK assistant thread post 00000100:00100000:1.0:1715330288.488058:0:26634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942456704:0@lo:1101:lfsck_namespace.0 00000100:00100000:1.0:1715330288.488102:0:26634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.489064:0:26634:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f840 going to sleep for 11 seconds 00100000:10000000:1.0:1715330288.489075:0:26632:0:(lfsck_lib.c:2617:lfsck_post_generic()) lustre-MDT0000-osd: the assistant has done lfsck_namespace post, rc = 1 00100000:10000000:1.0:1715330288.489120:0:26632:0:(lfsck_namespace.c:4826:lfsck_namespace_post()) lustre-MDT0000-osd: namespace LFSCK post done: rc = 0 00100000:10000000:1.0:1715330288.489127:0:26632:0:(lfsck_lib.c:2634:lfsck_double_scan_generic()) lustre-MDT0000-osd: waiting for assistant to do lfsck_namespace double_scan, status 2 00000100:00100000:1.0:1715330288.489544:0:26634:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942456704:0@lo:1101:lfsck_namespace.0 00100000:10000000:1.0:1715330288.489553:0:26634:0:(lfsck_engine.c:1696:lfsck_assistant_engine()) lustre-MDT0000-osd: LFSCK assistant notified others for lfsck_namespace post: rc = 0 00100000:10000000:1.0:1715330288.489557:0:26634:0:(lfsck_engine.c:1714:lfsck_assistant_engine()) lustre-MDT0000-osd: LFSCK assistant sync before the second-stage scaning 00000004:00080000:1.0:1715330288.489569:0:26634:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 262965837563ns, next at 206082064496ns, rc = 0 00080000:00080000:1.0:1715330288.489574:0:26634:0:(osd_handler.c:2696:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1715330288.489587:0:26634:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 262965856151ns, next at 201943329274ns, rc = 0 00080000:00080000:1.0:1715330288.489590:0:26634:0:(osd_handler.c:2696:osd_commit_async()) lustre-MDT0000: async commit OSD 00100000:10000000:1.0:1715330288.489599:0:26632:0:(lfsck_lib.c:2644:lfsck_double_scan_generic()) lustre-MDT0000-osd: the assistant has done lfsck_namespace double_scan, status 0 00000100:00100000:1.0:1715330288.490128:0:26637:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942456768:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.490154:0:26637:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.490164:0:26637:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f900 going to sleep for 11 seconds 00000100:00100000:1.0:1715330288.490173:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942456768 00000100:00100000:1.0:1715330288.490176:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942456768 00000100:00100000:1.0:1715330288.490628:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2694 00000100:00100000:1.0:1715330288.490635:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26637:x1798653942456768:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.491182:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26637:x1798653942456768:12345-0@lo:1000:lfsck_namespace.0 Request processed in 548us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330288.491189:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2694 00000100:00100000:1.0:1715330288.491213:0:26637:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942456768:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.491254:0:26637:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942456832:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.491274:0:26637:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.491284:0:26637:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f900 going to sleep for 11 seconds 00000100:00100000:1.0:1715330288.491291:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942456832 00000100:00100000:1.0:1715330288.491293:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942456832 00000100:00100000:1.0:1715330288.492112:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2695 00000100:00100000:1.0:1715330288.492117:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26637:x1798653942456832:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.492161:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26637:x1798653942456832:12345-0@lo:1000:lfsck_namespace.0 Request processed in 44us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330288.492166:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2695 00000100:00100000:1.0:1715330288.492517:0:26637:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942456832:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.492557:0:26637:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942456896:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.492576:0:26637:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.492598:0:26637:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f900 going to sleep for 11 seconds 00000100:00100000:1.0:1715330288.495365:0:26637:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942456896:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.495458:0:26637:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942456960:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.495483:0:26637:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.495493:0:26637:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f900 going to sleep for 11 seconds 00000100:00100000:1.0:1715330288.495953:0:26637:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942456960:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.496002:0:26637:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942457024:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.496020:0:26637:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.496028:0:26637:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f900 going to sleep for 11 seconds 00000100:00100000:1.0:1715330288.496036:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942457024 00000100:00100000:1.0:1715330288.496038:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942457024 00000100:00100000:1.0:1715330288.496063:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2698 00000100:00100000:1.0:1715330288.496067:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26637:x1798653942457024:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.496100:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26637:x1798653942457024:12345-0@lo:1000:lfsck_namespace.0 Request processed in 32us (80us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330288.496104:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2698 00000100:00100000:1.0:1715330288.496122:0:26637:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942457024:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.496179:0:26637:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942457088:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.496193:0:26637:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.496200:0:26637:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f900 going to sleep for 11 seconds 00000100:00100000:1.0:1715330288.496206:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942457088 00000100:00100000:1.0:1715330288.496209:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942457088 00000100:00100000:1.0:1715330288.496220:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2699 00000100:00100000:1.0:1715330288.496222:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26637:x1798653942457088:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.496251:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26637:x1798653942457088:12345-0@lo:1000:lfsck_namespace.0 Request processed in 28us (57us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330288.496255:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2699 00000100:00100000:1.0:1715330288.496271:0:26637:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942457088:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.496311:0:26637:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942457152:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.496328:0:26637:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.496336:0:26637:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f900 going to sleep for 11 seconds 00000100:00100000:1.0:1715330288.496342:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942457152 00000100:00100000:1.0:1715330288.496344:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942457152 00000100:00100000:1.0:1715330288.496353:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2700 00000100:00100000:1.0:1715330288.496356:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26637:x1798653942457152:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.496404:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26637:x1798653942457152:12345-0@lo:1000:lfsck_namespace.0 Request processed in 46us (75us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330288.496409:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2700 00000100:00100000:1.0:1715330288.496426:0:26637:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942457152:0@lo:1000:lfsck_namespace.0 00100000:10000000:1.0:1715330288.496457:0:26637:0:(lfsck_engine.c:1677:lfsck_assistant_engine()) lustre-MDT0001-osd: lfsck_namespace LFSCK assistant thread post 00000100:00100000:1.0:1715330288.496471:0:26637:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942457216:0@lo:1101:lfsck_namespace.0 00000100:00100000:1.0:1715330288.496486:0:26637:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.496495:0:26637:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f840 going to sleep for 11 seconds 00000100:00100000:1.0:1715330288.496501:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942457216 00000100:00100000:1.0:1715330288.496503:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942457216 00000100:00100000:1.0:1715330288.496524:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2701 00000100:00100000:1.0:1715330288.496527:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26637:x1798653942457216:12345-0@lo:1101:lfsck_namespace.0 00100000:10000000:1.0:1715330288.496540:0:9407:0:(lfsck_namespace.c:5148:lfsck_namespace_in_notify()) lustre-MDT0000-osd: namespace LFSCK handles notify 3 from MDT 1, status 1, flags 0 00000100:00100000:1.0:1715330288.496557:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:26637:x1798653942457216:12345-0@lo:1101:lfsck_namespace.0 Request processed in 30us (71us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330288.496561:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2701 00000100:00100000:1.0:1715330288.496577:0:26637:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942457216:0@lo:1101:lfsck_namespace.0 00100000:10000000:1.0:1715330288.496583:0:26637:0:(lfsck_engine.c:1696:lfsck_assistant_engine()) lustre-MDT0001-osd: LFSCK assistant notified others for lfsck_namespace post: rc = 0 00100000:10000000:2.0:1715330288.496791:0:26635:0:(lfsck_lib.c:2617:lfsck_post_generic()) lustre-MDT0001-osd: the assistant has done lfsck_namespace post, rc = 1 00100000:10000000:2.0:1715330288.496835:0:26635:0:(lfsck_namespace.c:4826:lfsck_namespace_post()) lustre-MDT0001-osd: namespace LFSCK post done: rc = 0 00100000:10000000:2.0:1715330288.496841:0:26635:0:(lfsck_lib.c:2634:lfsck_double_scan_generic()) lustre-MDT0001-osd: waiting for assistant to do lfsck_namespace double_scan, status 2 00100000:10000000:1.0:1715330288.500927:0:26637:0:(lfsck_engine.c:1714:lfsck_assistant_engine()) lustre-MDT0001-osd: LFSCK assistant sync before the second-stage scaning 00000004:00080000:1.0:1715330288.500948:0:26637:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 262977216911ns, next at 0ns, rc = 0 00080000:00080000:1.0:1715330288.500959:0:26637:0:(osd_handler.c:2696:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:1.0:1715330288.500977:0:26637:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 262977246150ns, next at 0ns, rc = 0 00080000:00080000:1.0:1715330288.500981:0:26637:0:(osd_handler.c:2696:osd_commit_async()) lustre-MDT0001: async commit OSD 00100000:10000000:2.0:1715330288.501022:0:26635:0:(lfsck_lib.c:2644:lfsck_double_scan_generic()) lustre-MDT0001-osd: the assistant has done lfsck_namespace double_scan, status 0 00100000:10000000:1.0:1715330288.502321:0:26634:0:(lfsck_engine.c:1721:lfsck_assistant_engine()) lustre-MDT0000-osd: LFSCK assistant phase2 scan start, synced: rc = 0 00100000:10000000:1.0:1715330288.502330:0:26634:0:(lfsck_namespace.c:6754:lfsck_namespace_assistant_handler_p2()) lustre-MDT0000-osd: namespace LFSCK phase2 scan start 00100000:10000000:1.0:1715330288.502386:0:26634:0:(lfsck_namespace.c:6362:lfsck_namespace_scan_local_lpf()) lustre-MDT0000-osd: start to scan backend /lost+found 00100000:10000000:1.0:1715330288.502418:0:26634:0:(lfsck_namespace.c:6470:lfsck_namespace_scan_local_lpf()) lustre-MDT0000-osd: stop to scan backend /lost+found: rc = 1 00000100:00100000:1.0:1715330288.502517:0:26634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942457408:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.502543:0:26634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.502554:0:26634:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f540 going to sleep for 11 seconds 00000100:00100000:0.0:1715330288.502607:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942457408 00000100:00100000:0.0:1715330288.502612:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942457408 00000100:00100000:0.0:1715330288.502640:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2703 00000100:00100000:0.0:1715330288.502646:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:26634:x1798653942457408:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1715330288.502703:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:26634:x1798653942457408:12345-0@lo:1000:lfsck_namespace.0 Request processed in 57us (159us total) trans 0 rc 1/1 00000100:00100000:0.0:1715330288.502709:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2703 00000100:00100000:1.0:1715330288.502716:0:26634:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942457408:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.502791:0:26634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942457472:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.502810:0:26634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.502826:0:26634:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f540 going to sleep for 11 seconds 00000100:00100000:0.0:1715330288.502841:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942457472 00000100:00100000:0.0:1715330288.502844:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942457472 00000100:00100000:0.0:1715330288.502856:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2704 00000100:00100000:0.0:1715330288.502860:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:26634:x1798653942457472:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.502904:0:26634:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942457472:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.502948:0:26634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942457536:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.502965:0:26634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.502973:0:26634:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f540 going to sleep for 11 seconds 00000100:00100000:1.0:1715330288.502979:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942457536 00000100:00100000:1.0:1715330288.502982:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942457536 00000100:00100000:0.0:1715330288.502996:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:26634:x1798653942457472:12345-0@lo:1000:lfsck_namespace.0 Request processed in 134us (185us total) trans 0 rc 1/1 00000100:00100000:0.0:1715330288.503001:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2704 00000100:00100000:0.0:1715330288.503011:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2705 00000100:00100000:0.0:1715330288.503014:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:26634:x1798653942457536:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1715330288.503046:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:26634:x1798653942457536:12345-0@lo:1000:lfsck_namespace.0 Request processed in 30us (80us total) trans 0 rc 1/1 00000100:00100000:0.0:1715330288.503050:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2705 00000100:00100000:1.0:1715330288.503069:0:26634:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942457536:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.503112:0:26634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942457600:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.503129:0:26634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.503144:0:26634:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f540 going to sleep for 11 seconds 00000100:00100000:2.0:1715330288.503181:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942457600 00000100:00100000:2.0:1715330288.503185:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942457600 00000100:00100000:2.0:1715330288.503207:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2706 00000100:00100000:2.0:1715330288.503211:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:26634:x1798653942457600:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1715330288.503254:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:26634:x1798653942457600:12345-0@lo:1000:lfsck_namespace.0 Request processed in 42us (124us total) trans 0 rc 1/1 00000100:00100000:2.0:1715330288.503259:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2706 00000100:00100000:1.0:1715330288.503308:0:26634:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942457600:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.503390:0:26634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012faeed80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942457664:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.503408:0:26634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.503416:0:26634:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f540 going to sleep for 11 seconds 00000100:00100000:0.0:1715330288.503420:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942457664 00000100:00100000:0.0:1715330288.503423:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942457664 00000100:00100000:0.0:1715330288.503444:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2707 00000100:00100000:0.0:1715330288.503835:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:26634:x1798653942457664:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1715330288.503878:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:26634:x1798653942457664:12345-0@lo:1000:lfsck_namespace.0 Request processed in 429us (469us total) trans 0 rc 1/1 00000100:00100000:0.0:1715330288.503883:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2707 00000100:00100000:1.0:1715330288.504886:0:26634:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012faeed80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942457664:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.504958:0:26634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012faeed80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942457728:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.504979:0:26634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.504993:0:26634:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f540 going to sleep for 11 seconds 00000100:00100000:0.0:1715330288.505377:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942457728 00000100:00100000:0.0:1715330288.505383:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942457728 00000100:00100000:0.0:1715330288.505407:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2708 00000100:00100000:0.0:1715330288.505538:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:26634:x1798653942457728:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1715330288.505596:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:26634:x1798653942457728:12345-0@lo:1000:lfsck_namespace.0 Request processed in 59us (615us total) trans 0 rc 1/1 00000100:00100000:0.0:1715330288.505602:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2708 00000100:00100000:1.0:1715330288.505684:0:26634:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012faeed80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942457728:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.505743:0:26634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012faeed80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942457792:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.505761:0:26634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.505780:0:26634:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f540 going to sleep for 11 seconds 00000100:00100000:0.0:1715330288.505829:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942457792 00000100:00100000:0.0:1715330288.505833:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942457792 00000100:00100000:0.0:1715330288.505848:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2709 00000100:00100000:0.0:1715330288.505852:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:26634:x1798653942457792:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1715330288.505893:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:26634:x1798653942457792:12345-0@lo:1000:lfsck_namespace.0 Request processed in 40us (131us total) trans 0 rc 1/1 00000100:00100000:0.0:1715330288.505899:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2709 00000001:00080000:2.0:1715330288.509347:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968383 is committed 00000004:00080000:2.0:1715330288.509358:0:8267:0:(osp_sync.c:1604:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 2 committed 00000004:00080000:2.0:1715330288.509367:0:8267:0:(osp_sync.c:1604:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 2 committed 00000020:00080000:2.0:1715330288.509398:0:8267:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0001: 382 batchid updated 00000001:00080000:2.0:1715330288.509418:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968380 is committed 00000020:00080000:2.0:1715330288.509424:0:8267:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0001: 381 batchid updated 00010000:00010000:2.0:1715330288.509669:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d84e1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x77656e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330288.509679:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d84e1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x77656e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330288.509685:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d84e1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x77656e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330288.509690:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfcb40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330288.509694:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d84e1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x77656e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330288.509700:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d84e1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x77656e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330288.509711:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x77656e (ffff88009bbf0b00) 00010000:00010000:2.0:1715330288.509714:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330288.509717:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d84e1 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x77656e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330288.509726:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcb40/0xd895711d66d84e1 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x77656e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330288.509751:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d84e8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330288.509756:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d84e8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330288.509761:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d84e8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330288.509765:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfcd80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330288.509767:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d84e8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330288.509771:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d84e8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330288.509777:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18b:0x0].0x0 (ffff88009bbf0f00) 00010000:00010000:2.0:1715330288.509778:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330288.509780:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d84e8 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330288.509785:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d84e8 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330288.509800:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d8512 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x77656e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330288.509804:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d8512 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x77656e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330288.509809:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d8512 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x77656e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330288.509813:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfed00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330288.509815:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d8512 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x77656e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330288.509819:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d8512 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x77656e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330288.509824:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x77656e (ffff88009bbf0b00) 00010000:00010000:2.0:1715330288.509826:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330288.509827:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d8512 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x77656e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330288.509831:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d8512 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x77656e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00000020:00080000:0.0:1715330288.509891:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 382 00000004:00080000:0.0:1715330288.509930:0:8285:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff880091cb2a80 with version 736 00000020:00080000:0.0:1715330288.509936:0:8285:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 381 cancel update log [0x200000401:0x3:0x0].384: rc = 0 00000020:00080000:0.0:1715330288.509989:0:8285:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 381 cancel update log [0x240000400:0x3:0x0].382: rc = 0 00000004:00080000:0.0:1715330288.510003:0:8285:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff880091cb2b40 with version 737 00000020:00080000:0.0:1715330288.510006:0:8285:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 382 cancel update log [0x200000401:0x3:0x0].385: rc = 0 00000020:00080000:0.0:1715330288.510017:0:8285:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 382 cancel update log [0x240000400:0x3:0x0].383: rc = 0 00000020:00080000:0.0:1715330288.510021:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 382 00000004:00080000:2.0:1715330288.510086:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 736 rpc_version 736 00000020:00100000:2.0:1715330288.510109:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1715330288.510117:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8801344c8000 x1798653942457920/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1715330288.510135:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344c8000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942457920:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1715330288.510196:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330288.510211:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435000 going to sleep for 11 seconds 00000100:00100000:1.0:1715330288.510270:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942457920 00000100:00100000:1.0:1715330288.510276:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942457920 00000100:00100000:1.0:1715330288.510301:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2710 00000100:00100000:1.0:1715330288.510306:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:8278:x1798653942457920:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1715330288.510396:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:8278:x1798653942457920:12345-0@lo:1000:osp_up0-1.0 Request processed in 89us (200us total) trans 4294983438 rc 0/0 00000100:00100000:1.0:1715330288.510402:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2710 00000100:00100000:1.0:1715330288.510434:0:26634:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012faeed80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942457792:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.510524:0:26634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012faeed80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942457984:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.510543:0:26634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.510551:0:26634:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f540 going to sleep for 11 seconds 00000100:00100000:1.0:1715330288.510558:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942457984 00000100:00100000:1.0:1715330288.510560:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942457984 00000100:00100000:1.0:1715330288.510573:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2711 00000100:00100000:1.0:1715330288.510576:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:26634:x1798653942457984:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.510615:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:26634:x1798653942457984:12345-0@lo:1000:lfsck_namespace.0 Request processed in 37us (70us total) trans 0 rc 1/1 00000100:00100000:1.0:1715330288.510619:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2711 00000100:00100000:1.0:1715330288.510637:0:26634:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968383 gen 2 00000004:00080000:1.0:1715330288.510641:0:26634:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968378 committed transno 4294968383 00000020:00080000:1.0:1715330288.510644:0:26634:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff880091ffce40 refcount 2 committed 0 result 0 batchid 375 00000020:00080000:1.0:1715330288.510647:0:26634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88012ca48100 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff880091ffcf00 00000020:00080000:1.0:1715330288.510649:0:26634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].359 00000020:00080000:1.0:1715330288.510651:0:26634:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88012ca48000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88012f5cbc00 00000020:00080000:1.0:1715330288.510653:0:26634:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].359 00000004:00080000:1.0:1715330288.510670:0:26634:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968381 committed transno 4294968383 00000004:00080000:1.0:1715330288.510682:0:26634:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968382 committed transno 4294968383 00000004:00080000:1.0:1715330288.510693:0:26634:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968383 committed transno 4294968383 00000100:00100000:1.0:1715330288.510702:0:26634:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012faeed80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942457984:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.510789:0:26634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012faeed80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942458048:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.510808:0:26634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.510815:0:26634:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f540 going to sleep for 11 seconds 00000100:00100000:1.0:1715330288.510824:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942458048 00000100:00100000:1.0:1715330288.510826:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942458048 00000100:00100000:1.0:1715330288.510838:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2712 00000100:00100000:1.0:1715330288.510842:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:26634:x1798653942458048:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.510881:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:26634:x1798653942458048:12345-0@lo:1000:lfsck_namespace.0 Request processed in 38us (72us total) trans 0 rc 1/1 00000100:00100000:1.0:1715330288.510886:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2712 00000100:00100000:1.0:1715330288.510905:0:26634:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012faeed80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942458048:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.510954:0:26634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012faeed80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942458112:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.510972:0:26634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.510980:0:26634:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f540 going to sleep for 11 seconds 00000100:00100000:1.0:1715330288.510986:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942458112 00000100:00100000:1.0:1715330288.510989:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942458112 00000100:00100000:1.0:1715330288.511001:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2713 00000100:00100000:1.0:1715330288.511004:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:26634:x1798653942458112:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.511033:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:26634:x1798653942458112:12345-0@lo:1000:lfsck_namespace.0 Request processed in 28us (60us total) trans 0 rc 1/1 00000100:00100000:1.0:1715330288.511038:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2713 00000100:00100000:1.0:1715330288.511055:0:26634:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012faeed80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942458112:0@lo:1000:lfsck_namespace.0 00100000:10000000:1.0:1715330288.511085:0:26634:0:(lfsck_namespace.c:6773:lfsck_namespace_assistant_handler_p2()) lustre-MDT0000-osd: namespace LFSCK phase2 scan stop at the No. 16 trace file: rc = 1 00000100:00100000:1.0:1715330288.511100:0:26634:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c2300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942458176:0@lo:1101:lfsck_namespace.0 00000100:00100000:1.0:1715330288.511117:0:26634:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.511124:0:26634:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f900 going to sleep for 11 seconds 00000100:00100000:1.0:1715330288.511132:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942458176 00000100:00100000:1.0:1715330288.511134:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942458176 00000100:00100000:1.0:1715330288.511145:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2714 00000100:00100000:1.0:1715330288.511148:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:26634:x1798653942458176:12345-0@lo:1101:lfsck_namespace.0 00100000:10000000:1.0:1715330288.511160:0:9407:0:(lfsck_namespace.c:5148:lfsck_namespace_in_notify()) lustre-MDT0001-osd: namespace LFSCK handles notify 4 from MDT 0, status 1, flags 0 00000100:00100000:1.0:1715330288.511180:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:26634:x1798653942458176:12345-0@lo:1101:lfsck_namespace.0 Request processed in 31us (62us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330288.511185:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2714 00000100:00100000:1.0:1715330288.511203:0:26634:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c2300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:26634:1798653942458176:0@lo:1101:lfsck_namespace.0 00000100:00100000:1.0:1715330288.511207:0:26634:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f900 going to sleep for 0 seconds 00100000:10000000:1.0:1715330288.511213:0:26634:0:(lfsck_engine.c:1839:lfsck_assistant_engine()) lustre-MDT0000-osd: LFSCK assistant sync before exit 00000004:00080000:1.0:1715330288.511224:0:26634:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 262987492478ns, next at 206082064496ns, rc = 0 00080000:00080000:1.0:1715330288.511229:0:26634:0:(osd_handler.c:2696:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1715330288.511359:0:26634:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 262987627000ns, next at 201943329274ns, rc = 0 00080000:00080000:1.0:1715330288.511364:0:26634:0:(osd_handler.c:2696:osd_commit_async()) lustre-MDT0000: async commit OSD 00100000:10000000:1.0:1715330288.511376:0:26637:0:(lfsck_engine.c:1721:lfsck_assistant_engine()) lustre-MDT0001-osd: LFSCK assistant phase2 scan start, synced: rc = 0 00100000:10000000:1.0:1715330288.511381:0:26637:0:(lfsck_namespace.c:6754:lfsck_namespace_assistant_handler_p2()) lustre-MDT0001-osd: namespace LFSCK phase2 scan start 00100000:10000000:1.0:1715330288.511423:0:26637:0:(lfsck_namespace.c:6362:lfsck_namespace_scan_local_lpf()) lustre-MDT0001-osd: start to scan backend /lost+found 00100000:10000000:1.0:1715330288.511457:0:26637:0:(lfsck_namespace.c:6470:lfsck_namespace_scan_local_lpf()) lustre-MDT0001-osd: stop to scan backend /lost+found: rc = 1 00000100:00100000:1.0:1715330288.511520:0:26637:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c2300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942458240:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.511539:0:26637:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.511548:0:26637:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330288.511555:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942458240 00000100:00100000:1.0:1715330288.511557:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942458240 00000100:00100000:1.0:1715330288.511569:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2715 00000100:00100000:1.0:1715330288.511572:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:26637:x1798653942458240:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.511606:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:26637:x1798653942458240:12345-0@lo:1000:lfsck_namespace.0 Request processed in 32us (67us total) trans 0 rc 1/1 00000100:00100000:1.0:1715330288.511610:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2715 00000100:00100000:1.0:1715330288.511626:0:26637:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c2300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942458240:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.511665:0:26637:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c2300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942458304:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.511681:0:26637:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.511688:0:26637:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330288.511694:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942458304 00000100:00100000:1.0:1715330288.511696:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942458304 00000100:00100000:1.0:1715330288.511707:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2716 00000100:00100000:1.0:1715330288.511710:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:26637:x1798653942458304:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.511760:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:26637:x1798653942458304:12345-0@lo:1000:lfsck_namespace.0 Request processed in 49us (78us total) trans 0 rc 1/1 00000100:00100000:1.0:1715330288.511765:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2716 00000100:00100000:1.0:1715330288.511781:0:26637:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c2300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942458304:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.511817:0:26637:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c2300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942458368:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.511834:0:26637:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.511842:0:26637:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330288.511848:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942458368 00000100:00100000:1.0:1715330288.511850:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942458368 00000100:00100000:2.0:1715330288.514322:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344c8000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942457920:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1715330288.514332:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 737 rpc_version 737 00000020:00100000:2.0:1715330288.514346:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1715330288.514351:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8801344c8a80 x1798653942458496/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1715330288.514363:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344c8a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942458496:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1715330288.514395:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330288.514406:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435000 going to sleep for 11 seconds 00000100:00100000:0.0:1715330288.514615:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942458496 00000100:00100000:0.0:1715330288.514620:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942458496 00000100:00100000:0.0:1715330288.514640:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2717 00000100:00100000:0.0:1715330288.514644:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:8278:x1798653942458496:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330288.514753:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:8278:x1798653942458496:12345-0@lo:1000:osp_up0-1.0 Request processed in 106us (356us total) trans 4294983439 rc 0/0 00000100:00100000:0.0:1715330288.514758:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2717 00000100:00100000:2.0:1715330288.514938:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344c8a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942458496:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1715330288.515149:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2718 00000100:00100000:1.0:1715330288.515154:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:26637:x1798653942458368:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.515214:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:26637:x1798653942458368:12345-0@lo:1000:lfsck_namespace.0 Request processed in 60us (3379us total) trans 0 rc 1/1 00000100:00100000:1.0:1715330288.515219:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2718 00000100:00100000:1.0:1715330288.515242:0:26637:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c2300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942458368:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.515317:0:26637:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c2300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942458560:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.515336:0:26637:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.515345:0:26637:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330288.515351:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942458560 00000100:00100000:1.0:1715330288.515354:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942458560 00000100:00100000:1.0:1715330288.515366:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2719 00000100:00100000:1.0:1715330288.515369:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:26637:x1798653942458560:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.515406:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:26637:x1798653942458560:12345-0@lo:1000:lfsck_namespace.0 Request processed in 36us (69us total) trans 0 rc 1/1 00000100:00100000:1.0:1715330288.515411:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2719 00000100:00100000:1.0:1715330288.515429:0:26637:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c2300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942458560:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.515477:0:26637:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c2300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942458624:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.515494:0:26637:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.515502:0:26637:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330288.515519:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942458624 00000100:00100000:1.0:1715330288.515521:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942458624 00000100:00100000:1.0:1715330288.515532:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2720 00000100:00100000:1.0:1715330288.515535:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:26637:x1798653942458624:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.515572:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:26637:x1798653942458624:12345-0@lo:1000:lfsck_namespace.0 Request processed in 35us (76us total) trans 0 rc 1/1 00000100:00100000:1.0:1715330288.515576:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2720 00000100:00100000:1.0:1715330288.515594:0:26637:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c2300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942458624:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.515635:0:26637:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c2300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942458688:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.515651:0:26637:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.515659:0:26637:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330288.515666:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942458688 00000100:00100000:1.0:1715330288.515668:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942458688 00000100:00100000:1.0:1715330288.515680:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2721 00000100:00100000:1.0:1715330288.515683:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:26637:x1798653942458688:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.515718:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:26637:x1798653942458688:12345-0@lo:1000:lfsck_namespace.0 Request processed in 34us (66us total) trans 0 rc 1/1 00000100:00100000:1.0:1715330288.515723:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2721 00000100:00100000:1.0:1715330288.515756:0:26637:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c2300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942458688:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.515817:0:26637:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c2300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942458752:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.515834:0:26637:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.515843:0:26637:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330288.515849:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942458752 00000100:00100000:1.0:1715330288.515851:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942458752 00000100:00100000:1.0:1715330288.515863:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2722 00000100:00100000:1.0:1715330288.515867:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:26637:x1798653942458752:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.515934:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:26637:x1798653942458752:12345-0@lo:1000:lfsck_namespace.0 Request processed in 66us (98us total) trans 0 rc -2/-2 00000100:00100000:1.0:1715330288.515939:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2722 00000100:00100000:1.0:1715330288.515959:0:26637:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c2300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942458752:0@lo:1000:lfsck_namespace.0 00010000:00010000:1.0:1715330288.515990:0:26637:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffcc0/0xd895711d66d8558 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 26637 initiator: MDT0 00010000:00010000:1.0:1715330288.516001:0:26637:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffcc0/0xd895711d66d8558 lrc: 3/0,1 mode: EX/EX res: [0x240000401:0x13:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26637 initiator: MDT1 00010000:00010000:1.0:1715330288.516010:0:26637:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffcc0/0xd895711d66d8558 lrc: 3/0,1 mode: EX/EX res: [0x240000401:0x13:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 26637 initiator: MDT1 00000100:00100000:1.0:1715330288.516038:0:26637:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c2300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942458816:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.516056:0:26637:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.516063:0:26637:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330288.516069:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942458816 00000100:00100000:1.0:1715330288.516072:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942458816 00000100:00100000:1.0:1715330288.516084:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2723 00000100:00100000:1.0:1715330288.516088:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:26637:x1798653942458816:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.516129:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:26637:x1798653942458816:12345-0@lo:1000:lfsck_namespace.0 Request processed in 40us (72us total) trans 0 rc -2/-2 00000100:00100000:1.0:1715330288.516133:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2723 00000100:00100000:1.0:1715330288.516150:0:26637:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c2300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942458816:0@lo:1000:lfsck_namespace.0 00010000:00010000:1.0:1715330288.516161:0:26637:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffcc0/0xd895711d66d8558 lrc: 3/0,1 mode: EX/EX res: [0x240000401:0x13:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26637 initiator: MDT1 00010000:00010000:1.0:1715330288.516167:0:26637:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffcc0/0xd895711d66d8558 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x13:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 26637 initiator: MDT1 00010000:00010000:1.0:1715330288.516172:0:26637:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffcc0/0xd895711d66d8558 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x13:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 26637 initiator: MDT1 00010000:00010000:1.0:1715330288.516177:0:26637:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bffcc0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:1.0:1715330288.516180:0:26637:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffcc0/0xd895711d66d8558 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x13:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 26637 initiator: MDT1 00010000:00010000:1.0:1715330288.516186:0:26637:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffcc0/0xd895711d66d8558 lrc: 4/0,0 mode: EX/EX res: [0x240000401:0x13:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 26637 initiator: MDT1 00010000:00010000:1.0:1715330288.516198:0:26637:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x13:0x0].0x0 (ffff88008b122500) 00010000:00010000:1.0:1715330288.516201:0:26637:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1715330288.516203:0:26637:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffcc0/0xd895711d66d8558 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x13:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 26637 initiator: MDT1 00010000:00010000:1.0:1715330288.516208:0:26637:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffcc0/0xd895711d66d8558 lrc: 0/0,0 mode: --/EX res: [0x240000401:0x13:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 26637 initiator: MDT1 00000100:00100000:1.0:1715330288.516236:0:26637:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c2300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942458880:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.516252:0:26637:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.516259:0:26637:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330288.516266:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942458880 00000100:00100000:1.0:1715330288.516268:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942458880 00000100:00100000:1.0:1715330288.516278:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2724 00000100:00100000:1.0:1715330288.516282:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:26637:x1798653942458880:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.516311:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:26637:x1798653942458880:12345-0@lo:1000:lfsck_namespace.0 Request processed in 28us (58us total) trans 0 rc 1/1 00000100:00100000:1.0:1715330288.516316:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2724 00000100:00100000:1.0:1715330288.516331:0:26637:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c2300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942458880:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.516355:0:26637:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c2300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942458944:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.516369:0:26637:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.516376:0:26637:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330288.516382:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942458944 00000100:00100000:1.0:1715330288.516384:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942458944 00000100:00100000:1.0:1715330288.516393:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2725 00000100:00100000:1.0:1715330288.516396:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:26637:x1798653942458944:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.516422:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:26637:x1798653942458944:12345-0@lo:1000:lfsck_namespace.0 Request processed in 25us (52us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330288.516427:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2725 00000100:00100000:1.0:1715330288.516440:0:26637:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c2300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942458944:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.516462:0:26637:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c2300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942459008:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.516476:0:26637:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.516482:0:26637:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330288.516487:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942459008 00000100:00100000:1.0:1715330288.516489:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942459008 00000100:00100000:1.0:1715330288.516496:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2726 00000100:00100000:1.0:1715330288.516499:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:26637:x1798653942459008:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.516561:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:26637:x1798653942459008:12345-0@lo:1000:lfsck_namespace.0 Request processed in 60us (84us total) trans 0 rc -2/-2 00000100:00100000:1.0:1715330288.516566:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2726 00000100:00100000:1.0:1715330288.516584:0:26637:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c2300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942459008:0@lo:1000:lfsck_namespace.0 00010000:00010000:1.0:1715330288.516603:0:26637:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfe400/0xd895711d66d855f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 26637 initiator: MDT0 00010000:00010000:1.0:1715330288.516609:0:26637:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfe400/0xd895711d66d855f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 26637 initiator: MDT1 00010000:00010000:1.0:1715330288.516616:0:26637:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfe400/0xd895711d66d855f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 26637 initiator: MDT1 00000100:00100000:1.0:1715330288.516624:0:26637:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c2300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942459072:0@lo:101:lfsck_namespace.0 00000100:00100000:1.0:1715330288.516639:0:26637:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.516648:0:26637:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f540 going to sleep for 11 seconds 00000100:00100000:1.0:1715330288.516654:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942459072 00000100:00100000:1.0:1715330288.516657:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942459072 00000100:00100000:1.0:1715330288.516668:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2727 00000100:00100000:1.0:1715330288.516672:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:26637:x1798653942459072:12345-0@lo:101:lfsck_namespace.0 00010000:00010000:1.0:1715330288.516679:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330288.516691:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe880/0xd895711d66d8566 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d855f expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330288.516704:0:9407:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe880/0xd895711d66d8566 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d855f expref: 10 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330288.516713:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe880/0xd895711d66d8566 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d855f expref: 10 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330288.516718:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff88008b122800) 00010000:00010000:1.0:1715330288.516720:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330288.516722:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfe880, rc 0) 00000004:00080000:0.0:1715330288.518183:0:7116:0:(osp_sync.c:1604:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 31 committed 00000001:00080000:0.0:1715330288.518204:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983438 is committed 00000001:00080000:0.0:1715330288.518705:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983439 is committed 00000020:00080000:0.0:1715330288.518711:0:7116:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 375 batchid updated 00000004:00080000:0.0:1715330288.518764:0:7116:0:(osp_sync.c:1604:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 32 committed 00000020:00080000:2.0:1715330288.518787:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 375 00000004:00080000:2.0:1715330288.518824:0:7163:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880134435000 with version 686 00000020:00080000:2.0:1715330288.518836:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 375 cancel update log [0x240000401:0x3:0x0].359: rc = 0 00000020:00080000:2.0:1715330288.518878:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 375 cancel update log [0x200000400:0x3:0x0].359: rc = 0 00000020:00080000:2.0:1715330288.518883:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 375 00100000:10000000:0.0:1715330288.518923:0:26634:0:(lfsck_engine.c:1845:lfsck_assistant_engine()) lustre-MDT0000-osd: LFSCK assistant synced before exit: rc = 0 00100000:10000000:0.0:1715330288.518972:0:26634:0:(lfsck_engine.c:1857:lfsck_assistant_engine()) lustre-MDT0000-osd: LFSCK assistant phase2 scan finished: rc = 1 00100000:10000000:0.0:1715330288.518974:0:26634:0:(lfsck_engine.c:1872:lfsck_assistant_engine()) lustre-MDT0000-osd: lfsck_namespace LFSCK assistant thread exit: rc = 1 00000100:00100000:1.0:1715330288.519900:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:26637:x1798653942459072:12345-0@lo:101:lfsck_namespace.0 Request processed in 3225us (3258us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330288.519907:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2727 00000100:00100000:0.0:1715330288.519935:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942459200 00000100:00100000:0.0:1715330288.519940:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942459200 00000100:00100000:0.0:1715330288.519961:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2728 00000100:00100000:0.0:1715330288.519966:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:8587:x1798653942459200:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330288.520060:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:8587:x1798653942459200:12345-0@lo:1000:osp_up1-0.0 Request processed in 93us (157us total) trans 4294968384 rc 0/0 00000100:00100000:0.0:1715330288.520068:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2728 00000100:00100000:2.0:1715330288.520135:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7b5500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942459200:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330288.520207:0:26637:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c2300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942459072:0@lo:101:lfsck_namespace.0 00010000:00010000:1.0:1715330288.520221:0:26637:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfe400/0xd895711d66d855f lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8566 expref: -99 pid: 26637 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330288.520231:0:26637:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfe400/0xd895711d66d855f lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8566 expref: -99 pid: 26637 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330288.520243:0:26637:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000403:0x1:0x0] 00010000:00010000:1.0:1715330288.520259:0:26637:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff840/0xd895711d66d856d lrc: 3/0,1 mode: --/PW res: [0x200000403:0x1:0x0].0xfe10a6a6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 26637 initiator: MDT0 00010000:00010000:1.0:1715330288.520265:0:26637:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff840/0xd895711d66d856d lrc: 3/0,1 mode: --/PW res: [0x200000403:0x1:0x0].0xfe10a6a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 26637 initiator: MDT1 00010000:00010000:1.0:1715330288.520273:0:26637:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff840/0xd895711d66d856d lrc: 3/0,1 mode: --/PW res: [0x200000403:0x1:0x0].0xfe10a6a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 26637 initiator: MDT1 00000100:00100000:1.0:1715330288.520282:0:26637:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c2300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942459264:0@lo:101:lfsck_namespace.0 00000100:00100000:1.0:1715330288.520299:0:26637:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.521511:0:26637:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f540 going to sleep for 11 seconds 00000100:00100000:0.0:1715330288.521839:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942459264 00000100:00100000:0.0:1715330288.521844:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942459264 00000100:00100000:0.0:1715330288.521880:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2729 00000100:00100000:0.0:1715330288.521885:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:26637:x1798653942459264:12345-0@lo:101:lfsck_namespace.0 00010000:00010000:0.0:1715330288.521894:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330288.521907:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1b00/0xd895711d66d8574 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x1:0x0].0xfe10a6a6 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d856d expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330288.521924:0:9407:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1b00/0xd895711d66d8574 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0xfe10a6a6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d856d expref: 9 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330288.521933:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1b00/0xd895711d66d8574 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0xfe10a6a6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d856d expref: 9 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330288.521940:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0xfe10a6a6 (ffff88008b374500) 00010000:00010000:0.0:1715330288.521943:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330288.521945:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f1b00, rc 0) 00000100:00100000:0.0:1715330288.521969:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:26637:x1798653942459264:12345-0@lo:101:lfsck_namespace.0 Request processed in 84us (1669us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330288.521975:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2729 00000100:00100000:1.0:1715330288.522161:0:26637:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983439 gen 2 00000004:00080000:1.0:1715330288.522165:0:26637:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983438 committed transno 4294983439 00000004:00080000:1.0:1715330288.522179:0:26637:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983439 committed transno 4294983439 00000100:00100000:1.0:1715330288.522189:0:26637:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c2300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942459264:0@lo:101:lfsck_namespace.0 00010000:00010000:1.0:1715330288.522200:0:26637:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff840/0xd895711d66d856d lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0xfe10a6a6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8574 expref: -99 pid: 26637 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330288.522207:0:26637:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff840/0xd895711d66d856d lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0xfe10a6a6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8574 expref: -99 pid: 26637 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330288.522216:0:26637:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000403:0x1:0x0] 00000100:00100000:1.0:1715330288.522237:0:26637:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c2300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942459328:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.522258:0:26637:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.522266:0:26637:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330288.522279:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942459328 00000100:00100000:1.0:1715330288.522282:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942459328 00000100:00100000:1.0:1715330288.522296:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2730 00000100:00100000:1.0:1715330288.522299:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:26637:x1798653942459328:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.522341:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:26637:x1798653942459328:12345-0@lo:1000:lfsck_namespace.0 Request processed in 41us (83us total) trans 0 rc -2/-2 00000100:00100000:1.0:1715330288.522542:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2730 00000100:00100000:1.0:1715330288.522562:0:26637:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c2300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942459328:0@lo:1000:lfsck_namespace.0 00000004:00080000:1.0:1715330288.522592:0:26637:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88012f49f540 with version 0 00000020:00100000:1.0:1715330288.522602:0:26637:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1715330288.522606:0:26637:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008b0c2300 x1798653942459456/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1240/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1715330288.522615:0:26637:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c2300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942459456:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.522632:0:26637:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.522638:0:26637:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f180 going to sleep for 11 seconds 00000100:00100000:0.0:1715330288.523037:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942459456 00000100:00100000:0.0:1715330288.523040:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942459456 00000100:00100000:0.0:1715330288.523060:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2731 00000100:00100000:0.0:1715330288.523063:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ba0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:26637:x1798653942459456:12345-0@lo:1000:lfsck_namespace.0 00000001:00080000:0.0:1715330288.545834:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983440 is committed 00000100:00100000:2.0:1715330288.545970:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ba0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:26637:x1798653942459456:12345-0@lo:1000:lfsck_namespace.0 Request processed in 22902us (23333us total) trans 4294983440 rc 0/0 00000100:00100000:2.0:1715330288.545983:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2731 00000004:00080000:0.0:1715330288.546296:0:26637:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983440 committed transno 4294983440 00000100:00100000:0.0:1715330288.546301:0:26637:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983440 gen 2 00000100:00100000:0.0:1715330288.546313:0:26637:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c2300 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942459456:0@lo:1000:lfsck_namespace.0 00010000:00010000:0.0:1715330288.546338:0:26637:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff840/0xd895711d66d856d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0xfe10a6a6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8574 expref: -99 pid: 26637 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330288.546347:0:26637:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff840/0xd895711d66d856d lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0xfe10a6a6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8574 expref: -99 pid: 26637 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330288.546354:0:26637:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfe400/0xd895711d66d855f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8566 expref: -99 pid: 26637 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330288.546359:0:26637:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfe400/0xd895711d66d855f lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8566 expref: -99 pid: 26637 timeout: 0 lvb_type: 0 00100000:10000000:0.0:1715330288.546364:0:26637:0:(lfsck_namespace.c:1675:lfsck_namespace_create_orphan_dir()) lustre-MDT0001-osd: namespace LFSCK create orphan dir for the object [0x200000402:0x13aa:0x0], name = [0x200000402:0x13aa:0x0]-P-0: rc = 1 00010000:00010000:0.0:1715330288.546396:0:26637:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f06c0/0xd895711d66d857b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x13aa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 26637 initiator: MDT0 00010000:00010000:0.0:1715330288.546400:0:26637:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f06c0/0xd895711d66d857b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x13aa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 26637 initiator: MDT1 00010000:00010000:0.0:1715330288.546407:0:26637:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f06c0/0xd895711d66d857b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x13aa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 26637 initiator: MDT1 00000100:00100000:0.0:1715330288.546421:0:26637:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e9500 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942459520:0@lo:101:lfsck_namespace.0 00000100:00100000:0.0:1715330288.546444:0:26637:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330288.546452:0:26637:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091cb26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715330288.547129:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942459520 00000100:00100000:2.0:1715330288.547134:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942459520 00000100:00100000:2.0:1715330288.547971:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2732 00000100:00100000:2.0:1715330288.547977:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:26637:x1798653942459520:12345-0@lo:101:lfsck_namespace.0 00010000:00010000:2.0:1715330288.547995:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330288.548010:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65f80/0xd895711d66d8582 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x13aa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d857b expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330288.548034:0:23404:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65f80/0xd895711d66d8582 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13aa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d857b expref: 10 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330288.548045:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65f80/0xd895711d66d8582 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13aa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d857b expref: 10 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330288.548052:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13aa:0x0].0x0 (ffff88009396d100) 00010000:00010000:2.0:1715330288.548055:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330288.548057:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db65f80, rc 0) 00000100:00100000:2.0:1715330288.548099:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:26637:x1798653942459520:12345-0@lo:101:lfsck_namespace.0 Request processed in 121us (1654us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330288.548110:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2732 00000100:00100000:0.0:1715330288.548389:0:26637:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e9500 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942459520:0@lo:101:lfsck_namespace.0 00010000:00010000:0.0:1715330288.548402:0:26637:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f06c0/0xd895711d66d857b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x13aa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8582 expref: -99 pid: 26637 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330288.548410:0:26637:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f06c0/0xd895711d66d857b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x13aa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8582 expref: -99 pid: 26637 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1715330288.548423:0:26637:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x13aa:0x0] 00010000:00010000:0.0:1715330288.548442:0:26637:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2d00/0xd895711d66d8589 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x13aa:0x0].0x1d820fdf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 26637 initiator: MDT0 00010000:00010000:0.0:1715330288.548447:0:26637:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2d00/0xd895711d66d8589 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x13aa:0x0].0x1d820fdf bits 0x23/0x0 rrc: 2 type: IBT flags: 0x0 pid: 26637 initiator: MDT1 00010000:00010000:0.0:1715330288.548453:0:26637:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2d00/0xd895711d66d8589 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x13aa:0x0].0x1d820fdf bits 0x23/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 26637 initiator: MDT1 00000100:00100000:0.0:1715330288.548464:0:26637:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e9500 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942459584:0@lo:101:lfsck_namespace.0 00000100:00100000:0.0:1715330288.548487:0:26637:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.548570:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942459584 00000100:00100000:0.0:1715330288.548572:0:26637:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091cb26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330288.548574:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942459584 00000100:00100000:1.0:1715330288.548602:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2733 00000100:00100000:1.0:1715330288.548607:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:26637:x1798653942459584:12345-0@lo:101:lfsck_namespace.0 00010000:00010000:1.0:1715330288.548613:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330288.548623:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d8590 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x13aa:0x0].0x1d820fdf bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d8589 expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330288.548634:0:9407:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d8590 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13aa:0x0].0x1d820fdf bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d8589 expref: 11 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330288.548641:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc900/0xd895711d66d8590 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13aa:0x0].0x1d820fdf bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8589 expref: 11 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330288.548646:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13aa:0x0].0x1d820fdf (ffff88008b122f00) 00010000:00010000:1.0:1715330288.548649:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 23 00010000:00010000:1.0:1715330288.548650:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfc900, rc 0) 00000100:00100000:1.0:1715330288.548678:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:26637:x1798653942459584:12345-0@lo:101:lfsck_namespace.0 Request processed in 70us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330288.548682:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2733 00000100:00100000:0.0:1715330288.548682:0:26637:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e9500 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942459584:0@lo:101:lfsck_namespace.0 00010000:00010000:0.0:1715330288.548690:0:26637:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2d00/0xd895711d66d8589 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x13aa:0x0].0x1d820fdf bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8590 expref: -99 pid: 26637 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330288.548696:0:26637:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2d00/0xd895711d66d8589 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x13aa:0x0].0x1d820fdf bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8590 expref: -99 pid: 26637 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1715330288.548703:0:26637:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x13aa:0x0] 00000100:00100000:0.0:1715330288.548766:0:26637:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e9500 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942459648:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1715330288.548784:0:26637:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330288.548798:0:26637:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091cb2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1715330288.548799:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942459648 00000100:00100000:1.0:1715330288.548802:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942459648 00000100:00100000:1.0:1715330288.548815:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2734 00000100:00100000:1.0:1715330288.548818:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:26637:x1798653942459648:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.548936:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:26637:x1798653942459648:12345-0@lo:1000:lfsck_namespace.0 Request processed in 115us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330288.548941:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2734 00000100:00100000:0.0:1715330288.549099:0:26637:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e9500 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942459648:0@lo:1000:lfsck_namespace.0 00000004:00080000:0.0:1715330288.549183:0:26637:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff880091cb26c0 with version 0 00000020:00100000:0.0:1715330288.549192:0:26637:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1715330288.549198:0:26637:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008d4e9500 x1798653942459776/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 328/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715330288.549208:0:26637:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e9500 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942459776:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1715330288.549226:0:26637:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330288.549246:0:26637:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091cb2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1715330288.549266:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942459776 00000100:00100000:2.0:1715330288.549269:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942459776 00000100:00100000:2.0:1715330288.549840:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2735 00000100:00100000:2.0:1715330288.549845:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:26637:x1798653942459776:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1715330288.549977:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:26637:x1798653942459776:12345-0@lo:1000:lfsck_namespace.0 Request processed in 131us (749us total) trans 4294983441 rc 0/0 00000100:00100000:2.0:1715330288.549983:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2735 00000100:00100000:0.0:1715330288.550052:0:26637:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e9500 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942459776:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1715330288.550078:0:26637:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4ea680 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942459840:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1715330288.550097:0:26637:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330288.550294:0:26637:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091cb2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1715330288.550476:0:26637:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4ea680 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942459840:0@lo:1000:lfsck_namespace.0 00000040:00080000:0.0:1715330288.550710:0:26637:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].384, 448 off580448 00000040:00080000:0.0:1715330288.550727:0:26637:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].386, 448 off635488 00000004:00080000:0.0:1715330288.551444:0:26637:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff880091cb2b40 with version 738 00000004:00080000:2.0:1715330288.551523:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 738 rpc_version 738 00000020:00100000:2.0:1715330288.551543:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1715330288.551550:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8801344c8e00 x1798653942459968/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1715330288.551562:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344c8e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942459968:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1715330288.551585:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330288.551607:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff8801344356c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330288.551662:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942459968 00000100:00100000:0.0:1715330288.551667:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942459968 00000100:00100000:0.0:1715330288.551683:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2737 00000100:00100000:0.0:1715330288.551687:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:8278:x1798653942459968:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330288.551922:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+13:8278:x1798653942459968:12345-0@lo:1000:osp_up0-1.0 Request processed in 233us (335us total) trans 4294983442 rc 0/0 00000100:00100000:0.0:1715330288.551928:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2737 00000100:00100000:2.0:1715330288.551993:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344c8e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942459968:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1715330288.552180:0:26637:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff880091cb2180 with version 0 00000020:00100000:0.0:1715330288.552188:0:26637:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1715330288.552192:0:26637:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008d4ea680 x1798653942460096/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 408/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715330288.552203:0:26637:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4ea680 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942460096:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1715330288.552222:0:26637:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330288.552790:0:26637:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa180 going to sleep for 11 seconds 00000100:00100000:2.0:1715330288.553208:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942460096 00000100:00100000:2.0:1715330288.553213:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942460096 00000100:00100000:2.0:1715330288.553394:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2738 00000100:00100000:2.0:1715330288.553399:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+13:26637:x1798653942460096:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1715330288.553474:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:26637:x1798653942460096:12345-0@lo:1000:lfsck_namespace.0 Request processed in 74us (1251us total) trans 4294983443 rc 0/0 00000100:00100000:2.0:1715330288.553482:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2738 00000100:00100000:1.0:1715330288.553586:0:26637:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4ea680 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942460096:0@lo:1000:lfsck_namespace.0 00010000:00010000:1.0:1715330288.553599:0:26637:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2d00/0xd895711d66d8589 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x13aa:0x0].0x1d820fdf bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8590 expref: -99 pid: 26637 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330288.553608:0:26637:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f2d00/0xd895711d66d8589 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x13aa:0x0].0x1d820fdf bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8590 expref: -99 pid: 26637 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330288.553615:0:26637:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f06c0/0xd895711d66d857b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x13aa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8582 expref: -99 pid: 26637 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330288.553621:0:26637:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f06c0/0xd895711d66d857b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x13aa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8582 expref: -99 pid: 26637 timeout: 0 lvb_type: 0 00100000:10000000:1.0:1715330288.553626:0:26637:0:(lfsck_namespace.c:1409:lfsck_namespace_insert_normal()) lustre-MDT0001-osd: namespace LFSCK insert object [0x240000401:0x13:0x0] with the name [0x240000401:0x13:0x0]:1 and type 40000 to the parent [0x200000402:0x13aa:0x0]: rc = 1 00000100:00100000:1.0:1715330288.553887:0:26637:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c2d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942460160:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.553912:0:26637:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.553928:0:26637:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f300 going to sleep for 11 seconds 00000100:00100000:0.0:1715330288.553963:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942460160 00000100:00100000:0.0:1715330288.553966:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942460160 00000100:00100000:0.0:1715330288.553980:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2739 00000100:00100000:0.0:1715330288.553984:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:26637:x1798653942460160:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1715330288.554026:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:26637:x1798653942460160:12345-0@lo:1000:lfsck_namespace.0 Request processed in 42us (114us total) trans 0 rc 1/1 00000100:00100000:0.0:1715330288.554031:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2739 00000100:00100000:1.0:1715330288.554072:0:26637:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c2d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942460160:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.554121:0:26637:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c2d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942460224:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.554136:0:26637:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.554142:0:26637:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f300 going to sleep for 11 seconds 00000100:00100000:0.0:1715330288.554174:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942460224 00000100:00100000:0.0:1715330288.554177:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942460224 00000100:00100000:0.0:1715330288.554192:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2740 00000100:00100000:0.0:1715330288.554195:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:26637:x1798653942460224:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1715330288.554230:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:26637:x1798653942460224:12345-0@lo:1000:lfsck_namespace.0 Request processed in 33us (93us total) trans 0 rc 1/1 00000100:00100000:0.0:1715330288.554234:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2740 00000100:00100000:1.0:1715330288.554272:0:26637:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c2d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942460224:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.554322:0:26637:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c2d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942460288:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.554336:0:26637:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.554341:0:26637:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f300 going to sleep for 11 seconds 00000100:00100000:0.0:1715330288.554374:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942460288 00000100:00100000:0.0:1715330288.554376:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942460288 00000100:00100000:0.0:1715330288.554387:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2741 00000100:00100000:0.0:1715330288.554390:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:26637:x1798653942460288:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1715330288.554423:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:26637:x1798653942460288:12345-0@lo:1000:lfsck_namespace.0 Request processed in 31us (86us total) trans 0 rc 1/1 00000100:00100000:0.0:1715330288.554427:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2741 00000100:00100000:1.0:1715330288.554470:0:26637:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c2d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942460288:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.554526:0:26637:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c2d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942460352:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.554540:0:26637:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.554547:0:26637:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f300 going to sleep for 11 seconds 00000100:00100000:2.0:1715330288.554555:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942460352 00000100:00100000:2.0:1715330288.554558:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942460352 00000100:00100000:2.0:1715330288.554663:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2742 00000100:00100000:2.0:1715330288.554667:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:26637:x1798653942460352:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1715330288.554900:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:26637:x1798653942460352:12345-0@lo:1000:lfsck_namespace.0 Request processed in 231us (358us total) trans 0 rc 1/1 00000100:00100000:2.0:1715330288.554906:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2742 00000100:00100000:1.0:1715330288.554971:0:26637:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c2d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942460352:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.555012:0:26637:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c2d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942460416:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.555030:0:26637:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.555038:0:26637:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f300 going to sleep for 11 seconds 00000100:00100000:2.0:1715330288.555098:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942460416 00000100:00100000:2.0:1715330288.555101:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942460416 00000100:00100000:2.0:1715330288.555123:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2743 00000100:00100000:2.0:1715330288.555126:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:26637:x1798653942460416:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1715330288.555165:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:26637:x1798653942460416:12345-0@lo:1000:lfsck_namespace.0 Request processed in 38us (134us total) trans 0 rc 1/1 00000100:00100000:2.0:1715330288.555170:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2743 00000100:00100000:1.0:1715330288.555214:0:26637:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c2d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942460416:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.555263:0:26637:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c2d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942460480:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.555280:0:26637:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.555287:0:26637:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f300 going to sleep for 11 seconds 00000100:00100000:0.0:1715330288.555322:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942460480 00000100:00100000:0.0:1715330288.555325:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942460480 00000100:00100000:0.0:1715330288.555338:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2744 00000100:00100000:0.0:1715330288.555342:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:26637:x1798653942460480:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1715330288.555381:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:26637:x1798653942460480:12345-0@lo:1000:lfsck_namespace.0 Request processed in 38us (100us total) trans 0 rc 1/1 00000100:00100000:0.0:1715330288.555385:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2744 00000100:00100000:1.0:1715330288.555584:0:26637:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c2d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942460480:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.555624:0:26637:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c2d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942460544:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.555641:0:26637:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.555660:0:26637:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f300 going to sleep for 11 seconds 00000100:00100000:0.0:1715330288.555786:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942460544 00000100:00100000:0.0:1715330288.555790:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942460544 00000100:00100000:0.0:1715330288.555988:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2745 00000100:00100000:0.0:1715330288.555993:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:26637:x1798653942460544:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1715330288.556038:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:26637:x1798653942460544:12345-0@lo:1000:lfsck_namespace.0 Request processed in 44us (395us total) trans 0 rc 1/1 00000100:00100000:0.0:1715330288.556044:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2745 00000100:00100000:1.0:1715330288.556096:0:26637:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c2d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942460544:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.556149:0:26637:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c2d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942460608:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.556166:0:26637:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.556173:0:26637:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f300 going to sleep for 11 seconds 00000100:00100000:2.0:1715330288.556223:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942460608 00000100:00100000:2.0:1715330288.556227:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942460608 00000100:00100000:2.0:1715330288.556242:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2746 00000100:00100000:2.0:1715330288.556245:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:26637:x1798653942460608:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1715330288.556286:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:26637:x1798653942460608:12345-0@lo:1000:lfsck_namespace.0 Request processed in 40us (119us total) trans 0 rc 1/1 00000100:00100000:2.0:1715330288.556291:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2746 00000100:00100000:1.0:1715330288.556423:0:26637:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c2d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942460608:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.556462:0:26637:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c2d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942460672:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1715330288.556478:0:26637:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330288.556496:0:26637:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f300 going to sleep for 11 seconds 00000100:00100000:0.0:1715330288.556557:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942460672 00000100:00100000:0.0:1715330288.556560:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942460672 00000100:00100000:0.0:1715330288.556573:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2747 00000100:00100000:0.0:1715330288.556576:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:26637:x1798653942460672:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1715330288.556616:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:26637:x1798653942460672:12345-0@lo:1000:lfsck_namespace.0 Request processed in 38us (137us total) trans 0 rc 1/1 00000100:00100000:0.0:1715330288.556620:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2747 00000100:00100000:1.0:1715330288.556756:0:26637:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c2d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:26637:1798653942460672:0@lo:1000:lfsck_namespace.0 00100000:10000000:1.0:1715330288.556790:0:26637:0:(lfsck_namespace.c:6773:lfsck_namespace_assistant_handler_p2()) lustre-MDT0001-osd: namespace LFSCK phase2 scan stop at the No. 16 trace file: rc = 1 00100000:10000000:1.0:1715330288.556798:0:26637:0:(lfsck_engine.c:1839:lfsck_assistant_engine()) lustre-MDT0001-osd: LFSCK assistant sync before exit 00000004:00080000:1.0:1715330288.556812:0:26637:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 263033079938ns, next at 0ns, rc = 0 00080000:00080000:1.0:1715330288.556819:0:26637:0:(osd_handler.c:2696:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:1.0:1715330288.556832:0:26637:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 263033100447ns, next at 0ns, rc = 0 00080000:00080000:1.0:1715330288.556835:0:26637:0:(osd_handler.c:2696:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1715330288.557669:0:8267:0:(osp_sync.c:1604:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3 committed 00000004:00080000:0.0:1715330288.557686:0:8267:0:(osp_sync.c:1604:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3 committed 00000001:00080000:0.0:1715330288.557708:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968384 is committed 00100000:10000000:1.0:1715330288.557725:0:26637:0:(lfsck_engine.c:1845:lfsck_assistant_engine()) lustre-MDT0001-osd: LFSCK assistant synced before exit: rc = 0 00100000:10000000:1.0:1715330288.557779:0:26637:0:(lfsck_engine.c:1857:lfsck_assistant_engine()) lustre-MDT0001-osd: LFSCK assistant phase2 scan finished: rc = 1 00100000:10000000:1.0:1715330288.557781:0:26637:0:(lfsck_engine.c:1872:lfsck_assistant_engine()) lustre-MDT0001-osd: lfsck_namespace LFSCK assistant thread exit: rc = 1 00000100:00100000:0.0:1715330289.406551:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330289.407125:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938027008 00000100:00100000:1.0:1715330289.407134:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938027008 00000100:00100000:1.0:1715330289.407181:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23374 00000100:00100000:1.0:1715330289.407188:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+13:16982:x1798653938027008:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:1.0:1715330289.407210:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330289.407229:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d8597 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb61c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330289.407275:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d859e lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330289.407285:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d859e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330289.407293:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d859e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00200000:1.0:1715330289.407330:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1715330289.407334:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00080000:0.0:1715330289.408180:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330259 00010000:00010000:1.0:1715330289.408816:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d8597 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb61c expref: 15 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330289.408833:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d859e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb61c expref: 14 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330289.408839:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88008b122e00) 00010000:00010000:1.0:1715330289.408842:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1715330289.408844:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bffcc0, rc 0) 00000100:00100000:1.0:1715330289.408893:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+14:16982:x1798653938027008:12345-192.168.204.49@tcp:101:ls.0 Request processed in 1704us (2348us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330289.408900:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23374 00000100:00100000:2.0:1715330289.414206:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330289.414508:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938027072 00000100:00100000:1.0:1715330289.414516:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938027072 00000100:00100000:1.0:1715330289.414563:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23375 00000100:00100000:1.0:1715330289.414569:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+6:16982:x1798653938027072:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:1.0:1715330289.414585:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330289.414600:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d85a5 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb623 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330289.414643:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d85ac lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330289.414653:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d85ac lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330289.414661:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d85ac lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000004:00200000:1.0:1715330289.414697:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000401:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1715330289.414701:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1715330289.414748:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d85a5 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb623 expref: 8 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330289.414761:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d85ac lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb623 expref: 7 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330289.414767:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88008b122200) 00010000:00010000:1.0:1715330289.414769:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1715330289.414771:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfcd80, rc 0) 00000100:00100000:1.0:1715330289.414806:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+7:16982:x1798653938027072:12345-192.168.204.49@tcp:101:ls.0 Request processed in 237us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330289.414812:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23375 00000100:00080000:0.0:1715330289.416906:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330259 00000100:00100000:0.0:1715330289.428032:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330289.428076:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938027136 00000100:00100000:1.0:1715330289.428084:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938027136 00000100:00100000:1.0:1715330289.428118:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5010 00000100:00100000:1.0:1715330289.428124:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+14:16982:x1798653938027136:12345-192.168.204.49@tcp:37:ls.0 00000100:00100000:0.0:1715330289.432596:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+14:16982:x1798653938027136:12345-192.168.204.49@tcp:37:ls.0 Request processed in 4463us (4562us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330289.432609:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5010 00000100:00100000:0.0:1715330289.439262:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330289.439289:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938027200 00000100:00100000:0.0:1715330289.439297:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938027200 00000100:00100000:0.0:1715330289.439327:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5011 00000100:00100000:0.0:1715330289.439334:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+7:16982:x1798653938027200:12345-192.168.204.49@tcp:37:ls.0 00000100:00100000:1.0:1715330289.445026:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+7:16982:x1798653938027200:12345-192.168.204.49@tcp:37:ls.0 Request processed in 5684us (5762us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330289.445039:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5011 00000100:00100000:1.0:1715330289.447799:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1715330289.447816:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942460736:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1715330289.447862:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330289.448625:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942460736 00000100:00100000:0.0:1715330289.448631:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942460736 00000100:00100000:0.0:1715330289.448658:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2748 00000100:00100000:0.0:1715330289.448663:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942460736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1715330289.448690:0:9408:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445019648 avail 1315557376 00000100:00100000:0.0:1715330289.448720:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942460736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330289.448726:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2748 00000100:00100000:1.0:1715330289.448873:0:3689:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968384 gen 2 00000004:00080000:1.0:1715330289.448879:0:3689:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968384 committed transno 4294968384 00000100:00100000:1.0:1715330289.448902:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942460736:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1715330289.450982:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330289.451039:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938027328 00000100:00100000:0.0:1715330289.451044:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938027328 00000100:00100000:0.0:1715330289.451076:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23376 00000100:00100000:0.0:1715330289.451082:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+7:16982:x1798653938027328:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:0.0:1715330289.451094:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330289.451108:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0000/0xd895711d66d85b3 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb62a expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330289.451183:0:9622:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID:9622:1798653942460800:0@lo:900:mdt00_003.0 00000100:00100000:0.0:1715330289.451212:0:9622:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330289.451238:0:9622:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffab40 going to sleep for 11 seconds 00000100:00100000:2.0:1715330289.451322:0:7145:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942460800 00000100:00100000:2.0:1715330289.451326:0:7145:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942460800 00000100:00100000:2.0:1715330289.451357:0:7145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1715330289.451362:0:7145:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9622:x1798653942460800:12345-0@lo:900:mdt00_003.0 00000100:00100000:2.0:1715330289.451408:0:7145:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9622:x1798653942460800:12345-0@lo:900:mdt00_003.0 Request processed in 45us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330289.451414:0:7145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1715330289.451431:0:9622:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID:9622:1798653942460800:0@lo:900:mdt00_003.0 00000100:00100000:0.0:1715330289.451469:0:9622:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9622:1798653942460864:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1715330289.451504:0:9622:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330289.451513:0:9622:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330289.451552:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942460864 00000100:00100000:1.0:1715330289.451555:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942460864 00000100:00100000:1.0:1715330289.451571:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2749 00000100:00100000:1.0:1715330289.451575:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:9622:x1798653942460864:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1715330289.451616:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:9622:x1798653942460864:12345-0@lo:1000:mdt00_003.0 Request processed in 40us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330289.451621:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2749 00000100:00100000:0.0:1715330289.453218:0:9622:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9622:1798653942460864:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1715330289.453258:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1f80/0xd895711d66d85ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.453266:0:9622:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1f80/0xd895711d66d85ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330289.453273:0:9622:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1f80/0xd895711d66d85ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 9622 initiator: MDT1 00000100:00100000:0.0:1715330289.453281:0:9622:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9622:1798653942460928:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1715330289.453299:0:9622:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330289.453308:0:9622:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffab40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330289.453385:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942460928 00000100:00100000:1.0:1715330289.453388:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942460928 00000100:00100000:1.0:1715330289.453405:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2750 00000100:00100000:1.0:1715330289.453409:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:9622:x1798653942460928:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1715330289.453416:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330289.453426:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcb40/0xd895711d66d85c1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d85ba expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330289.453444:0:23404:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcb40/0xd895711d66d85c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d85ba expref: 15 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330289.453453:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcb40/0xd895711d66d85c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d85ba expref: 15 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330289.453459:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:1.0:1715330289.453461:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1715330289.453463:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfcb40, rc 0) 00000100:00100000:1.0:1715330289.453481:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+15:9622:x1798653942460928:12345-0@lo:101:mdt00_003.0 Request processed in 71us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330289.453486:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2750 00000100:00100000:0.0:1715330289.453539:0:9622:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9622:1798653942460928:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1715330289.453548:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1f80/0xd895711d66d85ba lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d85c1 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.453555:0:9622:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1f80/0xd895711d66d85ba lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d85c1 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1715330289.453563:0:9622:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1715330289.453567:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1f80/0xd895711d66d85ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d85c1 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.453572:0:9622:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8800ad9f1f80/0xd895711d66d85ba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d85c1 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.453592:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0480/0xd895711d66d85c8 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.453597:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0480/0xd895711d66d85c8 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330289.453603:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0480/0xd895711d66d85c8 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330289.453611:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d85cf lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x393326f7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.453615:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d85cf lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x393326f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330289.453619:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d85cf lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x393326f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330289.453649:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d85d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x13fc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.453653:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d85d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13fc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330289.453657:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d85d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13fc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330289.453664:0:9622:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0480/0xd895711d66d85c8 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330289.453668:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0480/0xd895711d66d85c8 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330289.453672:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0480/0xd895711d66d85c8 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330289.453678:0:9622:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0480/0xd895711d66d85c8 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330289.453682:0:9622:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f0480 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330289.453685:0:9622:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0480/0xd895711d66d85c8 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330289.453689:0:9622:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0480/0xd895711d66d85c8 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330289.453696:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88008b122200) 00010000:00010000:0.0:1715330289.453698:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330289.453701:0:9622:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0480/0xd895711d66d85c8 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330289.453704:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0480/0xd895711d66d85c8 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330289.453712:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d85cf lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x393326f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330289.453716:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d85cf lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x393326f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330289.453720:0:9622:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d85cf lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x393326f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330289.453724:0:9622:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f1440 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330289.453726:0:9622:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d85cf lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x393326f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330289.453751:0:9622:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d85cf lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x393326f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330289.453761:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x393326f7 (ffff88011d537600) 00010000:00010000:0.0:1715330289.453763:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330289.453765:0:9622:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d85cf lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x393326f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330289.453769:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1440/0xd895711d66d85cf lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x393326f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330289.453793:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f0000/0xd895711d66d85b3 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb62a expref: 9 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.453802:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d85d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x13fc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb62a expref: 8 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.453806:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13fc:0x0].0x0 (ffff88011d537100) 00010000:00010000:0.0:1715330289.453808:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1715330289.453809:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f1d40, rc 0) 00000100:00100000:0.0:1715330289.453834:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+8:16982:x1798653938027328:12345-192.168.204.49@tcp:101:ls.0 Request processed in 2752us (2857us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330289.453839:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23376 00000100:00100000:0.0:1715330289.456033:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330289.456714:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938027456 00000100:00100000:1.0:1715330289.456721:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938027456 00000100:00100000:1.0:1715330289.456770:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23377 00000100:00100000:1.0:1715330289.456775:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+14:16982:x1798653938027456:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:1.0:1715330289.456789:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330289.456804:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d85dd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x13fc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb631 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715330289.456915:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x13fc:0x0]: returning size 4096 00010000:00010000:1.0:1715330289.456971:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d85dd lrc: 1/0,0 mode: --/CR res: [0x200000402:0x13fc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb631 expref: 16 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330289.456978:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d85dd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x13fc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb631 expref: 16 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330289.456995:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfc480, rc 0) 00000100:00100000:1.0:1715330289.457023:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+15:16982:x1798653938027456:12345-192.168.204.49@tcp:101:ls.0 Request processed in 248us (993us total) trans 4294983444 rc 301/301 00000100:00100000:1.0:1715330289.457028:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23377 00000100:00100000:0.0:1715330289.460117:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330289.460148:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938027520 00000100:00100000:1.0:1715330289.460154:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938027520 00000100:00100000:1.0:1715330289.460187:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23378 00000100:00100000:1.0:1715330289.460193:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+15:16982:x1798653938027520:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:1.0:1715330289.460207:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330289.460221:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d85eb lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb638 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330289.460267:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66d85f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x13fc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:1.0:1715330289.460278:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66d85f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13fc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:1.0:1715330289.460285:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66d85f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13fc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00000004:00200000:1.0:1715330289.460349:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x13fc:0x0]: returning size 4096 00000004:00200000:1.0:1715330289.460352:0:9622:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1715330289.460365:0:9622:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66d85f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13fc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:1.0:1715330289.460380:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d85eb lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb638 expref: 17 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330289.460399:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66d85f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x13fc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb638 expref: 16 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330289.460405:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13fc:0x0].0x0 (ffff88008b122300) 00010000:00010000:1.0:1715330289.460407:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1715330289.460409:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bff180, rc 0) 00000100:00100000:1.0:1715330289.460459:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+16:16982:x1798653938027520:12345-192.168.204.49@tcp:101:ls.0 Request processed in 261us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330289.460464:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23378 00000100:00100000:1.0:1715330289.469133:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330289.469158:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938027584 00000100:00100000:1.0:1715330289.469164:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938027584 00000100:00100000:1.0:1715330289.469201:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23379 00000100:00100000:1.0:1715330289.469207:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+16:16982:x1798653938027584:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:1.0:1715330289.469221:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330289.469236:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d85f9 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb63f expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330289.469278:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d8600 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:1.0:1715330289.469288:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d8600 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:1.0:1715330289.469297:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d8600 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00000004:00200000:1.0:1715330289.469328:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0x3c:0x0]: returning size 4096 00000004:00200000:1.0:1715330289.469332:0:9622:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1715330289.469355:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d85f9 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb63f expref: 18 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330289.469369:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d8600 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb63f expref: 17 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330289.469375:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x3c:0x0].0x0 (ffff88008b122700) 00010000:00010000:1.0:1715330289.469378:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1715330289.469380:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfdb00, rc 0) 00000100:00100000:1.0:1715330289.469414:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+17:16982:x1798653938027584:12345-192.168.204.49@tcp:101:ls.0 Request processed in 207us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330289.469420:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23379 00000100:00100000:0.0:1715330289.476137:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330289.478882:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938027648 00000100:00100000:1.0:1715330289.478892:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938027648 00000100:00100000:1.0:1715330289.478928:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23380 00000100:00100000:1.0:1715330289.478934:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+8:16982:x1798653938027648:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:1.0:1715330289.478948:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330289.478964:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd200/0xd895711d66d8607 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb646 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330289.479005:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfef40/0xd895711d66d860e lrc: 3/1,0 mode: --/PR res: [0x240000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330289.479015:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfef40/0xd895711d66d860e lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330289.479022:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfef40/0xd895711d66d860e lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000004:00200000:1.0:1715330289.479055:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000401:0x3c:0x0]: returning size 4096 00000004:00200000:1.0:1715330289.479059:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1715330289.479081:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd200/0xd895711d66d8607 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb646 expref: 10 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330289.479092:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfef40/0xd895711d66d860e lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb646 expref: 9 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330289.479098:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x3c:0x0].0x0 (ffff880135e32e00) 00010000:00010000:1.0:1715330289.479101:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1715330289.479103:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfef40, rc 0) 00000100:00100000:1.0:1715330289.479151:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+9:16982:x1798653938027648:12345-192.168.204.49@tcp:101:ls.0 Request processed in 216us (3019us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330289.479156:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23380 00000100:00100000:0.0:1715330289.483116:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330289.483189:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938027712 00000100:00100000:1.0:1715330289.483196:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938027712 00000100:00100000:1.0:1715330289.483225:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5012 00000100:00100000:1.0:1715330289.483231:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+17:16982:x1798653938027712:12345-192.168.204.49@tcp:37:ls.0 00000100:00100000:0.0:1715330289.487016:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+17:16982:x1798653938027712:12345-192.168.204.49@tcp:37:ls.0 Request processed in 3778us (3899us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330289.487027:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5012 00000100:00100000:2.0:1715330289.491454:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330289.491527:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938027776 00000100:00100000:0.0:1715330289.491534:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938027776 00000100:00100000:0.0:1715330289.491568:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5013 00000100:00100000:0.0:1715330289.491574:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ef3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+9:16982:x1798653938027776:12345-192.168.204.49@tcp:37:ls.0 00000100:00100000:1.0:1715330289.494819:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ef3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+9:16982:x1798653938027776:12345-192.168.204.49@tcp:37:ls.0 Request processed in 3237us (3365us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330289.494831:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5013 00000100:00100000:1.0:1715330289.497470:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330289.497547:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938027904 00000100:00100000:0.0:1715330289.497554:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938027904 00000100:00100000:0.0:1715330289.497593:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5014 00000100:00100000:0.0:1715330289.497598:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+17:16982:x1798653938027904:12345-192.168.204.49@tcp:35:ls.0 00000100:00100000:0.0:1715330289.498135:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+18:16982:x1798653938027904:12345-192.168.204.49@tcp:35:ls.0 Request processed in 535us (669us total) trans 4294983445 rc 0/0 00000100:00100000:0.0:1715330289.498142:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5014 00000100:00100000:0.0:1715330289.500668:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330289.500786:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938028032 00000100:00100000:1.0:1715330289.500792:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938028032 00000100:00100000:1.0:1715330289.500831:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23381 00000100:00100000:1.0:1715330289.500837:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+9:16982:x1798653938028032:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:1.0:1715330289.500851:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330289.500864:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d8615 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb64d expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330289.500918:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d861c lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:1.0:1715330289.500928:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d861c lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330289.500936:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d861c lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330289.500946:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdf80/0xd895711d66d8623 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x4b3326ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:1.0:1715330289.500951:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdf80/0xd895711d66d8623 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x4b3326ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330289.500956:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdf80/0xd895711d66d8623 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x4b3326ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330289.500993:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d862a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1408:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:1.0:1715330289.500998:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d862a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1408:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330289.501003:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d862a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1408:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330289.501012:0:9622:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d861c lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330289.501016:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d861c lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330289.501021:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d861c lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330289.501026:0:9622:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d861c lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330289.501031:0:9622:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfe1c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330289.501034:0:9622:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d861c lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330289.501040:0:9622:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d861c lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330289.501047:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88008b122200) 00010000:00010000:1.0:1715330289.501049:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330289.501052:0:9622:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d861c lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330289.501057:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d861c lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330289.501115:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdf80/0xd895711d66d8623 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x4b3326ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330289.501121:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdf80/0xd895711d66d8623 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x4b3326ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330289.501125:0:9622:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdf80/0xd895711d66d8623 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x4b3326ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330289.501129:0:9622:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfdf80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330289.501132:0:9622:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdf80/0xd895711d66d8623 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x4b3326ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330289.501136:0:9622:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdf80/0xd895711d66d8623 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x4b3326ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330289.501145:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x4b3326ef (ffff880135e32100) 00010000:00010000:1.0:1715330289.501147:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330289.501150:0:9622:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdf80/0xd895711d66d8623 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x4b3326ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330289.501154:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdf80/0xd895711d66d8623 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x4b3326ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330289.501176:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d8615 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb64d expref: 11 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330289.501185:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d862a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1408:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb64d expref: 10 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330289.501190:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1408:0x0].0x0 (ffff880135e32500) 00010000:00010000:1.0:1715330289.501192:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1715330289.501194:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfcfc0, rc 0) 00000100:00100000:1.0:1715330289.501233:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+10:16982:x1798653938028032:12345-192.168.204.49@tcp:101:ls.0 Request processed in 395us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330289.501238:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23381 00000100:00100000:1.0:1715330289.503599:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330289.503810:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938028160 00000100:00100000:2.0:1715330289.503818:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938028160 00000100:00100000:2.0:1715330289.503851:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23382 00000100:00100000:2.0:1715330289.503857:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+18:16982:x1798653938028160:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:2.0:1715330289.503872:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330289.503888:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d8631 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1408:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb654 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715330289.504002:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1408:0x0]: returning size 4096 00010000:00010000:2.0:1715330289.504064:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d8631 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1408:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb654 expref: 20 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.504072:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d8631 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1408:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb654 expref: 20 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.504101:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db66ac0, rc 0) 00000100:00100000:2.0:1715330289.504139:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+19:16982:x1798653938028160:12345-192.168.204.49@tcp:101:ls.0 Request processed in 282us (545us total) trans 4294983446 rc 301/301 00000100:00100000:2.0:1715330289.504145:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23382 00000100:00100000:2.0:1715330289.507236:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330289.507258:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938028224 00000100:00100000:0.0:1715330289.507265:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938028224 00000100:00100000:0.0:1715330289.507308:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23383 00000100:00100000:0.0:1715330289.507315:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+19:16982:x1798653938028224:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:0.0:1715330289.507331:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330289.507348:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d863f lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb65b expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.507395:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66d8646 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1408:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330289.507405:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66d8646 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1408:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330289.507413:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66d8646 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1408:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00200000:0.0:1715330289.507500:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1408:0x0]: returning size 4096 00000004:00200000:0.0:1715330289.507505:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1715330289.507518:0:7135:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66d8646 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1408:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330289.507534:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d863f lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb65b expref: 21 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.507565:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66d8646 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1408:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb65b expref: 20 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.507572:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1408:0x0].0x0 (ffff88011d537000) 00010000:00010000:0.0:1715330289.507575:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1715330289.507577:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f1440, rc 0) 00000100:00100000:0.0:1715330289.507608:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+20:16982:x1798653938028224:12345-192.168.204.49@tcp:101:ls.0 Request processed in 293us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330289.507614:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23383 00000100:00100000:1.0:1715330289.510357:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330289.510420:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938028288 00000100:00100000:2.0:1715330289.510427:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938028288 00000100:00100000:2.0:1715330289.510647:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23384 00000100:00100000:2.0:1715330289.510654:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+20:16982:x1798653938028288:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:2.0:1715330289.510668:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330289.510682:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66d864d lrc: 2/0,0 mode: --/CR res: [0x200000400:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb662 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.510721:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d8654 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.510748:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d8654 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x42:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.510757:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d8654 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x42:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00000004:00200000:2.0:1715330289.510788:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0x42:0x0]: returning size 4096 00000004:00200000:2.0:1715330289.510791:0:9622:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1715330289.510811:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66d864d lrc: 0/0,0 mode: --/CR res: [0x200000400:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb662 expref: 22 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.510824:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d8654 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb662 expref: 21 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.510831:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x42:0x0].0x0 (ffff88009396d500) 00010000:00010000:2.0:1715330289.510833:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1715330289.510836:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db66f40, rc 0) 00000100:00100000:2.0:1715330289.511315:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+21:16982:x1798653938028288:12345-192.168.204.49@tcp:101:ls.0 Request processed in 660us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330289.511321:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23384 00000100:00100000:1.0:1715330289.513502:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330289.513673:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938028352 00000100:00100000:2.0:1715330289.513681:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938028352 00000100:00100000:2.0:1715330289.513709:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23385 00000100:00100000:2.0:1715330289.513716:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+10:16982:x1798653938028352:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:2.0:1715330289.513747:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330289.513763:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64b40/0xd895711d66d865b lrc: 2/0,0 mode: --/CR res: [0x240000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb669 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.513802:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d8662 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.513811:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d8662 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330289.513820:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d8662 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT1 00000004:00200000:2.0:1715330289.513854:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000401:0x42:0x0]: returning size 4096 00000004:00200000:2.0:1715330289.513858:0:9622:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1715330289.513880:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64b40/0xd895711d66d865b lrc: 0/0,0 mode: --/CR res: [0x240000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb669 expref: 12 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.513891:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d8662 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb669 expref: 11 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.513898:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x42:0x0].0x0 (ffff88009396d300) 00010000:00010000:2.0:1715330289.513900:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1715330289.513902:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db64d80, rc 0) 00000100:00100000:2.0:1715330289.513930:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+11:16982:x1798653938028352:12345-192.168.204.49@tcp:101:ls.0 Request processed in 214us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330289.513936:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23385 00000100:00100000:0.0:1715330289.517600:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938028416 00000100:00100000:0.0:1715330289.517608:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938028416 00000100:00100000:0.0:1715330289.517648:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5015 00000100:00100000:0.0:1715330289.517653:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+21:16982:x1798653938028416:12345-192.168.204.49@tcp:37:ls.0 00000100:00100000:2.0:1715330289.521514:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+21:16982:x1798653938028416:12345-192.168.204.49@tcp:37:ls.0 Request processed in 3851us (4809us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330289.521526:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5015 00000100:00100000:1.0:1715330289.525846:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330289.525905:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938028480 00000100:00100000:2.0:1715330289.525913:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938028480 00000100:00100000:2.0:1715330289.527641:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5016 00000100:00100000:2.0:1715330289.527651:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+11:16982:x1798653938028480:12345-192.168.204.49@tcp:37:ls.0 00000100:00100000:2.0:1715330289.532923:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+11:16982:x1798653938028480:12345-192.168.204.49@tcp:37:ls.0 Request processed in 5264us (7074us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330289.532935:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5016 00000100:00100000:0.0:1715330289.535707:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330289.535796:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938028608 00000100:00100000:2.0:1715330289.535805:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938028608 00000100:00100000:2.0:1715330289.535835:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5017 00000100:00100000:2.0:1715330289.535841:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+21:16982:x1798653938028608:12345-192.168.204.49@tcp:35:ls.0 00000100:00100000:2.0:1715330289.536004:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+22:16982:x1798653938028608:12345-192.168.204.49@tcp:35:ls.0 Request processed in 162us (304us total) trans 4294983447 rc 0/0 00000100:00100000:2.0:1715330289.536011:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5017 00000100:00100000:1.0:1715330289.539170:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330289.539516:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938028736 00000100:00100000:0.0:1715330289.539524:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938028736 00000100:00100000:0.0:1715330289.540222:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23386 00000100:00100000:0.0:1715330289.540230:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+22:16982:x1798653938028736:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:0.0:1715330289.540247:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330289.540263:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0480/0xd895711d66d8669 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb670 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.540326:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d8670 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330289.540337:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d8670 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330289.540347:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d8670 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330289.540357:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d8677 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x4b3326f6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330289.540362:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d8677 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x4b3326f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330289.540367:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d8677 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x4b3326f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330289.540410:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d867e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x80:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330289.540415:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d867e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x80:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330289.540420:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d867e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x80:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330289.540428:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d8670 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330289.540433:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d8670 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330289.540438:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d8670 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330289.540442:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d8670 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330289.540447:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f2400 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330289.540449:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d8670 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330289.540454:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d8670 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330289.540462:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88008b122e00) 00010000:00010000:0.0:1715330289.540464:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330289.540467:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d8670 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330289.540472:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d8670 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330289.540712:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d8677 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x4b3326f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330289.540717:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d8677 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x4b3326f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330289.540722:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d8677 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x4b3326f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330289.540726:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f3840 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330289.540728:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d8677 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x4b3326f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330289.540872:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d8677 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x4b3326f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330289.540883:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x4b3326f6 (ffff88011d537200) 00010000:00010000:0.0:1715330289.540885:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330289.540887:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d8677 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x4b3326f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330289.540891:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d8677 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x4b3326f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330289.540915:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0480/0xd895711d66d8669 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb670 expref: 24 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.540925:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d867e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x80:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb670 expref: 23 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.540930:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x80:0x0].0x0 (ffff88011d537800) 00010000:00010000:0.0:1715330289.540932:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1715330289.540933:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f3a80, rc 0) 00000100:00100000:0.0:1715330289.541178:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+23:16982:x1798653938028736:12345-192.168.204.49@tcp:101:ls.0 Request processed in 947us (2013us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330289.541184:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23386 00000100:00100000:0.0:1715330289.544101:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938028864 00000100:00100000:0.0:1715330289.544110:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938028864 00000100:00100000:0.0:1715330289.544237:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23387 00000100:00100000:0.0:1715330289.544243:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+11:16982:x1798653938028864:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:0.0:1715330289.544258:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330289.544272:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d8685 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x80:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb677 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715330289.544408:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x80:0x0]: returning size 4096 00010000:00010000:0.0:1715330289.544469:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d8685 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x80:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb677 expref: 13 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.544476:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f3cc0/0xd895711d66d8685 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x80:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb677 expref: 13 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.544495:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f3cc0, rc 0) 00000100:00100000:0.0:1715330289.544976:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+12:16982:x1798653938028864:12345-192.168.204.49@tcp:101:ls.0 Request processed in 731us (951us total) trans 4294968385 rc 301/301 00000100:00100000:0.0:1715330289.544982:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23387 00000100:00100000:0.0:1715330289.547841:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330289.547904:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938028928 00000100:00100000:1.0:1715330289.547912:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938028928 00000100:00100000:1.0:1715330289.547952:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23388 00000100:00100000:1.0:1715330289.547959:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+12:16982:x1798653938028928:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:1.0:1715330289.547976:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330289.547992:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d8693 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb67e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330289.548040:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d869a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x80:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330289.548050:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d869a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x80:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330289.548059:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d869a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x80:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000004:00200000:1.0:1715330289.548157:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x80:0x0]: returning size 4096 00000004:00200000:1.0:1715330289.548161:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1715330289.548173:0:7135:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d869a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x80:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330289.548190:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d8693 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb67e expref: 14 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330289.548204:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d869a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x80:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb67e expref: 13 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330289.548210:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x80:0x0].0x0 (ffff880135e32100) 00010000:00010000:1.0:1715330289.548212:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1715330289.548214:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bff3c0, rc 0) 00000100:00100000:1.0:1715330289.548252:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+13:16982:x1798653938028928:12345-192.168.204.49@tcp:101:ls.0 Request processed in 293us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330289.548258:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23388 00000100:00100000:1.0:1715330289.551523:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330289.551816:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23389 00000100:00100000:1.0:1715330289.551823:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+13:16982:x1798653938028992:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:1.0:1715330289.551838:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330289.551854:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd680/0xd895711d66d86a1 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb685 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330289.551895:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfeac0/0xd895711d66d86a8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330289.551904:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfeac0/0xd895711d66d86a8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x43:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330289.551912:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfeac0/0xd895711d66d86a8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x43:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000004:00200000:1.0:1715330289.551948:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000400:0x43:0x0]: returning size 4096 00000004:00200000:1.0:1715330289.551952:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1715330289.551974:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd680/0xd895711d66d86a1 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb685 expref: 15 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330289.551988:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfeac0/0xd895711d66d86a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb685 expref: 14 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330289.551994:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x43:0x0].0x0 (ffff880135e32700) 00010000:00010000:1.0:1715330289.551997:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1715330289.551999:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfeac0, rc 0) 00000100:00100000:1.0:1715330289.552034:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+14:16982:x1798653938028992:12345-192.168.204.49@tcp:101:ls.0 Request processed in 211us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330289.552039:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23389 00000100:00100000:0.0:1715330289.555006:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938029056 00000100:00100000:0.0:1715330289.555011:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938029056 00000100:00100000:0.0:1715330289.555125:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23390 00000100:00100000:0.0:1715330289.555131:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+23:16982:x1798653938029056:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:0.0:1715330289.555145:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330289.555159:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d86af lrc: 2/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb68c expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.555202:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66d86b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.555211:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66d86b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.555218:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66d86b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00000004:00200000:0.0:1715330289.555251:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 4096 00000004:00200000:0.0:1715330289.555254:0:9622:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1715330289.555276:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66d86af lrc: 0/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb68c expref: 25 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.555498:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66d86b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb68c expref: 24 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.555506:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff88011d537600) 00010000:00010000:0.0:1715330289.555508:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1715330289.555510:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f18c0, rc 0) 00000100:00100000:0.0:1715330289.555997:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+24:16982:x1798653938029056:12345-192.168.204.49@tcp:101:ls.0 Request processed in 865us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330289.556004:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23390 00000100:00100000:0.0:1715330289.559315:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330289.559524:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938029120 00000100:00100000:2.0:1715330289.559531:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938029120 00000100:00100000:2.0:1715330289.559571:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5018 00000100:00100000:2.0:1715330289.559577:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ef3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+14:16982:x1798653938029120:12345-192.168.204.49@tcp:37:ls.0 00000100:00100000:2.0:1715330289.564245:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ef3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+14:16982:x1798653938029120:12345-192.168.204.49@tcp:37:ls.0 Request processed in 4660us (4929us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330289.564257:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5018 00000100:00100000:2.0:1715330289.568292:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938029184 00000100:00100000:2.0:1715330289.568300:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938029184 00000100:00100000:2.0:1715330289.568332:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5019 00000100:00100000:2.0:1715330289.568338:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+24:16982:x1798653938029184:12345-192.168.204.49@tcp:37:ls.0 00000100:00100000:2.0:1715330289.571593:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+24:16982:x1798653938029184:12345-192.168.204.49@tcp:37:ls.0 Request processed in 3247us (3379us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330289.571604:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5019 00000100:00100000:1.0:1715330289.575141:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330289.575219:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938029312 00000100:00100000:2.0:1715330289.575226:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938029312 00000100:00100000:2.0:1715330289.575301:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5020 00000100:00100000:2.0:1715330289.575307:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+14:16982:x1798653938029312:12345-192.168.204.49@tcp:35:ls.0 00000100:00100000:2.0:1715330289.575633:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+15:16982:x1798653938029312:12345-192.168.204.49@tcp:35:ls.0 Request processed in 326us (497us total) trans 4294968386 rc 0/0 00000100:00100000:2.0:1715330289.575639:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5020 00000100:00100000:0.0:1715330289.580420:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938029440 00000100:00100000:0.0:1715330289.580428:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938029440 00000100:00100000:0.0:1715330289.580512:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23391 00000100:00100000:0.0:1715330289.580519:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+15:16982:x1798653938029440:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:0.0:1715330289.580538:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330289.580553:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1680/0xd895711d66d86bd lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb693 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.580618:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2880/0xd895711d66d86c4 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.580628:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2880/0xd895711d66d86c4 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330289.580639:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2880/0xd895711d66d86c4 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330289.580648:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f21c0/0xd895711d66d86cb lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x6f3326f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.580653:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f21c0/0xd895711d66d86cb lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f3326f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330289.580657:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f21c0/0xd895711d66d86cb lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f3326f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330289.580696:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d86d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1432:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.580701:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d86d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1432:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330289.580705:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d86d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1432:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330289.580714:0:9622:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2880/0xd895711d66d86c4 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330289.580718:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2880/0xd895711d66d86c4 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330289.580723:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2880/0xd895711d66d86c4 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330289.580727:0:9622:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2880/0xd895711d66d86c4 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330289.580749:0:9622:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f2880 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330289.580753:0:9622:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2880/0xd895711d66d86c4 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330289.580758:0:9622:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2880/0xd895711d66d86c4 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330289.580767:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88008b122200) 00010000:00010000:0.0:1715330289.580769:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330289.580772:0:9622:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2880/0xd895711d66d86c4 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330289.580777:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2880/0xd895711d66d86c4 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330289.581601:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f21c0/0xd895711d66d86cb lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f3326f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330289.581608:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f21c0/0xd895711d66d86cb lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f3326f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330289.581613:0:9622:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f21c0/0xd895711d66d86cb lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f3326f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330289.581617:0:9622:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f21c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330289.581619:0:9622:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f21c0/0xd895711d66d86cb lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f3326f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330289.581624:0:9622:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f21c0/0xd895711d66d86cb lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6f3326f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330289.581630:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x6f3326f1 (ffff88011d537200) 00010000:00010000:0.0:1715330289.581633:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330289.581635:0:9622:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f21c0/0xd895711d66d86cb lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x6f3326f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330289.581643:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f21c0/0xd895711d66d86cb lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x6f3326f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330289.581668:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1680/0xd895711d66d86bd lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb693 expref: 17 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.581678:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d86d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1432:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb693 expref: 16 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.581684:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1432:0x0].0x0 (ffff88011d537500) 00010000:00010000:0.0:1715330289.581686:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1715330289.581687:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f2ac0, rc 0) 00000100:00100000:0.0:1715330289.581885:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+16:16982:x1798653938029440:12345-192.168.204.49@tcp:101:ls.0 Request processed in 1365us (1645us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330289.581892:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23391 00000100:00100000:0.0:1715330289.584655:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330289.584962:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938029568 00000100:00100000:2.0:1715330289.584970:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938029568 00000100:00100000:2.0:1715330289.585011:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23392 00000100:00100000:2.0:1715330289.585018:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+24:16982:x1798653938029568:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:2.0:1715330289.585033:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330289.585050:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d86d9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1432:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb69a expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715330289.585190:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1432:0x0]: returning size 4096 00010000:00010000:2.0:1715330289.585262:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d86d9 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1432:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb69a expref: 26 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.585271:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d86d9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1432:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb69a expref: 26 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.585307:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db64240, rc 0) 00000100:00100000:2.0:1715330289.585346:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+25:16982:x1798653938029568:12345-192.168.204.49@tcp:101:ls.0 Request processed in 328us (697us total) trans 4294983448 rc 301/301 00000100:00100000:2.0:1715330289.585351:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23392 00000100:00100000:1.0:1715330289.589389:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330289.589458:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938029632 00000100:00100000:2.0:1715330289.589465:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938029632 00000100:00100000:2.0:1715330289.589505:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23393 00000100:00100000:2.0:1715330289.589511:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+25:16982:x1798653938029632:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:2.0:1715330289.589528:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330289.589543:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d86e7 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb6a1 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.589595:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d86ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1432:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330289.589606:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d86ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1432:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330289.589615:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d86ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1432:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00200000:2.0:1715330289.589711:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1432:0x0]: returning size 4096 00000004:00200000:2.0:1715330289.589715:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1715330289.589748:0:7135:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d86ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1432:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330289.589766:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d86e7 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6a1 expref: 27 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.589785:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d86ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1432:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6a1 expref: 26 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.589791:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1432:0x0].0x0 (ffff88009396dc00) 00010000:00010000:2.0:1715330289.589794:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1715330289.589796:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db64480, rc 0) 00000100:00100000:2.0:1715330289.589842:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+26:16982:x1798653938029632:12345-192.168.204.49@tcp:101:ls.0 Request processed in 330us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330289.589848:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23393 00000100:00100000:0.0:1715330289.592020:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938029696 00000100:00100000:0.0:1715330289.592027:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938029696 00000100:00100000:0.0:1715330289.592106:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23394 00000100:00100000:0.0:1715330289.592113:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+26:16982:x1798653938029696:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:0.0:1715330289.592124:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330289.592136:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d86f5 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x57:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb6a8 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.592167:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0480/0xd895711d66d86fc lrc: 3/1,0 mode: --/PR res: [0x200000400:0x57:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.592175:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0480/0xd895711d66d86fc lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x57:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.592183:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0480/0xd895711d66d86fc lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x57:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00000004:00200000:0.0:1715330289.592211:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0x57:0x0]: returning size 4096 00000004:00200000:0.0:1715330289.592214:0:9622:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1715330289.592232:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d86f5 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x57:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6a8 expref: 28 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.592247:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0480/0xd895711d66d86fc lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x57:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6a8 expref: 27 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.592253:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x57:0x0].0x0 (ffff88011d537300) 00010000:00010000:0.0:1715330289.592255:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1715330289.592257:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f0480, rc 0) 00000100:00100000:0.0:1715330289.592473:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+27:16982:x1798653938029696:12345-192.168.204.49@tcp:101:ls.0 Request processed in 359us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330289.592479:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23394 00000100:00100000:0.0:1715330289.593935:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330289.594291:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938029760 00000100:00100000:2.0:1715330289.594298:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938029760 00000100:00100000:2.0:1715330289.594327:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23395 00000100:00100000:2.0:1715330289.594332:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+16:16982:x1798653938029760:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:2.0:1715330289.594343:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330289.594354:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64240/0xd895711d66d8703 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x57:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb6af expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.594385:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d870a lrc: 3/1,0 mode: --/PR res: [0x240000401:0x57:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.594393:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d870a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x57:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330289.594399:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d870a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x57:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT1 00000004:00200000:2.0:1715330289.594423:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000401:0x57:0x0]: returning size 4096 00000004:00200000:2.0:1715330289.594425:0:9622:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1715330289.594442:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64240/0xd895711d66d8703 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x57:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6af expref: 18 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.594453:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d870a lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x57:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6af expref: 17 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.594458:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x57:0x0].0x0 (ffff88009396de00) 00010000:00010000:2.0:1715330289.594461:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1715330289.594462:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db65d40, rc 0) 00000100:00100000:2.0:1715330289.594861:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+17:16982:x1798653938029760:12345-192.168.204.49@tcp:101:ls.0 Request processed in 528us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330289.594867:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23395 00000100:00100000:0.0:1715330289.598007:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330289.602726:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+27:16982:x1798653938029824:12345-192.168.204.49@tcp:37:ls.0 Request processed in 4557us (4719us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330289.602762:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5021 00000100:00100000:0.0:1715330289.606021:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330289.606307:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938029888 00000100:00100000:2.0:1715330289.606317:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938029888 00000100:00100000:2.0:1715330289.606352:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5022 00000100:00100000:2.0:1715330289.606358:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:16982:x1798653938029888:12345-192.168.204.49@tcp:37:ls.0 00000100:00100000:0.0:1715330289.610236:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:16982:x1798653938029888:12345-192.168.204.49@tcp:37:ls.0 Request processed in 3870us (4213us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330289.610248:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5022 00000100:00100000:0.0:1715330289.612587:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938030016 00000100:00100000:0.0:1715330289.612594:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938030016 00000100:00100000:0.0:1715330289.612634:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5023 00000100:00100000:0.0:1715330289.612640:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ef2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+27:16982:x1798653938030016:12345-192.168.204.49@tcp:35:ls.0 00000100:00100000:0.0:1715330289.613425:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ef2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+28:16982:x1798653938030016:12345-192.168.204.49@tcp:35:ls.0 Request processed in 783us (917us total) trans 4294983449 rc 0/0 00000100:00100000:0.0:1715330289.613432:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5023 00000100:00100000:0.0:1715330289.618086:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330289.618233:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938030144 00000100:00100000:2.0:1715330289.618241:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938030144 00000100:00100000:2.0:1715330289.618290:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23396 00000100:00100000:2.0:1715330289.618297:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+28:16982:x1798653938030144:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:2.0:1715330289.618315:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330289.618331:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d8711 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb6b6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.618386:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d8718 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.618396:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d8718 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.618405:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d8718 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.618415:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d871f lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x813c26f3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.618419:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d871f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x813c26f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.618424:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d871f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x813c26f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00000004:00200000:2.0:1715330289.619392:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x14ac:0x0]: returning size 4096 00010000:00010000:2.0:1715330289.619447:0:9622:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d8718 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.619453:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d8718 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.619458:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d8718 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.619463:0:9622:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d8718 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.619469:0:9622:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330289.619472:0:9622:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d8718 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.619478:0:9622:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d8718 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.619511:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88008b122e00) 00010000:00010000:2.0:1715330289.619514:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330289.619518:0:9622:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d8718 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.619523:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d8718 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.619534:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d871f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x813c26f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.619538:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d871f lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x813c26f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.619542:0:9622:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d871f lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x813c26f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.619546:0:9622:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64000 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330289.619548:0:9622:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d871f lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x813c26f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.619552:0:9622:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d871f lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x813c26f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.619613:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x813c26f3 (ffff88009396da00) 00010000:00010000:2.0:1715330289.619615:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330289.619646:0:9622:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d871f lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x813c26f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.619652:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d871f lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x813c26f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.619683:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d8711 lrc: 1/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6b6 expref: 30 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.619690:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d8711 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6b6 expref: 30 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.619698:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db64240, rc 0) 00000100:00100000:2.0:1715330289.619771:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+29:16982:x1798653938030144:12345-192.168.204.49@tcp:101:ls.0 Request processed in 1474us (1690us total) trans 4294983450 rc 301/301 00000100:00100000:2.0:1715330289.619777:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23396 00000100:00100000:2.0:1715330289.625386:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330289.625456:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938030208 00000100:00100000:0.0:1715330289.625464:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938030208 00000100:00100000:0.0:1715330289.625519:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23397 00000100:00100000:0.0:1715330289.625526:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+29:16982:x1798653938030208:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:0.0:1715330289.625544:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330289.625560:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d872d lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb6bd expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.625610:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d8734 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x14ac:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.625932:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d8734 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14ac:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.625942:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d8734 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14ac:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00000004:00200000:0.0:1715330289.626057:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x14ac:0x0]: returning size 4096 00000004:00200000:0.0:1715330289.626062:0:9622:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1715330289.626076:0:9622:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d8734 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14ac:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.626092:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d872d lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6bd expref: 31 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.626104:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d8734 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x14ac:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6bd expref: 30 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.626110:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14ac:0x0].0x0 (ffff88011d537700) 00010000:00010000:0.0:1715330289.626113:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1715330289.626116:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f2400, rc 0) 00000100:00100000:0.0:1715330289.627237:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+30:16982:x1798653938030208:12345-192.168.204.49@tcp:101:ls.0 Request processed in 1708us (1855us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330289.627244:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23397 00000100:00100000:0.0:1715330289.631652:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938030272 00000100:00100000:0.0:1715330289.631660:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938030272 00000100:00100000:0.0:1715330289.631704:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23398 00000100:00100000:0.0:1715330289.631710:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+30:16982:x1798653938030272:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:0.0:1715330289.631725:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330289.631762:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d873b lrc: 2/0,0 mode: --/CR res: [0x200000400:0x94:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb6c4 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.631877:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d8742 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x94:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.631891:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d8742 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.631900:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d8742 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00000004:00200000:0.0:1715330289.631938:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0x94:0x0]: returning size 4096 00000004:00200000:0.0:1715330289.631942:0:9622:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1715330289.631969:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d873b lrc: 0/0,0 mode: --/CR res: [0x200000400:0x94:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6c4 expref: 32 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.631982:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d8742 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x94:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6c4 expref: 31 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.631988:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x94:0x0].0x0 (ffff88011d537400) 00010000:00010000:0.0:1715330289.631991:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1715330289.631993:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f3cc0, rc 0) 00000100:00100000:0.0:1715330289.632198:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+31:16982:x1798653938030272:12345-192.168.204.49@tcp:101:ls.0 Request processed in 485us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330289.632204:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23398 00000100:00100000:0.0:1715330289.639026:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330289.639216:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938030336 00000100:00100000:2.0:1715330289.639225:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938030336 00000100:00100000:2.0:1715330289.639270:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23399 00000100:00100000:2.0:1715330289.639278:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+17:16982:x1798653938030336:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:2.0:1715330289.639300:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330289.639322:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d8749 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x94:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb6cb expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.639379:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db673c0/0xd895711d66d8750 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x94:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.639391:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db673c0/0xd895711d66d8750 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330289.639401:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db673c0/0xd895711d66d8750 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT1 00000004:00200000:2.0:1715330289.639444:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000401:0x94:0x0]: returning size 4096 00000004:00200000:2.0:1715330289.639447:0:9622:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1715330289.639478:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d8749 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x94:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6cb expref: 19 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.639521:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db673c0/0xd895711d66d8750 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x94:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6cb expref: 18 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.639529:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x94:0x0].0x0 (ffff88009396d800) 00010000:00010000:2.0:1715330289.639531:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1715330289.639534:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db673c0, rc 0) 00000100:00100000:2.0:1715330289.639581:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+18:16982:x1798653938030336:12345-192.168.204.49@tcp:101:ls.0 Request processed in 302us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330289.639587:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23399 00000100:00100000:2.0:1715330289.647502:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330289.647574:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938030400 00000100:00100000:0.0:1715330289.647583:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938030400 00000100:00100000:0.0:1715330289.647624:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5024 00000100:00100000:0.0:1715330289.647630:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+31:16982:x1798653938030400:12345-192.168.204.49@tcp:37:ls.0 00000100:00100000:2.0:1715330289.656845:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+31:16982:x1798653938030400:12345-192.168.204.49@tcp:37:ls.0 Request processed in 9207us (9353us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330289.656858:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5024 00000100:00100000:0.0:1715330289.661818:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330289.661894:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938030464 00000100:00100000:2.0:1715330289.661902:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938030464 00000100:00100000:2.0:1715330289.661932:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5025 00000100:00100000:2.0:1715330289.661937:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+18:16982:x1798653938030464:12345-192.168.204.49@tcp:37:ls.0 00000100:00100000:2.0:1715330289.666031:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+18:16982:x1798653938030464:12345-192.168.204.49@tcp:37:ls.0 Request processed in 4085us (4212us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330289.666042:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5025 00000100:00100000:1.0:1715330289.670854:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330289.671141:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938030592 00000100:00100000:2.0:1715330289.671149:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938030592 00000100:00100000:2.0:1715330289.671260:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5026 00000100:00100000:2.0:1715330289.671267:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+31:16982:x1798653938030592:12345-192.168.204.49@tcp:35:ls.0 00000100:00100000:2.0:1715330289.671851:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+32:16982:x1798653938030592:12345-192.168.204.49@tcp:35:ls.0 Request processed in 583us (1003us total) trans 4294983451 rc 0/0 00000100:00100000:2.0:1715330289.671858:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5026 00000100:00100000:0.0:1715330289.674493:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330289.674658:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938030720 00000100:00100000:2.0:1715330289.674665:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938030720 00000100:00100000:2.0:1715330289.674708:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23400 00000100:00100000:2.0:1715330289.674714:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+18:16982:x1798653938030720:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:2.0:1715330289.674747:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330289.674764:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64fc0/0xd895711d66d8757 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb6d2 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.674823:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d875e lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330289.674834:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d875e lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330289.674843:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d875e lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330289.674853:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65200/0xd895711d66d8765 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x8a3c26f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330289.674858:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65200/0xd895711d66d8765 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8a3c26f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330289.674863:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65200/0xd895711d66d8765 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8a3c26f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330289.674907:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67a80/0xd895711d66d876c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x14b4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330289.674912:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67a80/0xd895711d66d876c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14b4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330289.674918:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67a80/0xd895711d66d876c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14b4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330289.674930:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d875e lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330289.674935:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d875e lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330289.674940:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d875e lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330289.674945:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d875e lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330289.674949:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db65440 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330289.674953:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d875e lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330289.674959:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d875e lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330289.674967:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88008b122200) 00010000:00010000:2.0:1715330289.674969:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330289.674972:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d875e lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330289.674977:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d875e lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330289.675003:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65200/0xd895711d66d8765 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8a3c26f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330289.675007:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65200/0xd895711d66d8765 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8a3c26f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330289.675012:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65200/0xd895711d66d8765 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8a3c26f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330289.675016:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db65200 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330289.675018:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65200/0xd895711d66d8765 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8a3c26f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330289.675023:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65200/0xd895711d66d8765 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x8a3c26f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330289.675029:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x8a3c26f1 (ffff88009396dd00) 00010000:00010000:2.0:1715330289.675031:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330289.675033:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65200/0xd895711d66d8765 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x8a3c26f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330289.675037:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65200/0xd895711d66d8765 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x8a3c26f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330289.675059:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64fc0/0xd895711d66d8757 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6d2 expref: 20 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.675069:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67a80/0xd895711d66d876c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x14b4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6d2 expref: 19 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.675075:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14b4:0x0].0x0 (ffff88009396d700) 00010000:00010000:2.0:1715330289.675077:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1715330289.675078:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db67a80, rc 0) 00000100:00100000:2.0:1715330289.675123:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+19:16982:x1798653938030720:12345-192.168.204.49@tcp:101:ls.0 Request processed in 407us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330289.675129:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23400 00000100:00100000:1.0:1715330289.677833:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330289.677875:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938030848 00000100:00100000:0.0:1715330289.677881:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938030848 00000100:00100000:0.0:1715330289.677922:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23401 00000100:00100000:0.0:1715330289.677927:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+32:16982:x1798653938030848:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:0.0:1715330289.677944:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330289.677958:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d8773 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x14b4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb6d9 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715330289.678109:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x14b4:0x0]: returning size 4096 00010000:00010000:0.0:1715330289.678178:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d8773 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x14b4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6d9 expref: 34 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.678186:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d8773 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x14b4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6d9 expref: 34 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.678197:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f1680, rc 0) 00000100:00100000:0.0:1715330289.678241:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+33:16982:x1798653938030848:12345-192.168.204.49@tcp:101:ls.0 Request processed in 312us (412us total) trans 4294983452 rc 301/301 00000100:00100000:0.0:1715330289.678247:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23401 00000100:00100000:1.0:1715330289.683512:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330289.683841:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938030912 00000100:00100000:2.0:1715330289.683851:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938030912 00000100:00100000:2.0:1715330289.683897:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23402 00000100:00100000:2.0:1715330289.683903:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+33:16982:x1798653938030912:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:2.0:1715330289.683921:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330289.683939:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d8781 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb6e0 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.683990:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d8788 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x14b4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330289.683999:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d8788 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14b4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330289.684007:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d8788 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14b4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00200000:2.0:1715330289.684107:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x14b4:0x0]: returning size 4096 00000004:00200000:2.0:1715330289.684112:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1715330289.684124:0:7135:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d8788 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14b4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330289.684622:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d8781 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6e0 expref: 35 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.684638:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d8788 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x14b4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6e0 expref: 34 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.684645:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14b4:0x0].0x0 (ffff88009396d200) 00010000:00010000:2.0:1715330289.684647:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1715330289.684649:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db67180, rc 0) 00000100:00100000:2.0:1715330289.684691:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+34:16982:x1798653938030912:12345-192.168.204.49@tcp:101:ls.0 Request processed in 788us (1187us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330289.684699:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23402 00000100:00100000:0.0:1715330289.687083:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330289.687632:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938030976 00000100:00100000:2.0:1715330289.687641:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938030976 00000100:00100000:2.0:1715330289.687672:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23403 00000100:00100000:2.0:1715330289.687678:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+34:16982:x1798653938030976:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:2.0:1715330289.687691:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330289.687706:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db646c0/0xd895711d66d878f lrc: 2/0,0 mode: --/CR res: [0x200000400:0x98:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb6e7 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.687768:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d8796 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x98:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330289.687778:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d8796 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x98:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330289.687786:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d8796 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x98:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00200000:2.0:1715330289.687817:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0x98:0x0]: returning size 4096 00000004:00200000:2.0:1715330289.687821:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1715330289.687845:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db646c0/0xd895711d66d878f lrc: 0/0,0 mode: --/CR res: [0x200000400:0x98:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6e7 expref: 36 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.687857:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d8796 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x98:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6e7 expref: 35 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.687863:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x98:0x0].0x0 (ffff88009396d400) 00010000:00010000:2.0:1715330289.687865:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1715330289.687867:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db67cc0, rc 0) 00000100:00100000:2.0:1715330289.687902:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+35:16982:x1798653938030976:12345-192.168.204.49@tcp:101:ls.0 Request processed in 223us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330289.687908:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23403 00000100:00100000:1.0:1715330289.690687:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330289.690815:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938031040 00000100:00100000:0.0:1715330289.690821:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938031040 00000100:00100000:0.0:1715330289.690857:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23404 00000100:00100000:0.0:1715330289.690862:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+19:16982:x1798653938031040:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:0.0:1715330289.690876:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330289.690892:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f21c0/0xd895711d66d879d lrc: 2/0,0 mode: --/CR res: [0x240000401:0x98:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb6ee expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.690932:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2880/0xd895711d66d87a4 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x98:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.690941:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2880/0xd895711d66d87a4 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x98:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330289.690948:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2880/0xd895711d66d87a4 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x98:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT1 00000004:00200000:0.0:1715330289.690981:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000401:0x98:0x0]: returning size 4096 00000004:00200000:0.0:1715330289.690984:0:9622:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1715330289.691005:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f21c0/0xd895711d66d879d lrc: 0/0,0 mode: --/CR res: [0x240000401:0x98:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6ee expref: 21 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.691020:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2880/0xd895711d66d87a4 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x98:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6ee expref: 20 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.691026:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x98:0x0].0x0 (ffff88011d537200) 00010000:00010000:0.0:1715330289.691028:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1715330289.691030:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f2880, rc 0) 00000100:00100000:0.0:1715330289.691059:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+20:16982:x1798653938031040:12345-192.168.204.49@tcp:101:ls.0 Request processed in 197us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330289.691064:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23404 00000100:00100000:1.0:1715330289.693686:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330289.693782:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938031104 00000100:00100000:2.0:1715330289.693788:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938031104 00000100:00100000:2.0:1715330289.694371:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5027 00000100:00100000:2.0:1715330289.694377:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+35:16982:x1798653938031104:12345-192.168.204.49@tcp:37:ls.0 00000100:00100000:2.0:1715330289.698922:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+35:16982:x1798653938031104:12345-192.168.204.49@tcp:37:ls.0 Request processed in 4536us (5234us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330289.698935:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5027 00000100:00100000:1.0:1715330289.702891:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330289.703069:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938031168 00000100:00100000:2.0:1715330289.703078:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938031168 00000100:00100000:2.0:1715330289.703706:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5028 00000100:00100000:2.0:1715330289.703714:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ef2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+20:16982:x1798653938031168:12345-192.168.204.49@tcp:37:ls.0 00000100:00100000:2.0:1715330289.709158:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ef2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+20:16982:x1798653938031168:12345-192.168.204.49@tcp:37:ls.0 Request processed in 5436us (6265us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330289.709170:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5028 00000100:00100000:0.0:1715330289.713241:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330289.714607:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938031296 00000100:00100000:2.0:1715330289.714616:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938031296 00000100:00100000:2.0:1715330289.714718:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5029 00000100:00100000:2.0:1715330289.714725:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+35:16982:x1798653938031296:12345-192.168.204.49@tcp:35:ls.0 00000100:00100000:2.0:1715330289.715164:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+36:16982:x1798653938031296:12345-192.168.204.49@tcp:35:ls.0 Request processed in 438us (1929us total) trans 4294983453 rc 0/0 00000100:00100000:2.0:1715330289.715172:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5029 00000100:00100000:1.0:1715330289.718116:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330289.723934:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330289.729331:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330289.733707:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330289.737363:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330289.737463:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938031744 00000100:00100000:2.0:1715330289.737472:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938031744 00000100:00100000:2.0:1715330289.737528:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23409 00000100:00100000:2.0:1715330289.737535:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+21:16982:x1798653938031744:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:2.0:1715330289.737548:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330289.737564:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67840/0xd895711d66d87f1 lrc: 2/0,0 mode: --/CR res: [0x240000401:0xaa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb711 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.737606:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db646c0/0xd895711d66d87f8 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xaa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.737617:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db646c0/0xd895711d66d87f8 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xaa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330289.737625:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db646c0/0xd895711d66d87f8 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xaa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT1 00000004:00200000:2.0:1715330289.737659:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000401:0xaa:0x0]: returning size 4096 00000004:00200000:2.0:1715330289.737662:0:9622:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1715330289.737687:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67840/0xd895711d66d87f1 lrc: 0/0,0 mode: --/CR res: [0x240000401:0xaa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb711 expref: 23 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.737715:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db646c0/0xd895711d66d87f8 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xaa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb711 expref: 22 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.737722:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xaa:0x0].0x0 (ffff88009396dd00) 00010000:00010000:2.0:1715330289.737724:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1715330289.737726:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db646c0, rc 0) 00000100:00100000:2.0:1715330289.737784:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+22:16982:x1798653938031744:12345-192.168.204.49@tcp:101:ls.0 Request processed in 249us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330289.737789:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23409 00000100:00100000:0.0:1715330289.741381:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330289.741561:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938031808 00000100:00100000:2.0:1715330289.741570:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938031808 00000100:00100000:2.0:1715330289.741613:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5030 00000100:00100000:2.0:1715330289.741620:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+39:16982:x1798653938031808:12345-192.168.204.49@tcp:37:ls.0 00000100:00100000:0.0:1715330289.746052:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+39:16982:x1798653938031808:12345-192.168.204.49@tcp:37:ls.0 Request processed in 4424us (4669us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330289.746063:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5030 00000100:00100000:0.0:1715330289.748858:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330289.749054:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938031872 00000100:00100000:2.0:1715330289.749062:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938031872 00000100:00100000:2.0:1715330289.749104:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5031 00000100:00100000:2.0:1715330289.749110:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+22:16982:x1798653938031872:12345-192.168.204.49@tcp:37:ls.0 00000100:00100000:2.0:1715330289.755872:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+22:16982:x1798653938031872:12345-192.168.204.49@tcp:37:ls.0 Request processed in 6753us (7011us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330289.755884:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5031 00000100:00100000:2.0:1715330289.759442:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938032000 00000100:00100000:2.0:1715330289.759451:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938032000 00000100:00100000:2.0:1715330289.759501:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5032 00000100:00100000:2.0:1715330289.759508:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+39:16982:x1798653938032000:12345-192.168.204.49@tcp:35:ls.0 00000100:00100000:2.0:1715330289.759686:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+40:16982:x1798653938032000:12345-192.168.204.49@tcp:35:ls.0 Request processed in 177us (340us total) trans 4294983455 rc 0/0 00000100:00100000:2.0:1715330289.759692:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5032 00000100:00100000:2.0:1715330289.763795:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330289.769303:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330289.774170:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330289.778474:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330289.778609:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938032384 00000100:00100000:0.0:1715330289.778617:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938032384 00000100:00100000:0.0:1715330289.778665:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23413 00000100:00100000:0.0:1715330289.778673:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+42:16982:x1798653938032384:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:0.0:1715330289.778689:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330289.778707:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d8837 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xb0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb72d expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.778772:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d883e lrc: 3/1,0 mode: --/PR res: [0x200000400:0xb0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.778783:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d883e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xb0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.778791:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d883e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xb0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00000004:00200000:0.0:1715330289.778828:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0xb0:0x0]: returning size 4096 00000004:00200000:0.0:1715330289.778832:0:9622:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1715330289.778867:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d8837 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xb0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb72d expref: 44 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.778885:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d883e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xb0:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb72d expref: 43 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.778892:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xb0:0x0].0x0 (ffff88008b122500) 00010000:00010000:0.0:1715330289.778894:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1715330289.778897:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f1680, rc 0) 00000100:00100000:0.0:1715330289.778931:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+43:16982:x1798653938032384:12345-192.168.204.49@tcp:101:ls.0 Request processed in 259us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330289.778937:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23413 00000100:00100000:0.0:1715330289.781967:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330289.787792:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938032512 00000100:00100000:1.0:1715330289.787799:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938032512 00000100:00100000:1.0:1715330289.787845:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5033 00000100:00100000:1.0:1715330289.787852:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ef2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+43:16982:x1798653938032512:12345-192.168.204.49@tcp:37:ls.0 00000100:00100000:1.0:1715330289.790642:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ef2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+43:16982:x1798653938032512:12345-192.168.204.49@tcp:37:ls.0 Request processed in 2782us (2977us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330289.790653:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5033 00000100:00100000:1.0:1715330289.794354:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330289.795666:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938032576 00000100:00100000:2.0:1715330289.795675:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938032576 00000100:00100000:2.0:1715330289.796271:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5034 00000100:00100000:2.0:1715330289.796278:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+24:16982:x1798653938032576:12345-192.168.204.49@tcp:37:ls.0 00000100:00100000:2.0:1715330289.799497:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+24:16982:x1798653938032576:12345-192.168.204.49@tcp:37:ls.0 Request processed in 3204us (5134us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330289.799508:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5034 00000100:00100000:2.0:1715330289.803070:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938032704 00000100:00100000:2.0:1715330289.803077:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938032704 00000100:00100000:2.0:1715330289.803470:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5035 00000100:00100000:2.0:1715330289.803477:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+43:16982:x1798653938032704:12345-192.168.204.49@tcp:35:ls.0 00000100:00100000:2.0:1715330289.803725:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+44:16982:x1798653938032704:12345-192.168.204.49@tcp:35:ls.0 Request processed in 247us (761us total) trans 4294983457 rc 0/0 00000100:00100000:2.0:1715330289.804030:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5035 00000100:00100000:0.0:1715330289.807844:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330289.812584:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938032960 00000100:00100000:0.0:1715330289.812590:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938032960 00000100:00100000:0.0:1715330289.812628:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23416 00000100:00100000:0.0:1715330289.812635:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+44:16982:x1798653938032960:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:0.0:1715330289.812654:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330289.812670:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d886f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x14f8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb742 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715330289.813378:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x14f8:0x0]: returning size 4096 00010000:00010000:0.0:1715330289.813450:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d886f lrc: 1/0,0 mode: --/CR res: [0x200000402:0x14f8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb742 expref: 46 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.813459:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d886f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x14f8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb742 expref: 46 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.813471:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f21c0, rc 0) 00000100:00100000:0.0:1715330289.814068:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+45:16982:x1798653938032960:12345-192.168.204.49@tcp:101:ls.0 Request processed in 1430us (1544us total) trans 4294983458 rc 301/301 00000100:00100000:0.0:1715330289.814076:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23416 00000100:00100000:2.0:1715330289.817152:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330289.817246:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938033024 00000100:00100000:0.0:1715330289.817254:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938033024 00000100:00100000:0.0:1715330289.817290:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23417 00000100:00100000:0.0:1715330289.817296:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+45:16982:x1798653938033024:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:0.0:1715330289.817315:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330289.817332:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d887d lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb749 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.817385:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d8884 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x14f8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330289.817395:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d8884 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14f8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330289.817405:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d8884 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14f8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00200000:0.0:1715330289.817512:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x14f8:0x0]: returning size 4096 00000004:00200000:0.0:1715330289.817517:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1715330289.817531:0:7135:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d8884 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14f8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330289.817549:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d887d lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb749 expref: 47 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.817564:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d8884 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x14f8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb749 expref: 46 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.817571:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14f8:0x0].0x0 (ffff88008b122c00) 00010000:00010000:0.0:1715330289.817573:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1715330289.817575:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f3840, rc 0) 00000100:00100000:0.0:1715330289.818093:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+46:16982:x1798653938033024:12345-192.168.204.49@tcp:101:ls.0 Request processed in 430us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330289.818102:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23417 00000100:00100000:1.0:1715330289.821817:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330289.822527:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938033088 00000100:00100000:2.0:1715330289.822535:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938033088 00000100:00100000:2.0:1715330289.822584:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23418 00000100:00100000:2.0:1715330289.822591:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+46:16982:x1798653938033088:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:2.0:1715330289.822606:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330289.822623:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d888b lrc: 2/0,0 mode: --/CR res: [0x200000400:0xba:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb750 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.822666:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d8892 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xba:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330289.822675:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d8892 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xba:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330289.822683:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d8892 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xba:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00200000:2.0:1715330289.822721:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0xba:0x0]: returning size 4096 00000004:00200000:2.0:1715330289.822724:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1715330289.822772:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d888b lrc: 0/0,0 mode: --/CR res: [0x200000400:0xba:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb750 expref: 48 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.822800:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d8892 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xba:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb750 expref: 47 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.822806:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xba:0x0].0x0 (ffff88009396da00) 00010000:00010000:2.0:1715330289.822809:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1715330289.822811:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db64fc0, rc 0) 00000100:00100000:2.0:1715330289.823915:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+47:16982:x1798653938033088:12345-192.168.204.49@tcp:101:ls.0 Request processed in 1322us (2103us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330289.823922:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23418 00000100:00100000:2.0:1715330289.827239:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938033152 00000100:00100000:2.0:1715330289.827248:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938033152 00000100:00100000:2.0:1715330289.827289:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23419 00000100:00100000:2.0:1715330289.827295:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+25:16982:x1798653938033152:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:2.0:1715330289.827311:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330289.827328:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65200/0xd895711d66d8899 lrc: 2/0,0 mode: --/CR res: [0x240000401:0xba:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb757 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.827375:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d88a0 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xba:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330289.827384:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d88a0 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xba:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330289.827393:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d88a0 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xba:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000004:00200000:2.0:1715330289.827430:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000401:0xba:0x0]: returning size 4096 00000004:00200000:2.0:1715330289.827434:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1715330289.827460:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65200/0xd895711d66d8899 lrc: 0/0,0 mode: --/CR res: [0x240000401:0xba:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb757 expref: 27 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.827474:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d88a0 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xba:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb757 expref: 26 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.827491:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xba:0x0].0x0 (ffff88009396df00) 00010000:00010000:2.0:1715330289.827493:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1715330289.827496:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db65440, rc 0) 00000100:00100000:2.0:1715330289.827551:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+26:16982:x1798653938033152:12345-192.168.204.49@tcp:101:ls.0 Request processed in 255us (1299us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330289.827557:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23419 00000100:00100000:2.0:1715330289.832779:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938033216 00000100:00100000:2.0:1715330289.832788:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938033216 00000100:00100000:2.0:1715330289.832829:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5036 00000100:00100000:2.0:1715330289.832835:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+47:16982:x1798653938033216:12345-192.168.204.49@tcp:37:ls.0 00000100:00100000:2.0:1715330289.836199:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+47:16982:x1798653938033216:12345-192.168.204.49@tcp:37:ls.0 Request processed in 3356us (3614us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330289.836210:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5036 00000100:00100000:2.0:1715330289.839975:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938033280 00000100:00100000:2.0:1715330289.839983:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938033280 00000100:00100000:1.0:1715330289.840088:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5037 00000100:00100000:1.0:1715330289.840095:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+26:16982:x1798653938033280:12345-192.168.204.49@tcp:37:ls.0 00000100:00100000:1.0:1715330289.845580:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+26:16982:x1798653938033280:12345-192.168.204.49@tcp:37:ls.0 Request processed in 5477us (6054us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330289.845593:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5037 00000100:00100000:2.0:1715330289.851681:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330289.852803:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938033408 00000100:00100000:1.0:1715330289.852812:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938033408 00000100:00100000:1.0:1715330289.852864:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5038 00000100:00100000:1.0:1715330289.852871:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ef2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+47:16982:x1798653938033408:12345-192.168.204.49@tcp:35:ls.0 00000100:00100000:1.0:1715330289.853072:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ef2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+48:16982:x1798653938033408:12345-192.168.204.49@tcp:35:ls.0 Request processed in 200us (1396us total) trans 4294983459 rc 0/0 00000100:00100000:1.0:1715330289.853079:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5038 00000100:00100000:0.0:1715330289.856600:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938033536 00000100:00100000:0.0:1715330289.856607:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938033536 00000100:00100000:0.0:1715330289.856655:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23420 00000100:00100000:0.0:1715330289.856661:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+48:16982:x1798653938033536:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:0.0:1715330289.856679:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330289.856695:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d88a7 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb75e expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.856782:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d88ae lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.856793:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d88ae lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.856802:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d88ae lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.856812:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2ac0/0xd895711d66d88b5 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.856817:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2ac0/0xd895711d66d88b5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.856822:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2ac0/0xd895711d66d88b5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.856863:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66d88bc lrc: 3/1,0 mode: --/PR res: [0x240000402:0x170:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.856868:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66d88bc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x170:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.856873:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66d88bc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x170:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.856881:0:9622:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d88ae lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.856886:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d88ae lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.856889:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d88ae lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.856894:0:9622:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d88ae lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.856899:0:9622:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f21c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330289.856902:0:9622:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d88ae lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.856907:0:9622:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d88ae lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.856914:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88008b122e00) 00010000:00010000:0.0:1715330289.856917:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330289.856920:0:9622:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d88ae lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.856925:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66d88ae lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.856950:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2ac0/0xd895711d66d88b5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.856954:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2ac0/0xd895711d66d88b5 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.856958:0:9622:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2ac0/0xd895711d66d88b5 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.856961:0:9622:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a2ac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330289.856963:0:9622:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2ac0/0xd895711d66d88b5 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.856968:0:9622:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2ac0/0xd895711d66d88b5 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.856973:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x6f4526f6 (ffff88008b122d00) 00010000:00010000:0.0:1715330289.856975:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330289.856978:0:9622:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2ac0/0xd895711d66d88b5 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.856983:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2ac0/0xd895711d66d88b5 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.857006:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66d88a7 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb75e expref: 50 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.857016:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66d88bc lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x170:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb75e expref: 49 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.857022:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x170:0x0].0x0 (ffff88008b122600) 00010000:00010000:0.0:1715330289.857024:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1715330289.857026:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a0900, rc 0) 00000100:00100000:1.0:1715330289.857184:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+49:16982:x1798653938033536:12345-192.168.204.49@tcp:101:ls.0 Request processed in 521us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330289.857191:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23420 00000100:00100000:1.0:1715330289.861627:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938033664 00000100:00100000:1.0:1715330289.861635:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938033664 00000100:00100000:1.0:1715330289.861722:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23421 00000100:00100000:1.0:1715330289.861842:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+26:16982:x1798653938033664:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:1.0:1715330289.861860:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330289.861877:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d88c3 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x170:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb765 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715330289.862021:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x170:0x0]: returning size 4096 00010000:00010000:1.0:1715330289.862087:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d88c3 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x170:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb765 expref: 28 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330289.862095:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d88c3 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x170:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb765 expref: 28 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330289.862106:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfe640, rc 0) 00000100:00100000:1.0:1715330289.862142:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+27:16982:x1798653938033664:12345-192.168.204.49@tcp:101:ls.0 Request processed in 413us (685us total) trans 4294968387 rc 301/301 00000100:00100000:1.0:1715330289.862148:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23421 00000100:00100000:2.0:1715330289.865235:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330289.865282:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938033728 00000100:00100000:1.0:1715330289.865290:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938033728 00000100:00100000:1.0:1715330289.865325:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23422 00000100:00100000:1.0:1715330289.865331:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+27:16982:x1798653938033728:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:1.0:1715330289.865348:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330289.865363:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d88d1 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb76c expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330289.865408:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d88d8 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x170:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:1.0:1715330289.865418:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d88d8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x170:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330289.865427:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d88d8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x170:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT1 00000004:00200000:1.0:1715330289.865527:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x170:0x0]: returning size 4096 00000004:00200000:1.0:1715330289.865531:0:9622:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1715330289.865544:0:9622:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d88d8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x170:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330289.865563:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d88d1 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb76c expref: 29 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330289.865577:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d88d8 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x170:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb76c expref: 28 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330289.865582:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x170:0x0].0x0 (ffff88012dcc3e00) 00010000:00010000:1.0:1715330289.865585:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1715330289.865587:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfc6c0, rc 0) 00000100:00100000:1.0:1715330289.866225:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+28:16982:x1798653938033728:12345-192.168.204.49@tcp:101:ls.0 Request processed in 891us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330289.866232:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23422 00000100:00100000:2.0:1715330289.872986:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330289.873089:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938033792 00000100:00100000:0.0:1715330289.873101:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938033792 00000100:00100000:0.0:1715330289.873156:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23423 00000100:00100000:0.0:1715330289.873165:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+28:16982:x1798653938033792:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:0.0:1715330289.873189:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330289.873216:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a21c0/0xd895711d66d88df lrc: 2/0,0 mode: --/CR res: [0x240000400:0xbb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb773 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.873281:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a06c0/0xd895711d66d88e6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xbb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.873295:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a06c0/0xd895711d66d88e6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xbb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330289.873307:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a06c0/0xd895711d66d88e6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xbb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT1 00000004:00200000:0.0:1715330289.873359:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000400:0xbb:0x0]: returning size 4096 00000004:00200000:0.0:1715330289.873363:0:9622:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1715330289.873391:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a21c0/0xd895711d66d88df lrc: 0/0,0 mode: --/CR res: [0x240000400:0xbb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb773 expref: 30 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.873424:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a06c0/0xd895711d66d88e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xbb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb773 expref: 29 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.873431:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xbb:0x0].0x0 (ffff88008b122d00) 00010000:00010000:0.0:1715330289.873433:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1715330289.873436:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a06c0, rc 0) 00000100:00100000:0.0:1715330289.873495:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+29:16982:x1798653938033792:12345-192.168.204.49@tcp:101:ls.0 Request processed in 330us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330289.873500:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23423 00000100:00100000:0.0:1715330289.877896:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938033856 00000100:00100000:0.0:1715330289.877905:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938033856 00000100:00100000:0.0:1715330289.878587:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23424 00000100:00100000:0.0:1715330289.878594:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+49:16982:x1798653938033856:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:0.0:1715330289.878619:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330289.878646:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0fc0/0xd895711d66d88ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xbb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb77a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.878715:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1b00/0xd895711d66d88f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xbb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330289.878759:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1b00/0xd895711d66d88f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xbb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330289.878770:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1b00/0xd895711d66d88f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xbb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00200000:0.0:1715330289.878825:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xbb:0x0]: returning size 4096 00000004:00200000:0.0:1715330289.878830:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1715330289.878872:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0fc0/0xd895711d66d88ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0xbb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb77a expref: 51 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.878909:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1b00/0xd895711d66d88f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xbb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb77a expref: 50 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.878916:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xbb:0x0].0x0 (ffff88008b122a00) 00010000:00010000:0.0:1715330289.878918:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1715330289.878921:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a1b00, rc 0) 00000100:00100000:0.0:1715330289.878986:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+50:16982:x1798653938033856:12345-192.168.204.49@tcp:101:ls.0 Request processed in 391us (1190us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330289.878993:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23424 00000100:00100000:2.0:1715330289.884296:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330289.884606:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938033920 00000100:00100000:0.0:1715330289.884616:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938033920 00000100:00100000:0.0:1715330289.884779:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5039 00000100:00100000:0.0:1715330289.884786:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+29:16982:x1798653938033920:12345-192.168.204.49@tcp:37:ls.0 00000100:00100000:0.0:1715330289.887654:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+29:16982:x1798653938033920:12345-192.168.204.49@tcp:37:ls.0 Request processed in 2858us (3360us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330289.887667:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5039 00000100:00100000:0.0:1715330289.890831:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938033984 00000100:00100000:0.0:1715330289.890839:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938033984 00000100:00100000:0.0:1715330289.891474:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5040 00000100:00100000:0.0:1715330289.891492:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+50:16982:x1798653938033984:12345-192.168.204.49@tcp:37:ls.0 00000100:00100000:0.0:1715330289.896254:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+50:16982:x1798653938033984:12345-192.168.204.49@tcp:37:ls.0 Request processed in 4752us (5545us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330289.896267:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5040 00000100:00100000:2.0:1715330289.898847:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330289.899099:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938034112 00000100:00100000:0.0:1715330289.899109:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938034112 00000100:00100000:0.0:1715330289.899160:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5041 00000100:00100000:0.0:1715330289.899168:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+29:16982:x1798653938034112:12345-192.168.204.49@tcp:35:ls.0 00000100:00100000:0.0:1715330289.899386:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+30:16982:x1798653938034112:12345-192.168.204.49@tcp:35:ls.0 Request processed in 217us (663us total) trans 4294968388 rc 0/0 00000100:00100000:0.0:1715330289.899393:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5041 00000100:00100000:2.0:1715330289.902954:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938034240 00000100:00100000:2.0:1715330289.902963:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938034240 00000100:00100000:2.0:1715330289.903022:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23425 00000100:00100000:2.0:1715330289.903028:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+50:16982:x1798653938034240:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:2.0:1715330289.903045:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330289.903065:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d88fb lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb781 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.903135:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d8902 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.903146:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d8902 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.903156:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d8902 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.903167:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d8909 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x8a4526bf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.903171:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d8909 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.903176:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d8909 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.903219:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d8910 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.903224:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d8910 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.903228:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d8910 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.903243:0:9622:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d8902 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.903248:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d8902 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.903253:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d8902 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.903259:0:9622:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d8902 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.903264:0:9622:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64240 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330289.903267:0:9622:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d8902 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.903273:0:9622:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d8902 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.903282:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88008b122e00) 00010000:00010000:2.0:1715330289.903285:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330289.903288:0:9622:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d8902 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.903293:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d8902 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.904505:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d8909 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.904514:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d8909 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.904519:0:9622:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d8909 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.904524:0:9622:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64000 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330289.904527:0:9622:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d8909 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.904531:0:9622:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d8909 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8a4526bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.904539:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x8a4526bf (ffff8800a7e58900) 00010000:00010000:2.0:1715330289.904541:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330289.904543:0:9622:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d8909 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x8a4526bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.904548:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d8909 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x8a4526bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.904580:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d88fb lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb781 expref: 52 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.904591:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d8910 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb781 expref: 51 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.904597:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x28:0x0].0x0 (ffff8800a7e58b00) 00010000:00010000:2.0:1715330289.904599:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1715330289.904601:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db66640, rc 0) 00000100:00100000:2.0:1715330289.905163:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+51:16982:x1798653938034240:12345-192.168.204.49@tcp:101:ls.0 Request processed in 2133us (2654us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330289.905171:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23425 00000100:00100000:2.0:1715330289.907538:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330289.907607:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938034368 00000100:00100000:0.0:1715330289.907615:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938034368 00000100:00100000:0.0:1715330289.907660:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23426 00000100:00100000:0.0:1715330289.907667:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+30:16982:x1798653938034368:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:0.0:1715330289.907693:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330289.907716:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a3a80/0xd895711d66d8917 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb788 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715330289.907958:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x28:0x0]: returning size 4096 00010000:00010000:0.0:1715330289.908039:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a3a80/0xd895711d66d8917 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb788 expref: 32 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.908047:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a3a80/0xd895711d66d8917 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb788 expref: 32 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.908061:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a3a80, rc 0) 00000100:00100000:0.0:1715330289.908108:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+31:16982:x1798653938034368:12345-192.168.204.49@tcp:101:ls.0 Request processed in 441us (578us total) trans 4294968389 rc 301/301 00000100:00100000:0.0:1715330289.908118:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23426 00000100:00100000:2.0:1715330289.910524:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938034432 00000100:00100000:2.0:1715330289.910531:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938034432 00000100:00100000:2.0:1715330289.910578:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23427 00000100:00100000:2.0:1715330289.910585:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+31:16982:x1798653938034432:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:2.0:1715330289.910608:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330289.910629:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64b40/0xd895711d66d8925 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb78f expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.910679:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66d00/0xd895711d66d892c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330289.910690:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66d00/0xd895711d66d892c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x28:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330289.910698:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66d00/0xd895711d66d892c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x28:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000004:00200000:2.0:1715330289.910902:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x28:0x0]: returning size 4096 00000004:00200000:2.0:1715330289.910906:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1715330289.910921:0:7135:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66d00/0xd895711d66d892c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x28:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330289.910941:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64b40/0xd895711d66d8925 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb78f expref: 33 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.910954:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66d00/0xd895711d66d892c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x28:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb78f expref: 32 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.910961:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x28:0x0].0x0 (ffff8800a7e58800) 00010000:00010000:2.0:1715330289.910964:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1715330289.910967:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db66d00, rc 0) 00000100:00100000:2.0:1715330289.911011:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+32:16982:x1798653938034432:12345-192.168.204.49@tcp:101:ls.0 Request processed in 426us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330289.911019:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23427 00000100:00100000:1.0:1715330289.912964:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330289.913117:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938034496 00000100:00100000:2.0:1715330289.913123:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938034496 00000100:00100000:2.0:1715330289.913159:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23428 00000100:00100000:2.0:1715330289.913164:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+32:16982:x1798653938034496:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:2.0:1715330289.913176:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330289.913188:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66ac0/0xd895711d66d8933 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb796 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.913222:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66400/0xd895711d66d893a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330289.913230:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66400/0xd895711d66d893a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330289.913237:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66400/0xd895711d66d893a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000004:00200000:2.0:1715330289.913263:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000400:0x17:0x0]: returning size 4096 00000004:00200000:2.0:1715330289.913266:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1715330289.913281:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66ac0/0xd895711d66d8933 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb796 expref: 34 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.913293:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66400/0xd895711d66d893a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb796 expref: 33 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.913299:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x17:0x0].0x0 (ffff8800a7e58f00) 00010000:00010000:2.0:1715330289.913301:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1715330289.913303:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db66400, rc 0) 00000100:00100000:2.0:1715330289.913345:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+33:16982:x1798653938034496:12345-192.168.204.49@tcp:101:ls.0 Request processed in 181us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330289.913351:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23428 00000100:00100000:0.0:1715330289.914914:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330289.915014:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938034560 00000100:00100000:2.0:1715330289.915020:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938034560 00000100:00100000:2.0:1715330289.915048:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23429 00000100:00100000:2.0:1715330289.915053:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+51:16982:x1798653938034560:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:2.0:1715330289.915065:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330289.915081:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db661c0/0xd895711d66d8941 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb79d expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.915125:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d8948 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330289.915134:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d8948 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330289.915142:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d8948 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00200000:2.0:1715330289.915176:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x17:0x0]: returning size 4096 00000004:00200000:2.0:1715330289.915179:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1715330289.915200:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db661c0/0xd895711d66d8941 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb79d expref: 53 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.915213:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d8948 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb79d expref: 52 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.915218:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x0 (ffff8800a7e58700) 00010000:00010000:2.0:1715330289.915221:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1715330289.915223:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db64900, rc 0) 00000100:00100000:2.0:1715330289.915270:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+52:16982:x1798653938034560:12345-192.168.204.49@tcp:101:ls.0 Request processed in 216us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330289.915276:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23429 00000100:00100000:1.0:1715330289.918404:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938034624 00000100:00100000:1.0:1715330289.918413:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938034624 00000100:00100000:1.0:1715330289.918502:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5042 00000100:00100000:1.0:1715330289.918509:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+33:16982:x1798653938034624:12345-192.168.204.49@tcp:37:ls.0 00000100:00100000:2.0:1715330289.923227:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+33:16982:x1798653938034624:12345-192.168.204.49@tcp:37:ls.0 Request processed in 4705us (4894us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330289.923243:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5042 00000100:00100000:2.0:1715330289.926862:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330289.927003:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938034688 00000100:00100000:0.0:1715330289.927013:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938034688 00000100:00100000:0.0:1715330289.927066:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5043 00000100:00100000:0.0:1715330289.927074:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ef1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+52:16982:x1798653938034688:12345-192.168.204.49@tcp:37:ls.0 00000100:00100000:1.0:1715330289.936287:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ef1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+52:16982:x1798653938034688:12345-192.168.204.49@tcp:37:ls.0 Request processed in 9198us (9423us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330289.936302:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5043 00000100:00100000:2.0:1715330289.940825:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330289.940946:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938034816 00000100:00100000:1.0:1715330289.940957:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938034816 00000100:00100000:1.0:1715330289.941020:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5044 00000100:00100000:1.0:1715330289.941029:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+33:16982:x1798653938034816:12345-192.168.204.49@tcp:35:ls.0 00000100:00100000:1.0:1715330289.942511:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+34:16982:x1798653938034816:12345-192.168.204.49@tcp:35:ls.0 Request processed in 1476us (1691us total) trans 4294968390 rc 0/0 00000100:00100000:1.0:1715330289.942524:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5044 00000100:00100000:2.0:1715330289.948657:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330289.949846:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938034944 00000100:00100000:0.0:1715330289.949859:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938034944 00000100:00100000:0.0:1715330289.949922:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23430 00000100:00100000:0.0:1715330289.949930:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+52:16982:x1798653938034944:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:0.0:1715330289.949954:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330289.949977:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3840/0xd895711d66d894f lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb7a4 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.950054:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66d8956 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.950067:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66d8956 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.950077:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66d8956 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.950089:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66d895d lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x5d4e26bf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.950095:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66d895d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x5d4e26bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.950100:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66d895d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x5d4e26bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00000004:00200000:0.0:1715330289.950275:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x13bc:0x0]: returning size 4096 00010000:00010000:0.0:1715330289.950342:0:9622:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66d8956 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.950348:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66d8956 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.950354:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66d8956 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.950359:0:9622:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66d8956 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.950365:0:9622:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a1200 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330289.950368:0:9622:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66d8956 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.950374:0:9622:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66d8956 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.950385:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88008b122e00) 00010000:00010000:0.0:1715330289.950388:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330289.950391:0:9622:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66d8956 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.950397:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66d8956 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.950407:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66d895d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x5d4e26bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.950412:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66d895d lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x5d4e26bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.950421:0:9622:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66d895d lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x5d4e26bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.950425:0:9622:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a1d40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330289.950427:0:9622:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66d895d lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x5d4e26bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.950431:0:9622:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66d895d lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x5d4e26bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.950436:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x5d4e26bf (ffff88008b122900) 00010000:00010000:0.0:1715330289.950437:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330289.950439:0:9622:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66d895d lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x5d4e26bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.950443:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66d895d lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x5d4e26bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330289.950472:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3840/0xd895711d66d894f lrc: 1/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb7a4 expref: 54 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.950491:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3840/0xd895711d66d894f lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb7a4 expref: 54 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330289.950500:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a3840, rc 0) 00000100:00100000:0.0:1715330289.950550:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+53:16982:x1798653938034944:12345-192.168.204.49@tcp:101:ls.0 Request processed in 621us (1904us total) trans 4294983460 rc 301/301 00000100:00100000:0.0:1715330289.950557:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23430 00000100:00100000:2.0:1715330289.958135:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938035008 00000100:00100000:2.0:1715330289.958148:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938035008 00000100:00100000:2.0:1715330289.958198:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23431 00000100:00100000:2.0:1715330289.958205:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+53:16982:x1798653938035008:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:2.0:1715330289.958231:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330289.958252:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db661c0/0xd895711d66d896b lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb7ab expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.958319:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d8972 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x13bc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330289.958331:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d8972 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13bc:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330289.958342:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d8972 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13bc:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00200000:2.0:1715330289.958802:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x13bc:0x0]: returning size 4096 00000004:00200000:2.0:1715330289.958807:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1715330289.958823:0:7135:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d8972 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13bc:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330289.958843:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db661c0/0xd895711d66d896b lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb7ab expref: 55 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.958855:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d8972 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x13bc:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb7ab expref: 54 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.958860:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13bc:0x0].0x0 (ffff8800a7e58900) 00010000:00010000:2.0:1715330289.958862:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1715330289.958865:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db66ac0, rc 0) 00000100:00100000:2.0:1715330289.958907:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+54:16982:x1798653938035008:12345-192.168.204.49@tcp:101:ls.0 Request processed in 703us (2279us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330289.958911:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23431 00000100:00100000:2.0:1715330289.968688:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938035072 00000100:00100000:2.0:1715330289.968699:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938035072 00000100:00100000:2.0:1715330289.968780:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23432 00000100:00100000:2.0:1715330289.968788:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+54:16982:x1798653938035072:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:2.0:1715330289.968812:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330289.968842:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d8979 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb7b2 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.968903:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d8980 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330289.968916:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d8980 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330289.968927:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d8980 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00200000:2.0:1715330289.968970:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0x1c:0x0]: returning size 4096 00000004:00200000:2.0:1715330289.968975:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1715330289.969004:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d8979 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb7b2 expref: 56 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.969042:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d8980 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb7b2 expref: 55 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.969050:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1c:0x0].0x0 (ffff8800a7e58100) 00010000:00010000:2.0:1715330289.969052:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1715330289.969055:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db67600, rc 0) 00000100:00100000:2.0:1715330289.969119:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+55:16982:x1798653938035072:12345-192.168.204.49@tcp:101:ls.0 Request processed in 330us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330289.969125:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23432 00000100:00100000:0.0:1715330289.975176:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330289.975316:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938035136 00000100:00100000:2.0:1715330289.975325:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938035136 00000100:00100000:2.0:1715330289.975371:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23433 00000100:00100000:2.0:1715330289.975378:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+34:16982:x1798653938035136:12345-192.168.204.49@tcp:101:ls.0 00010000:00010000:2.0:1715330289.975404:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330289.975428:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64000/0xd895711d66d8987 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb7b9 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.975499:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64240/0xd895711d66d898e lrc: 3/1,0 mode: --/PR res: [0x240000401:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330289.975513:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64240/0xd895711d66d898e lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330289.975523:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64240/0xd895711d66d898e lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT1 00000004:00200000:2.0:1715330289.975563:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000401:0x1c:0x0]: returning size 4096 00000004:00200000:2.0:1715330289.975567:0:9622:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1715330289.975594:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64000/0xd895711d66d8987 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb7b9 expref: 36 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.977689:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64240/0xd895711d66d898e lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb7b9 expref: 35 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330289.977704:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x1c:0x0].0x0 (ffff8800a7e58d00) 00010000:00010000:2.0:1715330289.977707:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1715330289.977711:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db64240, rc 0) 00000100:00100000:2.0:1715330289.977808:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+35:16982:x1798653938035136:12345-192.168.204.49@tcp:101:ls.0 Request processed in 2429us (2643us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330289.977817:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23433 00000100:00100000:1.0:1715330289.983553:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938035200 00000100:00100000:1.0:1715330289.983564:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938035200 00000100:00100000:1.0:1715330289.983619:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5045 00000100:00100000:1.0:1715330289.983626:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+55:16982:x1798653938035200:12345-192.168.204.49@tcp:37:ls.0 00000100:00100000:1.0:1715330289.996554:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330290.012769:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330290.049376:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330290.049452:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938035520 00000100:00100000:0.0:1715330290.049462:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938035520 00000100:00100000:0.0:1715330290.049543:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23434 00000100:00100000:0.0:1715330290.049551:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+35:16983:x1798653938035520:12345-192.168.204.49@tcp:101:rm.0 00010000:00010000:0.0:1715330290.049573:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330290.049595:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a0000/0xd895711d66d8995 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb7c0 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715330290.049813:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x28:0x0]: returning size 4096 00010000:00010000:0.0:1715330290.049915:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a0000/0xd895711d66d8995 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x28:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb7c0 expref: 37 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.049923:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a0000/0xd895711d66d8995 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x28:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb7c0 expref: 37 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.049933:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a0000, rc 0) 00000100:00100000:0.0:1715330290.049983:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+36:16983:x1798653938035520:12345-192.168.204.49@tcp:101:rm.0 Request processed in 433us (620us total) trans 4294968391 rc 301/301 00000100:00100000:0.0:1715330290.049990:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23434 00000100:00100000:2.0:1715330290.061830:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938035648 00000100:00100000:2.0:1715330290.061841:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938035648 00000100:00100000:2.0:1715330290.061900:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5048 00000100:00100000:2.0:1715330290.061908:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ef1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+36:16983:x1798653938035648:12345-192.168.204.49@tcp:35:rm.0 00000100:00100000:2.0:1715330290.062138:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ef1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+37:16983:x1798653938035648:12345-192.168.204.49@tcp:35:rm.0 Request processed in 229us (861us total) trans 4294968392 rc 0/0 00000100:00100000:2.0:1715330290.062144:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5048 00000100:00100000:1.0:1715330290.066519:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330290.067070:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938035712 00000100:00100000:2.0:1715330290.067083:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938035712 00000100:00100000:2.0:1715330290.067153:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1301 00000100:00100000:2.0:1715330290.067160:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72de1896-1df4-4b3a-930a-9116d2c66168+56:2014:x1798653938035712:12345-192.168.204.49@tcp:103:rm.0 00010000:00010000:2.0:1715330290.067178:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330290.067204:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d8910 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x28:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb781 expref: 56 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.067232:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x28:0x0].0x0 (ffff8800a7e58b00) 00010000:00010000:2.0:1715330290.067244:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330290.067602:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938035840 00000100:00100000:0.0:1715330290.067609:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938035840 00000100:00100000:0.0:1715330290.067653:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23435 00000100:00100000:0.0:1715330290.067660:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+37:16983:x1798653938035840:12345-192.168.204.49@tcp:36:rm.0 00010000:00010000:0.0:1715330290.067703:0:9622:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330290.067722:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66d00/0xd895711d66d892c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x28:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb78f expref: 37 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.067768:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x28:0x0].0x0 (ffff8800a7e58800) 00010000:00010000:0.0:1715330290.067777:0:9622:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715330290.067814:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a2f40/0xd895711d66d89a3 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330290.067821:0:9622:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a2f40/0xd895711d66d89a3 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330290.067829:0:9622:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a2f40/0xd895711d66d89a3 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 9622 initiator: MDT1 00000100:00100000:0.0:1715330290.067845:0:9622:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800877ece00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9622:1798653942460992:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1715330290.067883:0:9622:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330290.067902:0:9622:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffab40 going to sleep for 11 seconds 00000100:00100000:0.0:1715330290.067912:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942460992 00000100:00100000:0.0:1715330290.067914:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942460992 00000100:00100000:2.0:1715330290.067917:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72de1896-1df4-4b3a-930a-9116d2c66168+55:2014:x1798653938035712:12345-192.168.204.49@tcp:103:rm.0 Request processed in 757us (1404us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330290.067926:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1301 00000100:00100000:0.0:1715330290.067933:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2751 00000100:00100000:0.0:1715330290.067937:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+15:9622:x1798653942460992:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1715330290.067945:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330290.067956:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66d89aa lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d89a3 expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.067972:0:9408:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d859e lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb61c expref: 54 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.067978:0:9408:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66d89aa lrc: 4/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d89a3 expref: 16 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.067995:0:9408:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d859e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb61c expref: 54 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.068005:0:9408:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d859e lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb61c expref: 54 pid: 7135 timeout: 364 lvb_type: 0 00000100:00100000:0.0:1715330290.068018:0:9408:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800877eea00 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:9408:1798653942461056:192.168.204.49@tcp:104: 00000100:00100000:0.0:1715330290.068046:0:9408:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa540 going to sleep for 11 seconds 00000100:00100000:0.0:1715330290.075344:0:9408:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800877eea00 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:9408:1798653942461056:192.168.204.49@tcp:104: 00010000:00010000:0.0:1715330290.075376:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66d89aa lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d89a3 expref: 16 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.075388:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88008b122e00) 00010000:00010000:0.0:1715330290.075391:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330290.075395:0:9408:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66d89aa lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d89a3 expref: 16 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.075403:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a2880, rc 0) 00000100:00100000:0.0:1715330290.075458:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+16:9622:x1798653942460992:12345-0@lo:101:mdt00_003.0 Request processed in 7519us (7574us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330290.075467:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2751 00000100:00100000:1.0:1715330290.075640:0:9622:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800877ece00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9622:1798653942460992:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1715330290.075660:0:9622:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a2f40/0xd895711d66d89a3 lrc: 4/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d89aa expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.075669:0:9622:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a2f40/0xd895711d66d89a3 lrc: 4/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d89aa expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330290.076456:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938035904 00000100:00100000:0.0:1715330290.076462:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938035904 00010000:00010000:0.0:1715330290.076491:0:7120:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d859e lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb61c expref: 55 pid: 7135 timeout: 364 lvb_type: 0 00000100:00100000:0.0:1715330290.076521:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1517 00000100:00100000:0.0:1715330290.076527:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72de1896-1df4-4b3a-930a-9116d2c66168+55:2012:x1798653938035904:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1715330290.076538:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330290.076543:0:7120:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d859e lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb61c expref: 55 pid: 7135 timeout: 364 lvb_type: 0 00010000:00010000:0.0:1715330290.076557:0:7120:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d859e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb61c expref: 55 pid: 7135 timeout: 364 lvb_type: 0 00010000:00010000:0.0:1715330290.076576:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d859e lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb61c expref: 55 pid: 7135 timeout: 364 lvb_type: 0 00010000:00010000:0.0:1715330290.076589:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88008b122e00) 00010000:00010000:0.0:1715330290.076593:0:7120:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66d89aa lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d89a3 expref: 15 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.076600:0:7120:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66d89aa lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d89a3 expref: 15 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.076607:0:7120:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66d89aa lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d89a3 expref: 15 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.076632:0:7120:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66d89aa lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d89a3 expref: 15 pid: 9408 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330290.076646:0:7120:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800877eea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:7120:1798653942461120:0@lo:105: 00000100:00100000:0.0:1715330290.076678:0:7120:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330290.076703:0:7120:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa540 going to sleep for 11 seconds 00010000:00010000:1.0:1715330290.077894:0:9622:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a2f40/0xd895711d66d89a3 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d89aa expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.077903:0:9622:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a2f40/0xd895711d66d89a3 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d89aa expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330290.077923:0:9622:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:1.0:1715330290.077950:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc240/0xd895711d66d89b1 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x8a4526bf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 9622 initiator: MDT0 00010000:00010000:1.0:1715330290.077955:0:9622:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc240/0xd895711d66d89b1 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x8a4526bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330290.077963:0:9622:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc240/0xd895711d66d89b1 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x8a4526bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 9622 initiator: MDT1 00000100:00100000:1.0:1715330290.077977:0:9622:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9622:1798653942461184:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1715330290.078001:0:9622:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330290.078312:0:7120:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800877eea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:7120:1798653942461120:0@lo:105: 00010000:00010000:0.0:1715330290.078322:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330290.078364:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72de1896-1df4-4b3a-930a-9116d2c66168+54:2012:x1798653938035904:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 1836us (2522us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330290.078370:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1517 00000100:00100000:1.0:1715330290.080626:0:9622:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715330290.080719:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942461184 00000100:00100000:2.0:1715330290.080726:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942461184 00000100:00100000:2.0:1715330290.080779:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2752 00000100:00100000:2.0:1715330290.080785:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+16:9622:x1798653942461184:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1715330290.080802:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330290.080820:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d89b8 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x8a4526bf bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d89b1 expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.080843:0:9408:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d89b8 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x8a4526bf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d89b1 expref: 17 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.080853:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d89b8 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x8a4526bf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d89b1 expref: 17 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.080859:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x8a4526bf (ffff88008b374600) 00010000:00010000:2.0:1715330290.080862:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330290.080864:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db65200, rc 0) 00000100:00100000:2.0:1715330290.080899:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+17:9622:x1798653942461184:12345-0@lo:101:mdt00_003.0 Request processed in 114us (2897us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330290.080907:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2752 00000100:00100000:1.0:1715330290.081121:0:9622:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091c3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9622:1798653942461184:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1715330290.081133:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc240/0xd895711d66d89b1 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x8a4526bf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d89b8 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.081141:0:9622:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc240/0xd895711d66d89b1 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x8a4526bf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d89b8 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330290.081157:0:9622:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:1.0:1715330290.081191:0:9622:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9622:1798653942461248:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1715330290.081217:0:9622:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330290.081225:0:9622:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f780 going to sleep for 11 seconds 00000100:00100000:2.0:1715330290.081274:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942461248 00000100:00100000:2.0:1715330290.081277:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942461248 00000100:00100000:2.0:1715330290.081302:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2753 00000100:00100000:2.0:1715330290.081306:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+17:9622:x1798653942461248:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1715330290.081363:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+17:9622:x1798653942461248:12345-0@lo:1000:mdt00_003.0 Request processed in 55us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330290.081368:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2753 00000100:00100000:1.0:1715330290.081418:0:9622:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091c3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9622:1798653942461248:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1715330290.081449:0:9622:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9622:1798653942461312:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1715330290.081463:0:9622:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330290.081470:0:9622:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f780 going to sleep for 11 seconds 00000100:00100000:1.0:1715330290.081660:0:9622:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091c3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9622:1798653942461312:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1715330290.081692:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfe640/0xd895711d66d89bf lrc: 3/0,1 mode: --/EX res: [0x240000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 9622 initiator: MDT0 00010000:00010000:1.0:1715330290.081699:0:9622:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfe640/0xd895711d66d89bf lrc: 3/0,1 mode: --/EX res: [0x240000402:0x28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330290.081706:0:9622:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfe640/0xd895711d66d89bf lrc: 3/0,1 mode: --/EX res: [0x240000402:0x28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 9622 initiator: MDT1 00000100:00100000:1.0:1715330290.081713:0:9622:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9622:1798653942461376:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1715330290.081727:0:9622:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330290.081757:0:9622:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330290.081966:0:9622:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091c3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9622:1798653942461376:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1715330290.081974:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfe640/0xd895711d66d89bf lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d89c6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.081980:0:9622:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfe640/0xd895711d66d89bf lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d89c6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.081997:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd680/0xd895711d66d89cd lrc: 3/0,1 mode: --/EX res: [0x240000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:1.0:1715330290.082004:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd680/0xd895711d66d89cd lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330290.082009:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd680/0xd895711d66d89cd lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330290.082022:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d89d4 lrc: 3/0,1 mode: --/EX res: [0x240000400:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:1.0:1715330290.082030:0:9622:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66400/0xd895711d66d893a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb796 expref: 36 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.082035:0:9622:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d89d4 lrc: 4/0,1 mode: --/EX res: [0x240000400:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330290.082052:0:9622:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66400/0xd895711d66d893a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb796 expref: 36 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.082061:0:9622:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66400/0xd895711d66d893a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb796 expref: 36 pid: 7135 timeout: 364 lvb_type: 0 00000100:00100000:1.0:1715330290.082070:0:9622:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:9622:1798653942461440:192.168.204.49@tcp:104: 00000100:00100000:1.0:1715330290.082212:0:9622:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330290.085103:0:9622:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091c3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:9622:1798653942461440:192.168.204.49@tcp:104: 00010000:00010000:1.0:1715330290.085126:0:9622:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d89d4 lrc: 3/0,1 mode: --/EX res: [0x240000400:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT1 00000100:00100000:0.0:1715330290.085774:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938035968 00000100:00100000:0.0:1715330290.085780:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938035968 00010000:00010000:1.0:1715330290.085824:0:7120:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66400/0xd895711d66d893a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb796 expref: 37 pid: 7135 timeout: 364 lvb_type: 0 00000100:00100000:1.0:1715330290.086064:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1518 00000100:00100000:1.0:1715330290.086070:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72de1896-1df4-4b3a-930a-9116d2c66168+37:2012:x1798653938035968:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1715330290.086081:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330290.086087:0:7120:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66400/0xd895711d66d893a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb796 expref: 37 pid: 7135 timeout: 364 lvb_type: 0 00010000:00010000:1.0:1715330290.086095:0:7120:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66400/0xd895711d66d893a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb796 expref: 37 pid: 7135 timeout: 364 lvb_type: 0 00010000:00010000:1.0:1715330290.086111:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66400/0xd895711d66d893a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb796 expref: 37 pid: 7135 timeout: 364 lvb_type: 0 00010000:00010000:1.0:1715330290.086136:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x17:0x0].0x0 (ffff8800a7e58f00) 00010000:00010000:1.0:1715330290.086139:0:7120:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d89d4 lrc: 3/0,1 mode: --/EX res: [0x240000400:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330290.086146:0:7120:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d89d4 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330290.086151:0:7120:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d89d4 lrc: 4/0,1 mode: EX/EX res: [0x240000400:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330290.086165:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330290.086207:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72de1896-1df4-4b3a-930a-9116d2c66168+36:2012:x1798653938035968:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 136us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330290.086213:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1518 00010000:00010000:1.0:1715330290.086230:0:9622:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d89d4 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330290.086235:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d89d4 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330290.086264:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff600/0xd895711d66d89db lrc: 3/0,1 mode: --/EX res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 9622 initiator: MDT0 00010000:00010000:1.0:1715330290.086269:0:9622:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff600/0xd895711d66d89db lrc: 3/0,1 mode: --/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330290.086277:0:9622:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff600/0xd895711d66d89db lrc: 3/0,1 mode: --/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 9622 initiator: MDT1 00000100:00100000:1.0:1715330290.086290:0:9622:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9622:1798653942461504:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1715330290.086318:0:9622:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330290.088913:0:9622:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715330290.088973:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942461504 00000100:00100000:2.0:1715330290.088980:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942461504 00000100:00100000:2.0:1715330290.089023:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2756 00000100:00100000:2.0:1715330290.089030:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+18:9622:x1798653942461504:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1715330290.089047:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330290.089063:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d89e2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d89db expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.089088:0:23404:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d8948 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb79d expref: 53 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.089096:0:23404:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d89e2 lrc: 4/0,0 mode: --/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d89db expref: 19 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.089121:0:23404:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d8948 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb79d expref: 53 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.089132:0:23404:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d8948 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb79d expref: 53 pid: 7135 timeout: 364 lvb_type: 0 00000100:00100000:2.0:1715330290.089148:0:23404:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344c9180 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:23404:1798653942461568:192.168.204.49@tcp:104: 00000100:00100000:2.0:1715330290.089200:0:23404:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435000 going to sleep for 11 seconds 00000100:00100000:2.0:1715330290.092637:0:23404:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344c9180 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:23404:1798653942461568:192.168.204.49@tcp:104: 00010000:00010000:2.0:1715330290.092663:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d89e2 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d89db expref: 19 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.092675:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x0 (ffff8800a7e58700) 00010000:00010000:2.0:1715330290.092677:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330290.092681:0:23404:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d89e2 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d89db expref: 19 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.092689:0:23404:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d89e2 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d89db expref: 19 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.092694:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db65b00, rc 0) 00000100:00100000:0.0:1715330290.093863:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938036032 00000100:00100000:0.0:1715330290.093869:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938036032 00010000:00010000:0.0:1715330290.093899:0:10674:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d8948 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb79d expref: 54 pid: 7135 timeout: 364 lvb_type: 0 00000100:00100000:0.0:1715330290.093931:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1519 00000100:00100000:0.0:1715330290.093937:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:72de1896-1df4-4b3a-930a-9116d2c66168+54:2013:x1798653938036032:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1715330290.093947:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330290.093951:0:10674:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d8948 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb79d expref: 54 pid: 7135 timeout: 364 lvb_type: 0 00010000:00010000:0.0:1715330290.093960:0:10674:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d8948 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb79d expref: 54 pid: 7135 timeout: 364 lvb_type: 0 00010000:00010000:0.0:1715330290.093978:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d8948 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x17:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb79d expref: 54 pid: 7135 timeout: 364 lvb_type: 0 00010000:00010000:0.0:1715330290.093994:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x0 (ffff8800a7e58700) 00010000:00010000:0.0:1715330290.093998:0:10674:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d89e2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d89db expref: 19 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.094005:0:10674:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d89e2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d89db expref: 19 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.094011:0:10674:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d89e2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d89db expref: 19 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.094040:0:10674:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d89e2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d89db expref: 19 pid: 23404 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330290.094054:0:10674:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f578e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:10674:1798653942461632:0@lo:105: 00000100:00100000:0.0:1715330290.094087:0:10674:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330290.094099:0:10674:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa540 going to sleep for 11 seconds 00000100:00100000:2.0:1715330290.094969:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+19:9622:x1798653942461504:12345-0@lo:101:mdt00_003.0 Request processed in 5938us (8648us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330290.094978:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2756 00000100:00100000:1.0:1715330290.095049:0:9622:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091c3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9622:1798653942461504:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1715330290.095064:0:9622:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff600/0xd895711d66d89db lrc: 4/0,1 mode: --/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d89e2 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.095071:0:9622:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff600/0xd895711d66d89db lrc: 4/0,1 mode: --/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d89e2 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330290.095204:0:9413:0:(service.c:168:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1715330290.095213:0:9413:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942461632 00000100:00100000:2.0:1715330290.095217:0:9413:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942461632 00000100:00100000:2.0:1715330290.095244:0:9413:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1154 00000100:00100000:2.0:1715330290.095248:0:9413:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fad9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:10674:x1798653942461632:12345-0@lo:105: 00010000:00010000:2.0:1715330290.095255:0:9413:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff600/0xd895711d66d89db lrc: 5/0,1 mode: --/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d89e2 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.095266:0:9413:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff600/0xd895711d66d89db lrc: 5/0,1 mode: --/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d89e2 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.095272:0:9413:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff600/0xd895711d66d89db lrc: 5/0,1 mode: --/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d89e2 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.095277:0:9413:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff600/0xd895711d66d89db lrc: 5/0,1 mode: EX/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d89e2 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.095282:0:9413:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff600/0xd895711d66d89db lrc: 6/0,1 mode: EX/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d89e2 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.095287:0:9413:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff600/0xd895711d66d89db lrc: 6/0,1 mode: EX/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d89e2 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.095306:0:9413:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff880093bff600) 00000100:00100000:2.0:1715330290.095332:0:9413:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fad9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:10674:x1798653942461632:12345-0@lo:105: Request processed in 83us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330290.095337:0:9413:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1154 00000100:00100000:0.0:1715330290.095413:0:10674:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f578e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:10674:1798653942461632:0@lo:105: 00010000:00010000:0.0:1715330290.095423:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330290.095453:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:72de1896-1df4-4b3a-930a-9116d2c66168+53:2013:x1798653938036032:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 1516us (2901us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330290.095459:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1519 00010000:00010000:1.0:1715330290.095536:0:9622:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff600/0xd895711d66d89db lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d89e2 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.095542:0:9622:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff600/0xd895711d66d89db lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d89e2 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330290.096871:0:9622:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9622:1798653942461696:0@lo:403:mdt00_003.0 00000100:00100000:1.0:1715330290.096904:0:9622:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330290.096956:0:9622:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715330290.097017:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942461696 00000100:00100000:2.0:1715330290.097020:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942461696 00000100:00100000:2.0:1715330290.097597:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2757 00000100:00100000:2.0:1715330290.097602:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+19:9622:x1798653942461696:12345-0@lo:403:mdt00_003.0 00000100:00100000:2.0:1715330290.098998:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+19:9622:x1798653942461696:12345-0@lo:403:mdt00_003.0 Request processed in 1393us (2091us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330290.099005:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2757 00000100:00100000:1.0:1715330290.099158:0:9622:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091c3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9622:1798653942461696:0@lo:403:mdt00_003.0 00000040:00080000:1.0:1715330290.099856:0:9622:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].385, 952 off581400 00000040:00080000:1.0:1715330290.100001:0:9622:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].387, 1032 off636520 00000004:00080000:1.0:1715330290.100006:0:9622:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88012f49f0c0 with version 739 00000004:00080000:2.0:1715330290.101348:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 739 rpc_version 739 00000020:00100000:2.0:1715330290.101373:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1715330290.101379:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8801344c9180 x1798653942461824/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2352/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1715330290.101397:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344c9180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942461824:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1715330290.101429:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330290.101440:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435f00 going to sleep for 11 seconds 00000100:00100000:2.0:1715330290.102250:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344c9180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942461824:0@lo:1000:osp_up0-1.0 00000004:00200000:1.0:1715330290.102327:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x28:0x0]: returning size 4096 00010000:00010000:1.0:1715330290.102347:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d89d4 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330290.102354:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d89d4 lrc: 2/0,0 mode: EX/EX res: [0x240000400:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330290.102360:0:9622:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d89d4 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330290.102364:0:9622:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bffa80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330290.102368:0:9622:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d89d4 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330290.102374:0:9622:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d89d4 lrc: 4/0,0 mode: EX/EX res: [0x240000400:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330290.102385:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x17:0x0].0x0 (ffff8800a7e58f00) 00010000:00010000:1.0:1715330290.102388:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330290.102391:0:9622:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d89d4 lrc: 2/0,0 mode: --/EX res: [0x240000400:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330290.102395:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d89d4 lrc: 0/0,0 mode: --/EX res: [0x240000400:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330290.102410:0:9622:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff600/0xd895711d66d89db lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d89e2 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.102417:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff600/0xd895711d66d89db lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d89e2 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.102422:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff600/0xd895711d66d89db lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d89e2 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.102527:0:9622:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1715330290.102534:0:9622:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000401:0x17:0x0] 00010000:00010000:1.0:1715330290.102541:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd680/0xd895711d66d89cd lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330290.102546:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd680/0xd895711d66d89cd lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330290.102550:0:9622:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd680/0xd895711d66d89cd lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330290.102554:0:9622:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfd680 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330290.102556:0:9622:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd680/0xd895711d66d89cd lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330290.102561:0:9622:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd680/0xd895711d66d89cd lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330290.102567:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x28:0x0].0x0 (ffff88009d5fab00) 00010000:00010000:1.0:1715330290.102569:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330290.102571:0:9622:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd680/0xd895711d66d89cd lrc: 2/0,0 mode: --/EX res: [0x240000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330290.102576:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd680/0xd895711d66d89cd lrc: 0/0,0 mode: --/EX res: [0x240000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT1 00010000:00010000:1.0:1715330290.102589:0:9622:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfe640/0xd895711d66d89bf lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d89c6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.102594:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfe640/0xd895711d66d89bf lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d89c6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.102598:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfe640/0xd895711d66d89bf lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d89c6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.103284:0:9622:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1715330290.103421:0:9622:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:1.0:1715330290.103425:0:9622:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a2f40/0xd895711d66d89a3 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d89aa expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.103432:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a2f40/0xd895711d66d89a3 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d89aa expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.103438:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a2f40/0xd895711d66d89a3 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d89aa expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.103447:0:9622:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:1.0:1715330290.103449:0:9622:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:1.0:1715330290.103454:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1715330290.103457:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfe640/0xd895711d66d89bf lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d89c6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.103462:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfe640 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330290.103465:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfe640/0xd895711d66d89bf lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d89c6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330290.103484:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfe640/0xd895711d66d89bf lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d89c6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.103499:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfe640/0xd895711d66d89bf lrc: 2/0,0 mode: --/EX res: [0x240000402:0x28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d89c6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.103504:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330290.103515:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfe640/0xd895711d66d89bf lrc: 1/0,0 mode: --/EX res: [0x240000402:0x28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d89c6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.103520:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfe640/0xd895711d66d89bf lrc: 0/0,0 mode: --/EX res: [0x240000402:0x28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d89c6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.103531:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715330290.103533:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a2f40/0xd895711d66d89a3 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d89aa expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.103537:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a2f40 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330290.103540:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a2f40/0xd895711d66d89a3 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d89aa expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330290.103545:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a2f40/0xd895711d66d89a3 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d89aa expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.103555:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a2f40/0xd895711d66d89a3 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d89aa expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.103559:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330290.103564:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a2f40/0xd895711d66d89a3 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d89aa expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.103573:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a2f40/0xd895711d66d89a3 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d89aa expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.103583:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330290.103584:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330290.103586:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330290.103595:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942461952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330290.103622:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1715330290.103784:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330290.104035:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1715330290.104044:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942461888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1715330290.104337:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942462016:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715330290.104359:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc240/0xd895711d66d89b1 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x8a4526bf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d89b8 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.104365:0:9622:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc240/0xd895711d66d89b1 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x8a4526bf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d89b8 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330290.104662:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+36:16983:x1798653938035840:12345-192.168.204.49@tcp:36:rm.0 Request processed in 36999us (37322us total) trans 4294968393 rc 0/0 00000100:00100000:2.0:1715330290.104669:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23435 00000100:00100000:2.0:1715330290.105177:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330290.105230:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942461952 00000100:00100000:0.0:1715330290.105235:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942461952 00000100:00100000:0.0:1715330290.105258:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942462016 00000100:00100000:0.0:1715330290.105259:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942462016 00000100:00100000:0.0:1715330290.105270:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942461888 00000100:00100000:0.0:1715330290.105271:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942461888 00000100:00100000:0.0:1715330290.105282:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1302 00000100:00100000:0.0:1715330290.105288:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+22:3690:x1798653942461952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330290.105297:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330290.105309:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d89c6 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x28:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d89bf expref: 22 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.105321:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x28:0x0].0x0 (ffff88009ef57200) 00010000:00010000:0.0:1715330290.105327:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330290.105347:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+21:3690:x1798653942461952:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (1725us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330290.105353:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1302 00000100:00100000:0.0:1715330290.105361:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1303 00000100:00100000:0.0:1715330290.105365:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+20:3691:x1798653942462016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330290.105370:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330290.105377:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66d89aa lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d89a3 expref: 20 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.105384:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88008b122e00) 00010000:00010000:0.0:1715330290.105389:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330290.105402:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+19:3691:x1798653942462016:12345-0@lo:103:ldlm_bl.0 Request processed in 37us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330290.105407:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1303 00000100:00100000:0.0:1715330290.105415:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1304 00000100:00100000:0.0:1715330290.105418:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+18:3688:x1798653942461888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330290.105423:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330290.105431:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d89e2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d89db expref: 18 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.105440:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x0 (ffff8800a7e58700) 00010000:00010000:0.0:1715330290.105445:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330290.105460:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+17:3688:x1798653942461888:12345-0@lo:103:ldlm_bl.0 Request processed in 41us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330290.105465:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1304 00000100:00100000:2.0:1715330290.105713:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942461888:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330290.105833:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091c3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942461952:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1715330290.110437:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938036160 00000100:00100000:2.0:1715330290.110445:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938036160 00000100:00100000:2.0:1715330290.110500:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23436 00000100:00100000:2.0:1715330290.110506:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+53:16983:x1798653938036160:12345-192.168.204.49@tcp:101:rm.0 00010000:00010000:2.0:1715330290.110527:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330290.110545:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d89e9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1432:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb7c7 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715330290.110706:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1432:0x0]: returning size 4096 00010000:00010000:2.0:1715330290.110795:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d89e9 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1432:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb7c7 expref: 55 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.110802:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d89e9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1432:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb7c7 expref: 55 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.110811:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db66400, rc 0) 00000100:00100000:2.0:1715330290.110849:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+54:16983:x1798653938036160:12345-192.168.204.49@tcp:101:rm.0 Request processed in 343us (1203us total) trans 4294983463 rc 301/301 00000100:00100000:2.0:1715330290.110855:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23436 00000100:00100000:2.0:1715330290.116259:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330290.123677:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330290.123725:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330290.123830:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938036480 00000100:00100000:0.0:1715330290.123838:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938036480 00000100:00100000:0.0:1715330290.123875:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23437 00000100:00100000:0.0:1715330290.123881:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+55:16983:x1798653938036480:12345-192.168.204.49@tcp:36:rm.0 00010000:00010000:0.0:1715330290.123925:0:7135:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330290.123946:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d86ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1432:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6a1 expref: 55 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.123969:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1432:0x0].0x0 (ffff88009396dc00) 00010000:00010000:0.0:1715330290.123978:0:7135:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715330290.124017:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a2880/0xd895711d66d89f7 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330290.124023:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a2880/0xd895711d66d89f7 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330290.124030:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a2880/0xd895711d66d89f7 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT0 00000100:00100000:0.0:1715330290.124045:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f578e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942462080:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1715330290.124079:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330290.124098:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa000 going to sleep for 11 seconds 00000100:00100000:1.0:1715330290.124338:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938036352 00000100:00100000:1.0:1715330290.124342:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938036352 00000100:00100000:1.0:1715330290.124363:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1305 00000100:00100000:1.0:1715330290.124367:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72de1896-1df4-4b3a-930a-9116d2c66168+36:2012:x1798653938036352:12345-192.168.204.49@tcp:103:rm.0 00010000:00010000:1.0:1715330290.124373:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330290.124382:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2ac0/0xd895711d66d86d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1432:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb693 expref: 36 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.124392:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1432:0x0].0x0 (ffff88011d537500) 00010000:00010000:1.0:1715330290.124398:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330290.125143:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72de1896-1df4-4b3a-930a-9116d2c66168+35:2012:x1798653938036352:12345-192.168.204.49@tcp:103:rm.0 Request processed in 46us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330290.125151:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1305 00000100:00100000:0.0:1715330290.130408:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f578e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942462080:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330290.130422:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a2880/0xd895711d66d89f7 lrc: 4/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d89fe expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.130430:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a2880/0xd895711d66d89f7 lrc: 4/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d89fe expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330290.132295:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330290.132368:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938036544 00000100:00100000:1.0:1715330290.132375:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938036544 00010000:00010000:1.0:1715330290.132416:0:7120:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d85ac lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb623 expref: 35 pid: 7135 timeout: 364 lvb_type: 0 00000100:00100000:1.0:1715330290.132659:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1520 00000100:00100000:1.0:1715330290.132665:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72de1896-1df4-4b3a-930a-9116d2c66168+35:2011:x1798653938036544:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1715330290.132677:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330290.132682:0:7120:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d85ac lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb623 expref: 35 pid: 7135 timeout: 364 lvb_type: 0 00010000:00010000:1.0:1715330290.132690:0:7120:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d85ac lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb623 expref: 35 pid: 7135 timeout: 364 lvb_type: 0 00010000:00010000:1.0:1715330290.132706:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d85ac lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb623 expref: 35 pid: 7135 timeout: 364 lvb_type: 0 00010000:00010000:1.0:1715330290.132718:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88008b122200) 00010000:00010000:1.0:1715330290.132722:0:7120:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f600/0xd895711d66d89fe lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d89f7 expref: 5 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.133286:0:7120:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f600/0xd895711d66d89fe lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d89f7 expref: 5 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.133295:0:7120:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f600/0xd895711d66d89fe lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d89f7 expref: 5 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.133322:0:7120:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f600/0xd895711d66d89fe lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d89f7 expref: 5 pid: 9408 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330290.133334:0:7120:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001_UUID:7120:1798653942462208:0@lo:105: 00000100:00100000:1.0:1715330290.133367:0:7120:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330290.133391:0:7120:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1715330290.133438:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942462208 00000100:00100000:0.0:1715330290.133446:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942462208 00000100:00100000:0.0:1715330290.133489:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1155 00000100:00100000:0.0:1715330290.133494:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7120:x1798653942462208:12345-0@lo:105: 00010000:00010000:0.0:1715330290.133501:0:7118:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a2880/0xd895711d66d89f7 lrc: 5/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d89fe expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.133509:0:7118:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a2880/0xd895711d66d89f7 lrc: 5/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d89fe expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.133516:0:7118:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a2880/0xd895711d66d89f7 lrc: 5/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d89fe expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.133521:0:7118:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a2880/0xd895711d66d89f7 lrc: 5/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d89fe expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.133526:0:7118:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a2880/0xd895711d66d89f7 lrc: 6/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d89fe expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.133532:0:7118:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a2880/0xd895711d66d89f7 lrc: 6/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d89fe expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.133546:0:7118:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88009d7a2880) 00000100:00100000:0.0:1715330290.133571:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7120:x1798653942462208:12345-0@lo:105: Request processed in 77us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330290.133577:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1155 00000100:00100000:1.0:1715330290.133706:0:7120:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091c3f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001_UUID:7120:1798653942462208:0@lo:105: 00010000:00010000:1.0:1715330290.133717:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330290.133756:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72de1896-1df4-4b3a-930a-9116d2c66168+34:2011:x1798653938036544:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 1091us (1465us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330290.133762:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1520 00010000:00010000:1.0:1715330290.133780:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a2880/0xd895711d66d89f7 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d89fe expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.133787:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a2880/0xd895711d66d89f7 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d89fe expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330290.133803:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:1.0:1715330290.133825:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff600/0xd895711d66d8a05 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x6f3326f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.133830:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff600/0xd895711d66d8a05 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x6f3326f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.133838:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff600/0xd895711d66d8a05 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x6f3326f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT0 00000100:00100000:1.0:1715330290.133849:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942462272:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1715330290.135959:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330290.135970:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330290.136690:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091c3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942462272:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330290.136702:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff600/0xd895711d66d8a05 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f3326f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8a0c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.136710:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff600/0xd895711d66d8a05 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f3326f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8a0c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330290.136725:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:1.0:1715330290.136773:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942462336:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330290.136794:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330290.136814:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f480 going to sleep for 11 seconds 00000100:00100000:1.0:1715330290.137104:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091c3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942462336:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330290.137136:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942462400:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330290.137150:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330290.137166:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f480 going to sleep for 11 seconds 00000100:00100000:0.0:1715330290.137206:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942462400 00000100:00100000:0.0:1715330290.137209:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942462400 00000100:00100000:0.0:1715330290.137225:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2762 00000100:00100000:0.0:1715330290.137229:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7135:x1798653942462400:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1715330290.137289:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7135:x1798653942462400:12345-0@lo:1000:mdt00_002.0 Request processed in 59us (137us total) trans 0 rc 1/1 00000100:00100000:0.0:1715330290.137294:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2762 00000100:00100000:1.0:1715330290.137398:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091c3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942462400:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1715330290.137428:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfdf80/0xd895711d66d8a13 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1432:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.137434:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfdf80/0xd895711d66d8a13 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1432:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.137440:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfdf80/0xd895711d66d8a13 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1432:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT0 00000100:00100000:1.0:1715330290.137447:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942462464:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1715330290.137463:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330290.137470:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330290.138012:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091c3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942462464:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330290.138020:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfdf80/0xd895711d66d8a13 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1432:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8a1a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.138026:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfdf80/0xd895711d66d8a13 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1432:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8a1a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.138046:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66d8a21 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1432:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.138052:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66d8a21 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1432:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.138058:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66d8a21 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1432:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.138070:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d8a28 lrc: 3/0,1 mode: --/EX res: [0x200000400:0x57:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.138078:0:7135:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0480/0xd895711d66d86fc lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x57:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6a8 expref: 54 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.138084:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d8a28 lrc: 4/0,1 mode: --/EX res: [0x200000400:0x57:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.138099:0:7135:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0480/0xd895711d66d86fc lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x57:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6a8 expref: 54 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.138108:0:7135:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0480/0xd895711d66d86fc lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x57:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6a8 expref: 54 pid: 9622 timeout: 364 lvb_type: 0 00000100:00100000:1.0:1715330290.138117:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7135:1798653942462528:192.168.204.49@tcp:104: 00000100:00100000:1.0:1715330290.138149:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330290.141094:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091c3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7135:1798653942462528:192.168.204.49@tcp:104: 00010000:00010000:1.0:1715330290.141113:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d8a28 lrc: 3/0,1 mode: --/EX res: [0x200000400:0x57:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000100:00100000:0.0:1715330290.141335:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330290.141504:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938036608 00000100:00100000:1.0:1715330290.141508:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938036608 00010000:00010000:1.0:1715330290.141528:0:7120:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0480/0xd895711d66d86fc lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x57:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6a8 expref: 55 pid: 9622 timeout: 364 lvb_type: 0 00000100:00100000:1.0:1715330290.141563:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1521 00000100:00100000:1.0:1715330290.141569:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72de1896-1df4-4b3a-930a-9116d2c66168+55:2012:x1798653938036608:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1715330290.141578:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330290.141584:0:7120:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0480/0xd895711d66d86fc lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x57:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6a8 expref: 55 pid: 9622 timeout: 364 lvb_type: 0 00010000:00010000:1.0:1715330290.141593:0:7120:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0480/0xd895711d66d86fc lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x57:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6a8 expref: 55 pid: 9622 timeout: 364 lvb_type: 0 00010000:00010000:1.0:1715330290.141610:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0480/0xd895711d66d86fc lrc: 0/0,0 mode: --/PR res: [0x200000400:0x57:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6a8 expref: 55 pid: 9622 timeout: 364 lvb_type: 0 00010000:00010000:1.0:1715330290.141621:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x57:0x0].0x0 (ffff88011d537300) 00010000:00010000:1.0:1715330290.141624:0:7120:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d8a28 lrc: 3/0,1 mode: --/EX res: [0x200000400:0x57:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.141630:0:7120:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d8a28 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x57:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.141636:0:7120:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d8a28 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0x57:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.141649:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330290.141677:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72de1896-1df4-4b3a-930a-9116d2c66168+54:2012:x1798653938036608:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 108us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330290.141683:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1521 00010000:00010000:0.0:1715330290.141946:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d8a28 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x57:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330290.141952:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d8a28 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x57:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330290.141982:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a0b40/0xd895711d66d8a2f lrc: 3/0,1 mode: --/EX res: [0x240000401:0x57:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330290.141988:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a0b40/0xd895711d66d8a2f lrc: 3/0,1 mode: --/EX res: [0x240000401:0x57:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330290.141995:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a0b40/0xd895711d66d8a2f lrc: 3/0,1 mode: --/EX res: [0x240000401:0x57:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT0 00000100:00100000:0.0:1715330290.142008:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f57a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942462592:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1715330290.142035:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330290.142057:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa000 going to sleep for 11 seconds 00000100:00100000:2.0:1715330290.142073:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942462592 00000100:00100000:2.0:1715330290.142078:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942462592 00000100:00100000:2.0:1715330290.142098:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2764 00000100:00100000:2.0:1715330290.142102:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f578700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:7135:x1798653942462592:12345-0@lo:101:mdt00_002.0 00010000:00010000:2.0:1715330290.142113:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330290.142125:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67840/0xd895711d66d8a36 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x57:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d8a2f expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.142140:0:23404:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d870a lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x57:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6af expref: 33 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.142147:0:23404:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67840/0xd895711d66d8a36 lrc: 4/0,0 mode: --/EX res: [0x240000401:0x57:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d8a2f expref: 9 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.142162:0:23404:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d870a lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x57:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6af expref: 33 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.142171:0:23404:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d870a lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x57:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6af expref: 33 pid: 9622 timeout: 364 lvb_type: 0 00000100:00100000:2.0:1715330290.142179:0:23404:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012faef100 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:23404:1798653942462656:192.168.204.49@tcp:104: 00000100:00100000:2.0:1715330290.142214:0:23404:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435300 going to sleep for 11 seconds 00000100:00100000:2.0:1715330290.146384:0:23404:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012faef100 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:23404:1798653942462656:192.168.204.49@tcp:104: 00010000:00010000:2.0:1715330290.146412:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67840/0xd895711d66d8a36 lrc: 3/0,0 mode: --/EX res: [0x240000401:0x57:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8a2f expref: 9 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.146422:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x57:0x0].0x0 (ffff88009396de00) 00010000:00010000:2.0:1715330290.146424:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330290.146427:0:23404:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67840/0xd895711d66d8a36 lrc: 3/0,0 mode: --/EX res: [0x240000401:0x57:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8a2f expref: 9 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.146434:0:23404:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67840/0xd895711d66d8a36 lrc: 3/0,0 mode: --/EX res: [0x240000401:0x57:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8a2f expref: 9 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.146438:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db67840, rc 0) 00000100:00100000:2.0:1715330290.146494:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f578700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7135:x1798653942462592:12345-0@lo:101:mdt00_002.0 Request processed in 4390us (4457us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330290.146502:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2764 00000100:00100000:0.0:1715330290.146515:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f57a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942462592:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330290.146531:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a0b40/0xd895711d66d8a2f lrc: 4/0,1 mode: --/EX res: [0x240000401:0x57:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8a36 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.146541:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a0b40/0xd895711d66d8a2f lrc: 4/0,1 mode: --/EX res: [0x240000401:0x57:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8a36 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330290.148088:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330290.149440:0:9413:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942462720 00000100:00100000:0.0:1715330290.149444:0:9413:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942462720 00000100:00100000:0.0:1715330290.149583:0:9413:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1156 00000100:00100000:0.0:1715330290.149588:0:9413:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:7121:x1798653942462720:12345-0@lo:105: 00010000:00010000:0.0:1715330290.149596:0:9413:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a0b40/0xd895711d66d8a2f lrc: 5/0,1 mode: --/EX res: [0x240000401:0x57:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8a36 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.149605:0:9413:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a0b40/0xd895711d66d8a2f lrc: 5/0,1 mode: --/EX res: [0x240000401:0x57:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8a36 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.149625:0:9413:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a0b40/0xd895711d66d8a2f lrc: 5/0,1 mode: --/EX res: [0x240000401:0x57:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8a36 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.149632:0:9413:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a0b40/0xd895711d66d8a2f lrc: 5/0,1 mode: EX/EX res: [0x240000401:0x57:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d8a36 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.149637:0:9413:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a0b40/0xd895711d66d8a2f lrc: 6/0,1 mode: EX/EX res: [0x240000401:0x57:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d8a36 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.149644:0:9413:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a0b40/0xd895711d66d8a2f lrc: 6/0,1 mode: EX/EX res: [0x240000401:0x57:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d8a36 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.149761:0:9413:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88009d7a0b40) 00000100:00100000:0.0:1715330290.149796:0:9413:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:7121:x1798653942462720:12345-0@lo:105: Request processed in 207us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330290.149802:0:9413:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1156 00010000:00010000:1.0:1715330290.149850:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a0b40/0xd895711d66d8a2f lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x57:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8a36 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.149858:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a0b40/0xd895711d66d8a2f lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x57:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8a36 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330290.150350:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942462784:0@lo:403:mdt00_002.0 00000100:00100000:1.0:1715330290.150381:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330290.150391:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1715330290.151620:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942462784 00000100:00100000:2.0:1715330290.151625:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942462784 00000100:00100000:2.0:1715330290.151656:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2765 00000100:00100000:2.0:1715330290.151661:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7135:x1798653942462784:12345-0@lo:403:mdt00_002.0 00000100:00100000:2.0:1715330290.156047:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7135:x1798653942462784:12345-0@lo:403:mdt00_002.0 Request processed in 4377us (5657us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330290.156060:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2765 00000100:00100000:1.0:1715330290.156261:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091c3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942462784:0@lo:403:mdt00_002.0 00000040:00080000:1.0:1715330290.156984:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].360, 952 off551016 00000040:00080000:1.0:1715330290.157101:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].360, 1032 off593968 00000004:00080000:1.0:1715330290.157105:0:7135:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88012f49fb40 with version 687 00000004:00080000:2.0:1715330290.157345:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 687 rpc_version 687 00000020:00100000:2.0:1715330290.157371:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1715330290.157377:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012faef100 x1798653942462912/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 2352/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1715330290.157393:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012faef100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942462912:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1715330290.157423:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330290.157446:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435300 going to sleep for 11 seconds 00000100:00100000:0.0:1715330290.157614:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942462912 00000100:00100000:0.0:1715330290.157620:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942462912 00000100:00100000:0.0:1715330290.157657:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2766 00000100:00100000:0.0:1715330290.157662:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:8587:x1798653942462912:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330290.158006:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:8587:x1798653942462912:12345-0@lo:1000:osp_up1-0.0 Request processed in 343us (581us total) trans 4294968394 rc 0/0 00000100:00100000:0.0:1715330290.158012:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2766 00000004:00200000:1.0:1715330290.158102:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1432:0x0]: returning size 4096 00010000:00010000:1.0:1715330290.158119:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d8a28 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x57:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.158127:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d8a28 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x57:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.158133:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d8a28 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x57:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.158138:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfd200 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330290.158142:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d8a28 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x57:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.158148:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d8a28 lrc: 4/0,0 mode: EX/EX res: [0x200000400:0x57:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.158159:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x57:0x0].0x0 (ffff88011d537300) 00010000:00010000:1.0:1715330290.158162:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330290.158165:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d8a28 lrc: 2/0,0 mode: --/EX res: [0x200000400:0x57:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.158169:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d8a28 lrc: 0/0,0 mode: --/EX res: [0x200000400:0x57:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.158183:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a0b40/0xd895711d66d8a2f lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x57:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8a36 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.158188:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a0b40/0xd895711d66d8a2f lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x57:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8a36 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.158193:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a0b40/0xd895711d66d8a2f lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x57:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8a36 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.158576:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1715330290.158583:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x57:0x0] 00010000:00010000:1.0:1715330290.158591:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66d8a21 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1432:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.158595:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66d8a21 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1432:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.158599:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66d8a21 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1432:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.158603:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfe1c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330290.158605:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66d8a21 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1432:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.158613:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66d8a21 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1432:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.158620:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1432:0x0].0x0 (ffff88009d5fa100) 00010000:00010000:1.0:1715330290.158621:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330290.158624:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66d8a21 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1432:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.158628:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66d8a21 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1432:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.158637:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfdf80/0xd895711d66d8a13 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1432:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8a1a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.158643:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfdf80/0xd895711d66d8a13 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1432:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8a1a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.158648:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfdf80/0xd895711d66d8a13 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1432:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8a1a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.159362:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1715330290.159506:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1715330290.159512:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a0b40/0xd895711d66d8a2f lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x57:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d8a36 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.159518:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a0b40 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:2.0:1715330290.159525:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a0b40/0xd895711d66d8a2f lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x57:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d8a36 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1715330290.159531:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a0b40/0xd895711d66d8a2f lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x57:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d8a36 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.159552:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a0b40/0xd895711d66d8a2f lrc: 2/0,0 mode: --/EX res: [0x240000401:0x57:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8a36 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.159556:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1715330290.159575:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a0b40/0xd895711d66d8a2f lrc: 1/0,0 mode: --/EX res: [0x240000401:0x57:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8a36 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.159580:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a0b40/0xd895711d66d8a2f lrc: 0/0,0 mode: --/EX res: [0x240000401:0x57:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8a36 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.159592:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1715330290.159594:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfdf80/0xd895711d66d8a13 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1432:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d8a1a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.159598:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfdf80 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:2.0:1715330290.159600:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfdf80/0xd895711d66d8a13 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1432:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d8a1a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1715330290.159604:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfdf80/0xd895711d66d8a13 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1432:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d8a1a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.159614:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfdf80/0xd895711d66d8a13 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1432:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8a1a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.159618:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1715330290.159622:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfdf80/0xd895711d66d8a13 lrc: 1/0,0 mode: --/EX res: [0x200000402:0x1432:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8a1a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.159626:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfdf80/0xd895711d66d8a13 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1432:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8a1a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.159633:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330290.159635:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330290.159636:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330290.159644:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012faef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942462976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1715330290.159671:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330290.159686:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1715330290.159690:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942463040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1715330290.159703:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330290.159771:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942462976 00000100:00100000:1.0:1715330290.159775:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942462976 00000100:00100000:1.0:1715330290.159796:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942463040 00000100:00100000:1.0:1715330290.159798:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942463040 00000100:00100000:1.0:1715330290.159809:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1306 00000100:00100000:1.0:1715330290.159814:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+11:3688:x1798653942462976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330290.159822:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330290.159834:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67840/0xd895711d66d8a36 lrc: 0/0,0 mode: --/EX res: [0x240000401:0x57:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d8a2f expref: 11 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.159848:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x57:0x0].0x0 (ffff88009396de00) 00010000:00010000:1.0:1715330290.159855:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330290.159874:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+10:3688:x1798653942462976:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330290.159880:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1306 00000100:00100000:1.0:1715330290.159890:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1307 00000100:00100000:1.0:1715330290.159893:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+9:3688:x1798653942463040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330290.159898:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330290.159904:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457df80/0xd895711d66d8a1a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1432:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d8a13 expref: 9 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.159911:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1432:0x0].0x0 (ffff88009ef57900) 00010000:00010000:1.0:1715330290.159916:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330290.159927:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+8:3688:x1798653942463040:12345-0@lo:103:ldlm_bl.0 Request processed in 33us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330290.159932:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1307 00000004:00080000:1.0:1715330290.159955:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:1.0:1715330290.159958:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a2880/0xd895711d66d89f7 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d89fe expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.159965:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a2880/0xd895711d66d89f7 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d89fe expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.159970:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a2880/0xd895711d66d89f7 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d89fe expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.159979:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1715330290.159983:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:1.0:1715330290.159986:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff600/0xd895711d66d8a05 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f3326f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8a0c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.159992:0:7135:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff600/0xd895711d66d8a05 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f3326f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8a0c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330290.160038:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+54:16983:x1798653938036480:12345-192.168.204.49@tcp:36:rm.0 Request processed in 36155us (36310us total) trans 4294983465 rc 0/0 00000100:00100000:1.0:1715330290.160044:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23437 00000100:00100000:2.0:1715330290.160585:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942463040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1715330290.160593:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012faef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942462976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1715330290.160670:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942463104 00000100:00100000:2.0:1715330290.160674:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942463104 00000100:00100000:2.0:1715330290.160692:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1308 00000100:00100000:2.0:1715330290.160696:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+8:3691:x1798653942463104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715330290.160703:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330290.160712:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f600/0xd895711d66d89fe lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d89f7 expref: 8 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.160721:0:9416:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88008b122200) 00010000:00010000:2.0:1715330290.160728:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330290.160773:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+7:3691:x1798653942463104:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330290.160778:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1308 00000100:00100000:0.0:1715330290.170343:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330290.170402:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938036800 00000100:00100000:1.0:1715330290.170412:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938036800 00000100:00100000:1.0:1715330290.170463:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23438 00000100:00100000:1.0:1715330290.170471:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+54:16983:x1798653938036800:12345-192.168.204.49@tcp:101:rm.0 00010000:00010000:1.0:1715330290.170505:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330290.170522:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d8a3d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x14ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb7ce expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715330290.171699:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x14ac:0x0]: returning size 4096 00010000:00010000:1.0:1715330290.171808:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d8a3d lrc: 1/0,0 mode: --/CR res: [0x200000402:0x14ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb7ce expref: 56 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.171817:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d8a3d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x14ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb7ce expref: 56 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.171827:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfdf80, rc 0) 00000100:00100000:1.0:1715330290.171875:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+55:16983:x1798653938036800:12345-192.168.204.49@tcp:101:rm.0 Request processed in 1404us (1539us total) trans 4294983466 rc 301/301 00000100:00100000:1.0:1715330290.171885:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23438 00000100:00100000:0.0:1715330290.176648:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330290.176715:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938036928 00000100:00100000:2.0:1715330290.176724:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938036928 00000100:00100000:2.0:1715330290.176813:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5050 00000100:00100000:2.0:1715330290.176820:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f579180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+55:16983:x1798653938036928:12345-192.168.204.49@tcp:35:rm.0 00000100:00100000:2.0:1715330290.177008:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f579180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+56:16983:x1798653938036928:12345-192.168.204.49@tcp:35:rm.0 Request processed in 187us (366us total) trans 4294983467 rc 0/0 00000100:00100000:2.0:1715330290.177015:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5050 00000100:00100000:0.0:1715330290.185380:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330290.185499:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938037056 00000100:00100000:1.0:1715330290.185509:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938037056 00000100:00100000:2.0:1715330290.186596:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23439 00000100:00100000:2.0:1715330290.186605:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+56:16983:x1798653938037056:12345-192.168.204.49@tcp:36:rm.0 00010000:00010000:2.0:1715330290.186668:0:9622:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330290.186695:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66d8734 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x14ac:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6bd expref: 56 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.186748:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14ac:0x0].0x0 (ffff88011d537700) 00010000:00010000:2.0:1715330290.186760:0:9622:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330290.186792:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d8a4b lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.186805:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d8a4b lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.186814:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d8a4b lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.186824:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d8a52 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x813c26f3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.186829:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d8a52 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x813c26f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.186834:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d8a52 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x813c26f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.186880:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d8a59 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14ac:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.186886:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d8a59 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14ac:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.186891:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d8a59 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14ac:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.186908:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d8a60 lrc: 3/0,1 mode: --/EX res: [0x200000400:0x94:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.186915:0:9622:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d8742 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6c4 expref: 55 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.186922:0:9622:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d8a60 lrc: 4/0,1 mode: --/EX res: [0x200000400:0x94:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.186955:0:9622:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d8742 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6c4 expref: 55 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.186968:0:9622:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d8742 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6c4 expref: 55 pid: 9622 timeout: 364 lvb_type: 0 00000100:00100000:2.0:1715330290.186982:0:9622:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9622:1798653942463168:192.168.204.49@tcp:104: 00000100:00100000:2.0:1715330290.187049:0:9622:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435600 going to sleep for 11 seconds 00000100:00100000:2.0:1715330290.192801:0:9622:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9622:1798653942463168:192.168.204.49@tcp:104: 00010000:00010000:2.0:1715330290.192836:0:9622:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d8a60 lrc: 3/0,1 mode: --/EX res: [0x200000400:0x94:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00000100:00100000:0.0:1715330290.195039:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330290.195645:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938037120 00000100:00100000:2.0:1715330290.195653:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938037120 00010000:00010000:2.0:1715330290.195680:0:9416:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d8742 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6c4 expref: 56 pid: 9622 timeout: 364 lvb_type: 0 00000100:00100000:2.0:1715330290.195718:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1523 00000100:00100000:2.0:1715330290.195724:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f579f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+56:2011:x1798653938037120:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1715330290.195769:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330290.195774:0:9416:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d8742 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x94:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6c4 expref: 56 pid: 9622 timeout: 364 lvb_type: 0 00010000:00010000:2.0:1715330290.195783:0:9416:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d8742 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x94:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6c4 expref: 56 pid: 9622 timeout: 364 lvb_type: 0 00010000:00010000:2.0:1715330290.195801:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66d8742 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x94:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6c4 expref: 56 pid: 9622 timeout: 364 lvb_type: 0 00010000:00010000:2.0:1715330290.195822:0:9416:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x94:0x0].0x0 (ffff88011d537400) 00010000:00010000:2.0:1715330290.195827:0:9416:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d8a60 lrc: 3/0,1 mode: --/EX res: [0x200000400:0x94:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.195834:0:9416:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d8a60 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x94:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.195839:0:9416:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d8a60 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0x94:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.195867:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330290.195917:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f579f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+55:2011:x1798653938037120:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 193us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330290.195923:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1523 00010000:00010000:2.0:1715330290.195943:0:9622:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d8a60 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x94:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.195949:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d8a60 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x94:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.195978:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db65b00/0xd895711d66d8a67 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x94:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.195984:0:9622:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db65b00/0xd895711d66d8a67 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x94:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.195991:0:9622:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db65b00/0xd895711d66d8a67 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x94:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 9622 initiator: MDT0 00000100:00100000:2.0:1715330290.196005:0:9622:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9622:1798653942463232:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1715330290.196035:0:9622:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330290.196048:0:9622:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435600 going to sleep for 11 seconds 00000100:00100000:2.0:1715330290.205577:0:9622:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9622:1798653942463232:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1715330290.205598:0:9622:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db65b00/0xd895711d66d8a67 lrc: 4/0,1 mode: --/EX res: [0x240000401:0x94:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8a6e expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.205609:0:9622:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db65b00/0xd895711d66d8a67 lrc: 4/0,1 mode: --/EX res: [0x240000401:0x94:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8a6e expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330290.206263:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330290.207111:0:9413:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942463360 00000100:00100000:1.0:1715330290.207115:0:9413:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942463360 00000100:00100000:1.0:1715330290.207135:0:9413:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1157 00000100:00100000:1.0:1715330290.207139:0:9413:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:7121:x1798653942463360:12345-0@lo:105: 00010000:00010000:1.0:1715330290.207145:0:9413:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db65b00/0xd895711d66d8a67 lrc: 5/0,1 mode: --/EX res: [0x240000401:0x94:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8a6e expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.207152:0:9413:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db65b00/0xd895711d66d8a67 lrc: 5/0,1 mode: --/EX res: [0x240000401:0x94:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8a6e expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.207158:0:9413:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db65b00/0xd895711d66d8a67 lrc: 5/0,1 mode: --/EX res: [0x240000401:0x94:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8a6e expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.207163:0:9413:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db65b00/0xd895711d66d8a67 lrc: 5/0,1 mode: EX/EX res: [0x240000401:0x94:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d8a6e expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.207168:0:9413:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db65b00/0xd895711d66d8a67 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0x94:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d8a6e expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.207173:0:9413:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db65b00/0xd895711d66d8a67 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0x94:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d8a6e expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.207185:0:9413:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88011db65b00) 00000100:00100000:1.0:1715330290.207211:0:9413:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:7121:x1798653942463360:12345-0@lo:105: Request processed in 71us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330290.207216:0:9413:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1157 00010000:00010000:1.0:1715330290.207241:0:9622:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db65b00/0xd895711d66d8a67 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x94:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8a6e expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.207247:0:9622:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db65b00/0xd895711d66d8a67 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x94:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8a6e expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330290.207792:0:9622:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9622:1798653942463424:0@lo:403:mdt00_003.0 00000100:00100000:1.0:1715330290.207820:0:9622:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330290.207831:0:9622:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1715330290.207842:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942463424 00000100:00100000:1.0:1715330290.207844:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942463424 00000100:00100000:1.0:1715330290.207860:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2768 00000100:00100000:1.0:1715330290.207864:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:9622:x1798653942463424:12345-0@lo:403:mdt00_003.0 00000100:00100000:1.0:1715330290.209176:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:9622:x1798653942463424:12345-0@lo:403:mdt00_003.0 Request processed in 1308us (1351us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330290.209183:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2768 00000100:00100000:1.0:1715330290.209214:0:9622:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091c3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9622:1798653942463424:0@lo:403:mdt00_003.0 00000040:00080000:1.0:1715330290.209938:0:9622:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].361, 952 off551968 00000040:00080000:1.0:1715330290.210060:0:9622:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].361, 1032 off595000 00000004:00080000:1.0:1715330290.210065:0:9622:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88012f49fd80 with version 688 00000004:00080000:1.0:1715330290.210099:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 688 rpc_version 688 00000020:00100000:1.0:1715330290.210124:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1715330290.211488:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880091c3f480 x1798653942463552/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1992/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1715330290.212157:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3f480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942463552:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330290.212197:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330290.212220:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f180 going to sleep for 11 seconds 00000100:00100000:1.0:1715330290.218029:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091c3f480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942463552:0@lo:1000:osp_up1-0.0 00000004:00200000:0.0:1715330290.218136:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x14ac:0x0]: returning size 4096 00010000:00010000:0.0:1715330290.218157:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d8a60 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x94:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330290.218165:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d8a60 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x94:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330290.218171:0:9622:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d8a60 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x94:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330290.218176:0:9622:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66400 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330290.218179:0:9622:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d8a60 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x94:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330290.218185:0:9622:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d8a60 lrc: 4/0,0 mode: EX/EX res: [0x200000400:0x94:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330290.218197:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x94:0x0].0x0 (ffff88011d537400) 00010000:00010000:0.0:1715330290.218199:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715330290.218203:0:9622:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d8a60 lrc: 2/0,0 mode: --/EX res: [0x200000400:0x94:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330290.218207:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d8a60 lrc: 0/0,0 mode: --/EX res: [0x200000400:0x94:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330290.218227:0:9622:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db65b00/0xd895711d66d8a67 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x94:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8a6e expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.218233:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db65b00/0xd895711d66d8a67 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x94:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8a6e expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.218238:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db65b00/0xd895711d66d8a67 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x94:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8a6e expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.218264:0:9622:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1715330290.218271:0:9622:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x94:0x0] 00010000:00010000:0.0:1715330290.218279:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d8a59 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14ac:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330290.218283:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d8a59 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x14ac:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330290.218287:0:9622:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d8a59 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14ac:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330290.218290:0:9622:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64480 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330290.218293:0:9622:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d8a59 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14ac:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330290.218296:0:9622:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d8a59 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x14ac:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330290.218302:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14ac:0x0].0x0 (ffff88008b374a00) 00010000:00010000:0.0:1715330290.218304:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715330290.218306:0:9622:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d8a59 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x14ac:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330290.218310:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d8a59 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x14ac:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330290.218439:0:9622:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d8a4b lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330290.218443:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d8a4b lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330290.218447:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d8a4b lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330290.218451:0:9622:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d8a4b lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330290.218455:0:9622:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db67840 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330290.218457:0:9622:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d8a4b lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330290.218461:0:9622:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d8a4b lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330290.218467:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88008b374e00) 00010000:00010000:0.0:1715330290.218469:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330290.218471:0:9622:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d8a4b lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330290.218486:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d8a4b lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00000004:00010000:0.0:1715330290.218495:0:9622:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012f57aa00 reply state ffff8801345ac000 transno 4294983468 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d8a52 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x813c26f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330290.218502:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d8a52 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x813c26f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330290.218507:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x813c26f3 (ffff88008b374400) 00010000:00010000:0.0:1715330290.218509:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330290.218511:0:9622:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1715330290.218570:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+56:16983:x1798653938037056:12345-192.168.204.49@tcp:36:rm.0 Request processed in 31963us (33200us total) trans 4294983468 rc 0/0 00000100:00100000:0.0:1715330290.218577:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23439 00010000:00010000:2.0:1715330290.218813:0:7124:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1715330290.218819:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db65b00/0xd895711d66d8a67 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x94:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d8a6e expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.218824:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db65b00 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:2.0:1715330290.218827:0:7124:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db65b00/0xd895711d66d8a67 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x94:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d8a6e expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1715330290.218833:0:7124:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db65b00/0xd895711d66d8a67 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x94:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d8a6e expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.218859:0:7124:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db65b00/0xd895711d66d8a67 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x94:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8a6e expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.218867:0:7124:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1715330290.218884:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db65b00/0xd895711d66d8a67 lrc: 1/0,0 mode: --/EX res: [0x240000401:0x94:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8a6e expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.218889:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db65b00/0xd895711d66d8a67 lrc: 0/0,0 mode: --/EX res: [0x240000401:0x94:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8a6e expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.218904:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330290.218905:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330290.218907:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330290.219290:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942463616 00000100:00100000:2.0:1715330290.219296:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942463616 00000100:00100000:2.0:1715330290.219324:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1309 00000100:00100000:2.0:1715330290.219329:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+9:3691:x1798653942463616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715330290.219339:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330290.219352:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457df80/0xd895711d66d8a6e lrc: 0/0,0 mode: --/EX res: [0x240000401:0x94:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d8a67 expref: 9 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.219360:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x94:0x0].0x0 (ffff88009396d800) 00010000:00010000:2.0:1715330290.219366:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330290.219386:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+8:3691:x1798653942463616:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330290.219391:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1309 00000100:00100000:2.0:1715330290.228093:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330290.228204:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938037312 00000100:00100000:0.0:1715330290.228212:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938037312 00000100:00100000:0.0:1715330290.228256:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23440 00000100:00100000:0.0:1715330290.228264:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+56:16983:x1798653938037312:12345-192.168.204.49@tcp:101:rm.0 00010000:00010000:0.0:1715330290.228284:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330290.228299:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66d8a75 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x14b4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb7d5 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715330290.228444:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x14b4:0x0]: returning size 4096 00010000:00010000:0.0:1715330290.228528:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66d8a75 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x14b4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb7d5 expref: 58 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.228536:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66d8a75 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x14b4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb7d5 expref: 58 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.228544:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a2880, rc 0) 00000100:00100000:0.0:1715330290.228580:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+57:16983:x1798653938037312:12345-192.168.204.49@tcp:101:rm.0 Request processed in 316us (492us total) trans 4294983469 rc 301/301 00000100:00100000:0.0:1715330290.228586:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23440 00000100:00100000:1.0:1715330290.241298:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330290.258237:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330290.262176:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330290.262236:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938037504 00000100:00100000:2.0:1715330290.262244:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938037504 00000100:00100000:2.0:1715330290.262280:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1310 00000100:00100000:2.0:1715330290.262286:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+32:2011:x1798653938037504:12345-192.168.204.49@tcp:103:rm.0 00010000:00010000:2.0:1715330290.262299:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330290.262316:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67a80/0xd895711d66d876c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x14b4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6d2 expref: 32 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.262341:0:9416:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14b4:0x0].0x0 (ffff88009396d700) 00010000:00010000:2.0:1715330290.262350:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330290.262381:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+31:2011:x1798653938037504:12345-192.168.204.49@tcp:103:rm.0 Request processed in 95us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330290.262387:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1310 00000100:00100000:1.0:1715330290.262623:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938037632 00000100:00100000:1.0:1715330290.262628:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938037632 00000100:00100000:1.0:1715330290.262659:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23441 00000100:00100000:1.0:1715330290.262663:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+58:16983:x1798653938037632:12345-192.168.204.49@tcp:36:rm.0 00010000:00010000:1.0:1715330290.262695:0:7135:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330290.262706:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d8788 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x14b4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6e0 expref: 58 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.262718:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14b4:0x0].0x0 (ffff88009396d200) 00010000:00010000:1.0:1715330290.262723:0:7135:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330290.262775:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc480/0xd895711d66d8a83 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.262782:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc480/0xd895711d66d8a83 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.262789:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc480/0xd895711d66d8a83 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT0 00000100:00100000:1.0:1715330290.262804:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d644a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942463680:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1715330290.262830:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330290.262841:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a8556600 going to sleep for 11 seconds 00000100:00100000:1.0:1715330290.262862:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942463680 00000100:00100000:1.0:1715330290.262864:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942463680 00000100:00100000:1.0:1715330290.262879:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2770 00000100:00100000:1.0:1715330290.262883:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d647800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:7135:x1798653942463680:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330290.262892:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330290.262901:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd440/0xd895711d66d8a8a lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d8a83 expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.262916:0:9408:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd440/0xd895711d66d8a8a lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d8a83 expref: 9 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.262925:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd440/0xd895711d66d8a8a lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8a83 expref: 9 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.262931:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88009d5faa00) 00010000:00010000:1.0:1715330290.262933:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330290.262935:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfd440, rc 0) 00000100:00100000:1.0:1715330290.264326:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d647800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7135:x1798653942463680:12345-0@lo:101:mdt00_002.0 Request processed in 1440us (1493us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330290.264333:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2770 00000100:00100000:2.0:1715330290.264397:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d644a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942463680:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1715330290.264409:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc480/0xd895711d66d8a83 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8a8a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.264418:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc480/0xd895711d66d8a83 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8a8a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715330290.264431:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:2.0:1715330290.264446:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db64900/0xd895711d66d8a91 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x8a3c26f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330290.264452:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db64900/0xd895711d66d8a91 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x8a3c26f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330290.264458:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db64900/0xd895711d66d8a91 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x8a3c26f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT0 00000100:00100000:2.0:1715330290.264468:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942463744:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1715330290.264495:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330290.264512:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435f00 going to sleep for 11 seconds 00000100:00100000:1.0:1715330290.264549:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942463744 00000100:00100000:1.0:1715330290.264553:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942463744 00000100:00100000:1.0:1715330290.264574:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2771 00000100:00100000:1.0:1715330290.264578:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7135:x1798653942463744:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330290.264586:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330290.264595:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d8a98 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x8a3c26f1 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d8a91 expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.264606:0:9408:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d8a98 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x8a3c26f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d8a91 expref: 10 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.264614:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d8a98 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x8a3c26f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8a91 expref: 10 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.264620:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x8a3c26f1 (ffff88009d5fa200) 00010000:00010000:1.0:1715330290.264622:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330290.264624:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfed00, rc 0) 00000100:00100000:1.0:1715330290.264640:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7135:x1798653942463744:12345-0@lo:101:mdt00_002.0 Request processed in 62us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330290.264644:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2771 00000100:00100000:2.0:1715330290.267608:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942463744:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1715330290.267629:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db64900/0xd895711d66d8a91 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x8a3c26f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8a98 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.267638:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db64900/0xd895711d66d8a91 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x8a3c26f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8a98 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715330290.267655:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:2.0:1715330290.267692:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942463808:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1715330290.267770:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330290.268377:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435a80 going to sleep for 11 seconds 00000100:00100000:1.0:1715330290.268437:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942463808 00000100:00100000:1.0:1715330290.268442:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942463808 00000100:00100000:1.0:1715330290.268488:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2772 00000100:00100000:1.0:1715330290.268494:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7135:x1798653942463808:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330290.268907:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7135:x1798653942463808:12345-0@lo:1000:mdt00_002.0 Request processed in 412us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330290.268913:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2772 00000100:00100000:0.0:1715330290.269856:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942463872 00000100:00100000:0.0:1715330290.269860:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942463872 00000100:00100000:0.0:1715330290.269888:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2773 00000100:00100000:0.0:1715330290.269893:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7135:x1798653942463872:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1715330290.270101:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7135:x1798653942463872:12345-0@lo:1000:mdt00_002.0 Request processed in 206us (306us total) trans 0 rc 1/1 00000100:00100000:0.0:1715330290.270107:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2773 00000100:00100000:0.0:1715330290.270426:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942463936 00000100:00100000:0.0:1715330290.270429:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942463936 00000100:00100000:0.0:1715330290.270439:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2774 00000100:00100000:0.0:1715330290.270442:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7135:x1798653942463936:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330290.270449:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330290.270460:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a3cc0/0xd895711d66d8aa6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x14b4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d8a9f expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.270484:0:23404:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a3cc0/0xd895711d66d8aa6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14b4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d8a9f expref: 11 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.270493:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a3cc0/0xd895711d66d8aa6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14b4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8a9f expref: 11 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.270499:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14b4:0x0].0x0 (ffff88009bbb0600) 00010000:00010000:0.0:1715330290.270501:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1715330290.270503:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a3cc0, rc 0) 00000100:00100000:0.0:1715330290.270520:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:7135:x1798653942463936:12345-0@lo:101:mdt00_002.0 Request processed in 77us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330290.270524:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2774 00000100:00100000:1.0:1715330290.278623:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1715330290.278631:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f57b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942464064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1715330290.278655:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330290.279532:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f57b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942464064:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1715330290.279587:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330260 00000100:00100000:0.0:1715330290.287458:0:9408:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc7bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:9408:1798653942464192:192.168.204.49@tcp:104: 00010000:00010000:0.0:1715330290.287509:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c000/0xd895711d66d8ac2 lrc: 3/0,0 mode: --/EX res: [0x240000401:0x98:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8abb expref: 12 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.287522:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x98:0x0].0x0 (ffff88011d537200) 00010000:00010000:0.0:1715330290.287525:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715330290.287528:0:9408:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c000/0xd895711d66d8ac2 lrc: 3/0,0 mode: --/EX res: [0x240000401:0x98:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8abb expref: 12 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.287541:0:9408:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c000/0xd895711d66d8ac2 lrc: 3/0,0 mode: --/EX res: [0x240000401:0x98:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8abb expref: 12 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.287547:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013457c000, rc 0) 00000100:00100000:0.0:1715330290.287677:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:7135:x1798653942464128:12345-0@lo:101:mdt00_002.0 Request processed in 9261us (9305us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330290.287686:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2775 00000100:00100000:0.0:1715330290.288364:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938037760 00000100:00100000:0.0:1715330290.288372:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938037760 00010000:00010000:0.0:1715330290.288399:0:9416:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2880/0xd895711d66d87a4 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x98:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6ee expref: 31 pid: 9622 timeout: 364 lvb_type: 0 00000100:00100000:0.0:1715330290.288418:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1526 00000100:00100000:0.0:1715330290.288423:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+31:2011:x1798653938037760:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1715330290.288435:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330290.288440:0:9416:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2880/0xd895711d66d87a4 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x98:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6ee expref: 31 pid: 9622 timeout: 364 lvb_type: 0 00010000:00010000:0.0:1715330290.288450:0:9416:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2880/0xd895711d66d87a4 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x98:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6ee expref: 31 pid: 9622 timeout: 364 lvb_type: 0 00010000:00010000:0.0:1715330290.288469:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f2880/0xd895711d66d87a4 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x98:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6ee expref: 31 pid: 9622 timeout: 364 lvb_type: 0 00010000:00010000:0.0:1715330290.288494:0:9416:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x98:0x0].0x0 (ffff88011d537200) 00010000:00010000:0.0:1715330290.288498:0:9416:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c000/0xd895711d66d8ac2 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x98:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8abb expref: 11 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.288510:0:9416:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c000/0xd895711d66d8ac2 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x98:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d8abb expref: 11 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.288518:0:9416:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c000/0xd895711d66d8ac2 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x98:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d8abb expref: 11 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.288546:0:9416:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c000/0xd895711d66d8ac2 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x98:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8abb expref: 11 pid: 9408 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330290.288557:0:9416:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f578a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001_UUID:9416:1798653942464256:0@lo:105: 00000100:00100000:0.0:1715330290.288586:0:9416:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330290.288599:0:9416:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715330290.288680:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942464256 00000100:00100000:2.0:1715330290.288687:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942464256 00000100:00100000:2.0:1715330290.289331:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1158 00000100:00100000:2.0:1715330290.289338:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f579880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:9416:x1798653942464256:12345-0@lo:105: 00010000:00010000:2.0:1715330290.289351:0:7118:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457eac0/0xd895711d66d8abb lrc: 4/0,1 mode: --/EX res: [0x240000401:0x98:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8ac2 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.289360:0:7118:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457eac0/0xd895711d66d8abb lrc: 4/0,1 mode: --/EX res: [0x240000401:0x98:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8ac2 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.289367:0:7118:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457eac0/0xd895711d66d8abb lrc: 4/0,1 mode: --/EX res: [0x240000401:0x98:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8ac2 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.289374:0:7118:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457eac0/0xd895711d66d8abb lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x98:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d8ac2 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.289380:0:7118:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457eac0/0xd895711d66d8abb lrc: 5/0,1 mode: EX/EX res: [0x240000401:0x98:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d8ac2 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.289391:0:7118:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457eac0/0xd895711d66d8abb lrc: 5/0,1 mode: EX/EX res: [0x240000401:0x98:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d8ac2 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.289405:0:7118:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88013457eac0) 00000100:00100000:2.0:1715330290.289458:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f579880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:9416:x1798653942464256:12345-0@lo:105: Request processed in 121us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330290.289464:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1158 00000100:00100000:0.0:1715330290.289493:0:9416:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f578a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001_UUID:9416:1798653942464256:0@lo:105: 00010000:00010000:0.0:1715330290.289506:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330290.289513:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942464128:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1715330290.289525:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457eac0/0xd895711d66d8abb lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x98:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8ac2 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330290.289554:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+30:2011:x1798653938037760:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 1129us (1767us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330290.289561:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1526 00000100:00100000:0.0:1715330290.290858:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d647100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942464320:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1715330290.290899:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330290.291250:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942464384:0@lo:403:mdt00_002.0 00000100:00100000:2.0:1715330290.291294:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330290.291317:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435900 going to sleep for 11 seconds 00000100:00100000:0.0:1715330290.291338:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942464384 00000100:00100000:0.0:1715330290.291344:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942464384 00000100:00100000:0.0:1715330290.291372:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2776 00000100:00100000:0.0:1715330290.291377:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:7135:x1798653942464384:12345-0@lo:403:mdt00_002.0 00000100:00100000:0.0:1715330290.291648:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d647100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942464320:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1715330290.291676:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330260 00000100:00100000:1.0:1715330290.292745:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:7135:x1798653942464384:12345-0@lo:403:mdt00_002.0 Request processed in 1350us (1434us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330290.292752:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2776 00000004:00080000:1.0:1715330290.294448:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 689 rpc_version 689 00000020:00100000:1.0:1715330290.294482:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1715330290.294488:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88009d644380 x1798653942464512/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 2352/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1715330290.294505:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d644380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942464512:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330290.294543:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330290.294555:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a8556600 going to sleep for 11 seconds 00000100:00100000:2.0:1715330290.294568:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942464512 00000100:00100000:2.0:1715330290.294573:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942464512 00000100:00100000:2.0:1715330290.294607:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2777 00000100:00100000:2.0:1715330290.294612:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:8587:x1798653942464512:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330290.297369:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d644380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942464512:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1715330290.299886:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1715330290.299892:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457eac0/0xd895711d66d8abb lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x98:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d8ac2 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.299897:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457eac0 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:2.0:1715330290.299901:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457eac0/0xd895711d66d8abb lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x98:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d8ac2 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1715330290.299907:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457eac0/0xd895711d66d8abb lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x98:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d8ac2 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.299934:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457eac0/0xd895711d66d8abb lrc: 2/0,0 mode: --/EX res: [0x240000401:0x98:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8ac2 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.299940:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330290.300027:0:7123:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1715330290.300032:0:7123:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457ed00/0xd895711d66d8a9f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x14b4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d8aa6 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.300037:0:7123:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457ed00 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330290.300040:0:7123:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457ed00/0xd895711d66d8a9f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14b4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d8aa6 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330290.300045:0:7123:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457ed00/0xd895711d66d8a9f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14b4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d8aa6 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.300059:0:7123:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457ed00/0xd895711d66d8a9f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x14b4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8aa6 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.300064:0:7123:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1715330290.300092:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457eac0/0xd895711d66d8abb lrc: 1/0,0 mode: --/EX res: [0x240000401:0x98:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8ac2 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.300098:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457eac0/0xd895711d66d8abb lrc: 0/0,0 mode: --/EX res: [0x240000401:0x98:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8ac2 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.300109:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1715330290.300112:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc480/0xd895711d66d8a83 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d8a8a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.300116:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfc480 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:2.0:1715330290.300118:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc480/0xd895711d66d8a83 lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d8a8a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1715330290.300123:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc480/0xd895711d66d8a83 lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d8a8a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.300135:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc480/0xd895711d66d8a83 lrc: 4/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8a8a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.300139:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1715330290.300149:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc480/0xd895711d66d8a83 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8a8a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.300155:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330290.300156:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330290.300158:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330290.300172:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942464704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1715330290.300212:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330290.300242:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942464704 00000100:00100000:2.0:1715330290.300247:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942464704 00000100:00100000:2.0:1715330290.300272:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1311 00000100:00100000:2.0:1715330290.300278:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+13:3688:x1798653942464704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715330290.300287:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330290.300299:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd440/0xd895711d66d8a8a lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d8a83 expref: 13 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.300308:0:9416:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88009d5faa00) 00010000:00010000:2.0:1715330290.300313:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330290.300334:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+12:3688:x1798653942464704:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330290.300339:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1311 00000100:00100000:2.0:1715330290.300363:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942464704:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330290.300424:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942464576:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330290.300444:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1715330290.301614:0:7123:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457ed00/0xd895711d66d8a9f lrc: 1/0,0 mode: --/EX res: [0x200000402:0x14b4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8aa6 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.301622:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457ed00/0xd895711d66d8a9f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x14b4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8aa6 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.301638:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330290.301639:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330290.301640:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330290.301751:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942464576 00000100:00100000:2.0:1715330290.301755:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942464576 00000100:00100000:2.0:1715330290.301774:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942464640 00000100:00100000:2.0:1715330290.301775:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942464640 00000100:00100000:2.0:1715330290.302103:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1312 00000100:00100000:2.0:1715330290.302109:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d644700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+13:3690:x1798653942464576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715330290.302118:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330290.302130:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c000/0xd895711d66d8ac2 lrc: 0/0,0 mode: --/EX res: [0x240000401:0x98:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d8abb expref: 13 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.302140:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x98:0x0].0x0 (ffff88011d537200) 00010000:00010000:2.0:1715330290.302148:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330290.302235:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1313 00000100:00100000:0.0:1715330290.302240:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+12:3691:x1798653942464640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330290.302247:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330290.302256:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a3cc0/0xd895711d66d8aa6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x14b4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d8a9f expref: 12 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.302265:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14b4:0x0].0x0 (ffff88009bbb0600) 00010000:00010000:0.0:1715330290.302272:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330290.302307:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+11:3691:x1798653942464640:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (1788us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330290.302313:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1313 00000100:00100000:2.0:1715330290.302491:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d644700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+10:3690:x1798653942464576:12345-0@lo:103:ldlm_bl.0 Request processed in 382us (2045us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330290.302495:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1312 00000100:00100000:1.0:1715330290.302595:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942464576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330290.319906:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938037888 00000100:00100000:0.0:1715330290.319916:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938037888 00000100:00100000:0.0:1715330290.319965:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23442 00000100:00100000:0.0:1715330290.319973:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+30:16983:x1798653938037888:12345-192.168.204.49@tcp:101:rm.0 00010000:00010000:0.0:1715330290.319992:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330290.320008:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a2d00/0xd895711d66d8ac9 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x170:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb7dc expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715330290.320213:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x170:0x0]: returning size 4096 00010000:00010000:1.0:1715330290.320280:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a2d00/0xd895711d66d8ac9 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x170:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb7dc expref: 32 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.320287:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a2d00/0xd895711d66d8ac9 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x170:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb7dc expref: 32 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.321781:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a2d00, rc 0) 00000100:00100000:1.0:1715330290.321995:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+31:16983:x1798653938037888:12345-192.168.204.49@tcp:101:rm.0 Request processed in 2021us (2177us total) trans 4294968397 rc 301/301 00000100:00100000:1.0:1715330290.322003:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23442 00000100:00100000:0.0:1715330290.333099:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330290.333180:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938038016 00000100:00100000:2.0:1715330290.333188:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938038016 00000100:00100000:2.0:1715330290.335177:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5052 00000100:00100000:2.0:1715330290.335185:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f579500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+31:16983:x1798653938038016:12345-192.168.204.49@tcp:35:rm.0 00000100:00100000:2.0:1715330290.336277:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f579500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+32:16983:x1798653938038016:12345-192.168.204.49@tcp:35:rm.0 Request processed in 1090us (3183us total) trans 4294968398 rc 0/0 00000100:00100000:2.0:1715330290.336285:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5052 00000100:00100000:0.0:1715330290.341852:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330290.342467:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938038080 00000100:00100000:2.0:1715330290.342485:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938038080 00000100:00100000:2.0:1715330290.342531:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1314 00000100:00100000:2.0:1715330290.342538:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+57:2011:x1798653938038080:12345-192.168.204.49@tcp:103:rm.0 00010000:00010000:2.0:1715330290.342550:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330290.342570:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66d88bc lrc: 0/0,0 mode: --/PR res: [0x240000402:0x170:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb75e expref: 57 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.343202:0:9416:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x170:0x0].0x0 (ffff88008b122600) 00010000:00010000:2.0:1715330290.343213:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330290.343322:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+56:2011:x1798653938038080:12345-192.168.204.49@tcp:103:rm.0 Request processed in 783us (1478us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330290.343328:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1314 00000100:00100000:0.0:1715330290.343366:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330290.343697:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938038208 00000100:00100000:1.0:1715330290.343703:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938038208 00000100:00100000:1.0:1715330290.343745:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23443 00000100:00100000:1.0:1715330290.343754:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f579c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+32:16983:x1798653938038208:12345-192.168.204.49@tcp:36:rm.0 00010000:00010000:1.0:1715330290.343796:0:7135:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330290.343809:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d88d8 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x170:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb76c expref: 32 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.343832:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x170:0x0].0x0 (ffff88012dcc3e00) 00010000:00010000:1.0:1715330290.343839:0:7135:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330290.343874:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc480/0xd895711d66d8ad7 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.343880:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc480/0xd895711d66d8ad7 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330290.343887:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc480/0xd895711d66d8ad7 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT1 00000100:00100000:1.0:1715330290.343904:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d644e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942464768:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1715330290.343979:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330290.343998:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f240 going to sleep for 11 seconds 00000100:00100000:1.0:1715330290.344024:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942464768 00000100:00100000:1.0:1715330290.344027:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942464768 00000100:00100000:1.0:1715330290.344054:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2778 00000100:00100000:1.0:1715330290.344058:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d647480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+17:7135:x1798653942464768:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330290.344068:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330290.344079:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d8ade lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d8ad7 expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.344302:0:9407:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d8ade lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d8ad7 expref: 18 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.344315:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d8ade lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8ad7 expref: 18 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.344320:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88009d5fa500) 00010000:00010000:1.0:1715330290.344323:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330290.344325:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfdd40, rc 0) 00000100:00100000:2.0:1715330290.344813:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d644e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942464768:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1715330290.344825:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc480/0xd895711d66d8ad7 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8ade expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.344835:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc480/0xd895711d66d8ad7 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8ade expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715330290.344849:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:2.0:1715330290.344863:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d8ae5 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330290.344869:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d8ae5 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330290.344875:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d8ae5 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT1 00000100:00100000:2.0:1715330290.344884:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942464832:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1715330290.344903:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330290.344925:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435a80 going to sleep for 11 seconds 00000100:00100000:0.0:1715330290.344945:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942464832 00000100:00100000:0.0:1715330290.344949:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942464832 00000100:00100000:0.0:1715330290.344967:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2779 00000100:00100000:0.0:1715330290.344971:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+19:7135:x1798653942464832:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330290.344978:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330290.344988:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0d80/0xd895711d66d8aec lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d8ae5 expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.345000:0:9408:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0d80/0xd895711d66d8aec lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d8ae5 expref: 20 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.345008:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0d80/0xd895711d66d8aec lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8ae5 expref: 20 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.345016:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x6f4526f6 (ffff88009bbb0100) 00010000:00010000:0.0:1715330290.345018:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330290.345020:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a0d80, rc 0) 00000100:00100000:0.0:1715330290.345095:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+20:7135:x1798653942464832:12345-0@lo:101:mdt00_002.0 Request processed in 122us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330290.345100:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2779 00000100:00100000:1.0:1715330290.345108:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d647480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+20:7135:x1798653942464768:12345-0@lo:101:mdt00_002.0 Request processed in 300us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330290.345116:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2778 00000100:00100000:1.0:1715330290.346264:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942464896 00000100:00100000:1.0:1715330290.346269:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942464896 00000100:00100000:1.0:1715330290.346298:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2780 00000100:00100000:1.0:1715330290.346303:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+19:7135:x1798653942464896:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330290.346370:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+19:7135:x1798653942464896:12345-0@lo:1000:mdt00_002.0 Request processed in 65us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330290.346376:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2780 00000100:00100000:1.0:1715330290.346552:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942464960 00000100:00100000:1.0:1715330290.346556:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942464960 00000100:00100000:1.0:1715330290.346580:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2781 00000100:00100000:1.0:1715330290.346583:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+19:7135:x1798653942464960:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330290.346639:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+19:7135:x1798653942464960:12345-0@lo:1000:mdt00_002.0 Request processed in 54us (131us total) trans 0 rc 1/1 00000100:00100000:1.0:1715330290.346645:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2781 00000100:00100000:2.0:1715330290.351870:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942465024 00000100:00100000:2.0:1715330290.351879:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942465024 00000100:00100000:2.0:1715330290.351933:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2782 00000100:00100000:2.0:1715330290.351940:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+19:7135:x1798653942465024:12345-0@lo:101:mdt00_002.0 00010000:00010000:2.0:1715330290.351957:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330290.351983:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d8afa lrc: 2/0,0 mode: --/EX res: [0x240000402:0x170:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d8af3 expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.352013:0:23404:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d8afa lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x170:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d8af3 expref: 20 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.352025:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d8afa lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x170:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8af3 expref: 20 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.352036:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x170:0x0].0x0 (ffff88009edfa200) 00010000:00010000:2.0:1715330290.352038:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1715330290.352041:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db66640, rc 0) 00000100:00100000:2.0:1715330290.352088:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+20:7135:x1798653942465024:12345-0@lo:101:mdt00_002.0 Request processed in 149us (5225us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330290.352093:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2782 00000100:00100000:0.0:1715330290.362863:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330290.362936:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938038272 00000100:00100000:2.0:1715330290.362944:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938038272 00010000:00010000:2.0:1715330290.362976:0:9416:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a06c0/0xd895711d66d88e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xbb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb773 expref: 32 pid: 9622 timeout: 364 lvb_type: 0 00000100:00100000:2.0:1715330290.363001:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1527 00000100:00100000:2.0:1715330290.363008:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+32:2012:x1798653938038272:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1715330290.363020:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330290.363025:0:9416:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a06c0/0xd895711d66d88e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xbb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb773 expref: 32 pid: 9622 timeout: 364 lvb_type: 0 00010000:00010000:2.0:1715330290.363035:0:9416:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a06c0/0xd895711d66d88e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xbb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb773 expref: 32 pid: 9622 timeout: 364 lvb_type: 0 00010000:00010000:2.0:1715330290.363052:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a06c0/0xd895711d66d88e6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xbb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb773 expref: 32 pid: 9622 timeout: 364 lvb_type: 0 00010000:00010000:2.0:1715330290.363074:0:9416:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xbb:0x0].0x0 (ffff88008b122d00) 00010000:00010000:2.0:1715330290.363079:0:9416:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e1c0/0xd895711d66d8b08 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330290.363089:0:9416:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e1c0/0xd895711d66d8b08 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330290.363095:0:9416:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e1c0/0xd895711d66d8b08 lrc: 4/0,1 mode: EX/EX res: [0x240000400:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330290.363126:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330290.363163:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+31:2012:x1798653938038272:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 154us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330290.363170:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1527 00000100:00100000:0.0:1715330290.363414:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942465152 00000100:00100000:0.0:1715330290.363418:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942465152 00000100:00100000:0.0:1715330290.363438:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2783 00000100:00100000:0.0:1715330290.363442:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+20:7135:x1798653942465152:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330290.363456:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330290.363468:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a33c0/0xd895711d66d8b16 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xbb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d8b0f expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.363493:0:9407:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1b00/0xd895711d66d88f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xbb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb77a expref: 55 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.363500:0:9407:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a33c0/0xd895711d66d8b16 lrc: 4/0,0 mode: --/EX res: [0x200000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d8b0f expref: 21 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.363516:0:9407:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1b00/0xd895711d66d88f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xbb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb77a expref: 55 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.363526:0:9407:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1b00/0xd895711d66d88f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xbb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb77a expref: 55 pid: 7135 timeout: 364 lvb_type: 0 00000100:00100000:0.0:1715330290.363539:0:9407:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f578700 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:9407:1798653942465216:192.168.204.49@tcp:104: 00000100:00100000:0.0:1715330290.363567:0:9407:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715330290.369563:0:9407:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f578700 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:9407:1798653942465216:192.168.204.49@tcp:104: 00010000:00010000:2.0:1715330290.369592:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a33c0/0xd895711d66d8b16 lrc: 3/0,0 mode: --/EX res: [0x200000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8b0f expref: 21 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.369603:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xbb:0x0].0x0 (ffff88008b122a00) 00010000:00010000:2.0:1715330290.369605:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330290.369608:0:9407:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a33c0/0xd895711d66d8b16 lrc: 3/0,0 mode: --/EX res: [0x200000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8b0f expref: 21 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.369616:0:9407:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a33c0/0xd895711d66d8b16 lrc: 3/0,0 mode: --/EX res: [0x200000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8b0f expref: 21 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.369621:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a33c0, rc 0) 00000100:00100000:2.0:1715330290.370254:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+21:7135:x1798653942465152:12345-0@lo:101:mdt00_002.0 Request processed in 6809us (6881us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330290.370261:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2783 00000100:00100000:1.0:1715330290.370557:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330290.370615:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938038336 00000100:00100000:2.0:1715330290.370620:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938038336 00010000:00010000:2.0:1715330290.370639:0:9416:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1b00/0xd895711d66d88f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xbb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb77a expref: 56 pid: 7135 timeout: 364 lvb_type: 0 00000100:00100000:2.0:1715330290.370669:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1528 00000100:00100000:2.0:1715330290.370674:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d646300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+56:2012:x1798653938038336:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1715330290.370685:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330290.370690:0:9416:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1b00/0xd895711d66d88f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xbb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb77a expref: 56 pid: 7135 timeout: 364 lvb_type: 0 00010000:00010000:2.0:1715330290.370699:0:9416:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1b00/0xd895711d66d88f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xbb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb77a expref: 56 pid: 7135 timeout: 364 lvb_type: 0 00010000:00010000:2.0:1715330290.370717:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1b00/0xd895711d66d88f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xbb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb77a expref: 56 pid: 7135 timeout: 364 lvb_type: 0 00010000:00010000:2.0:1715330290.370789:0:9416:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xbb:0x0].0x0 (ffff88008b122a00) 00010000:00010000:2.0:1715330290.370794:0:9416:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a33c0/0xd895711d66d8b16 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8b0f expref: 20 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.370801:0:9416:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a33c0/0xd895711d66d8b16 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d8b0f expref: 20 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.370807:0:9416:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a33c0/0xd895711d66d8b16 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d8b0f expref: 20 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.370830:0:9416:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a33c0/0xd895711d66d8b16 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8b0f expref: 20 pid: 9407 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330290.370842:0:9416:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:9416:1798653942465280:0@lo:105: 00000100:00100000:2.0:1715330290.370868:0:9416:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330290.371917:0:9416:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435300 going to sleep for 11 seconds 00000100:00100000:1.0:1715330290.371947:0:9413:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942465280 00000100:00100000:1.0:1715330290.371951:0:9413:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942465280 00000100:00100000:1.0:1715330290.371974:0:9413:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1159 00000100:00100000:1.0:1715330290.371978:0:9413:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:9416:x1798653942465280:12345-0@lo:105: 00010000:00010000:1.0:1715330290.371985:0:9413:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f180/0xd895711d66d8b0f lrc: 5/0,1 mode: --/EX res: [0x200000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8b16 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.371992:0:9413:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f180/0xd895711d66d8b0f lrc: 5/0,1 mode: --/EX res: [0x200000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8b16 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.371998:0:9413:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f180/0xd895711d66d8b0f lrc: 5/0,1 mode: --/EX res: [0x200000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8b16 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.372003:0:9413:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f180/0xd895711d66d8b0f lrc: 5/0,1 mode: EX/EX res: [0x200000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d8b16 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.372009:0:9413:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f180/0xd895711d66d8b0f lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d8b16 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.372014:0:9413:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f180/0xd895711d66d8b0f lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d8b16 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.372661:0:9413:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88013457f180) 00000100:00100000:1.0:1715330290.372696:0:9413:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:9416:x1798653942465280:12345-0@lo:105: Request processed in 716us (1825us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330290.372702:0:9413:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1159 00000100:00100000:2.0:1715330290.372768:0:9416:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:9416:1798653942465280:0@lo:105: 00010000:00010000:2.0:1715330290.372780:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330290.372821:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d646300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+55:2012:x1798653938038336:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 2146us (2265us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330290.372828:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1528 00000100:00100000:0.0:1715330290.379492:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc79500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942465344:0@lo:403:mdt00_002.0 00000040:00080000:0.0:1715330290.380363:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].386, 952 off582352 00000040:00080000:0.0:1715330290.381019:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].388, 1032 off637552 00000004:00080000:0.0:1715330290.381024:0:7135:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff880091ffacc0 with version 740 00000004:00080000:2.0:1715330290.381061:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 740 rpc_version 740 00000020:00100000:2.0:1715330290.381085:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1715330290.381091:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012b55c700 x1798653942465472/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2352/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1715330290.381107:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55c700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942465472:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1715330290.381141:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330290.381183:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435300 going to sleep for 11 seconds 00000100:00100000:0.0:1715330290.382016:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55c700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942465472:0@lo:1000:osp_up0-1.0 00000004:00200000:2.0:1715330290.382043:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x170:0x0]: returning size 4096 00010000:00010000:2.0:1715330290.382060:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e1c0/0xd895711d66d8b08 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330290.382068:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e1c0/0xd895711d66d8b08 lrc: 2/0,0 mode: EX/EX res: [0x240000400:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330290.382073:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e1c0/0xd895711d66d8b08 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330290.382078:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457e1c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330290.382082:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e1c0/0xd895711d66d8b08 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330290.382088:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e1c0/0xd895711d66d8b08 lrc: 4/0,0 mode: EX/EX res: [0x240000400:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330290.382103:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xbb:0x0].0x0 (ffff88008b122d00) 00010000:00010000:2.0:1715330290.382105:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330290.382108:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e1c0/0xd895711d66d8b08 lrc: 2/0,0 mode: --/EX res: [0x240000400:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330290.382112:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e1c0/0xd895711d66d8b08 lrc: 0/0,0 mode: --/EX res: [0x240000400:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330290.383447:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f180/0xd895711d66d8b0f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8b16 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.383457:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f180/0xd895711d66d8b0f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8b16 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.383462:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f180/0xd895711d66d8b0f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8b16 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.383484:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1715330290.383491:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000401:0xbb:0x0] 00010000:00010000:2.0:1715330290.383498:0:7124:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1715330290.383503:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f180/0xd895711d66d8b0f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d8b16 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.383509:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457f180 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:2.0:1715330290.383512:0:7124:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f180/0xd895711d66d8b0f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d8b16 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1715330290.383518:0:7124:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f180/0xd895711d66d8b0f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d8b16 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.383547:0:7124:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f180/0xd895711d66d8b0f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8b16 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.383552:0:7124:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1715330290.383577:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f180/0xd895711d66d8b0f lrc: 1/0,0 mode: --/EX res: [0x200000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8b16 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.383582:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f180/0xd895711d66d8b0f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8b16 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.383593:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330290.383594:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330290.383595:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330290.383602:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1715330290.383612:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942465536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1715330290.383644:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330290.383666:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942465536 00000100:00100000:2.0:1715330290.383670:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942465536 00000100:00100000:2.0:1715330290.383693:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1315 00000100:00100000:2.0:1715330290.383698:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+22:3688:x1798653942465536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715330290.383706:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330290.383717:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a33c0/0xd895711d66d8b16 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xbb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d8b0f expref: 22 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.383727:0:9416:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xbb:0x0].0x0 (ffff88008b122a00) 00010000:00010000:2.0:1715330290.383746:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330290.383764:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+21:3688:x1798653942465536:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330290.383771:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1315 00000100:00100000:2.0:1715330290.383791:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942465536:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715330290.383807:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e880/0xd895711d66d8b01 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x170:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330290.383812:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e880/0xd895711d66d8b01 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x170:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330290.383816:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e880/0xd895711d66d8b01 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x170:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330290.383819:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457e880 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330290.383821:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e880/0xd895711d66d8b01 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x170:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330290.383825:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e880/0xd895711d66d8b01 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x170:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330290.383831:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x170:0x0].0x0 (ffff88011d537700) 00010000:00010000:2.0:1715330290.383833:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330290.383834:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e880/0xd895711d66d8b01 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x170:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330290.383838:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e880/0xd895711d66d8b01 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x170:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330290.383846:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457ed00/0xd895711d66d8af3 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x170:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8afa expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.383851:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457ed00/0xd895711d66d8af3 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x170:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8afa expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.383860:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457ed00/0xd895711d66d8af3 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x170:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8afa expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.383867:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1715330290.383881:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1715330290.383884:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457ed00/0xd895711d66d8af3 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x170:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d8afa expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.383889:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457ed00 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:2.0:1715330290.383891:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457ed00/0xd895711d66d8af3 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x170:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d8afa expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1715330290.383897:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457ed00/0xd895711d66d8af3 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x170:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d8afa expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.383909:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457ed00/0xd895711d66d8af3 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x170:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8afa expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.383914:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1715330290.383930:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457ed00/0xd895711d66d8af3 lrc: 1/0,0 mode: --/EX res: [0x240000402:0x170:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8afa expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.383936:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457ed00/0xd895711d66d8af3 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x170:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8afa expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.383944:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330290.383945:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330290.383947:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1715330290.384074:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:2.0:1715330290.384078:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc480/0xd895711d66d8ad7 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8ade expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.384083:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc480/0xd895711d66d8ad7 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8ade expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.384088:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc480/0xd895711d66d8ad7 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8ade expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.384095:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1715330290.384098:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:2.0:1715330290.384101:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d8ae5 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8aec expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.384106:0:7135:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d8ae5 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8aec expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330290.384153:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f579c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+31:16983:x1798653938038208:12345-192.168.204.49@tcp:36:rm.0 Request processed in 40401us (40787us total) trans 4294968399 rc 0/0 00000100:00100000:2.0:1715330290.384158:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23443 00000100:00100000:1.0:1715330290.384841:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942465600 00000100:00100000:1.0:1715330290.384846:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942465600 00000100:00100000:1.0:1715330290.384864:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942465664 00000100:00100000:1.0:1715330290.384865:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942465664 00000100:00100000:1.0:1715330290.384887:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1316 00000100:00100000:1.0:1715330290.384891:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+22:3691:x1798653942465600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330290.384898:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330290.384907:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d8afa lrc: 0/0,0 mode: --/EX res: [0x240000402:0x170:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d8af3 expref: 22 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.384919:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x170:0x0].0x0 (ffff88009edfa200) 00010000:00010000:1.0:1715330290.384924:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330290.384945:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+21:3691:x1798653942465600:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330290.384950:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1316 00000100:00100000:1.0:1715330290.384961:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1317 00000100:00100000:1.0:1715330290.384964:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+20:3691:x1798653942465664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330290.384969:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330290.384977:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d8ade lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d8ad7 expref: 20 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.384985:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88009d5fa500) 00010000:00010000:1.0:1715330290.384990:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330290.385002:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+19:3691:x1798653942465664:12345-0@lo:103:ldlm_bl.0 Request processed in 38us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330290.385006:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1317 00000100:00100000:1.0:1715330290.391357:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330290.406975:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330290.407072:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938038592 00000100:00100000:2.0:1715330290.407080:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938038592 00000100:00100000:2.0:1715330290.407130:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5053 00000100:00100000:2.0:1715330290.407138:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+56:16983:x1798653938038592:12345-192.168.204.49@tcp:35:rm.0 00000100:00100000:2.0:1715330290.407318:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+57:16983:x1798653938038592:12345-192.168.204.49@tcp:35:rm.0 Request processed in 181us (350us total) trans 4294983474 rc 0/0 00000100:00100000:2.0:1715330290.407325:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5053 00000100:00100000:0.0:1715330290.411490:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330290.418225:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330290.418549:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938038784 00000100:00100000:2.0:1715330290.418555:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938038784 00010000:00010000:2.0:1715330290.418583:0:9416:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d8980 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb7b2 expref: 57 pid: 7135 timeout: 364 lvb_type: 0 00000100:00100000:2.0:1715330290.418614:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1529 00000100:00100000:2.0:1715330290.418619:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+57:2011:x1798653938038784:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1715330290.418630:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330290.418635:0:9416:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d8980 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb7b2 expref: 57 pid: 7135 timeout: 364 lvb_type: 0 00010000:00010000:2.0:1715330290.418644:0:9416:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d8980 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb7b2 expref: 57 pid: 7135 timeout: 364 lvb_type: 0 00010000:00010000:2.0:1715330290.418662:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d8980 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb7b2 expref: 57 pid: 7135 timeout: 364 lvb_type: 0 00010000:00010000:2.0:1715330290.418686:0:9416:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x1c:0x0].0x0 (ffff8800a7e58100) 00010000:00010000:2.0:1715330290.418690:0:9416:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f600/0xd895711d66d8b40 lrc: 3/0,1 mode: --/EX res: [0x200000400:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330290.418697:0:9416:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f600/0xd895711d66d8b40 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330290.418702:0:9416:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f600/0xd895711d66d8b40 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330290.418715:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330290.418762:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+56:2011:x1798653938038784:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 141us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330290.418768:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1529 00000100:00100000:2.0:1715330290.419680:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942465792 00000100:00100000:2.0:1715330290.419684:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942465792 00000100:00100000:2.0:1715330290.419704:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2786 00000100:00100000:2.0:1715330290.419708:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7135:x1798653942465792:12345-0@lo:101:mdt00_002.0 00010000:00010000:2.0:1715330290.419721:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330290.419758:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64000/0xd895711d66d8b4e lrc: 2/0,0 mode: --/EX res: [0x240000401:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d8b47 expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.419774:0:23404:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64240/0xd895711d66d898e lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb7b9 expref: 30 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.419780:0:23404:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64000/0xd895711d66d8b4e lrc: 4/0,0 mode: --/EX res: [0x240000401:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d8b47 expref: 11 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.419797:0:23404:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64240/0xd895711d66d898e lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb7b9 expref: 30 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.419807:0:23404:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64240/0xd895711d66d898e lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb7b9 expref: 30 pid: 9622 timeout: 364 lvb_type: 0 00000100:00100000:2.0:1715330290.419816:0:23404:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55e680 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:23404:1798653942465856:192.168.204.49@tcp:104: 00000100:00100000:2.0:1715330290.419848:0:23404:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435e40 going to sleep for 11 seconds 00000100:00100000:2.0:1715330290.424004:0:23404:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55e680 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:23404:1798653942465856:192.168.204.49@tcp:104: 00010000:00010000:2.0:1715330290.424033:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64000/0xd895711d66d8b4e lrc: 3/0,0 mode: --/EX res: [0x240000401:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8b47 expref: 11 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.424044:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x1c:0x0].0x0 (ffff8800a7e58d00) 00010000:00010000:2.0:1715330290.424046:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330290.424049:0:23404:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64000/0xd895711d66d8b4e lrc: 3/0,0 mode: --/EX res: [0x240000401:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8b47 expref: 11 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.424057:0:23404:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64000/0xd895711d66d8b4e lrc: 3/0,0 mode: --/EX res: [0x240000401:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8b47 expref: 11 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.424063:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db64000, rc 0) 00000100:00100000:2.0:1715330290.424115:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:7135:x1798653942465792:12345-0@lo:101:mdt00_002.0 Request processed in 4405us (4503us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330290.424123:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2786 00000100:00100000:1.0:1715330290.426118:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330290.426982:0:10673:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938038848 00000100:00100000:2.0:1715330290.426989:0:10673:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938038848 00010000:00010000:2.0:1715330290.427014:0:10673:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64240/0xd895711d66d898e lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb7b9 expref: 31 pid: 9622 timeout: 364 lvb_type: 0 00000100:00100000:2.0:1715330290.427054:0:10673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1530 00000100:00100000:2.0:1715330290.427061:0:10673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d645c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:72de1896-1df4-4b3a-930a-9116d2c66168+31:2012:x1798653938038848:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1715330290.427073:0:10673:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330290.427078:0:10673:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64240/0xd895711d66d898e lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb7b9 expref: 31 pid: 9622 timeout: 364 lvb_type: 0 00010000:00010000:2.0:1715330290.427092:0:10673:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64240/0xd895711d66d898e lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb7b9 expref: 31 pid: 9622 timeout: 364 lvb_type: 0 00010000:00010000:2.0:1715330290.427110:0:10673:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64240/0xd895711d66d898e lrc: 0/0,0 mode: --/PR res: [0x240000401:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb7b9 expref: 31 pid: 9622 timeout: 364 lvb_type: 0 00010000:00010000:2.0:1715330290.427135:0:10673:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x1c:0x0].0x0 (ffff8800a7e58d00) 00010000:00010000:2.0:1715330290.427140:0:10673:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64000/0xd895711d66d8b4e lrc: 2/0,0 mode: --/EX res: [0x240000401:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8b47 expref: 10 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.427152:0:10673:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64000/0xd895711d66d8b4e lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d8b47 expref: 10 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.427159:0:10673:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64000/0xd895711d66d8b4e lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d8b47 expref: 10 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.427185:0:10673:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64000/0xd895711d66d8b4e lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8b47 expref: 10 pid: 23404 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330290.427196:0:10673:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001_UUID:10673:1798653942465920:0@lo:105: 00000100:00100000:2.0:1715330290.427228:0:10673:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330290.427241:0:10673:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435e40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330290.427332:0:9413:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942465920 00000100:00100000:1.0:1715330290.427336:0:9413:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942465920 00000100:00100000:1.0:1715330290.427360:0:9413:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1160 00000100:00100000:1.0:1715330290.427364:0:9413:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:10673:x1798653942465920:12345-0@lo:105: 00010000:00010000:1.0:1715330290.427372:0:9413:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c480/0xd895711d66d8b47 lrc: 5/0,1 mode: --/EX res: [0x240000401:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8b4e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.427380:0:9413:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c480/0xd895711d66d8b47 lrc: 5/0,1 mode: --/EX res: [0x240000401:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8b4e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.427387:0:9413:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c480/0xd895711d66d8b47 lrc: 5/0,1 mode: --/EX res: [0x240000401:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8b4e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.427392:0:9413:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c480/0xd895711d66d8b47 lrc: 5/0,1 mode: EX/EX res: [0x240000401:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d8b4e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.427401:0:9413:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c480/0xd895711d66d8b47 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d8b4e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.427406:0:9413:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c480/0xd895711d66d8b47 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d8b4e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.427894:0:9413:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88013457c480) 00000100:00100000:1.0:1715330290.427920:0:9413:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:10673:x1798653942465920:12345-0@lo:105: Request processed in 555us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330290.427925:0:9413:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1160 00000100:00100000:2.0:1715330290.427998:0:10673:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001_UUID:10673:1798653942465920:0@lo:105: 00010000:00010000:2.0:1715330290.428008:0:10673:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330290.431578:0:10673:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d645c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:72de1896-1df4-4b3a-930a-9116d2c66168+30:2012:x1798653938038848:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 4513us (5460us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330290.431586:0:10673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1530 00000100:00100000:0.0:1715330290.437373:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc7a300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942466112:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1715330290.438270:0:7123:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715330290.438276:0:7123:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c480/0xd895711d66d8b47 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d8b4e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.438282:0:7123:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457c480 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330290.438286:0:7123:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c480/0xd895711d66d8b47 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d8b4e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330290.438291:0:7123:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c480/0xd895711d66d8b47 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d8b4e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.438317:0:7123:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c480/0xd895711d66d8b47 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8b4e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.438322:0:7123:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330290.439632:0:7123:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c480/0xd895711d66d8b47 lrc: 1/0,0 mode: --/EX res: [0x240000401:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8b4e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.439640:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c480/0xd895711d66d8b47 lrc: 0/0,0 mode: --/EX res: [0x240000401:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8b4e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.439654:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330290.439656:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330290.439657:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330290.439664:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1715330290.439678:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f57b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942466176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330290.439717:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330290.439757:0:10673:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942466176 00000100:00100000:0.0:1715330290.439762:0:10673:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942466176 00000100:00100000:0.0:1715330290.439793:0:10673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1318 00000100:00100000:0.0:1715330290.440749:0:10673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+12:3689:x1798653942466176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330290.440760:0:10673:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330290.440776:0:10673:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64000/0xd895711d66d8b4e lrc: 0/0,0 mode: --/EX res: [0x240000401:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d8b47 expref: 12 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.440788:0:10673:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x1c:0x0].0x0 (ffff8800a7e58d00) 00010000:00010000:0.0:1715330290.440795:0:10673:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330290.440819:0:10673:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+11:3689:x1798653942466176:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (1102us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330290.440825:0:10673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1318 00000100:00100000:0.0:1715330290.440951:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f57b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942466176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330290.453530:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330290.460849:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330290.468614:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330290.468666:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330290.468768:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938039296 00000100:00100000:2.0:1715330290.468777:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938039296 00000100:00100000:2.0:1715330290.468824:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23447 00000100:00100000:2.0:1715330290.468831:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+59:16983:x1798653938039296:12345-192.168.204.49@tcp:36:rm.0 00010000:00010000:2.0:1715330290.468877:0:9622:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330290.468899:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66d85f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x13fc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb638 expref: 59 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.468920:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13fc:0x0].0x0 (ffff88008b122300) 00010000:00010000:2.0:1715330290.468929:0:9622:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330290.468962:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db64b40/0xd895711d66d8b63 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.468968:0:9622:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db64b40/0xd895711d66d8b63 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.468975:0:9622:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db64b40/0xd895711d66d8b63 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 9622 initiator: MDT0 00000100:00100000:2.0:1715330290.468991:0:9622:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9622:1798653942466240:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1715330290.469021:0:9622:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330290.469033:0:9622:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435e40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330290.469292:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938039168 00000100:00100000:1.0:1715330290.469295:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938039168 00000100:00100000:1.0:1715330290.469445:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1319 00000100:00100000:1.0:1715330290.469450:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+30:2011:x1798653938039168:12345-192.168.204.49@tcp:103:rm.0 00010000:00010000:1.0:1715330290.469457:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330290.469478:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800ad9f1d40/0xd895711d66d85d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x13fc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb62a expref: 30 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.469488:0:9416:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13fc:0x0].0x0 (ffff88011d537100) 00010000:00010000:1.0:1715330290.469494:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330290.469664:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+29:2011:x1798653938039168:12345-192.168.204.49@tcp:103:rm.0 Request processed in 213us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330290.469671:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1319 00000100:00100000:2.0:1715330290.470063:0:9622:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9622:1798653942466240:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1715330290.470075:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db64b40/0xd895711d66d8b63 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8b6a expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.470083:0:9622:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db64b40/0xd895711d66d8b63 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8b6a expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715330290.470097:0:9622:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:2.0:1715330290.470111:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db661c0/0xd895711d66d8b71 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x393326f7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.470116:0:9622:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db661c0/0xd895711d66d8b71 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x393326f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.470122:0:9622:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db661c0/0xd895711d66d8b71 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x393326f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 9622 initiator: MDT0 00000100:00100000:2.0:1715330290.470131:0:9622:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9622:1798653942466304:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1715330290.470149:0:9622:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330290.470169:0:9622:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435e40 going to sleep for 11 seconds 00000100:00100000:2.0:1715330290.470551:0:9622:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9622:1798653942466304:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1715330290.470559:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db661c0/0xd895711d66d8b71 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x393326f7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8b78 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.470565:0:9622:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db661c0/0xd895711d66d8b71 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x393326f7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8b78 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715330290.470573:0:9622:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:2.0:1715330290.470597:0:9622:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9622:1798653942466368:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1715330290.470616:0:9622:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330290.470824:0:9622:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435900 going to sleep for 11 seconds 00000100:00100000:1.0:1715330290.471860:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942466368 00000100:00100000:1.0:1715330290.471864:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942466368 00000100:00100000:1.0:1715330290.471893:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2791 00000100:00100000:1.0:1715330290.471898:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:9622:x1798653942466368:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1715330290.471965:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:9622:x1798653942466368:12345-0@lo:1000:mdt00_003.0 Request processed in 66us (1347us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330290.471971:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2791 00000100:00100000:2.0:1715330290.472074:0:9622:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9622:1798653942466368:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1715330290.472107:0:9622:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9622:1798653942466432:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1715330290.472126:0:9622:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330290.472135:0:9622:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435900 going to sleep for 11 seconds 00000100:00100000:2.0:1715330290.472391:0:9622:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9622:1798653942466432:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1715330290.472424:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db64000/0xd895711d66d8b7f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x13fc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.472431:0:9622:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db64000/0xd895711d66d8b7f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x13fc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.472438:0:9622:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db64000/0xd895711d66d8b7f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x13fc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 9622 initiator: MDT0 00000100:00100000:2.0:1715330290.472447:0:9622:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9622:1798653942466496:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1715330290.472463:0:9622:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330290.472532:0:9622:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435e40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330290.472563:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942466496 00000100:00100000:1.0:1715330290.472565:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942466496 00000100:00100000:1.0:1715330290.472631:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2793 00000100:00100000:1.0:1715330290.472634:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:9622:x1798653942466496:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1715330290.472641:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330290.472651:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc480/0xd895711d66d8b86 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x13fc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d8b7f expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.472665:0:9407:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc480/0xd895711d66d8b86 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13fc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d8b7f expref: 14 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.472672:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc480/0xd895711d66d8b86 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13fc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8b7f expref: 14 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.472678:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13fc:0x0].0x0 (ffff88009d5fa300) 00010000:00010000:1.0:1715330290.472680:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1715330290.472681:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfc480, rc 0) 00000100:00100000:1.0:1715330290.472706:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:9622:x1798653942466496:12345-0@lo:101:mdt00_003.0 Request processed in 71us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330290.472711:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2793 00000100:00100000:2.0:1715330290.472773:0:9622:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9622:1798653942466496:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1715330290.472780:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db64000/0xd895711d66d8b7f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x13fc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8b86 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.472787:0:9622:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db64000/0xd895711d66d8b7f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x13fc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8b86 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.472801:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d8b8d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x13fc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.472806:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d8b8d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x13fc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.472811:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d8b8d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x13fc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.472823:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d8b94 lrc: 3/0,1 mode: --/EX res: [0x200000400:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.472830:0:9622:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d8600 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb63f expref: 58 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.472836:0:9622:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d8b94 lrc: 4/0,1 mode: --/EX res: [0x200000400:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.472851:0:9622:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d8600 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb63f expref: 58 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.472869:0:9622:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d8600 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb63f expref: 58 pid: 9622 timeout: 364 lvb_type: 0 00000100:00100000:2.0:1715330290.472877:0:9622:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9622:1798653942466560:192.168.204.49@tcp:104: 00000100:00100000:2.0:1715330290.473064:0:9622:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435e40 going to sleep for 11 seconds 00000100:00100000:2.0:1715330290.475843:0:9622:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9622:1798653942466560:192.168.204.49@tcp:104: 00010000:00010000:2.0:1715330290.475866:0:9622:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d8b94 lrc: 3/0,1 mode: --/EX res: [0x200000400:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00000100:00100000:0.0:1715330290.476701:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330290.476871:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938039360 00000100:00100000:1.0:1715330290.476877:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938039360 00010000:00010000:1.0:1715330290.476903:0:9416:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d8600 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb63f expref: 59 pid: 9622 timeout: 364 lvb_type: 0 00000100:00100000:1.0:1715330290.476928:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1531 00000100:00100000:1.0:1715330290.476934:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+59:2011:x1798653938039360:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1715330290.476944:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330290.476948:0:9416:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d8600 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb63f expref: 59 pid: 9622 timeout: 364 lvb_type: 0 00010000:00010000:1.0:1715330290.476961:0:9416:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d8600 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb63f expref: 59 pid: 9622 timeout: 364 lvb_type: 0 00010000:00010000:1.0:1715330290.476979:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d8600 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb63f expref: 59 pid: 9622 timeout: 364 lvb_type: 0 00010000:00010000:1.0:1715330290.476992:0:9416:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x3c:0x0].0x0 (ffff88008b122700) 00010000:00010000:1.0:1715330290.476996:0:9416:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d8b94 lrc: 3/0,1 mode: --/EX res: [0x200000400:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:1.0:1715330290.477003:0:9416:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d8b94 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9622 initiator: MDT0 00010000:00010000:1.0:1715330290.477008:0:9416:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d8b94 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9622 initiator: MDT0 00010000:00010000:1.0:1715330290.477032:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330290.478403:0:9622:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d8b94 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.478414:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d8b94 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.478452:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66ac0/0xd895711d66d8b9b lrc: 3/0,1 mode: --/EX res: [0x240000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.478458:0:9622:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66ac0/0xd895711d66d8b9b lrc: 3/0,1 mode: --/EX res: [0x240000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.478476:0:9622:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66ac0/0xd895711d66d8b9b lrc: 3/0,1 mode: --/EX res: [0x240000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 9622 initiator: MDT0 00000100:00100000:2.0:1715330290.478495:0:9622:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9622:1798653942466624:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1715330290.478533:0:9622:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330290.478562:0:9622:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435e40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330290.478748:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+58:2011:x1798653938039360:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 1812us (2046us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330290.478755:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1531 00000100:00100000:1.0:1715330290.482224:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330290.482437:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938039424 00000100:00100000:0.0:1715330290.482444:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938039424 00010000:00010000:0.0:1715330290.482481:0:9416:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfef40/0xd895711d66d860e lrc: 5/0,0 mode: PR/PR res: [0x240000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb646 expref: 29 pid: 7135 timeout: 364 lvb_type: 0 00000100:00100000:0.0:1715330290.482505:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1532 00000100:00100000:0.0:1715330290.482511:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d647b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+29:2011:x1798653938039424:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1715330290.482521:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330290.482526:0:9416:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfef40/0xd895711d66d860e lrc: 5/0,0 mode: PR/PR res: [0x240000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb646 expref: 29 pid: 7135 timeout: 364 lvb_type: 0 00010000:00010000:0.0:1715330290.482536:0:9416:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfef40/0xd895711d66d860e lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb646 expref: 29 pid: 7135 timeout: 364 lvb_type: 0 00010000:00010000:0.0:1715330290.482551:0:9416:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x3c:0x0].0x0 (ffff880135e32e00) 00010000:00010000:0.0:1715330290.482557:0:9416:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c6c0/0xd895711d66d8ba2 lrc: 3/0,0 mode: --/EX res: [0x240000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d8b9b expref: 15 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.482565:0:9416:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c6c0/0xd895711d66d8ba2 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xd895711d66d8b9b expref: 15 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.482571:0:9416:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c6c0/0xd895711d66d8ba2 lrc: 4/0,0 mode: EX/EX res: [0x240000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xd895711d66d8b9b expref: 15 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.482593:0:9416:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c6c0/0xd895711d66d8ba2 lrc: 4/0,0 mode: EX/EX res: [0x240000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8b9b expref: 15 pid: 23404 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330290.482604:0:9416:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f578e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001_UUID:9416:1798653942466752:0@lo:105: 00000100:00100000:0.0:1715330290.482640:0:9416:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330290.482653:0:9416:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa000 going to sleep for 11 seconds 00000100:00100000:1.0:1715330290.482723:0:9413:0:(service.c:168:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1715330290.482756:0:9413:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942466752 00000100:00100000:1.0:1715330290.482759:0:9413:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942466752 00000100:00100000:1.0:1715330290.482853:0:9413:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1161 00000100:00100000:1.0:1715330290.482859:0:9413:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca76050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:9416:x1798653942466752:12345-0@lo:105: 00010000:00010000:1.0:1715330290.482866:0:9413:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66ac0/0xd895711d66d8b9b lrc: 4/0,1 mode: --/EX res: [0x240000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8ba2 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.482873:0:9413:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66ac0/0xd895711d66d8b9b lrc: 4/0,1 mode: --/EX res: [0x240000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8ba2 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.482879:0:9413:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66ac0/0xd895711d66d8b9b lrc: 4/0,1 mode: --/EX res: [0x240000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8ba2 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.482884:0:9413:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66ac0/0xd895711d66d8b9b lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d8ba2 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.482889:0:9413:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66ac0/0xd895711d66d8b9b lrc: 5/0,1 mode: EX/EX res: [0x240000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d8ba2 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.482895:0:9413:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66ac0/0xd895711d66d8b9b lrc: 5/0,1 mode: EX/EX res: [0x240000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d8ba2 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.482905:0:9413:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88011db66ac0) 00000100:00100000:1.0:1715330290.482936:0:9413:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca76050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:9416:x1798653942466752:12345-0@lo:105: Request processed in 77us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330290.482941:0:9413:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1161 00000100:00100000:2.0:1715330290.483230:0:9622:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9622:1798653942466624:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1715330290.483242:0:9622:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66ac0/0xd895711d66d8b9b lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8ba2 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330290.483769:0:9416:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f578e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001_UUID:9416:1798653942466752:0@lo:105: 00010000:00010000:0.0:1715330290.483778:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330290.483781:0:9622:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9622:1798653942466816:0@lo:403:mdt00_003.0 00000100:00100000:2.0:1715330290.483806:0:9622:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330290.483814:0:9622:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435e40 going to sleep for 11 seconds 00000100:00100000:0.0:1715330290.483837:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d647b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+28:2011:x1798653938039424:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 1292us (1587us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330290.483845:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1532 00000100:00100000:2.0:1715330290.486665:0:9622:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9622:1798653942466816:0@lo:403:mdt00_003.0 00000040:00080000:2.0:1715330290.487387:0:9622:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].364, 952 off554824 00000040:00080000:2.0:1715330290.487529:0:9622:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].364, 1032 off598096 00000004:00080000:2.0:1715330290.487534:0:9622:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880134435e40 with version 691 00000004:00080000:0.0:1715330290.487833:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 691 rpc_version 691 00000020:00100000:0.0:1715330290.487857:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1715330290.487863:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012f578e00 x1798653942466944/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 2352/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715330290.487880:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f578e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942466944:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330290.487913:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330290.487936:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa000 going to sleep for 11 seconds 00000100:00100000:1.0:1715330290.488459:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f578e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942466944:0@lo:1000:osp_up1-0.0 00000004:00200000:2.0:1715330290.488510:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x13fc:0x0]: returning size 4096 00010000:00010000:2.0:1715330290.488528:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d8b94 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.488536:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d8b94 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.488542:0:9622:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d8b94 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.488547:0:9622:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db67600 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330290.488550:0:9622:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d8b94 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.488556:0:9622:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d8b94 lrc: 4/0,0 mode: EX/EX res: [0x200000400:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.488567:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x3c:0x0].0x0 (ffff88008b122700) 00010000:00010000:2.0:1715330290.488569:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330290.488572:0:9622:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d8b94 lrc: 2/0,0 mode: --/EX res: [0x200000400:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.488576:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d8b94 lrc: 0/0,0 mode: --/EX res: [0x200000400:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.488591:0:9622:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66ac0/0xd895711d66d8b9b lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8ba2 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.488596:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66ac0/0xd895711d66d8b9b lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8ba2 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.488604:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66ac0/0xd895711d66d8b9b lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8ba2 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.489034:0:9622:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1715330290.489040:0:9622:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x3c:0x0] 00010000:00010000:2.0:1715330290.489048:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d8b8d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x13fc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.489053:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d8b8d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x13fc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.489058:0:9622:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d8b8d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13fc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.489061:0:9622:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64240 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330290.489063:0:9622:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d8b8d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13fc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.489068:0:9622:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d8b8d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x13fc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.489075:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13fc:0x0].0x0 (ffff88009edfa500) 00010000:00010000:2.0:1715330290.489077:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330290.489080:0:9622:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d8b8d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x13fc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.489084:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d8b8d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x13fc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.489095:0:9622:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db64000/0xd895711d66d8b7f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x13fc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8b86 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.489104:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db64000/0xd895711d66d8b7f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x13fc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8b86 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.489109:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db64000/0xd895711d66d8b7f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13fc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8b86 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.489129:0:9622:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:2.0:1715330290.489230:0:9622:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:2.0:1715330290.489234:0:9622:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db64b40/0xd895711d66d8b63 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8b6a expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.489240:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db64b40/0xd895711d66d8b63 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8b6a expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.489245:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db64b40/0xd895711d66d8b63 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8b6a expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.489253:0:9622:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000004:00080000:2.0:1715330290.489256:0:9622:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:2.0:1715330290.489259:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db661c0/0xd895711d66d8b71 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x393326f7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8b78 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.489263:0:9622:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db661c0/0xd895711d66d8b71 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x393326f7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8b78 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330290.489311:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+58:16983:x1798653938039296:12345-192.168.204.49@tcp:36:rm.0 Request processed in 20478us (20702us total) trans 4294983478 rc 0/0 00000100:00100000:2.0:1715330290.489319:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23447 00010000:00010000:3.0:1715330290.489946:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db64b40/0xd895711d66d8b63 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8b6a expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.489950:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1715330290.489954:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db64b40/0xd895711d66d8b63 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8b6a expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.489958:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db64b40/0xd895711d66d8b63 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8b6a expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.489966:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715330290.489967:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715330290.489969:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715330290.489973:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330290.489979:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1715330290.489987:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942467008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1715330290.490015:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330290.490059:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942467072:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330290.490345:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330290.491286:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942467136:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1715330290.491309:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330290.491902:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330290.495282:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942467008 00000100:00100000:0.0:1715330290.495294:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942467008 00000100:00100000:0.0:1715330290.495340:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942467136 00000100:00100000:0.0:1715330290.495343:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942467136 00000100:00100000:0.0:1715330290.495363:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942467072 00000100:00100000:0.0:1715330290.495365:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942467072 00000100:00100000:0.0:1715330290.495381:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1320 00000100:00100000:0.0:1715330290.495388:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+18:3688:x1798653942467008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330290.495400:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330290.495421:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c6c0/0xd895711d66d8ba2 lrc: 0/0,0 mode: --/EX res: [0x240000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d8b9b expref: 18 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.495444:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x3c:0x0].0x0 (ffff880135e32e00) 00010000:00010000:0.0:1715330290.495455:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330290.495516:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+17:3688:x1798653942467008:12345-0@lo:103:ldlm_bl.0 Request processed in 128us (5500us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330290.495521:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1320 00000100:00100000:0.0:1715330290.495533:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1321 00000100:00100000:0.0:1715330290.495536:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+16:3691:x1798653942467136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330290.495542:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330290.495550:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e400/0xd895711d66d8b6a lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d8b63 expref: 16 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.495557:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88009ef57f00) 00010000:00010000:0.0:1715330290.495562:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330290.495579:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+15:3691:x1798653942467136:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (4270us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330290.495583:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1321 00000100:00100000:0.0:1715330290.495591:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1322 00000100:00100000:0.0:1715330290.495594:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d645500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+14:3690:x1798653942467072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330290.495599:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330290.495606:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc480/0xd895711d66d8b86 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x13fc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d8b7f expref: 14 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.495615:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13fc:0x0].0x0 (ffff88009d5fa300) 00010000:00010000:0.0:1715330290.495620:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330290.495639:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d645500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+13:3690:x1798653942467072:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (3737us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330290.495643:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1322 00000100:00100000:3.0:1715330290.495758:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942467008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1715330290.495792:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942467136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330290.495869:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942467072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330290.495931:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330290.496011:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938039552 00000100:00100000:3.0:1715330290.496014:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938039552 00000100:00100000:3.0:1715330290.496036:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23448 00000100:00100000:3.0:1715330290.496040:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+58:16983:x1798653938039552:12345-192.168.204.49@tcp:101:rm.0 00010000:00010000:3.0:1715330290.496056:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330290.496068:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d8ba9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x14e4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb7f1 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715330290.496229:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x14e4:0x0]: returning size 4096 00010000:00010000:3.0:1715330290.496308:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d8ba9 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x14e4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb7f1 expref: 60 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.496315:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d8ba9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x14e4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb7f1 expref: 60 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.496322:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013457c480, rc 0) 00000100:00100000:3.0:1715330290.496350:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+59:16983:x1798653938039552:12345-192.168.204.49@tcp:101:rm.0 Request processed in 309us (422us total) trans 4294983479 rc 301/301 00000100:00100000:3.0:1715330290.496356:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23448 00000100:00100000:0.0:1715330290.500487:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330290.500568:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938039680 00000100:00100000:2.0:1715330290.500577:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938039680 00000100:00100000:2.0:1715330290.500620:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5055 00000100:00100000:2.0:1715330290.500626:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f579880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+59:16983:x1798653938039680:12345-192.168.204.49@tcp:35:rm.0 00000100:00100000:2.0:1715330290.500803:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f579880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+60:16983:x1798653938039680:12345-192.168.204.49@tcp:35:rm.0 Request processed in 177us (322us total) trans 4294983480 rc 0/0 00000100:00100000:2.0:1715330290.500809:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5055 00000100:00100000:1.0:1715330290.504633:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330290.505353:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330290.505831:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938039744 00000100:00100000:2.0:1715330290.505839:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938039744 00000100:00100000:2.0:1715330290.505882:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1323 00000100:00100000:2.0:1715330290.505888:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+28:2012:x1798653938039744:12345-192.168.204.49@tcp:103:rm.0 00010000:00010000:2.0:1715330290.505901:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330290.505921:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e640/0xd895711d66d8814 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x14e4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb718 expref: 28 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.505934:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14e4:0x0].0x0 (ffff88012dcc3200) 00010000:00010000:2.0:1715330290.505942:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330290.505975:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+27:2012:x1798653938039744:12345-192.168.204.49@tcp:103:rm.0 Request processed in 86us (1349us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330290.505981:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1323 00000100:00100000:3.0:1715330290.506320:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938039872 00000100:00100000:3.0:1715330290.506324:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938039872 00000100:00100000:3.0:1715330290.506346:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23449 00000100:00100000:3.0:1715330290.506350:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d646a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+60:16983:x1798653938039872:12345-192.168.204.49@tcp:36:rm.0 00010000:00010000:3.0:1715330290.506388:0:9622:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330290.506400:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457dd40/0xd895711d66d8830 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x14e4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb726 expref: 60 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.506413:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14e4:0x0].0x0 (ffff88012dcc3800) 00010000:00010000:3.0:1715330290.506419:0:9622:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330290.506457:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e400/0xd895711d66d8bb7 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330290.506464:0:9622:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e400/0xd895711d66d8bb7 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330290.506481:0:9622:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e400/0xd895711d66d8bb7 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 9622 initiator: MDT0 00000100:00100000:3.0:1715330290.506498:0:9622:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc7bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9622:1798653942467200:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1715330290.506526:0:9622:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330290.506540:0:9622:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffc540 going to sleep for 11 seconds 00000100:00100000:3.0:1715330290.506549:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942467200 00000100:00100000:3.0:1715330290.506551:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942467200 00000100:00100000:3.0:1715330290.506569:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2797 00000100:00100000:3.0:1715330290.506573:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:9622:x1798653942467200:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1715330290.506582:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330290.506593:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c6c0/0xd895711d66d8bbe lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d8bb7 expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.506609:0:9407:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c6c0/0xd895711d66d8bbe lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d8bb7 expref: 14 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.506617:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c6c0/0xd895711d66d8bbe lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8bb7 expref: 14 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.506622:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88009ef57100) 00010000:00010000:3.0:1715330290.506625:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330290.506626:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013457c6c0, rc 0) 00000100:00100000:3.0:1715330290.506644:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:9622:x1798653942467200:12345-0@lo:101:mdt00_003.0 Request processed in 70us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330290.506648:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2797 00000100:00100000:3.0:1715330290.506678:0:9622:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc7bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9622:1798653942467200:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1715330290.506686:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e400/0xd895711d66d8bb7 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8bbe expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.506697:0:9622:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e400/0xd895711d66d8bb7 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8bbe expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330290.506711:0:9622:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:3.0:1715330290.506723:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c000/0xd895711d66d8bc5 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x5d4526ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330290.506728:0:9622:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c000/0xd895711d66d8bc5 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x5d4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330290.506751:0:9622:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c000/0xd895711d66d8bc5 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x5d4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 9622 initiator: MDT0 00000100:00100000:3.0:1715330290.506759:0:9622:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc7bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9622:1798653942467264:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1715330290.506774:0:9622:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330290.506782:0:9622:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffc540 going to sleep for 11 seconds 00000100:00100000:3.0:1715330290.506792:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942467264 00000100:00100000:3.0:1715330290.506794:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942467264 00000100:00100000:3.0:1715330290.506808:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2798 00000100:00100000:3.0:1715330290.506811:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:9622:x1798653942467264:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1715330290.506817:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330290.506824:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013457df80/0xd895711d66d8bcc lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x5d4526ef bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d8bc5 expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.506834:0:9407:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457df80/0xd895711d66d8bcc lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x5d4526ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d8bc5 expref: 15 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.506841:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457df80/0xd895711d66d8bcc lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x5d4526ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8bc5 expref: 15 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.506849:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x5d4526ef (ffff88011d537100) 00010000:00010000:3.0:1715330290.506851:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330290.506853:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013457df80, rc 0) 00000100:00100000:3.0:1715330290.506868:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:9622:x1798653942467264:12345-0@lo:101:mdt00_003.0 Request processed in 56us (93us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330290.506872:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2798 00000100:00100000:3.0:1715330290.506888:0:9622:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc7bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9622:1798653942467264:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1715330290.506894:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c000/0xd895711d66d8bc5 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x5d4526ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8bcc expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.506899:0:9622:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c000/0xd895711d66d8bc5 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x5d4526ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8bcc expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330290.506906:0:9622:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:3.0:1715330290.506925:0:9622:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc7bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9622:1798653942467328:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1715330290.506942:0:9622:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330290.506950:0:9622:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffcf00 going to sleep for 11 seconds 00000100:00100000:3.0:1715330290.506957:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942467328 00000100:00100000:3.0:1715330290.506959:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942467328 00000100:00100000:3.0:1715330290.506972:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2799 00000100:00100000:3.0:1715330290.506975:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:9622:x1798653942467328:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1715330290.507019:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:9622:x1798653942467328:12345-0@lo:1000:mdt00_003.0 Request processed in 43us (76us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330290.507024:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2799 00000100:00100000:3.0:1715330290.507042:0:9622:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc7bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9622:1798653942467328:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1715330290.507070:0:9622:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc7bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9622:1798653942467392:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1715330290.507084:0:9622:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330290.507089:0:9622:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4333b40 going to sleep for 11 seconds 00000100:00100000:3.0:1715330290.507096:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942467392 00000100:00100000:3.0:1715330290.507098:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942467392 00000100:00100000:3.0:1715330290.507108:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2800 00000100:00100000:3.0:1715330290.507111:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:9622:x1798653942467392:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1715330290.507164:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:9622:x1798653942467392:12345-0@lo:1000:mdt00_003.0 Request processed in 52us (79us total) trans 0 rc 1/1 00000100:00100000:3.0:1715330290.507169:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2800 00000100:00100000:3.0:1715330290.507187:0:9622:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc7bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9622:1798653942467392:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1715330290.507210:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f600/0xd895711d66d8bd3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14e4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330290.507215:0:9622:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f600/0xd895711d66d8bd3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14e4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330290.507220:0:9622:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f600/0xd895711d66d8bd3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14e4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 9622 initiator: MDT0 00000100:00100000:3.0:1715330290.507228:0:9622:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc7bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9622:1798653942467456:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1715330290.507244:0:9622:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330290.507252:0:9622:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4333900 going to sleep for 11 seconds 00000100:00100000:3.0:1715330290.507260:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942467456 00000100:00100000:3.0:1715330290.507262:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942467456 00000100:00100000:3.0:1715330290.507275:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2801 00000100:00100000:3.0:1715330290.507279:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:9622:x1798653942467456:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1715330290.507285:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330290.507293:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013457cd80/0xd895711d66d8bda lrc: 2/0,0 mode: --/EX res: [0x200000402:0x14e4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d8bd3 expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.507305:0:9407:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457cd80/0xd895711d66d8bda lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14e4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d8bd3 expref: 16 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.507311:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457cd80/0xd895711d66d8bda lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14e4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8bd3 expref: 16 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.507316:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14e4:0x0].0x0 (ffff88011d537300) 00010000:00010000:3.0:1715330290.507318:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1715330290.507320:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013457cd80, rc 0) 00000100:00100000:3.0:1715330290.507337:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:9622:x1798653942467456:12345-0@lo:101:mdt00_003.0 Request processed in 57us (92us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330290.507341:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2801 00000100:00100000:3.0:1715330290.507358:0:9622:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc7bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9622:1798653942467456:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1715330290.507365:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f600/0xd895711d66d8bd3 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x14e4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8bda expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.507371:0:9622:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f600/0xd895711d66d8bd3 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x14e4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8bda expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.507384:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ed00/0xd895711d66d8be1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14e4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330290.507389:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ed00/0xd895711d66d8be1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14e4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330290.507395:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ed00/0xd895711d66d8be1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14e4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330290.507410:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d8be8 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xb0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330290.507418:0:9622:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d883e lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xb0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb72d expref: 59 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.507424:0:9622:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d8be8 lrc: 4/0,1 mode: --/EX res: [0x200000400:0xb0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330290.507438:0:9622:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d883e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xb0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb72d expref: 59 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.507448:0:9622:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d883e lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xb0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb72d expref: 59 pid: 9622 timeout: 364 lvb_type: 0 00000100:00100000:3.0:1715330290.507457:0:9622:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc7bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9622:1798653942467520:192.168.204.49@tcp:104: 00000100:00100000:3.0:1715330290.507490:0:9622:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4333900 going to sleep for 11 seconds 00000100:00100000:3.0:1715330290.509526:0:9622:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc7bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9622:1798653942467520:192.168.204.49@tcp:104: 00010000:00010000:3.0:1715330290.509546:0:9622:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d8be8 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xb0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00000100:00100000:0.0:1715330290.510013:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330290.510992:0:10673:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938039936 00000100:00100000:2.0:1715330290.510999:0:10673:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938039936 00010000:00010000:2.0:1715330290.511024:0:10673:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d883e lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xb0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb72d expref: 60 pid: 9622 timeout: 364 lvb_type: 0 00000100:00100000:2.0:1715330290.511046:0:10673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1533 00000100:00100000:2.0:1715330290.511052:0:10673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f579180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:72de1896-1df4-4b3a-930a-9116d2c66168+60:2012:x1798653938039936:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1715330290.511063:0:10673:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330290.511068:0:10673:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d883e lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xb0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb72d expref: 60 pid: 9622 timeout: 364 lvb_type: 0 00010000:00010000:2.0:1715330290.511077:0:10673:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d883e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xb0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb72d expref: 60 pid: 9622 timeout: 364 lvb_type: 0 00010000:00010000:2.0:1715330290.511095:0:10673:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66d883e lrc: 0/0,0 mode: --/PR res: [0x200000400:0xb0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb72d expref: 60 pid: 9622 timeout: 364 lvb_type: 0 00010000:00010000:2.0:1715330290.511106:0:10673:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xb0:0x0].0x0 (ffff88008b122500) 00010000:00010000:2.0:1715330290.511110:0:10673:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d8be8 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xb0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.511118:0:10673:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d8be8 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xb0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.511123:0:10673:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d8be8 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xb0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.511150:0:10673:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330290.511193:0:10673:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f579180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:72de1896-1df4-4b3a-930a-9116d2c66168+59:2012:x1798653938039936:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 139us (1181us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330290.511199:0:10673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1533 00010000:00010000:3.0:1715330290.511358:0:9622:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d8be8 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xb0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330290.511365:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d8be8 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xb0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330290.511403:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f180/0xd895711d66d8bef lrc: 3/0,1 mode: --/EX res: [0x240000401:0xb0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330290.511412:0:9622:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f180/0xd895711d66d8bef lrc: 3/0,1 mode: --/EX res: [0x240000401:0xb0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330290.511421:0:9622:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f180/0xd895711d66d8bef lrc: 3/0,1 mode: --/EX res: [0x240000401:0xb0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 9622 initiator: MDT0 00000100:00100000:3.0:1715330290.511435:0:9622:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc7bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9622:1798653942467584:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1715330290.511477:0:9622:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330290.511611:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942467584 00000100:00100000:3.0:1715330290.511613:0:9622:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4333900 going to sleep for 11 seconds 00000100:00100000:0.0:1715330290.511614:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942467584 00000100:00100000:0.0:1715330290.511632:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2802 00000100:00100000:0.0:1715330290.511637:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:9622:x1798653942467584:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1715330290.511650:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330290.511661:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a33c0/0xd895711d66d8bf6 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xb0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d8bef expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.511676:0:23404:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457d680/0xd895711d66d884c lrc: 2/0,0 mode: PR/PR res: [0x240000401:0xb0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb734 expref: 26 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.511683:0:23404:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a33c0/0xd895711d66d8bf6 lrc: 4/0,0 mode: --/EX res: [0x240000401:0xb0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d8bef expref: 17 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.511699:0:23404:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88013457d680/0xd895711d66d884c lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xb0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb734 expref: 26 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.511709:0:23404:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457d680/0xd895711d66d884c lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xb0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb734 expref: 26 pid: 7135 timeout: 364 lvb_type: 0 00000100:00100000:0.0:1715330290.511718:0:23404:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f579500 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:23404:1798653942467648:192.168.204.49@tcp:104: 00000100:00100000:0.0:1715330290.511991:0:23404:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffab40 going to sleep for 11 seconds 00000100:00100000:2.0:1715330290.514291:0:23404:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f579500 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:23404:1798653942467648:192.168.204.49@tcp:104: 00010000:00010000:2.0:1715330290.514315:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a33c0/0xd895711d66d8bf6 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xb0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8bef expref: 17 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.514325:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xb0:0x0].0x0 (ffff88012dcc3300) 00010000:00010000:2.0:1715330290.514328:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330290.514331:0:23404:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a33c0/0xd895711d66d8bf6 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xb0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8bef expref: 17 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.514338:0:23404:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a33c0/0xd895711d66d8bf6 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xb0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8bef expref: 17 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.514343:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a33c0, rc 0) 00000100:00100000:2.0:1715330290.514647:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:9622:x1798653942467584:12345-0@lo:101:mdt00_003.0 Request processed in 3009us (3177us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330290.514658:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2802 00000100:00100000:3.0:1715330290.514724:0:9622:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc7bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9622:1798653942467584:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1715330290.514768:0:9622:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f180/0xd895711d66d8bef lrc: 4/0,1 mode: --/EX res: [0x240000401:0xb0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8bf6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.514777:0:9622:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f180/0xd895711d66d8bef lrc: 4/0,1 mode: --/EX res: [0x240000401:0xb0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8bf6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330290.515282:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330290.515315:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938040000 00000100:00100000:0.0:1715330290.515320:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938040000 00010000:00010000:0.0:1715330290.515338:0:7121:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013457d680/0xd895711d66d884c lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xb0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb734 expref: 27 pid: 7135 timeout: 364 lvb_type: 0 00000100:00100000:0.0:1715330290.515393:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1534 00000100:00100000:0.0:1715330290.515399:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d645180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+27:2012:x1798653938040000:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1715330290.515409:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330290.515414:0:7121:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88013457d680/0xd895711d66d884c lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xb0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb734 expref: 27 pid: 7135 timeout: 364 lvb_type: 0 00010000:00010000:0.0:1715330290.515422:0:7121:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88013457d680/0xd895711d66d884c lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xb0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb734 expref: 27 pid: 7135 timeout: 364 lvb_type: 0 00010000:00010000:0.0:1715330290.515438:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457d680/0xd895711d66d884c lrc: 0/0,0 mode: --/PR res: [0x240000401:0xb0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb734 expref: 27 pid: 7135 timeout: 364 lvb_type: 0 00010000:00010000:0.0:1715330290.515607:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xb0:0x0].0x0 (ffff88012dcc3300) 00010000:00010000:0.0:1715330290.515612:0:7121:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a33c0/0xd895711d66d8bf6 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xb0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8bef expref: 16 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.515620:0:7121:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a33c0/0xd895711d66d8bf6 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xb0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d8bef expref: 16 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.515627:0:7121:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a33c0/0xd895711d66d8bf6 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xb0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d8bef expref: 16 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.515650:0:7121:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a33c0/0xd895711d66d8bf6 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xb0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8bef expref: 16 pid: 23404 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330290.515660:0:7121:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f57b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:7121:1798653942467712:0@lo:105: 00000100:00100000:0.0:1715330290.515688:0:7121:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330290.515709:0:7121:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffae40 going to sleep for 11 seconds 00000100:00100000:2.0:1715330290.515753:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942467712 00000100:00100000:2.0:1715330290.515756:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942467712 00000100:00100000:2.0:1715330290.515781:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1162 00000100:00100000:2.0:1715330290.515785:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f578700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7121:x1798653942467712:12345-0@lo:105: 00010000:00010000:2.0:1715330290.515791:0:7118:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f180/0xd895711d66d8bef lrc: 5/0,1 mode: --/EX res: [0x240000401:0xb0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8bf6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.515798:0:7118:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f180/0xd895711d66d8bef lrc: 5/0,1 mode: --/EX res: [0x240000401:0xb0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8bf6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.515804:0:7118:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f180/0xd895711d66d8bef lrc: 5/0,1 mode: --/EX res: [0x240000401:0xb0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8bf6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.515810:0:7118:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f180/0xd895711d66d8bef lrc: 5/0,1 mode: EX/EX res: [0x240000401:0xb0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d8bf6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.515815:0:7118:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f180/0xd895711d66d8bef lrc: 6/0,1 mode: EX/EX res: [0x240000401:0xb0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d8bf6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.515830:0:7118:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f180/0xd895711d66d8bef lrc: 6/0,1 mode: EX/EX res: [0x240000401:0xb0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d8bf6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.515848:0:7118:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88013457f180) 00010000:00010000:3.0:1715330290.515908:0:9622:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f180/0xd895711d66d8bef lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xb0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8bf6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.515914:0:9622:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f180/0xd895711d66d8bef lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xb0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8bf6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330290.516242:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f578700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7121:x1798653942467712:12345-0@lo:105: Request processed in 455us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330290.516248:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1162 00000100:00100000:0.0:1715330290.516310:0:7121:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f57b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:7121:1798653942467712:0@lo:105: 00010000:00010000:0.0:1715330290.516319:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330290.516357:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d645180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+26:2012:x1798653938040000:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 957us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330290.516362:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1534 00000100:00100000:3.0:1715330290.516487:0:9622:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4eaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9622:1798653942467776:0@lo:403:mdt00_003.0 00000100:00100000:3.0:1715330290.516517:0:9622:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330290.516538:0:9622:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4333900 going to sleep for 11 seconds 00000100:00100000:2.0:1715330290.516582:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942467776 00000100:00100000:2.0:1715330290.516585:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942467776 00000100:00100000:2.0:1715330290.516603:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2803 00000100:00100000:2.0:1715330290.516607:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:9622:x1798653942467776:12345-0@lo:403:mdt00_003.0 00000100:00100000:2.0:1715330290.521048:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:9622:x1798653942467776:12345-0@lo:403:mdt00_003.0 Request processed in 4434us (4524us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330290.521062:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2803 00000100:00100000:3.0:1715330290.521153:0:9622:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4eaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9622:1798653942467776:0@lo:403:mdt00_003.0 00000040:00080000:3.0:1715330290.522153:0:9622:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].365, 952 off555776 00000040:00080000:3.0:1715330290.522281:0:9622:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].365, 1032 off599128 00000004:00080000:3.0:1715330290.522286:0:9622:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8800b4333900 with version 692 00000004:00080000:1.0:1715330290.522411:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 692 rpc_version 692 00000020:00100000:1.0:1715330290.522435:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1715330290.522442:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88009d645f80 x1798653942467904/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 2352/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1715330290.522460:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d645f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942467904:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330290.522508:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330290.522533:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1715330290.522552:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942467904 00000100:00100000:2.0:1715330290.522557:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942467904 00000100:00100000:2.0:1715330290.522595:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2804 00000100:00100000:2.0:1715330290.522600:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d647b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:8587:x1798653942467904:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1715330290.522980:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d647b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+18:8587:x1798653942467904:12345-0@lo:1000:osp_up1-0.0 Request processed in 378us (470us total) trans 4294968402 rc 0/0 00000100:00100000:2.0:1715330290.522987:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2804 00000100:00100000:1.0:1715330290.523271:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d645f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942467904:0@lo:1000:osp_up1-0.0 00000004:00200000:3.0:1715330290.523316:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x14e4:0x0]: returning size 4096 00010000:00010000:3.0:1715330290.523335:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d8be8 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xb0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330290.523342:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d8be8 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0xb0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330290.523348:0:9622:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d8be8 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xb0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330290.523352:0:9622:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457e880 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330290.523356:0:9622:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d8be8 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xb0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330290.523361:0:9622:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d8be8 lrc: 4/0,0 mode: EX/EX res: [0x200000400:0xb0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330290.523373:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xb0:0x0].0x0 (ffff88008b122500) 00010000:00010000:3.0:1715330290.523376:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330290.523379:0:9622:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d8be8 lrc: 2/0,0 mode: --/EX res: [0x200000400:0xb0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330290.523384:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d8be8 lrc: 0/0,0 mode: --/EX res: [0x200000400:0xb0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330290.523399:0:9622:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f180/0xd895711d66d8bef lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xb0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8bf6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.523405:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f180/0xd895711d66d8bef lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xb0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8bf6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.523448:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f180/0xd895711d66d8bef lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xb0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8bf6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.523532:0:9622:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1715330290.523538:0:9622:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0xb0:0x0] 00010000:00010000:3.0:1715330290.523548:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ed00/0xd895711d66d8be1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14e4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330290.523553:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ed00/0xd895711d66d8be1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x14e4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330290.523557:0:9622:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ed00/0xd895711d66d8be1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14e4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330290.523561:0:9622:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457ed00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330290.523564:0:9622:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ed00/0xd895711d66d8be1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14e4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330290.523568:0:9622:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ed00/0xd895711d66d8be1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x14e4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330290.523575:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14e4:0x0].0x0 (ffff88011d537200) 00010000:00010000:3.0:1715330290.523576:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330290.523578:0:9622:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ed00/0xd895711d66d8be1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x14e4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330290.523582:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ed00/0xd895711d66d8be1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x14e4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330290.523592:0:9622:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f600/0xd895711d66d8bd3 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x14e4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8bda expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.523597:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f600/0xd895711d66d8bd3 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x14e4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8bda expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.523606:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f600/0xd895711d66d8bd3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14e4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8bda expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.523623:0:9622:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1715330290.523643:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1715330290.523648:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f180/0xd895711d66d8bef lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xb0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d8bf6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.523654:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457f180 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:2.0:1715330290.523658:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f180/0xd895711d66d8bef lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xb0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d8bf6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1715330290.523664:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f180/0xd895711d66d8bef lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xb0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d8bf6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.523684:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f180/0xd895711d66d8bef lrc: 2/0,0 mode: --/EX res: [0x240000401:0xb0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8bf6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.523690:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1715330290.523715:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942467968:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715330290.523718:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f180/0xd895711d66d8bef lrc: 1/0,0 mode: --/EX res: [0x240000401:0xb0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8bf6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.523723:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f180/0xd895711d66d8bef lrc: 0/0,0 mode: --/EX res: [0x240000401:0xb0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8bf6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.523752:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1715330290.523753:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1715330290.523755:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f600/0xd895711d66d8bd3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x14e4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d8bda expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.523759:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457f600 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:2.0:1715330290.523762:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f600/0xd895711d66d8bd3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14e4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d8bda expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1715330290.523767:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f600/0xd895711d66d8bd3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14e4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d8bda expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.523780:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f600/0xd895711d66d8bd3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x14e4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8bda expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.523784:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1715330290.523789:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f600/0xd895711d66d8bd3 lrc: 1/0,0 mode: --/EX res: [0x200000402:0x14e4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8bda expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.523794:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f600/0xd895711d66d8bd3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x14e4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8bda expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.523797:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330290.523802:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330290.523803:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330290.523805:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330290.523848:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942468032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330290.524200:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1715330290.524226:0:9622:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:3.0:1715330290.524235:0:9622:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e400/0xd895711d66d8bb7 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8bbe expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.524240:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e400/0xd895711d66d8bb7 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8bbe expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.524246:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e400/0xd895711d66d8bb7 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8bbe expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.524255:0:9622:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1715330290.524258:0:9622:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:3.0:1715330290.524294:0:9415:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1715330290.524298:0:9415:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e400/0xd895711d66d8bb7 lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d8bbe expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.524303:0:9415:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457e400 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:3.0:1715330290.524305:0:9415:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e400/0xd895711d66d8bb7 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d8bbe expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1715330290.524310:0:9415:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e400/0xd895711d66d8bb7 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d8bbe expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.524328:0:9415:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e400/0xd895711d66d8bb7 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8bbe expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.524332:0:9415:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1715330290.524341:0:9415:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e400/0xd895711d66d8bb7 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8bbe expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.524347:0:9415:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e400/0xd895711d66d8bb7 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8bbe expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330290.524350:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942468096:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1715330290.524356:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715330290.524357:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715330290.524359:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330290.524366:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1715330290.524367:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c000/0xd895711d66d8bc5 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x5d4526ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8bcc expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.524373:0:9622:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c000/0xd895711d66d8bc5 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x5d4526ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8bcc expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330290.524570:0:10673:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942467968 00000100:00100000:2.0:1715330290.524575:0:10673:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942467968 00000100:00100000:3.0:1715330290.524583:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d646a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+59:16983:x1798653938039872:12345-192.168.204.49@tcp:36:rm.0 Request processed in 18230us (19230us total) trans 4294983481 rc 0/0 00000100:00100000:3.0:1715330290.524589:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23449 00000100:00100000:2.0:1715330290.524595:0:10673:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942468032 00000100:00100000:2.0:1715330290.524597:0:10673:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942468032 00000100:00100000:2.0:1715330290.524611:0:10673:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942468096 00000100:00100000:2.0:1715330290.524613:0:10673:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942468096 00000100:00100000:2.0:1715330290.524624:0:10673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1324 00000100:00100000:2.0:1715330290.524628:0:10673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+20:3688:x1798653942467968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715330290.524636:0:10673:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1715330290.524636:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1325 00000100:00100000:0.0:1715330290.524640:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d645500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+20:3689:x1798653942468032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330290.524645:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330290.524650:0:10673:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a33c0/0xd895711d66d8bf6 lrc: 0/0,0 mode: --/EX res: [0x240000401:0xb0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d8bef expref: 20 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.524652:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457cd80/0xd895711d66d8bda lrc: 0/0,0 mode: --/EX res: [0x200000402:0x14e4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d8bd3 expref: 20 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.524659:0:10673:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xb0:0x0].0x0 (ffff88012dcc3300) 00010000:00010000:0.0:1715330290.524662:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14e4:0x0].0x0 (ffff88011d537300) 00010000:00010000:2.0:1715330290.524666:0:10673:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715330290.524666:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330290.524686:0:10673:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+18:3688:x1798653942467968:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330290.524686:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d645500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+18:3689:x1798653942468032:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330290.524690:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1325 00000100:00100000:2.0:1715330290.524692:0:10673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1324 00000100:00100000:2.0:1715330290.524700:0:10673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1326 00000100:00100000:2.0:1715330290.524703:0:10673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d646300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+16:3690:x1798653942468096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715330290.524708:0:10673:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330290.524715:0:10673:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c6c0/0xd895711d66d8bbe lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d8bb7 expref: 16 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.524722:0:10673:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88009ef57100) 00010000:00010000:2.0:1715330290.524727:0:10673:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330290.524759:0:10673:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d646300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+15:3690:x1798653942468096:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330290.524763:0:10673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1326 00000100:00100000:1.0:1715330290.524830:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942468096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1715330290.524844:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942467968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330290.524845:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942468032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330290.528671:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330290.528785:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938040128 00000100:00100000:3.0:1715330290.528793:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938040128 00000100:00100000:3.0:1715330290.528842:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23450 00000100:00100000:3.0:1715330290.528849:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+59:16983:x1798653938040128:12345-192.168.204.49@tcp:101:rm.0 00010000:00010000:3.0:1715330290.528872:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330290.528887:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457dd40/0xd895711d66d8bfd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x14f8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb7f8 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715330290.529027:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x14f8:0x0]: returning size 4096 00010000:00010000:3.0:1715330290.529097:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457dd40/0xd895711d66d8bfd lrc: 1/0,0 mode: --/CR res: [0x200000402:0x14f8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb7f8 expref: 61 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.529104:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457dd40/0xd895711d66d8bfd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x14f8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb7f8 expref: 61 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.529114:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013457dd40, rc 0) 00000100:00100000:3.0:1715330290.529160:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+60:16983:x1798653938040128:12345-192.168.204.49@tcp:101:rm.0 Request processed in 311us (496us total) trans 4294983482 rc 301/301 00000100:00100000:3.0:1715330290.529165:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23450 00000100:00100000:0.0:1715330290.532566:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330290.533374:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938040256 00000100:00100000:3.0:1715330290.533383:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938040256 00000100:00100000:2.0:1715330290.533941:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5056 00000100:00100000:2.0:1715330290.533949:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+60:16983:x1798653938040256:12345-192.168.204.49@tcp:35:rm.0 00000100:00100000:2.0:1715330290.534122:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+61:16983:x1798653938040256:12345-192.168.204.49@tcp:35:rm.0 Request processed in 174us (1564us total) trans 4294983483 rc 0/0 00000100:00100000:2.0:1715330290.534127:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5056 00000100:00100000:1.0:1715330290.540853:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330290.540911:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330290.541035:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938040448 00000100:00100000:2.0:1715330290.541043:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938040448 00000100:00100000:2.0:1715330290.541087:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23451 00000100:00100000:2.0:1715330290.541093:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d644700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+61:16983:x1798653938040448:12345-192.168.204.49@tcp:36:rm.0 00010000:00010000:2.0:1715330290.541141:0:7135:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330290.541174:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66d8884 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x14f8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb749 expref: 61 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330290.541175:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938040320 00000100:00100000:3.0:1715330290.541180:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938040320 00010000:00010000:2.0:1715330290.541187:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14f8:0x0].0x0 (ffff88008b122c00) 00010000:00010000:2.0:1715330290.541195:0:7135:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715330290.541206:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1327 00000100:00100000:3.0:1715330290.541211:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d644e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72de1896-1df4-4b3a-930a-9116d2c66168+26:2012:x1798653938040320:12345-192.168.204.49@tcp:103:rm.0 00010000:00010000:3.0:1715330290.541219:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330290.541230:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66640/0xd895711d66d8c0b lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.541232:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f3c0/0xd895711d66d8868 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x14f8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb73b expref: 26 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.541236:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66640/0xd895711d66d8c0b lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.541245:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14f8:0x0].0x0 (ffff88012dcc3c00) 00010000:00010000:2.0:1715330290.541246:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66640/0xd895711d66d8c0b lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.541251:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330290.541262:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942468160:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1715330290.541285:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d644e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72de1896-1df4-4b3a-930a-9116d2c66168+25:2012:x1798653938040320:12345-192.168.204.49@tcp:103:rm.0 Request processed in 73us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330290.541292:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1327 00000100:00100000:2.0:1715330290.541292:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330290.541305:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435300 going to sleep for 11 seconds 00000100:00100000:3.0:1715330290.541320:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942468160 00000100:00100000:3.0:1715330290.541323:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942468160 00000100:00100000:3.0:1715330290.541338:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2805 00000100:00100000:3.0:1715330290.541342:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:7135:x1798653942468160:12345-0@lo:101:mdt00_002.0 00010000:00010000:3.0:1715330290.541352:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330290.541361:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013457dd40/0xd895711d66d8c12 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d8c0b expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.541378:0:23404:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457dd40/0xd895711d66d8c12 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d8c0b expref: 16 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.541387:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457dd40/0xd895711d66d8c12 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8c0b expref: 16 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.541392:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88008b122d00) 00010000:00010000:3.0:1715330290.541395:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330290.541397:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013457dd40, rc 0) 00000100:00100000:3.0:1715330290.541421:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:7135:x1798653942468160:12345-0@lo:101:mdt00_002.0 Request processed in 78us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330290.541425:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2805 00000100:00100000:2.0:1715330290.541801:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942468160:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1715330290.541812:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66640/0xd895711d66d8c0b lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8c12 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.541820:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66640/0xd895711d66d8c0b lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8c12 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715330290.541833:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:2.0:1715330290.541845:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67cc0/0xd895711d66d8c19 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x6f4526ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330290.541850:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67cc0/0xd895711d66d8c19 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x6f4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330290.541854:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67cc0/0xd895711d66d8c19 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x6f4526ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT0 00000100:00100000:2.0:1715330290.541863:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942468224:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1715330290.541879:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330290.541897:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435300 going to sleep for 11 seconds 00000100:00100000:0.0:1715330290.541983:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942468224 00000100:00100000:0.0:1715330290.541987:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942468224 00000100:00100000:0.0:1715330290.542013:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2806 00000100:00100000:0.0:1715330290.542018:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:7135:x1798653942468224:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330290.542025:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330290.542033:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a06c0/0xd895711d66d8c20 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x6f4526ef bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d8c19 expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.542044:0:9407:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a06c0/0xd895711d66d8c20 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d8c19 expref: 17 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.542056:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a06c0/0xd895711d66d8c20 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8c19 expref: 17 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.542062:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x6f4526ef (ffff88009bbb0700) 00010000:00010000:0.0:1715330290.542064:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330290.542066:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a06c0, rc 0) 00000100:00100000:0.0:1715330290.542097:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:7135:x1798653942468224:12345-0@lo:101:mdt00_002.0 Request processed in 78us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330290.542102:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2806 00000100:00100000:2.0:1715330290.542150:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942468224:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1715330290.542158:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67cc0/0xd895711d66d8c19 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8c20 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.542169:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67cc0/0xd895711d66d8c19 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8c20 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715330290.542177:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:2.0:1715330290.542197:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942468288:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1715330290.542217:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330290.542234:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435000 going to sleep for 11 seconds 00000100:00100000:3.0:1715330290.542314:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942468288 00000100:00100000:3.0:1715330290.542318:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942468288 00000100:00100000:3.0:1715330290.542486:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2807 00000100:00100000:3.0:1715330290.542490:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:7135:x1798653942468288:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1715330290.542543:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:7135:x1798653942468288:12345-0@lo:1000:mdt00_002.0 Request processed in 52us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330290.542548:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2807 00000100:00100000:2.0:1715330290.542562:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942468288:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1715330290.542583:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942468352:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1715330290.542595:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330290.542601:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435000 going to sleep for 11 seconds 00000100:00100000:0.0:1715330290.542607:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942468352 00000100:00100000:0.0:1715330290.542610:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942468352 00000100:00100000:0.0:1715330290.542621:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2808 00000100:00100000:0.0:1715330290.542625:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:7135:x1798653942468352:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1715330290.543084:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:7135:x1798653942468352:12345-0@lo:1000:mdt00_002.0 Request processed in 456us (485us total) trans 0 rc 1/1 00000100:00100000:0.0:1715330290.543089:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2808 00000100:00100000:2.0:1715330290.543139:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942468352:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1715330290.543170:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67180/0xd895711d66d8c27 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14f8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330290.543175:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67180/0xd895711d66d8c27 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14f8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330290.543181:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67180/0xd895711d66d8c27 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14f8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT0 00000100:00100000:2.0:1715330290.543189:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942468416:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1715330290.543207:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330290.543227:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435300 going to sleep for 11 seconds 00000100:00100000:0.0:1715330290.543244:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942468416 00000100:00100000:0.0:1715330290.543247:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942468416 00000100:00100000:0.0:1715330290.543268:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2809 00000100:00100000:0.0:1715330290.543271:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:7135:x1798653942468416:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330290.543278:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330290.543329:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a2400/0xd895711d66d8c2e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x14f8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d8c27 expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.543344:0:9407:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a2400/0xd895711d66d8c2e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14f8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d8c27 expref: 18 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.543356:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a2400/0xd895711d66d8c2e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14f8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8c27 expref: 18 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.543361:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14f8:0x0].0x0 (ffff88009bbb0300) 00010000:00010000:0.0:1715330290.543363:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1715330290.543365:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a2400, rc 0) 00000100:00100000:0.0:1715330290.543441:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+18:7135:x1798653942468416:12345-0@lo:101:mdt00_002.0 Request processed in 167us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330290.543445:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2809 00000100:00100000:2.0:1715330290.543510:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942468416:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1715330290.543518:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67180/0xd895711d66d8c27 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x14f8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8c2e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.543529:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67180/0xd895711d66d8c27 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x14f8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8c2e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.543544:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d8c35 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14f8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330290.543550:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d8c35 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14f8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330290.543556:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d8c35 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14f8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330290.543569:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d8c3c lrc: 3/0,1 mode: --/EX res: [0x200000400:0xba:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330290.543577:0:7135:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d8892 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xba:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb750 expref: 60 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.543583:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d8c3c lrc: 4/0,1 mode: --/EX res: [0x200000400:0xba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330290.543598:0:7135:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d8892 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xba:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb750 expref: 60 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.543608:0:7135:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d8892 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xba:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb750 expref: 60 pid: 7135 timeout: 365 lvb_type: 0 00000100:00100000:2.0:1715330290.543617:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7135:1798653942468480:192.168.204.49@tcp:104: 00000100:00100000:2.0:1715330290.543937:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435300 going to sleep for 11 seconds 00000100:00100000:2.0:1715330290.549411:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7135:1798653942468480:192.168.204.49@tcp:104: 00010000:00010000:2.0:1715330290.549435:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d8c3c lrc: 3/0,1 mode: --/EX res: [0x200000400:0xba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000100:00100000:0.0:1715330290.550290:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330290.550477:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938040512 00000100:00100000:1.0:1715330290.550484:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938040512 00010000:00010000:1.0:1715330290.550507:0:7120:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d8892 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xba:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb750 expref: 61 pid: 7135 timeout: 365 lvb_type: 0 00000100:00100000:1.0:1715330290.550541:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1535 00000100:00100000:1.0:1715330290.550547:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72de1896-1df4-4b3a-930a-9116d2c66168+61:2011:x1798653938040512:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1715330290.550558:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330290.550563:0:7120:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d8892 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xba:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb750 expref: 61 pid: 7135 timeout: 365 lvb_type: 0 00010000:00010000:1.0:1715330290.550571:0:7120:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d8892 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xba:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb750 expref: 61 pid: 7135 timeout: 365 lvb_type: 0 00010000:00010000:1.0:1715330290.550589:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d8892 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xba:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb750 expref: 61 pid: 7135 timeout: 365 lvb_type: 0 00010000:00010000:1.0:1715330290.550614:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xba:0x0].0x0 (ffff88009396da00) 00010000:00010000:1.0:1715330290.550618:0:7120:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d8c3c lrc: 3/0,1 mode: --/EX res: [0x200000400:0xba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.550626:0:7120:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d8c3c lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.550632:0:7120:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d8c3c lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.550721:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330290.550781:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72de1896-1df4-4b3a-930a-9116d2c66168+60:2011:x1798653938040512:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 232us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330290.550788:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1535 00010000:00010000:2.0:1715330290.550907:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d8c3c lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330290.550913:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d8c3c lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330290.550945:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67840/0xd895711d66d8c43 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xba:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330290.550950:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67840/0xd895711d66d8c43 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330290.550958:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67840/0xd895711d66d8c43 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT0 00000100:00100000:2.0:1715330290.550972:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942468544:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1715330290.550999:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330290.551571:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435300 going to sleep for 11 seconds 00000100:00100000:0.0:1715330290.551613:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942468544 00000100:00100000:0.0:1715330290.551617:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942468544 00000100:00100000:0.0:1715330290.552083:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2810 00000100:00100000:0.0:1715330290.552089:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+18:7135:x1798653942468544:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330290.552102:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330290.552115:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a0480/0xd895711d66d8c4a lrc: 2/0,0 mode: --/EX res: [0x240000401:0xba:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d8c43 expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.552132:0:9407:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d88a0 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0xba:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb757 expref: 24 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.552139:0:9407:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a0480/0xd895711d66d8c4a lrc: 4/0,0 mode: --/EX res: [0x240000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d8c43 expref: 19 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.552156:0:9407:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d88a0 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xba:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb757 expref: 24 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.552165:0:9407:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d88a0 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xba:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb757 expref: 24 pid: 7135 timeout: 365 lvb_type: 0 00000100:00100000:0.0:1715330290.552174:0:9407:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f57b800 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:9407:1798653942468608:192.168.204.49@tcp:104: 00000100:00100000:0.0:1715330290.552216:0:9407:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffae40 going to sleep for 11 seconds 00000100:00100000:2.0:1715330290.555226:0:9407:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f57b800 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:9407:1798653942468608:192.168.204.49@tcp:104: 00010000:00010000:2.0:1715330290.555250:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a0480/0xd895711d66d8c4a lrc: 3/0,0 mode: --/EX res: [0x240000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8c43 expref: 19 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.555259:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xba:0x0].0x0 (ffff88009396df00) 00010000:00010000:2.0:1715330290.555261:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330290.555265:0:9407:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a0480/0xd895711d66d8c4a lrc: 3/0,0 mode: --/EX res: [0x240000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8c43 expref: 19 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.555271:0:9407:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a0480/0xd895711d66d8c4a lrc: 3/0,0 mode: --/EX res: [0x240000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8c43 expref: 19 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.555277:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a0480, rc 0) 00000100:00100000:2.0:1715330290.555312:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:7135:x1798653942468544:12345-0@lo:101:mdt00_002.0 Request processed in 3223us (4312us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330290.555319:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2810 00000100:00100000:0.0:1715330290.557093:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942468544:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330290.557112:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67840/0xd895711d66d8c43 lrc: 4/0,1 mode: --/EX res: [0x240000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8c4a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.557122:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67840/0xd895711d66d8c43 lrc: 4/0,1 mode: --/EX res: [0x240000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8c4a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330290.557298:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330290.557485:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938040576 00000100:00100000:1.0:1715330290.557491:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938040576 00010000:00010000:1.0:1715330290.557512:0:7120:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d88a0 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xba:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb757 expref: 25 pid: 7135 timeout: 365 lvb_type: 0 00000100:00100000:1.0:1715330290.557545:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1536 00000100:00100000:1.0:1715330290.557551:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72de1896-1df4-4b3a-930a-9116d2c66168+25:2011:x1798653938040576:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1715330290.557561:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330290.557566:0:7120:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d88a0 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xba:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb757 expref: 25 pid: 7135 timeout: 365 lvb_type: 0 00010000:00010000:1.0:1715330290.557575:0:7120:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d88a0 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xba:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb757 expref: 25 pid: 7135 timeout: 365 lvb_type: 0 00010000:00010000:1.0:1715330290.557593:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d88a0 lrc: 0/0,0 mode: --/PR res: [0x240000401:0xba:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb757 expref: 25 pid: 7135 timeout: 365 lvb_type: 0 00010000:00010000:1.0:1715330290.557623:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xba:0x0].0x0 (ffff88009396df00) 00010000:00010000:1.0:1715330290.557628:0:7120:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a0480/0xd895711d66d8c4a lrc: 2/0,0 mode: --/EX res: [0x240000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8c43 expref: 18 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.557636:0:7120:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a0480/0xd895711d66d8c4a lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d8c43 expref: 18 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.557642:0:7120:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a0480/0xd895711d66d8c4a lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d8c43 expref: 18 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.558697:0:7120:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a0480/0xd895711d66d8c4a lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8c43 expref: 18 pid: 9407 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330290.558711:0:7120:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d645180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001_UUID:7120:1798653942468672:0@lo:105: 00000100:00100000:1.0:1715330290.558988:0:7120:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330290.559013:0:7120:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f240 going to sleep for 11 seconds 00000100:00100000:2.0:1715330290.559159:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942468672 00000100:00100000:2.0:1715330290.559164:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942468672 00000100:00100000:2.0:1715330290.559188:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1163 00000100:00100000:2.0:1715330290.559193:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d645500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7120:x1798653942468672:12345-0@lo:105: 00010000:00010000:2.0:1715330290.559200:0:7118:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67840/0xd895711d66d8c43 lrc: 5/0,1 mode: --/EX res: [0x240000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8c4a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.559207:0:7118:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67840/0xd895711d66d8c43 lrc: 5/0,1 mode: --/EX res: [0x240000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8c4a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.559214:0:7118:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67840/0xd895711d66d8c43 lrc: 5/0,1 mode: --/EX res: [0x240000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8c4a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.559219:0:7118:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67840/0xd895711d66d8c43 lrc: 5/0,1 mode: EX/EX res: [0x240000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d8c4a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.559225:0:7118:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67840/0xd895711d66d8c43 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d8c4a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.559232:0:7118:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67840/0xd895711d66d8c43 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d8c4a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.559254:0:7118:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88011db67840) 00000100:00100000:2.0:1715330290.559280:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d645500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7120:x1798653942468672:12345-0@lo:105: Request processed in 86us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330290.559285:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1163 00010000:00010000:0.0:1715330290.559348:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67840/0xd895711d66d8c43 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8c4a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330290.559352:0:7120:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d645180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001_UUID:7120:1798653942468672:0@lo:105: 00010000:00010000:0.0:1715330290.559356:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67840/0xd895711d66d8c43 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8c4a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.559363:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330290.559391:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72de1896-1df4-4b3a-930a-9116d2c66168+24:2011:x1798653938040576:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 1839us (2093us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330290.559397:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1536 00000100:00100000:0.0:1715330290.563150:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f57b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942468736:0@lo:403:mdt00_002.0 00000100:00100000:0.0:1715330290.563209:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330290.563244:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffae40 going to sleep for 11 seconds 00000100:00100000:2.0:1715330290.563628:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942468736 00000100:00100000:2.0:1715330290.563636:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942468736 00000100:00100000:2.0:1715330290.563682:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2811 00000100:00100000:2.0:1715330290.563688:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f579180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:7135:x1798653942468736:12345-0@lo:403:mdt00_002.0 00000100:00100000:2.0:1715330290.566631:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f579180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:7135:x1798653942468736:12345-0@lo:403:mdt00_002.0 Request processed in 2938us (3416us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330290.566642:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2811 00000100:00100000:0.0:1715330290.566791:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f57b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942468736:0@lo:403:mdt00_002.0 00000040:00080000:0.0:1715330290.567622:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].366, 952 off556728 00000040:00080000:0.0:1715330290.567760:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].366, 1032 off600160 00000004:00080000:0.0:1715330290.567765:0:7135:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880091ffae40 with version 693 00000004:00080000:1.0:1715330290.569011:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 693 rpc_version 693 00000020:00100000:1.0:1715330290.569582:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1715330290.569590:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88009d645180 x1798653942468864/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 2352/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1715330290.569609:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d645180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942468864:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330290.569659:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330290.569688:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f240 going to sleep for 11 seconds 00000100:00100000:2.0:1715330290.569755:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942468864 00000100:00100000:2.0:1715330290.569761:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942468864 00000100:00100000:2.0:1715330290.569799:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2812 00000100:00100000:2.0:1715330290.569805:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d646300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:8587:x1798653942468864:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1715330290.571761:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d646300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+20:8587:x1798653942468864:12345-0@lo:1000:osp_up1-0.0 Request processed in 1953us (2098us total) trans 4294968403 rc 0/0 00000100:00100000:2.0:1715330290.571768:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2812 00000100:00100000:1.0:1715330290.571999:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d645180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942468864:0@lo:1000:osp_up1-0.0 00000004:00200000:0.0:1715330290.572043:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x14f8:0x0]: returning size 4096 00010000:00010000:0.0:1715330290.572062:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d8c3c lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330290.572070:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d8c3c lrc: 2/0,0 mode: EX/EX res: [0x200000400:0xba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330290.572076:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d8c3c lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330290.572081:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db65b00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330290.572084:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d8c3c lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330290.572090:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d8c3c lrc: 4/0,0 mode: EX/EX res: [0x200000400:0xba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330290.572101:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xba:0x0].0x0 (ffff88009396da00) 00010000:00010000:0.0:1715330290.572104:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715330290.572107:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d8c3c lrc: 2/0,0 mode: --/EX res: [0x200000400:0xba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330290.572111:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d8c3c lrc: 0/0,0 mode: --/EX res: [0x200000400:0xba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330290.572128:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67840/0xd895711d66d8c43 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8c4a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.572134:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67840/0xd895711d66d8c43 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8c4a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.572138:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67840/0xd895711d66d8c43 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8c4a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.572185:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1715330290.572193:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0xba:0x0] 00010000:00010000:0.0:1715330290.572202:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d8c35 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14f8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330290.572210:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d8c35 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x14f8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330290.572214:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d8c35 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14f8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330290.572218:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db67a80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330290.572220:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d8c35 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14f8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330290.572224:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d8c35 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x14f8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330290.572231:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14f8:0x0].0x0 (ffff88009ef57100) 00010000:00010000:0.0:1715330290.572233:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330290.572235:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d8c35 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x14f8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330290.572239:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d8c35 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x14f8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330290.572250:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67180/0xd895711d66d8c27 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x14f8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8c2e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.572255:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67180/0xd895711d66d8c27 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x14f8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8c2e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.572260:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67180/0xd895711d66d8c27 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14f8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8c2e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.572399:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:0.0:1715330290.572543:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:0.0:1715330290.572547:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66640/0xd895711d66d8c0b lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8c12 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.572552:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66640/0xd895711d66d8c0b lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8c12 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.572557:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66640/0xd895711d66d8c0b lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8c12 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.572667:0:7124:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1715330290.572672:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67840/0xd895711d66d8c43 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d8c4a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.572678:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db67840 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:2.0:1715330290.572681:0:7124:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67840/0xd895711d66d8c43 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d8c4a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1715330290.572686:0:7124:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67840/0xd895711d66d8c43 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d8c4a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.572712:0:7124:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67840/0xd895711d66d8c43 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8c4a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.572716:0:7124:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1715330290.573027:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67840/0xd895711d66d8c43 lrc: 1/0,0 mode: --/EX res: [0x240000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8c4a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.573033:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67840/0xd895711d66d8c43 lrc: 0/0,0 mode: --/EX res: [0x240000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8c4a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.573044:0:7124:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1715330290.573046:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67180/0xd895711d66d8c27 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x14f8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d8c2e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.573050:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db67180 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:2.0:1715330290.573052:0:7124:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67180/0xd895711d66d8c27 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14f8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d8c2e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1715330290.573057:0:7124:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67180/0xd895711d66d8c27 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14f8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d8c2e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.573068:0:7124:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67180/0xd895711d66d8c27 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x14f8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8c2e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.573072:0:7124:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330290.573188:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1715330290.573193:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:0.0:1715330290.573197:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67cc0/0xd895711d66d8c19 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8c20 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.573203:0:7135:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67cc0/0xd895711d66d8c19 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8c20 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330290.573257:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d644700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+60:16983:x1798653938040448:12345-192.168.204.49@tcp:36:rm.0 Request processed in 32163us (32411us total) trans 4294983484 rc 0/0 00000100:00100000:0.0:1715330290.573264:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23451 00000100:00100000:3.0:1715330290.573421:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942468928:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1715330290.573454:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330290.573492:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942468928 00000100:00100000:3.0:1715330290.573498:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942468928 00000100:00100000:3.0:1715330290.573526:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1328 00000100:00100000:3.0:1715330290.573531:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+20:3691:x1798653942468928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1715330290.573540:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330290.573552:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a0480/0xd895711d66d8c4a lrc: 0/0,0 mode: --/EX res: [0x240000401:0xba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d8c43 expref: 20 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.573566:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xba:0x0].0x0 (ffff88009396df00) 00010000:00010000:3.0:1715330290.573572:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715330290.573590:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+19:3691:x1798653942468928:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330290.573596:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1328 00000100:00100000:3.0:1715330290.573624:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942468928:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1715330290.573643:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1715330290.573647:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66640/0xd895711d66d8c0b lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d8c12 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.573652:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66640 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:3.0:1715330290.573655:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66640/0xd895711d66d8c0b lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d8c12 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1715330290.573660:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66640/0xd895711d66d8c0b lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d8c12 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.573676:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66640/0xd895711d66d8c0b lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8c12 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.573681:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1715330290.573707:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67180/0xd895711d66d8c27 lrc: 1/0,0 mode: --/EX res: [0x200000402:0x14f8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8c2e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.573713:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67180/0xd895711d66d8c27 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x14f8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8c2e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.573728:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330290.573741:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330290.573742:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330290.573833:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715330290.573969:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66640/0xd895711d66d8c0b lrc: 1/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8c12 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.573976:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66640/0xd895711d66d8c0b lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8c12 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.573987:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715330290.573988:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715330290.573989:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330290.573996:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942469056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1715330290.574014:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330290.574037:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1715330290.574041:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942468992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1715330290.574056:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330290.574209:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942469056 00000100:00100000:0.0:1715330290.574213:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942469056 00000100:00100000:0.0:1715330290.574481:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942468992 00000100:00100000:0.0:1715330290.574483:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942468992 00000100:00100000:0.0:1715330290.574498:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1329 00000100:00100000:0.0:1715330290.574501:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+20:3689:x1798653942469056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330290.574507:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330290.574517:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457dd40/0xd895711d66d8c12 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d8c0b expref: 20 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.574530:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88008b122d00) 00010000:00010000:0.0:1715330290.574535:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330290.574556:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+19:3689:x1798653942469056:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330290.574562:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1329 00000100:00100000:0.0:1715330290.574571:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1330 00000100:00100000:0.0:1715330290.574574:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+18:3689:x1798653942468992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330290.574579:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330290.574587:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a2400/0xd895711d66d8c2e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x14f8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d8c27 expref: 18 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.574593:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14f8:0x0].0x0 (ffff88009bbb0300) 00010000:00010000:0.0:1715330290.574598:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330290.574610:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+17:3689:x1798653942468992:12345-0@lo:103:ldlm_bl.0 Request processed in 35us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330290.574615:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1330 00000100:00100000:3.0:1715330290.574726:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942468992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1715330290.574749:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942469056:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1715330290.582192:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330290.582986:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938040704 00000100:00100000:0.0:1715330290.582994:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938040704 00000100:00100000:0.0:1715330290.583043:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23452 00000100:00100000:0.0:1715330290.583050:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+60:16983:x1798653938040704:12345-192.168.204.49@tcp:101:rm.0 00010000:00010000:0.0:1715330290.583070:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330290.583084:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1680/0xd895711d66d8c51 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1408:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb7ff expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715330290.583233:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1408:0x0]: returning size 4096 00010000:00010000:0.0:1715330290.583304:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1680/0xd895711d66d8c51 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1408:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb7ff expref: 62 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.583313:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1680/0xd895711d66d8c51 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1408:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb7ff expref: 62 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.583322:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a1680, rc 0) 00000100:00100000:0.0:1715330290.583373:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+61:16983:x1798653938040704:12345-192.168.204.49@tcp:101:rm.0 Request processed in 323us (1189us total) trans 4294983485 rc 301/301 00000100:00100000:0.0:1715330290.583379:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23452 00000100:00100000:0.0:1715330290.591322:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330290.591393:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938040832 00000100:00100000:2.0:1715330290.591401:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938040832 00000100:00100000:2.0:1715330290.591450:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5057 00000100:00100000:2.0:1715330290.591456:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+61:16983:x1798653938040832:12345-192.168.204.49@tcp:35:rm.0 00000100:00100000:2.0:1715330290.591647:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+62:16983:x1798653938040832:12345-192.168.204.49@tcp:35:rm.0 Request processed in 190us (330us total) trans 4294983486 rc 0/0 00000100:00100000:2.0:1715330290.591655:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5057 00000100:00100000:3.0:1715330290.595131:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330290.595214:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938040896 00000100:00100000:0.0:1715330290.595227:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938040896 00000100:00100000:0.0:1715330290.597653:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1331 00000100:00100000:0.0:1715330290.597664:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+24:2011:x1798653938040896:12345-192.168.204.49@tcp:103:rm.0 00010000:00010000:0.0:1715330290.597680:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330290.597700:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d862a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1408:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb64d expref: 24 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.597718:0:9416:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1408:0x0].0x0 (ffff880135e32500) 00010000:00010000:0.0:1715330290.597725:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330290.597786:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+23:2011:x1798653938040896:12345-192.168.204.49@tcp:103:rm.0 Request processed in 124us (2661us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330290.597793:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1331 00000100:00100000:2.0:1715330290.598156:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330290.598678:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938041024 00000100:00100000:0.0:1715330290.598685:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938041024 00000100:00100000:0.0:1715330290.598717:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23453 00000100:00100000:0.0:1715330290.598722:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+62:16983:x1798653938041024:12345-192.168.204.49@tcp:36:rm.0 00010000:00010000:0.0:1715330290.598776:0:7135:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330290.598787:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66d8646 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1408:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb65b expref: 62 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.598797:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1408:0x0].0x0 (ffff88011d537000) 00010000:00010000:0.0:1715330290.598803:0:7135:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715330290.598836:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a1680/0xd895711d66d8c5f lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330290.598841:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a1680/0xd895711d66d8c5f lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330290.598849:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a1680/0xd895711d66d8c5f lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT0 00000100:00100000:0.0:1715330290.598865:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f579500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942469120:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1715330290.598895:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330290.598916:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa300 going to sleep for 11 seconds 00000100:00100000:2.0:1715330290.598958:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942469120 00000100:00100000:2.0:1715330290.598961:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942469120 00000100:00100000:2.0:1715330290.598986:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2813 00000100:00100000:2.0:1715330290.598990:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:7135:x1798653942469120:12345-0@lo:101:mdt00_002.0 00010000:00010000:2.0:1715330290.598999:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330290.599009:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67180/0xd895711d66d8c66 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d8c5f expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.599025:0:9407:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67180/0xd895711d66d8c66 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d8c5f expref: 18 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.599035:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67180/0xd895711d66d8c66 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8c5f expref: 18 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.599040:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88011d537200) 00010000:00010000:2.0:1715330290.599043:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330290.599045:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db67180, rc 0) 00000100:00100000:2.0:1715330290.599067:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+18:7135:x1798653942469120:12345-0@lo:101:mdt00_002.0 Request processed in 77us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330290.599073:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2813 00000100:00100000:0.0:1715330290.599126:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f579500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942469120:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330290.599135:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a1680/0xd895711d66d8c5f lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8c66 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.599143:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a1680/0xd895711d66d8c5f lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8c66 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1715330290.599156:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:0.0:1715330290.599168:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a2400/0xd895711d66d8c6d lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x4b3326ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330290.599173:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a2400/0xd895711d66d8c6d lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x4b3326ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330290.599177:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a2400/0xd895711d66d8c6d lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x4b3326ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT0 00000100:00100000:0.0:1715330290.599186:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f579500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942469184:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1715330290.599201:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330290.599208:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa300 going to sleep for 11 seconds 00000100:00100000:2.0:1715330290.599362:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942469184 00000100:00100000:2.0:1715330290.599365:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942469184 00000100:00100000:2.0:1715330290.599387:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2814 00000100:00100000:2.0:1715330290.599391:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+18:7135:x1798653942469184:12345-0@lo:101:mdt00_002.0 00010000:00010000:2.0:1715330290.599398:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330290.599405:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67840/0xd895711d66d8c74 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x4b3326ef bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d8c6d expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.599416:0:9407:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67840/0xd895711d66d8c74 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x4b3326ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d8c6d expref: 19 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.599422:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67840/0xd895711d66d8c74 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x4b3326ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8c6d expref: 19 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.599427:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x4b3326ef (ffff88011d537300) 00010000:00010000:2.0:1715330290.599429:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330290.599431:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db67840, rc 0) 00000100:00100000:2.0:1715330290.599661:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:7135:x1798653942469184:12345-0@lo:101:mdt00_002.0 Request processed in 269us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330290.599667:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2814 00000100:00100000:0.0:1715330290.599761:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f579500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942469184:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330290.599768:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a2400/0xd895711d66d8c6d lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x4b3326ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8c74 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.599774:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a2400/0xd895711d66d8c6d lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x4b3326ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8c74 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1715330290.599782:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:0.0:1715330290.599802:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f579500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942469248:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1715330290.599820:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330290.599827:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa180 going to sleep for 11 seconds 00000100:00100000:2.0:1715330290.600280:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942469248 00000100:00100000:2.0:1715330290.600284:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942469248 00000100:00100000:2.0:1715330290.600305:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2815 00000100:00100000:2.0:1715330290.600309:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b163100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:7135:x1798653942469248:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1715330290.600356:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b163100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:7135:x1798653942469248:12345-0@lo:1000:mdt00_002.0 Request processed in 45us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330290.600361:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2815 00000100:00100000:0.0:1715330290.600433:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f579500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942469248:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1715330290.600464:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b160000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942469312:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1715330290.600489:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330290.600506:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa180 going to sleep for 11 seconds 00000100:00100000:2.0:1715330290.600820:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942469312 00000100:00100000:2.0:1715330290.600824:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942469312 00000100:00100000:2.0:1715330290.600846:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2816 00000100:00100000:2.0:1715330290.600850:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b160700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:7135:x1798653942469312:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1715330290.600923:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b160700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:7135:x1798653942469312:12345-0@lo:1000:mdt00_002.0 Request processed in 71us (432us total) trans 0 rc 1/1 00000100:00100000:2.0:1715330290.600928:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2816 00000100:00100000:1.0:1715330290.600945:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b160000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942469312:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1715330290.600975:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfef40/0xd895711d66d8c7b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1408:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.600981:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfef40/0xd895711d66d8c7b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1408:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.600987:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfef40/0xd895711d66d8c7b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1408:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT0 00000100:00100000:1.0:1715330290.600994:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d644e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942469376:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1715330290.601012:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330290.601021:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f240 going to sleep for 11 seconds 00000100:00100000:2.0:1715330290.601321:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942469376 00000100:00100000:2.0:1715330290.601324:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942469376 00000100:00100000:2.0:1715330290.601346:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2817 00000100:00100000:2.0:1715330290.601350:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d647800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:7135:x1798653942469376:12345-0@lo:101:mdt00_002.0 00010000:00010000:2.0:1715330290.601356:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330290.601366:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64480/0xd895711d66d8c82 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1408:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d8c7b expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.601379:0:9407:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64480/0xd895711d66d8c82 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1408:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d8c7b expref: 20 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.601387:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64480/0xd895711d66d8c82 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1408:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8c7b expref: 20 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.601392:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1408:0x0].0x0 (ffff88011d537700) 00010000:00010000:2.0:1715330290.601394:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1715330290.601396:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db64480, rc 0) 00000100:00100000:2.0:1715330290.601426:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d647800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+20:7135:x1798653942469376:12345-0@lo:101:mdt00_002.0 Request processed in 75us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330290.601431:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2817 00000100:00100000:1.0:1715330290.601446:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d644e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942469376:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330290.601454:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfef40/0xd895711d66d8c7b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1408:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8c82 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.601462:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfef40/0xd895711d66d8c7b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1408:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8c82 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.601485:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d8c89 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1408:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.601491:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d8c89 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1408:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.601497:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d8c89 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1408:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.601508:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d8c90 lrc: 3/0,1 mode: --/EX res: [0x200000400:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.601515:0:7135:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d8654 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x42:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb662 expref: 61 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.601520:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d8c90 lrc: 4/0,1 mode: --/EX res: [0x200000400:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.601535:0:7135:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d8654 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x42:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb662 expref: 61 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.601545:0:7135:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d8654 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x42:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb662 expref: 61 pid: 9622 timeout: 365 lvb_type: 0 00000100:00100000:1.0:1715330290.601553:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d644e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7135:1798653942469440:192.168.204.49@tcp:104: 00000100:00100000:1.0:1715330290.601597:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f240 going to sleep for 11 seconds 00000100:00100000:3.0:1715330290.605135:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330290.605214:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d644e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7135:1798653942469440:192.168.204.49@tcp:104: 00010000:00010000:1.0:1715330290.605236:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d8c90 lrc: 3/0,1 mode: --/EX res: [0x200000400:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000100:00100000:0.0:1715330290.605291:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938041088 00000100:00100000:0.0:1715330290.605297:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938041088 00010000:00010000:0.0:1715330290.605323:0:7121:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d8654 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x42:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb662 expref: 62 pid: 9622 timeout: 365 lvb_type: 0 00000100:00100000:0.0:1715330290.605356:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1537 00000100:00100000:0.0:1715330290.605362:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+62:2011:x1798653938041088:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1715330290.605373:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330290.605377:0:7121:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d8654 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x42:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb662 expref: 62 pid: 9622 timeout: 365 lvb_type: 0 00010000:00010000:0.0:1715330290.605386:0:7121:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d8654 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x42:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb662 expref: 62 pid: 9622 timeout: 365 lvb_type: 0 00010000:00010000:0.0:1715330290.605403:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d8654 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x42:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb662 expref: 62 pid: 9622 timeout: 365 lvb_type: 0 00010000:00010000:0.0:1715330290.605695:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x42:0x0].0x0 (ffff88009396d500) 00010000:00010000:0.0:1715330290.605699:0:7121:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d8c90 lrc: 3/0,1 mode: --/EX res: [0x200000400:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330290.605707:0:7121:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d8c90 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330290.605713:0:7121:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d8c90 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.605746:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d8c90 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330290.605749:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330290.605753:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d8c90 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.605784:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc480/0xd895711d66d8c97 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00000100:00100000:0.0:1715330290.605789:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+61:2011:x1798653938041088:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 425us (660us total) trans 0 rc 0/0 00010000:00010000:1.0:1715330290.605794:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc480/0xd895711d66d8c97 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT0 00000100:00100000:0.0:1715330290.605795:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1537 00010000:00010000:1.0:1715330290.605802:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc480/0xd895711d66d8c97 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT0 00000100:00100000:1.0:1715330290.605817:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d644e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942469504:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1715330290.605847:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330290.605865:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f240 going to sleep for 11 seconds 00000100:00100000:2.0:1715330290.605885:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942469504 00000100:00100000:2.0:1715330290.605889:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942469504 00000100:00100000:2.0:1715330290.605919:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2818 00000100:00100000:2.0:1715330290.605923:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d647100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+20:7135:x1798653942469504:12345-0@lo:101:mdt00_002.0 00010000:00010000:2.0:1715330290.605935:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330290.605946:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66400/0xd895711d66d8c9e lrc: 2/0,0 mode: --/EX res: [0x240000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d8c97 expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.605962:0:9407:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d8662 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb669 expref: 22 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.605969:0:9407:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66400/0xd895711d66d8c9e lrc: 4/0,0 mode: --/EX res: [0x240000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d8c97 expref: 21 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.605987:0:9407:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d8662 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb669 expref: 22 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.605997:0:9407:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d8662 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb669 expref: 22 pid: 9622 timeout: 365 lvb_type: 0 00000100:00100000:2.0:1715330290.606007:0:9407:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012faef800 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:9407:1798653942469568:192.168.204.49@tcp:104: 00000100:00100000:2.0:1715330290.606042:0:9407:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435a80 going to sleep for 11 seconds 00000100:00100000:2.0:1715330290.607629:0:9407:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012faef800 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:9407:1798653942469568:192.168.204.49@tcp:104: 00010000:00010000:2.0:1715330290.607646:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66400/0xd895711d66d8c9e lrc: 3/0,0 mode: --/EX res: [0x240000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8c97 expref: 21 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.607659:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x42:0x0].0x0 (ffff88009396d300) 00010000:00010000:2.0:1715330290.607661:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330290.607664:0:9407:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66400/0xd895711d66d8c9e lrc: 3/0,0 mode: --/EX res: [0x240000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8c97 expref: 21 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.607671:0:9407:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66400/0xd895711d66d8c9e lrc: 3/0,0 mode: --/EX res: [0x240000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8c97 expref: 21 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.607676:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db66400, rc 0) 00000100:00100000:2.0:1715330290.608095:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d647100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+21:7135:x1798653942469504:12345-0@lo:101:mdt00_002.0 Request processed in 2170us (2245us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330290.608102:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2818 00000100:00100000:1.0:1715330290.608210:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d644e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942469504:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330290.608222:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc480/0xd895711d66d8c97 lrc: 4/0,1 mode: --/EX res: [0x240000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8c9e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.608229:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc480/0xd895711d66d8c97 lrc: 4/0,1 mode: --/EX res: [0x240000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8c9e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330290.608779:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330290.608918:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938041152 00000100:00100000:2.0:1715330290.608923:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938041152 00010000:00010000:2.0:1715330290.608939:0:7121:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d8662 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb669 expref: 23 pid: 9622 timeout: 365 lvb_type: 0 00000100:00100000:2.0:1715330290.608966:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1538 00000100:00100000:2.0:1715330290.608971:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+23:2012:x1798653938041152:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1715330290.608982:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330290.608986:0:7121:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d8662 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb669 expref: 23 pid: 9622 timeout: 365 lvb_type: 0 00010000:00010000:2.0:1715330290.608994:0:7121:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d8662 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb669 expref: 23 pid: 9622 timeout: 365 lvb_type: 0 00010000:00010000:2.0:1715330290.609009:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d8662 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb669 expref: 23 pid: 9622 timeout: 365 lvb_type: 0 00010000:00010000:2.0:1715330290.609033:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x42:0x0].0x0 (ffff88009396d300) 00010000:00010000:2.0:1715330290.609037:0:7121:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66400/0xd895711d66d8c9e lrc: 2/0,0 mode: --/EX res: [0x240000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8c97 expref: 20 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.609044:0:7121:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66400/0xd895711d66d8c9e lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d8c97 expref: 20 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.609050:0:7121:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66400/0xd895711d66d8c9e lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d8c97 expref: 20 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.609069:0:7121:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66400/0xd895711d66d8c9e lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8c97 expref: 20 pid: 9407 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330290.609078:0:7121:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012faef800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:7121:1798653942469632:0@lo:105: 00000100:00100000:2.0:1715330290.609102:0:7121:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330290.609113:0:7121:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435a80 going to sleep for 11 seconds 00000100:00100000:1.0:1715330290.609268:0:9413:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942469632 00000100:00100000:1.0:1715330290.609272:0:9413:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942469632 00000100:00100000:1.0:1715330290.609291:0:9413:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1164 00000100:00100000:1.0:1715330290.609296:0:9413:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:7121:x1798653942469632:12345-0@lo:105: 00010000:00010000:1.0:1715330290.609303:0:9413:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc480/0xd895711d66d8c97 lrc: 5/0,1 mode: --/EX res: [0x240000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8c9e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.609310:0:9413:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc480/0xd895711d66d8c97 lrc: 5/0,1 mode: --/EX res: [0x240000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8c9e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.609316:0:9413:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc480/0xd895711d66d8c97 lrc: 5/0,1 mode: --/EX res: [0x240000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8c9e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.609322:0:9413:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc480/0xd895711d66d8c97 lrc: 5/0,1 mode: EX/EX res: [0x240000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d8c9e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.609327:0:9413:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc480/0xd895711d66d8c97 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d8c9e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.609333:0:9413:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc480/0xd895711d66d8c97 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d8c9e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.609344:0:9413:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff880093bfc480) 00000100:00100000:1.0:1715330290.609370:0:9413:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:7121:x1798653942469632:12345-0@lo:105: Request processed in 73us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330290.609375:0:9413:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1164 00010000:00010000:1.0:1715330290.609394:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc480/0xd895711d66d8c97 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8c9e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.609401:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc480/0xd895711d66d8c97 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8c9e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330290.609945:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d644e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942469696:0@lo:403:mdt00_002.0 00000100:00100000:1.0:1715330290.609974:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330290.609983:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f240 going to sleep for 11 seconds 00000100:00100000:2.0:1715330290.610063:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942469696 00000100:00100000:2.0:1715330290.610066:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942469696 00000100:00100000:2.0:1715330290.610082:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2819 00000100:00100000:2.0:1715330290.610086:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d644a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+21:7135:x1798653942469696:12345-0@lo:403:mdt00_002.0 00000100:00100000:2.0:1715330290.611392:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d644a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+21:7135:x1798653942469696:12345-0@lo:403:mdt00_002.0 Request processed in 1302us (1414us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330290.611399:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2819 00000100:00100000:3.0:1715330290.611493:0:7121:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012faef800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:7121:1798653942469632:0@lo:105: 00010000:00010000:3.0:1715330290.611505:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715330290.611537:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+22:2012:x1798653938041152:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 2564us (2757us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330290.611547:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1538 00000100:00100000:1.0:1715330290.611676:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d644e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942469696:0@lo:403:mdt00_002.0 00000040:00080000:1.0:1715330290.612371:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].368, 952 off558008 00000040:00080000:1.0:1715330290.612476:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].367, 1032 off601192 00000004:00080000:1.0:1715330290.612480:0:7135:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88012f49f240 with version 694 00000004:00080000:0.0:1715330290.612533:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 694 rpc_version 694 00000020:00100000:0.0:1715330290.612554:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1715330290.612559:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008b161180 x1798653942469824/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 2352/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715330290.612577:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b161180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942469824:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330290.612603:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330290.612611:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa300 going to sleep for 11 seconds 00000100:00100000:1.0:1715330290.612847:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942469824 00000100:00100000:1.0:1715330290.612851:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942469824 00000100:00100000:1.0:1715330290.613703:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2820 00000100:00100000:1.0:1715330290.613708:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880073ba0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+21:8587:x1798653942469824:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330290.615904:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880073ba0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+22:8587:x1798653942469824:12345-0@lo:1000:osp_up1-0.0 Request processed in 2192us (3296us total) trans 4294968404 rc 0/0 00000100:00100000:1.0:1715330290.615913:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2820 00000100:00100000:0.0:1715330290.616197:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b161180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942469824:0@lo:1000:osp_up1-0.0 00000004:00200000:1.0:1715330290.616524:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1408:0x0]: returning size 4096 00010000:00010000:1.0:1715330290.616545:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d8c90 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.616553:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d8c90 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.616559:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d8c90 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.616564:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfcfc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330290.616567:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d8c90 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.616577:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d8c90 lrc: 4/0,0 mode: EX/EX res: [0x200000400:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.616589:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x42:0x0].0x0 (ffff88009396d500) 00010000:00010000:1.0:1715330290.616591:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330290.616594:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d8c90 lrc: 2/0,0 mode: --/EX res: [0x200000400:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.616599:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d8c90 lrc: 0/0,0 mode: --/EX res: [0x200000400:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.616615:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc480/0xd895711d66d8c97 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8c9e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.616622:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc480/0xd895711d66d8c97 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8c9e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.616627:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc480/0xd895711d66d8c97 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8c9e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.616684:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1715330290.616691:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x42:0x0] 00010000:00010000:1.0:1715330290.616698:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d8c89 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1408:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.616702:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d8c89 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1408:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.616706:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d8c89 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1408:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.616709:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfdd40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330290.616712:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d8c89 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1408:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.616716:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d8c89 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1408:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.616722:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1408:0x0].0x0 (ffff88009d5fac00) 00010000:00010000:1.0:1715330290.616724:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330290.616725:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d8c89 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1408:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.616837:0:9415:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1715330290.616842:0:9415:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc480/0xd895711d66d8c97 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d8c9e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.616847:0:9415:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfc480 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:3.0:1715330290.616850:0:9415:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc480/0xd895711d66d8c97 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d8c9e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1715330290.616855:0:9415:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc480/0xd895711d66d8c97 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d8c9e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.616876:0:9415:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc480/0xd895711d66d8c97 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8c9e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.616880:0:9415:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1715330290.616928:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942469888:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330290.616957:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1715330290.617015:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d8c89 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1408:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.617025:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfef40/0xd895711d66d8c7b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1408:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8c82 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.617030:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfef40/0xd895711d66d8c7b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1408:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8c82 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.617035:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfef40/0xd895711d66d8c7b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1408:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8c82 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.617052:0:9415:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc480/0xd895711d66d8c97 lrc: 1/0,0 mode: --/EX res: [0x240000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8c9e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.617057:0:9415:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfc480/0xd895711d66d8c97 lrc: 0/0,0 mode: --/EX res: [0x240000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8c9e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.617068:0:9415:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1715330290.617070:0:9415:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfef40/0xd895711d66d8c7b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1408:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d8c82 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.617074:0:9415:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfef40 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:3.0:1715330290.617076:0:9415:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfef40/0xd895711d66d8c7b lrc: 5/0,0 mode: EX/EX res: [0x200000402:0x1408:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d8c82 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1715330290.617085:0:9415:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfef40/0xd895711d66d8c7b lrc: 5/0,0 mode: EX/EX res: [0x200000402:0x1408:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d8c82 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.617096:0:9415:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfef40/0xd895711d66d8c7b lrc: 4/0,0 mode: --/EX res: [0x200000402:0x1408:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8c82 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.617100:0:9415:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1715330290.617105:0:9415:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfef40/0xd895711d66d8c7b lrc: 3/0,0 mode: --/EX res: [0x200000402:0x1408:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8c82 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.617110:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715330290.617111:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330290.617137:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1715330290.617143:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942469952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330290.617161:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1715330290.617259:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1715330290.617263:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfef40/0xd895711d66d8c7b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1408:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8c82 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330290.617424:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:1.0:1715330290.617428:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a1680/0xd895711d66d8c5f lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8c66 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.617434:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a1680/0xd895711d66d8c5f lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8c66 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.617439:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a1680/0xd895711d66d8c5f lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8c66 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.617498:0:9415:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1715330290.617502:0:9415:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a1680/0xd895711d66d8c5f lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d8c66 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.617506:0:9415:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a1680 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:3.0:1715330290.617509:0:9415:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a1680/0xd895711d66d8c5f lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d8c66 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1715330290.617514:0:9415:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a1680/0xd895711d66d8c5f lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d8c66 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.617526:0:9415:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a1680/0xd895711d66d8c5f lrc: 4/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8c66 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.617530:0:9415:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1715330290.617539:0:9415:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a1680/0xd895711d66d8c5f lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8c66 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.617548:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715330290.617549:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715330290.617551:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330290.617559:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942470016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1715330290.617577:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330290.617598:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942469888 00000100:00100000:3.0:1715330290.617602:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942469888 00000100:00100000:3.0:1715330290.617620:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942469952 00000100:00100000:3.0:1715330290.617622:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942469952 00000100:00100000:3.0:1715330290.617631:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942470016 00000100:00100000:3.0:1715330290.617632:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942470016 00000100:00100000:3.0:1715330290.617640:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1332 00000100:00100000:3.0:1715330290.617645:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b161c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+24:3690:x1798653942469888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1715330290.617653:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330290.617664:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66400/0xd895711d66d8c9e lrc: 0/0,0 mode: --/EX res: [0x240000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d8c97 expref: 24 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.617673:0:9416:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x42:0x0].0x0 (ffff88009396d300) 00010000:00010000:3.0:1715330290.617679:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715330290.617695:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b161c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+23:3690:x1798653942469888:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330290.617699:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1332 00000100:00100000:3.0:1715330290.617708:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1333 00000100:00100000:3.0:1715330290.617710:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b162300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+22:3690:x1798653942469952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1715330290.617715:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330290.617720:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64480/0xd895711d66d8c82 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1408:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d8c7b expref: 22 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.617745:0:9416:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1408:0x0].0x0 (ffff88011d537700) 00010000:00010000:3.0:1715330290.617750:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715330290.617761:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b162300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+21:3690:x1798653942469952:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330290.617765:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1333 00000100:00100000:3.0:1715330290.617772:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1334 00000100:00100000:3.0:1715330290.617775:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+20:3688:x1798653942470016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1715330290.617779:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330290.617784:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67180/0xd895711d66d8c66 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d8c5f expref: 20 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.617790:0:9416:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88011d537200) 00010000:00010000:3.0:1715330290.617794:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715330290.617804:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+19:3688:x1798653942470016:12345-0@lo:103:ldlm_bl.0 Request processed in 28us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330290.617808:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1334 00000100:00100000:3.0:1715330290.617822:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942470016:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330290.617893:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942469952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330290.617899:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942469888:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330290.618279:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1715330290.618282:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a1680/0xd895711d66d8c5f lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8c66 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330290.618293:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:1.0:1715330290.618297:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a2400/0xd895711d66d8c6d lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x4b3326ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8c74 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.618302:0:7135:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a2400/0xd895711d66d8c6d lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x4b3326ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8c74 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330290.618350:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+61:16983:x1798653938041024:12345-192.168.204.49@tcp:36:rm.0 Request processed in 19626us (20194us total) trans 4294983487 rc 0/0 00000100:00100000:1.0:1715330290.618355:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23453 00010000:00010000:0.0:1715330290.618395:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330290.618456:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330290.621513:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330290.621582:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938041280 00000100:00100000:1.0:1715330290.621589:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938041280 00000100:00100000:1.0:1715330290.621627:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23454 00000100:00100000:1.0:1715330290.621632:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b162d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+22:16983:x1798653938041280:12345-192.168.204.49@tcp:101:rm.0 00010000:00010000:1.0:1715330290.621649:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330290.621662:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d8ca5 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x80:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb806 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715330290.621807:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x80:0x0]: returning size 4096 00010000:00010000:1.0:1715330290.621870:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d8ca5 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x80:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb806 expref: 24 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.621878:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d8ca5 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x80:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb806 expref: 24 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.621885:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfdb00, rc 0) 00000100:00100000:1.0:1715330290.621928:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b162d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+23:16983:x1798653938041280:12345-192.168.204.49@tcp:101:rm.0 Request processed in 295us (419us total) trans 4294968405 rc 301/301 00000100:00100000:1.0:1715330290.621933:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23454 00000100:00100000:3.0:1715330290.627484:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330290.627546:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938041408 00000100:00100000:0.0:1715330290.627554:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938041408 00000100:00100000:2.0:1715330290.628147:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5058 00000100:00100000:2.0:1715330290.628155:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+23:16983:x1798653938041408:12345-192.168.204.49@tcp:35:rm.0 00000100:00100000:2.0:1715330290.628424:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+24:16983:x1798653938041408:12345-192.168.204.49@tcp:35:rm.0 Request processed in 269us (955us total) trans 4294968406 rc 0/0 00000100:00100000:2.0:1715330290.628431:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5058 00000100:00100000:3.0:1715330290.633406:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330290.633460:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330290.633516:0:10673:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938041472 00000100:00100000:2.0:1715330290.633522:0:10673:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938041472 00000100:00100000:2.0:1715330290.633560:0:10673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1335 00000100:00100000:2.0:1715330290.633565:0:10673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:72de1896-1df4-4b3a-930a-9116d2c66168+61:2012:x1798653938041472:12345-192.168.204.49@tcp:103:rm.0 00010000:00010000:2.0:1715330290.633576:0:10673:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330290.633593:0:10673:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66d867e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x80:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb670 expref: 61 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.633616:0:10673:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x80:0x0].0x0 (ffff88011d537800) 00010000:00010000:2.0:1715330290.633623:0:10673:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330290.633654:0:10673:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:72de1896-1df4-4b3a-930a-9116d2c66168+60:2012:x1798653938041472:12345-192.168.204.49@tcp:103:rm.0 Request processed in 89us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330290.633659:0:10673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1335 00000100:00100000:0.0:1715330290.633707:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938041600 00000100:00100000:0.0:1715330290.633710:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938041600 00000100:00100000:0.0:1715330290.633747:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23455 00000100:00100000:0.0:1715330290.633751:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+24:16983:x1798653938041600:12345-192.168.204.49@tcp:36:rm.0 00010000:00010000:0.0:1715330290.633794:0:9622:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330290.633805:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d869a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x80:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb67e expref: 24 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.633817:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x80:0x0].0x0 (ffff880135e32100) 00010000:00010000:0.0:1715330290.633822:0:9622:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715330290.633857:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a18c0/0xd895711d66d8cb3 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330290.633863:0:9622:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a18c0/0xd895711d66d8cb3 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330290.633870:0:9622:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a18c0/0xd895711d66d8cb3 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 9622 initiator: MDT1 00000100:00100000:0.0:1715330290.633886:0:9622:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b161500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9622:1798653942470080:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1715330290.633914:0:9622:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330290.633926:0:9622:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa300 going to sleep for 11 seconds 00000100:00100000:1.0:1715330290.633981:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942470080 00000100:00100000:1.0:1715330290.633984:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942470080 00000100:00100000:1.0:1715330290.634001:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2821 00000100:00100000:1.0:1715330290.634005:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b160e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+19:9622:x1798653942470080:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1715330290.634014:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330290.634024:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66d8cba lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d8cb3 expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.634039:0:23404:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66d8cba lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d8cb3 expref: 20 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.634047:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66d8cba lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8cb3 expref: 20 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.634052:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88009d5fa500) 00010000:00010000:1.0:1715330290.634053:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330290.634055:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bff180, rc 0) 00000100:00100000:1.0:1715330290.634077:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b160e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+20:9622:x1798653942470080:12345-0@lo:101:mdt00_003.0 Request processed in 71us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330290.634081:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2821 00000100:00100000:0.0:1715330290.634458:0:9622:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b161500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9622:1798653942470080:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1715330290.634478:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a18c0/0xd895711d66d8cb3 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8cba expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.634485:0:9622:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a18c0/0xd895711d66d8cb3 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8cba expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1715330290.634498:0:9622:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:0.0:1715330290.634509:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a3180/0xd895711d66d8cc1 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x4b3326f6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330290.634513:0:9622:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a3180/0xd895711d66d8cc1 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x4b3326f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330290.634518:0:9622:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a3180/0xd895711d66d8cc1 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x4b3326f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 9622 initiator: MDT1 00000100:00100000:0.0:1715330290.634526:0:9622:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b161500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9622:1798653942470144:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1715330290.634541:0:9622:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330290.634823:0:9622:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa300 going to sleep for 11 seconds 00000100:00100000:3.0:1715330290.635039:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942470144 00000100:00100000:3.0:1715330290.635042:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942470144 00000100:00100000:3.0:1715330290.635067:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2822 00000100:00100000:3.0:1715330290.635071:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b161f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+20:9622:x1798653942470144:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1715330290.635078:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330290.635087:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f3c0/0xd895711d66d8cc8 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x4b3326f6 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d8cc1 expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.635098:0:9407:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f3c0/0xd895711d66d8cc8 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x4b3326f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d8cc1 expref: 21 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.635105:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f3c0/0xd895711d66d8cc8 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x4b3326f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8cc1 expref: 21 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.635110:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x4b3326f6 (ffff88008b122e00) 00010000:00010000:3.0:1715330290.635112:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330290.635114:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013457f3c0, rc 0) 00000100:00100000:3.0:1715330290.635144:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b161f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+21:9622:x1798653942470144:12345-0@lo:101:mdt00_003.0 Request processed in 72us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330290.635149:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2822 00000100:00100000:0.0:1715330290.635410:0:9622:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b161500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9622:1798653942470144:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1715330290.635419:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a3180/0xd895711d66d8cc1 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x4b3326f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8cc8 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.635426:0:9622:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a3180/0xd895711d66d8cc1 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x4b3326f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8cc8 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1715330290.635436:0:9622:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:0.0:1715330290.635459:0:9622:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b161500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9622:1798653942470208:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1715330290.635487:0:9622:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330290.635495:0:9622:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa180 going to sleep for 11 seconds 00000100:00100000:1.0:1715330290.635559:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942470208 00000100:00100000:1.0:1715330290.635563:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942470208 00000100:00100000:1.0:1715330290.635576:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2823 00000100:00100000:1.0:1715330290.635580:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b161880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+21:9622:x1798653942470208:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1715330290.635623:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b161880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+21:9622:x1798653942470208:12345-0@lo:1000:mdt00_003.0 Request processed in 42us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330290.635628:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2823 00000100:00100000:0.0:1715330290.635927:0:9622:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b161500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9622:1798653942470208:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1715330290.635952:0:9622:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b161500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9622:1798653942470272:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1715330290.635966:0:9622:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330290.635973:0:9622:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa180 going to sleep for 11 seconds 00000100:00100000:3.0:1715330290.636022:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942470272 00000100:00100000:3.0:1715330290.636025:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942470272 00000100:00100000:3.0:1715330290.636043:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2824 00000100:00100000:3.0:1715330290.636047:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b163b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+21:9622:x1798653942470272:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1715330290.636105:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b163b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+21:9622:x1798653942470272:12345-0@lo:1000:mdt00_003.0 Request processed in 57us (138us total) trans 0 rc 1/1 00000100:00100000:3.0:1715330290.636109:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2824 00000100:00100000:0.0:1715330290.636412:0:9622:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b161500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9622:1798653942470272:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1715330290.636441:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a1440/0xd895711d66d8ccf lrc: 3/0,1 mode: --/EX res: [0x240000402:0x80:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330290.636447:0:9622:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a1440/0xd895711d66d8ccf lrc: 3/0,1 mode: --/EX res: [0x240000402:0x80:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330290.636453:0:9622:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a1440/0xd895711d66d8ccf lrc: 3/0,1 mode: --/EX res: [0x240000402:0x80:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 9622 initiator: MDT1 00000100:00100000:0.0:1715330290.636461:0:9622:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b161500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9622:1798653942470336:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1715330290.636489:0:9622:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330290.636527:0:9622:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa300 going to sleep for 11 seconds 00000100:00100000:1.0:1715330290.636558:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942470336 00000100:00100000:1.0:1715330290.636561:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942470336 00000100:00100000:1.0:1715330290.636598:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2825 00000100:00100000:1.0:1715330290.636602:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b163800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+21:9622:x1798653942470336:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1715330290.636608:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330290.636619:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66d8cd6 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x80:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d8ccf expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.636632:0:23404:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66d8cd6 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x80:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d8ccf expref: 22 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.636640:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66d8cd6 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x80:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8ccf expref: 22 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.636646:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x80:0x0].0x0 (ffff88009d5fa000) 00010000:00010000:1.0:1715330290.636648:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1715330290.636650:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfc6c0, rc 0) 00000100:00100000:1.0:1715330290.636674:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b163800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+22:9622:x1798653942470336:12345-0@lo:101:mdt00_003.0 Request processed in 71us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330290.636678:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2825 00000100:00100000:0.0:1715330290.636720:0:9622:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b161500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9622:1798653942470336:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1715330290.636728:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a1440/0xd895711d66d8ccf lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x80:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8cd6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.636754:0:9622:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a1440/0xd895711d66d8ccf lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x80:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8cd6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.636769:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a3600/0xd895711d66d8cdd lrc: 3/0,1 mode: --/EX res: [0x240000402:0x80:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330290.636775:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a3600/0xd895711d66d8cdd lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x80:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330290.636780:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a3600/0xd895711d66d8cdd lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x80:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330290.636792:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a2640/0xd895711d66d8ce4 lrc: 3/0,1 mode: --/EX res: [0x240000400:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330290.636799:0:9622:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfeac0/0xd895711d66d86a8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x43:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb685 expref: 23 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.636805:0:9622:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a2640/0xd895711d66d8ce4 lrc: 4/0,1 mode: --/EX res: [0x240000400:0x43:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT1 00010000:00010000:0.0:1715330290.636819:0:9622:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfeac0/0xd895711d66d86a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x43:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb685 expref: 23 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.636827:0:9622:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfeac0/0xd895711d66d86a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x43:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb685 expref: 23 pid: 7135 timeout: 365 lvb_type: 0 00000100:00100000:0.0:1715330290.636835:0:9622:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b161500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:9622:1798653942470400:192.168.204.49@tcp:104: 00000100:00100000:0.0:1715330290.636865:0:9622:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa300 going to sleep for 11 seconds 00000100:00100000:0.0:1715330290.639828:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330290.639856:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330290.639931:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938041856 00000100:00100000:3.0:1715330290.639938:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938041856 00010000:00010000:3.0:1715330290.639968:0:7120:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfeac0/0xd895711d66d86a8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x43:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb685 expref: 24 pid: 7135 timeout: 365 lvb_type: 0 00000100:00100000:3.0:1715330290.639990:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1539 00000100:00100000:3.0:1715330290.639995:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b160a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72de1896-1df4-4b3a-930a-9116d2c66168+24:2014:x1798653938041856:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1715330290.640006:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330290.640010:0:7120:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfeac0/0xd895711d66d86a8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x43:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb685 expref: 24 pid: 7135 timeout: 365 lvb_type: 0 00010000:00010000:3.0:1715330290.640019:0:7120:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfeac0/0xd895711d66d86a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x43:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb685 expref: 24 pid: 7135 timeout: 365 lvb_type: 0 00010000:00010000:3.0:1715330290.640035:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x43:0x0].0x0 (ffff880135e32700) 00010000:00010000:3.0:1715330290.640039:0:7120:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a2640/0xd895711d66d8ce4 lrc: 3/0,1 mode: --/EX res: [0x240000400:0x43:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT1 00010000:00010000:3.0:1715330290.640046:0:7120:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a2640/0xd895711d66d8ce4 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x43:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9622 initiator: MDT1 00010000:00010000:3.0:1715330290.640051:0:7120:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a2640/0xd895711d66d8ce4 lrc: 4/0,1 mode: EX/EX res: [0x240000400:0x43:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9622 initiator: MDT1 00010000:00010000:3.0:1715330290.640065:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715330290.640096:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b160a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72de1896-1df4-4b3a-930a-9116d2c66168+24:2014:x1798653938041856:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 100us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330290.640102:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1539 00010000:00010000:2.0:1715330290.640325:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfeac0/0xd895711d66d86a8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x43:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb685 expref: 23 pid: 7135 timeout: 365 lvb_type: 0 00000100:00100000:2.0:1715330290.640343:0:9622:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b161500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:9622:1798653942470400:192.168.204.49@tcp:104: 00010000:00010000:2.0:1715330290.640358:0:9622:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a2640/0xd895711d66d8ce4 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330290.640365:0:9622:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a2640/0xd895711d66d8ce4 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330290.640369:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a2640/0xd895711d66d8ce4 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330290.640399:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d8ceb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330290.640405:0:9622:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d8ceb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330290.640412:0:9622:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d8ceb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 9622 initiator: MDT1 00000100:00100000:2.0:1715330290.640427:0:9622:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9622:1798653942470464:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1715330290.640457:0:9622:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330290.640481:0:9622:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435a80 going to sleep for 11 seconds 00000100:00100000:1.0:1715330290.640696:0:17200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938041728 00000100:00100000:1.0:1715330290.640700:0:17200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938041728 00000100:00100000:1.0:1715330290.640727:0:17200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 172 00000100:00100000:1.0:1715330290.640753:0:17200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b163480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:72de1896-1df4-4b3a-930a-9116d2c66168+7:2012:x1798653938041728:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:1.0:1715330290.640783:0:17200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b163480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:72de1896-1df4-4b3a-930a-9116d2c66168+7:2012:x1798653938041728:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 31us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330290.640788:0:17200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 172 00000100:00080000:0.0:1715330290.641036:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330260 00000100:00100000:3.0:1715330290.641095:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942470464 00000100:00100000:3.0:1715330290.641098:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942470464 00000100:00100000:1.0:1715330290.641189:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330290.641239:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330290.641250:0:17197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938041792 00000100:00100000:1.0:1715330290.641253:0:17197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938041792 00000100:00100000:3.0:1715330290.641330:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2826 00000100:00100000:3.0:1715330290.641335:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+22:9622:x1798653942470464:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1715330290.641344:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330290.641355:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d8cf2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d8ceb expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.641372:0:9407:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66d86b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb68c expref: 59 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.641380:0:9407:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d8cf2 lrc: 4/0,0 mode: --/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d8ceb expref: 23 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.641396:0:9407:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66d86b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb68c expref: 59 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.641405:0:9407:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66d86b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb68c expref: 59 pid: 9622 timeout: 365 lvb_type: 0 00000100:00100000:3.0:1715330290.641414:0:9407:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4ea300 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:9407:1798653942470528:192.168.204.49@tcp:104: 00000100:00100000:3.0:1715330290.641438:0:9407:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b43336c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330290.641557:0:17197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 173 00000100:00100000:1.0:1715330290.641561:0:17197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d647480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:72de1896-1df4-4b3a-930a-9116d2c66168+6:2012:x1798653938041792:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:1.0:1715330290.641585:0:17197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d647480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:72de1896-1df4-4b3a-930a-9116d2c66168+6:2012:x1798653938041792:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 23us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330290.641591:0:17197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 173 00000100:00080000:0.0:1715330290.641656:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330260 00000100:00100000:2.0:1715330290.641802:0:7129:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938041664 00000100:00100000:2.0:1715330290.641805:0:7129:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938041664 00000100:00080000:0.0:1715330290.642033:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330260 00000100:00100000:2.0:1715330290.642691:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 329 00000100:00100000:2.0:1715330290.642697:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2012:x1798653938041664:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:2.0:1715330290.643017:0:7129:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2012:x1798653938041664:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 319us (1827us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330290.643024:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 329 00000100:00100000:3.0:1715330290.645542:0:9407:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4ea300 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:9407:1798653942470528:192.168.204.49@tcp:104: 00010000:00010000:3.0:1715330290.645570:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d8cf2 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8ceb expref: 23 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.645582:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff88011d537600) 00010000:00010000:3.0:1715330290.645584:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330290.645587:0:9407:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d8cf2 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8ceb expref: 23 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.645595:0:9407:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d8cf2 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8ceb expref: 23 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.645600:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013457e400, rc 0) 00000100:00100000:3.0:1715330290.645647:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+23:9622:x1798653942470464:12345-0@lo:101:mdt00_003.0 Request processed in 4310us (5188us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330290.645654:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2826 00000100:00100000:2.0:1715330290.645763:0:9622:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9622:1798653942470464:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1715330290.645935:0:9622:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d8ceb lrc: 4/0,1 mode: --/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8cf2 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.645944:0:9622:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d8ceb lrc: 4/0,1 mode: --/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8cf2 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330290.646383:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330290.646531:0:10673:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938041920 00000100:00100000:2.0:1715330290.646537:0:10673:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938041920 00010000:00010000:2.0:1715330290.646555:0:10673:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66d86b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb68c expref: 60 pid: 9622 timeout: 365 lvb_type: 0 00000100:00100000:2.0:1715330290.646586:0:10673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1540 00000100:00100000:2.0:1715330290.646592:0:10673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b160380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:72de1896-1df4-4b3a-930a-9116d2c66168+60:2011:x1798653938041920:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1715330290.646602:0:10673:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330290.646607:0:10673:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66d86b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb68c expref: 60 pid: 9622 timeout: 365 lvb_type: 0 00010000:00010000:2.0:1715330290.646616:0:10673:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66d86b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb68c expref: 60 pid: 9622 timeout: 365 lvb_type: 0 00010000:00010000:2.0:1715330290.646633:0:10673:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66d86b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb68c expref: 60 pid: 9622 timeout: 365 lvb_type: 0 00010000:00010000:2.0:1715330290.646767:0:10673:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff88011d537600) 00010000:00010000:2.0:1715330290.646773:0:10673:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d8cf2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8ceb expref: 22 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.646781:0:10673:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d8cf2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d8ceb expref: 22 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.646788:0:10673:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d8cf2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d8ceb expref: 22 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.646815:0:10673:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d8cf2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8ceb expref: 22 pid: 9407 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330290.646826:0:10673:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:10673:1798653942470592:0@lo:105: 00000100:00100000:2.0:1715330290.646851:0:10673:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330290.646872:0:10673:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435a80 going to sleep for 11 seconds 00000100:00100000:0.0:1715330290.646898:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942470592 00000100:00100000:0.0:1715330290.646901:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942470592 00000100:00100000:0.0:1715330290.646932:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1165 00000100:00100000:0.0:1715330290.646936:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:10673:x1798653942470592:12345-0@lo:105: 00010000:00010000:0.0:1715330290.646942:0:7118:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d8ceb lrc: 5/0,1 mode: --/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8cf2 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.646948:0:7118:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d8ceb lrc: 5/0,1 mode: --/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8cf2 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.646953:0:7118:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d8ceb lrc: 5/0,1 mode: --/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8cf2 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.646956:0:7118:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d8ceb lrc: 5/0,1 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d8cf2 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.646959:0:7118:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d8ceb lrc: 6/0,1 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d8cf2 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.646963:0:7118:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d8ceb lrc: 6/0,1 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d8cf2 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.646976:0:7118:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88011db66f40) 00010000:00010000:2.0:1715330290.646998:0:9622:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d8ceb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8cf2 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.647005:0:9622:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d8ceb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8cf2 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330290.647081:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:10673:x1798653942470592:12345-0@lo:105: Request processed in 144us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330290.647088:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1165 00000100:00100000:3.0:1715330290.647135:0:10673:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:10673:1798653942470592:0@lo:105: 00010000:00010000:3.0:1715330290.647144:0:10673:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715330290.647168:0:10673:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b160380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:72de1896-1df4-4b3a-930a-9116d2c66168+59:2011:x1798653938041920:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 576us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330290.647174:0:10673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1540 00000100:00100000:2.0:1715330290.647898:0:9622:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9622:1798653942470656:0@lo:403:mdt00_003.0 00000100:00100000:2.0:1715330290.647925:0:9622:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330290.647944:0:9622:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435300 going to sleep for 11 seconds 00000100:00100000:3.0:1715330290.648010:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942470656 00000100:00100000:3.0:1715330290.648013:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942470656 00000100:00100000:3.0:1715330290.648043:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2827 00000100:00100000:3.0:1715330290.648047:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+23:9622:x1798653942470656:12345-0@lo:403:mdt00_003.0 00000100:00100000:3.0:1715330290.649598:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+23:9622:x1798653942470656:12345-0@lo:403:mdt00_003.0 Request processed in 1548us (1670us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330290.649606:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2827 00000100:00100000:2.0:1715330290.649664:0:9622:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:9622:1798653942470656:0@lo:403:mdt00_003.0 00000040:00080000:2.0:1715330290.650892:0:9622:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].387, 952 off583304 00000040:00080000:2.0:1715330290.651020:0:9622:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].389, 1032 off638584 00000004:00080000:2.0:1715330290.651024:0:9622:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff880134435300 with version 741 00000004:00080000:0.0:1715330290.651076:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 741 rpc_version 741 00000020:00100000:0.0:1715330290.651101:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1715330290.651108:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008b162680 x1798653942470784/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2352/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715330290.651126:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b162680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942470784:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330290.651158:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330290.651178:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa180 going to sleep for 11 seconds 00000100:00100000:3.0:1715330290.651222:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942470784 00000100:00100000:3.0:1715330290.651824:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942470784 00000100:00100000:3.0:1715330290.652085:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2828 00000100:00100000:3.0:1715330290.652091:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b162a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+23:8278:x1798653942470784:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1715330290.652378:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b162a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+24:8278:x1798653942470784:12345-0@lo:1000:osp_up0-1.0 Request processed in 286us (1218us total) trans 4294983488 rc 0/0 00000100:00100000:3.0:1715330290.652384:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2828 00000100:00100000:1.0:1715330290.652534:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b162680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942470784:0@lo:1000:osp_up0-1.0 00000004:00200000:2.0:1715330290.655018:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x80:0x0]: returning size 4096 00010000:00010000:2.0:1715330290.655045:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a2640/0xd895711d66d8ce4 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330290.655055:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a2640/0xd895711d66d8ce4 lrc: 2/0,0 mode: EX/EX res: [0x240000400:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330290.655061:0:9622:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a2640/0xd895711d66d8ce4 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330290.655065:0:9622:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a2640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330290.655069:0:9622:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a2640/0xd895711d66d8ce4 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330290.655075:0:9622:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a2640/0xd895711d66d8ce4 lrc: 4/0,0 mode: EX/EX res: [0x240000400:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330290.655091:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x43:0x0].0x0 (ffff880135e32700) 00010000:00010000:2.0:1715330290.655095:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330290.655098:0:9622:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a2640/0xd895711d66d8ce4 lrc: 2/0,0 mode: --/EX res: [0x240000400:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330290.655102:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a2640/0xd895711d66d8ce4 lrc: 0/0,0 mode: --/EX res: [0x240000400:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330290.655129:0:9622:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d8ceb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8cf2 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.655136:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d8ceb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8cf2 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.655141:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d8ceb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8cf2 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.655176:0:9622:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1715330290.655185:0:9622:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000401:0x43:0x0] 00010000:00010000:2.0:1715330290.655193:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a3600/0xd895711d66d8cdd lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x80:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330290.655198:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a3600/0xd895711d66d8cdd lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x80:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330290.655203:0:9622:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a3600/0xd895711d66d8cdd lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x80:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330290.655207:0:9622:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a3600 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330290.655210:0:9622:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a3600/0xd895711d66d8cdd lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x80:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330290.655218:0:9622:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a3600/0xd895711d66d8cdd lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x80:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330290.655225:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x80:0x0].0x0 (ffff88012dcc3200) 00010000:00010000:2.0:1715330290.655227:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330290.655229:0:9622:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a3600/0xd895711d66d8cdd lrc: 2/0,0 mode: --/EX res: [0x240000402:0x80:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330290.655234:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a3600/0xd895711d66d8cdd lrc: 0/0,0 mode: --/EX res: [0x240000402:0x80:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT1 00010000:00010000:2.0:1715330290.655245:0:9622:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a1440/0xd895711d66d8ccf lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x80:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8cd6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.655251:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a1440/0xd895711d66d8ccf lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x80:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8cd6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.655256:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a1440/0xd895711d66d8ccf lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x80:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8cd6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.655280:0:9622:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:2.0:1715330290.655456:0:9622:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:2.0:1715330290.655460:0:9622:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a18c0/0xd895711d66d8cb3 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8cba expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.655476:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a18c0/0xd895711d66d8cb3 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8cba expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.655481:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a18c0/0xd895711d66d8cb3 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8cba expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.655509:0:9622:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000004:00080000:2.0:1715330290.655512:0:9622:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:2.0:1715330290.655515:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a3180/0xd895711d66d8cc1 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x4b3326f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8cc8 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.655522:0:9622:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a3180/0xd895711d66d8cc1 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x4b3326f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8cc8 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330290.655582:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+23:16983:x1798653938041600:12345-192.168.204.49@tcp:36:rm.0 Request processed in 21827us (22118us total) trans 4294968407 rc 0/0 00000100:00100000:2.0:1715330290.655591:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23455 00010000:00010000:1.0:1715330290.655792:0:7123:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1715330290.655798:0:7123:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d8ceb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d8cf2 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.655804:0:7123:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66f40 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330290.655807:0:7123:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d8ceb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d8cf2 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330290.655813:0:7123:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d8ceb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d8cf2 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.655836:0:7123:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d8ceb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8cf2 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.655842:0:7123:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330290.655858:0:7123:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d8ceb lrc: 1/0,0 mode: --/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8cf2 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.655863:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d8ceb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8cf2 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.655878:0:7123:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1715330290.655880:0:7123:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a1440/0xd895711d66d8ccf lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x80:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d8cd6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.655885:0:7123:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a1440 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330290.655888:0:7123:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a1440/0xd895711d66d8ccf lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x80:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d8cd6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330290.655893:0:7123:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a1440/0xd895711d66d8ccf lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x80:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d8cd6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.655904:0:7123:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a1440/0xd895711d66d8ccf lrc: 2/0,0 mode: --/EX res: [0x240000402:0x80:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8cd6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.655908:0:7123:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330290.655917:0:7123:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a1440/0xd895711d66d8ccf lrc: 1/0,0 mode: --/EX res: [0x240000402:0x80:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8cd6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.655923:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a1440/0xd895711d66d8ccf lrc: 0/0,0 mode: --/EX res: [0x240000402:0x80:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8cd6 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.655931:0:7123:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715330290.655933:0:7123:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a18c0/0xd895711d66d8cb3 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d8cba expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.655938:0:7123:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a18c0 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330290.655940:0:7123:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a18c0/0xd895711d66d8cb3 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d8cba expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330290.655945:0:7123:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a18c0/0xd895711d66d8cb3 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d8cba expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.655953:0:7123:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a18c0/0xd895711d66d8cb3 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8cba expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.655957:0:7123:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330290.655961:0:7123:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a18c0/0xd895711d66d8cb3 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8cba expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.655965:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a18c0/0xd895711d66d8cb3 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8cba expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.655974:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330290.655975:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330290.655976:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330290.655986:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d646300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942470912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330290.656023:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330290.656041:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1715330290.656045:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d647800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942470976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330290.656057:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330290.656074:0:10673:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942470912 00000100:00100000:1.0:1715330290.656080:0:10673:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942470912 00000100:00100000:1.0:1715330290.656097:0:10673:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942470976 00000100:00100000:1.0:1715330290.656099:0:10673:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942470976 00000100:00100000:1.0:1715330290.656110:0:10673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1336 00000100:00100000:1.0:1715330290.656115:0:10673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+25:3690:x1798653942470912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330290.656123:0:10673:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330290.656133:0:10673:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66d8cd6 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x80:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d8ccf expref: 25 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.656142:0:10673:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x80:0x0].0x0 (ffff88009d5fa000) 00010000:00010000:1.0:1715330290.656147:0:10673:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330290.656163:0:10673:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+24:3690:x1798653942470912:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330290.656168:0:10673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1336 00000100:00100000:1.0:1715330290.656196:0:10673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1337 00000100:00100000:1.0:1715330290.656199:0:10673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d647100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+23:3690:x1798653942470976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330290.656204:0:10673:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330290.656211:0:10673:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66d8cba lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d8cb3 expref: 23 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.656219:0:10673:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88009d5fa500) 00010000:00010000:1.0:1715330290.656223:0:10673:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330290.656234:0:10673:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d647100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+22:3690:x1798653942470976:12345-0@lo:103:ldlm_bl.0 Request processed in 34us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330290.656238:0:10673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1337 00000100:00100000:1.0:1715330290.656259:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d647800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942470976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330290.656265:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d646300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942470912:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330290.656418:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330290.656868:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d647b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942470848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1715330290.656890:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330290.657093:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942470848 00000100:00100000:0.0:1715330290.657097:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942470848 00010000:00010000:3.0:1715330290.657107:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330290.657116:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1338 00000100:00100000:0.0:1715330290.657121:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+22:3689:x1798653942470848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330290.657127:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330290.657141:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d8cf2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d8ceb expref: 22 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.657163:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff88011d537600) 00010000:00010000:0.0:1715330290.657169:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330290.657202:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+21:3689:x1798653942470848:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330290.657208:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1338 00000100:00100000:3.0:1715330290.657390:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d647b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942470848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330290.660289:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330290.660914:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938042048 00000100:00100000:2.0:1715330290.660922:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938042048 00000100:00100000:2.0:1715330290.661078:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23456 00000100:00100000:2.0:1715330290.661085:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+59:16983:x1798653938042048:12345-192.168.204.49@tcp:101:rm.0 00010000:00010000:2.0:1715330290.661103:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330290.661117:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d8cf9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x14d8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb80d expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715330290.661250:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x14d8:0x0]: returning size 4096 00010000:00010000:2.0:1715330290.661312:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d8cf9 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x14d8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb80d expref: 61 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.661320:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d8cf9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x14d8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb80d expref: 61 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.661330:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db673c0, rc 0) 00000100:00100000:2.0:1715330290.661378:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+60:16983:x1798653938042048:12345-192.168.204.49@tcp:101:rm.0 Request processed in 293us (1093us total) trans 4294983489 rc 301/301 00000100:00100000:2.0:1715330290.661384:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23456 00000100:00100000:0.0:1715330290.666025:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330290.666071:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938042176 00000100:00100000:2.0:1715330290.666079:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938042176 00000100:00100000:2.0:1715330290.666110:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5059 00000100:00100000:2.0:1715330290.666117:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+60:16983:x1798653938042176:12345-192.168.204.49@tcp:35:rm.0 00000100:00100000:2.0:1715330290.666274:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+61:16983:x1798653938042176:12345-192.168.204.49@tcp:35:rm.0 Request processed in 157us (255us total) trans 4294983490 rc 0/0 00000100:00100000:2.0:1715330290.666281:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5059 00000100:00100000:0.0:1715330290.668690:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330290.668962:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938042240 00000100:00100000:2.0:1715330290.668968:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938042240 00000100:00100000:2.0:1715330290.669035:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1339 00000100:00100000:2.0:1715330290.669042:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b160a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72de1896-1df4-4b3a-930a-9116d2c66168+23:2011:x1798653938042240:12345-192.168.204.49@tcp:103:rm.0 00010000:00010000:2.0:1715330290.669052:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330290.669072:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457cfc0/0xd895711d66d87c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x14d8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb6f5 expref: 23 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.669086:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14d8:0x0].0x0 (ffff88012dcc3a00) 00010000:00010000:2.0:1715330290.669094:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330290.669132:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b160a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72de1896-1df4-4b3a-930a-9116d2c66168+22:2011:x1798653938042240:12345-192.168.204.49@tcp:103:rm.0 Request processed in 90us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330290.669138:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1339 00000100:00100000:1.0:1715330290.669299:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330290.669422:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938042368 00000100:00100000:2.0:1715330290.669426:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938042368 00000100:00100000:2.0:1715330290.669456:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23457 00000100:00100000:2.0:1715330290.669461:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+61:16983:x1798653938042368:12345-192.168.204.49@tcp:36:rm.0 00010000:00010000:2.0:1715330290.669506:0:7135:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330290.669517:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d87dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x14d8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb703 expref: 61 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.669683:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14d8:0x0].0x0 (ffff88012dcc3d00) 00010000:00010000:2.0:1715330290.669689:0:7135:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330290.669720:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66f40/0xd895711d66d8d07 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330290.669727:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66f40/0xd895711d66d8d07 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330290.669749:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66f40/0xd895711d66d8d07 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT0 00000100:00100000:2.0:1715330290.669764:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942471040:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1715330290.669790:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330290.669808:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009396cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1715330290.669846:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942471040 00000100:00100000:0.0:1715330290.669848:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942471040 00000100:00100000:0.0:1715330290.669874:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2829 00000100:00100000:0.0:1715330290.669877:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:7135:x1798653942471040:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330290.669887:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330290.669895:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a1f80/0xd895711d66d8d0e lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d8d07 expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.669910:0:23404:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a1f80/0xd895711d66d8d0e lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d8d07 expref: 20 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.669918:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a1f80/0xd895711d66d8d0e lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8d07 expref: 20 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.669923:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88009ef57100) 00010000:00010000:0.0:1715330290.669925:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330290.669927:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a1f80, rc 0) 00000100:00100000:0.0:1715330290.669945:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+20:7135:x1798653942471040:12345-0@lo:101:mdt00_002.0 Request processed in 67us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330290.669949:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2829 00000100:00100000:2.0:1715330290.669997:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942471040:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1715330290.670006:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66f40/0xd895711d66d8d07 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8d0e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.670013:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66f40/0xd895711d66d8d07 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8d0e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715330290.670024:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:2.0:1715330290.670036:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67180/0xd895711d66d8d15 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x4b4526f7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330290.670041:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67180/0xd895711d66d8d15 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x4b4526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330290.670047:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67180/0xd895711d66d8d15 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x4b4526f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT0 00000100:00100000:2.0:1715330290.670055:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942471104:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1715330290.670070:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330290.670078:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009396cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1715330290.670130:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942471104 00000100:00100000:3.0:1715330290.670134:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942471104 00000100:00100000:3.0:1715330290.670159:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2830 00000100:00100000:3.0:1715330290.670164:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+20:7135:x1798653942471104:12345-0@lo:101:mdt00_002.0 00010000:00010000:3.0:1715330290.670170:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330290.670180:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013457ed00/0xd895711d66d8d1c lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x4b4526f7 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d8d15 expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.670192:0:9407:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457ed00/0xd895711d66d8d1c lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x4b4526f7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d8d15 expref: 21 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.670199:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457ed00/0xd895711d66d8d1c lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x4b4526f7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8d15 expref: 21 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.670204:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x4b4526f7 (ffff88008b122400) 00010000:00010000:3.0:1715330290.670206:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330290.670208:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013457ed00, rc 0) 00000100:00100000:3.0:1715330290.670229:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+21:7135:x1798653942471104:12345-0@lo:101:mdt00_002.0 Request processed in 65us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330290.670234:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2830 00000100:00100000:2.0:1715330290.670381:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942471104:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1715330290.670389:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67180/0xd895711d66d8d15 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x4b4526f7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8d1c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.670395:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67180/0xd895711d66d8d15 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x4b4526f7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8d1c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715330290.670404:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:2.0:1715330290.670425:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942471168:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1715330290.670444:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330290.670462:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009396c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330290.670485:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942471168 00000100:00100000:0.0:1715330290.670488:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942471168 00000100:00100000:0.0:1715330290.670510:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2831 00000100:00100000:0.0:1715330290.670513:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+21:7135:x1798653942471168:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1715330290.670575:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+21:7135:x1798653942471168:12345-0@lo:1000:mdt00_002.0 Request processed in 61us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330290.670609:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2831 00000100:00100000:2.0:1715330290.670631:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942471168:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1715330290.670655:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942471232:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1715330290.670668:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330290.670675:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009396c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330290.670681:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942471232 00000100:00100000:0.0:1715330290.670684:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942471232 00000100:00100000:0.0:1715330290.670703:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2832 00000100:00100000:0.0:1715330290.670707:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+21:7135:x1798653942471232:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1715330290.670822:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+21:7135:x1798653942471232:12345-0@lo:1000:mdt00_002.0 Request processed in 114us (152us total) trans 0 rc 1/1 00000100:00100000:0.0:1715330290.670827:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2832 00000100:00100000:3.0:1715330290.670915:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942471232:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1715330290.670941:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e880/0xd895711d66d8d23 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14d8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.670946:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e880/0xd895711d66d8d23 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14d8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.670951:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e880/0xd895711d66d8d23 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14d8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT0 00000100:00100000:3.0:1715330290.671002:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4ea300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942471296:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1715330290.671019:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330290.671037:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b43336c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330290.671076:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942471296 00000100:00100000:0.0:1715330290.671079:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942471296 00000100:00100000:0.0:1715330290.671131:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2833 00000100:00100000:0.0:1715330290.671135:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+21:7135:x1798653942471296:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330290.671141:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330290.671149:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a3600/0xd895711d66d8d2a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x14d8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d8d23 expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.671160:0:23404:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a3600/0xd895711d66d8d2a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14d8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d8d23 expref: 22 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.671166:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a3600/0xd895711d66d8d2a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14d8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8d23 expref: 22 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.671171:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14d8:0x0].0x0 (ffff88009ef57f00) 00010000:00010000:0.0:1715330290.671173:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1715330290.671174:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a3600, rc 0) 00000100:00100000:0.0:1715330290.671192:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+22:7135:x1798653942471296:12345-0@lo:101:mdt00_002.0 Request processed in 56us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330290.671196:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2833 00000100:00100000:3.0:1715330290.671258:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4ea300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942471296:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1715330290.671266:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e880/0xd895711d66d8d23 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x14d8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8d2a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.671272:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e880/0xd895711d66d8d23 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x14d8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8d2a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.671288:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d8d31 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14d8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.671294:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d8d31 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14d8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.671300:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d8d31 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14d8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.671312:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d8d38 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xaa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.671319:0:7135:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d200/0xd895711d66d87ea lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xaa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb70a expref: 60 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.671325:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d8d38 lrc: 4/0,1 mode: --/EX res: [0x200000400:0xaa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.671339:0:7135:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d200/0xd895711d66d87ea lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xaa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb70a expref: 60 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.671349:0:7135:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d200/0xd895711d66d87ea lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xaa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb70a expref: 60 pid: 7135 timeout: 365 lvb_type: 0 00000100:00100000:3.0:1715330290.671357:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4ea300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7135:1798653942471360:192.168.204.49@tcp:104: 00000100:00100000:3.0:1715330290.671385:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b43336c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330290.675203:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330290.675290:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4ea300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7135:1798653942471360:192.168.204.49@tcp:104: 00010000:00010000:3.0:1715330290.675313:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d8d38 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xaa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000100:00100000:1.0:1715330290.675380:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938042432 00000100:00100000:1.0:1715330290.675386:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938042432 00010000:00010000:1.0:1715330290.675409:0:10674:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d200/0xd895711d66d87ea lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xaa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb70a expref: 61 pid: 7135 timeout: 365 lvb_type: 0 00000100:00100000:1.0:1715330290.675441:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1541 00000100:00100000:1.0:1715330290.675446:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b160380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:72de1896-1df4-4b3a-930a-9116d2c66168+61:2012:x1798653938042432:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1715330290.675457:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330290.675462:0:10674:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d200/0xd895711d66d87ea lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xaa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb70a expref: 61 pid: 7135 timeout: 365 lvb_type: 0 00010000:00010000:1.0:1715330290.675480:0:10674:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d200/0xd895711d66d87ea lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xaa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb70a expref: 61 pid: 7135 timeout: 365 lvb_type: 0 00010000:00010000:1.0:1715330290.675496:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d200/0xd895711d66d87ea lrc: 0/0,0 mode: --/PR res: [0x200000400:0xaa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb70a expref: 61 pid: 7135 timeout: 365 lvb_type: 0 00010000:00010000:1.0:1715330290.675517:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xaa:0x0].0x0 (ffff88012dcc3600) 00010000:00010000:1.0:1715330290.675521:0:10674:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d8d38 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xaa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.675528:0:10674:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d8d38 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xaa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.675534:0:10674:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d8d38 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xaa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330290.675548:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330290.675589:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b160380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:72de1896-1df4-4b3a-930a-9116d2c66168+60:2012:x1798653938042432:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 142us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330290.675596:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1541 00010000:00010000:3.0:1715330290.675692:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d8d38 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xaa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.675699:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d8d38 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xaa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.675748:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457dd40/0xd895711d66d8d3f lrc: 3/0,1 mode: --/EX res: [0x240000401:0xaa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.675754:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457dd40/0xd895711d66d8d3f lrc: 3/0,1 mode: --/EX res: [0x240000401:0xaa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.675762:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457dd40/0xd895711d66d8d3f lrc: 3/0,1 mode: --/EX res: [0x240000401:0xaa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT0 00000100:00100000:3.0:1715330290.675777:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4ea300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942471424:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1715330290.675805:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330290.675817:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b43336c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330290.676084:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942471424 00000100:00100000:1.0:1715330290.676087:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942471424 00000100:00100000:1.0:1715330290.676350:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2834 00000100:00100000:1.0:1715330290.676355:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+22:7135:x1798653942471424:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330290.676367:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330290.676376:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfeac0/0xd895711d66d8d46 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xaa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d8d3f expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.676392:0:9408:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db646c0/0xd895711d66d87f8 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0xaa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb711 expref: 21 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.676399:0:9408:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfeac0/0xd895711d66d8d46 lrc: 4/0,0 mode: --/EX res: [0x240000401:0xaa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d8d3f expref: 23 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.676413:0:9408:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88011db646c0/0xd895711d66d87f8 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xaa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb711 expref: 21 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.676420:0:9408:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db646c0/0xd895711d66d87f8 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xaa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb711 expref: 21 pid: 9622 timeout: 365 lvb_type: 0 00000100:00100000:1.0:1715330290.676428:0:9408:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d647800 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:9408:1798653942471488:192.168.204.49@tcp:104: 00000100:00100000:1.0:1715330290.676930:0:9408:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4b2f180 going to sleep for 11 seconds 00000100:00100000:1.0:1715330290.680302:0:9408:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d647800 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:9408:1798653942471488:192.168.204.49@tcp:104: 00010000:00010000:1.0:1715330290.680327:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfeac0/0xd895711d66d8d46 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xaa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8d3f expref: 23 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.680336:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xaa:0x0].0x0 (ffff88009396dd00) 00010000:00010000:1.0:1715330290.680339:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330290.680343:0:9408:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfeac0/0xd895711d66d8d46 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xaa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8d3f expref: 23 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.680350:0:9408:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfeac0/0xd895711d66d8d46 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xaa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8d3f expref: 23 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.680355:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfeac0, rc 0) 00000100:00100000:1.0:1715330290.680404:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+23:7135:x1798653942471424:12345-0@lo:101:mdt00_002.0 Request processed in 4048us (4598us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330290.680411:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2834 00000100:00100000:3.0:1715330290.680528:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4ea300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942471424:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1715330290.680543:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457dd40/0xd895711d66d8d3f lrc: 4/0,1 mode: --/EX res: [0x240000401:0xaa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8d46 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.680551:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457dd40/0xd895711d66d8d3f lrc: 4/0,1 mode: --/EX res: [0x240000401:0xaa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8d46 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330290.680953:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330290.681134:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938042496 00000100:00100000:2.0:1715330290.681140:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938042496 00010000:00010000:2.0:1715330290.681158:0:7122:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db646c0/0xd895711d66d87f8 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xaa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb711 expref: 22 pid: 9622 timeout: 365 lvb_type: 0 00000100:00100000:2.0:1715330290.681178:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1542 00000100:00100000:2.0:1715330290.681183:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b161500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72de1896-1df4-4b3a-930a-9116d2c66168+22:2012:x1798653938042496:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1715330290.681193:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330290.681198:0:7122:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff88011db646c0/0xd895711d66d87f8 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xaa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb711 expref: 22 pid: 9622 timeout: 365 lvb_type: 0 00010000:00010000:2.0:1715330290.681207:0:7122:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff88011db646c0/0xd895711d66d87f8 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xaa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb711 expref: 22 pid: 9622 timeout: 365 lvb_type: 0 00010000:00010000:2.0:1715330290.681222:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db646c0/0xd895711d66d87f8 lrc: 0/0,0 mode: --/PR res: [0x240000401:0xaa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb711 expref: 22 pid: 9622 timeout: 365 lvb_type: 0 00010000:00010000:2.0:1715330290.681248:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xaa:0x0].0x0 (ffff88009396dd00) 00010000:00010000:2.0:1715330290.681252:0:7122:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfeac0/0xd895711d66d8d46 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xaa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8d3f expref: 22 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.681259:0:7122:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfeac0/0xd895711d66d8d46 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xaa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d8d3f expref: 22 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.681265:0:7122:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfeac0/0xd895711d66d8d46 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xaa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d8d3f expref: 22 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.681289:0:7122:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfeac0/0xd895711d66d8d46 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xaa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8d3f expref: 22 pid: 9408 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330290.681300:0:7122:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:7122:1798653942471552:0@lo:105: 00000100:00100000:2.0:1715330290.681325:0:7122:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330290.681338:0:7122:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009396cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1715330290.681697:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942471552 00000100:00100000:0.0:1715330290.681701:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942471552 00000100:00100000:0.0:1715330290.681719:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1166 00000100:00100000:0.0:1715330290.681724:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7122:x1798653942471552:12345-0@lo:105: 00010000:00010000:0.0:1715330290.681749:0:7118:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457dd40/0xd895711d66d8d3f lrc: 5/0,1 mode: --/EX res: [0x240000401:0xaa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8d46 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.681757:0:7118:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457dd40/0xd895711d66d8d3f lrc: 5/0,1 mode: --/EX res: [0x240000401:0xaa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8d46 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.681763:0:7118:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457dd40/0xd895711d66d8d3f lrc: 5/0,1 mode: --/EX res: [0x240000401:0xaa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8d46 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.681768:0:7118:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457dd40/0xd895711d66d8d3f lrc: 5/0,1 mode: EX/EX res: [0x240000401:0xaa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d8d46 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.681773:0:7118:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457dd40/0xd895711d66d8d3f lrc: 6/0,1 mode: EX/EX res: [0x240000401:0xaa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d8d46 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.681779:0:7118:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457dd40/0xd895711d66d8d3f lrc: 6/0,1 mode: EX/EX res: [0x240000401:0xaa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d8d46 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.681792:0:7118:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88013457dd40) 00000100:00100000:0.0:1715330290.681815:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7122:x1798653942471552:12345-0@lo:105: Request processed in 90us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330290.681820:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1166 00010000:00010000:3.0:1715330290.681867:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457dd40/0xd895711d66d8d3f lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xaa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8d46 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.681874:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457dd40/0xd895711d66d8d3f lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xaa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8d46 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330290.682380:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4ea300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942471616:0@lo:403:mdt00_002.0 00000100:00100000:3.0:1715330290.682408:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330290.682419:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b43336c0 going to sleep for 11 seconds 00000100:00100000:3.0:1715330290.682428:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942471616 00000100:00100000:3.0:1715330290.682431:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942471616 00000100:00100000:3.0:1715330290.682445:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2835 00000100:00100000:3.0:1715330290.682449:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+23:7135:x1798653942471616:12345-0@lo:403:mdt00_002.0 00000100:00100000:3.0:1715330290.683754:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+23:7135:x1798653942471616:12345-0@lo:403:mdt00_002.0 Request processed in 1279us (1321us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330290.683761:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2835 00000100:00100000:3.0:1715330290.683808:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4ea300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942471616:0@lo:403:mdt00_002.0 00000100:00100000:2.0:1715330290.684116:0:7122:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:7122:1798653942471552:0@lo:105: 00010000:00010000:2.0:1715330290.684127:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330290.684159:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b161500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72de1896-1df4-4b3a-930a-9116d2c66168+21:2012:x1798653938042496:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 2975us (3208us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330290.684165:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1542 00000040:00080000:3.0:1715330290.684633:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].369, 952 off558960 00000040:00080000:3.0:1715330290.684843:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].368, 1032 off602224 00000004:00080000:3.0:1715330290.684848:0:7135:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8800b43336c0 with version 695 00000004:00080000:0.0:1715330290.684862:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 695 rpc_version 695 00000020:00100000:0.0:1715330290.684884:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1715330290.684889:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008b163100 x1798653942471744/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 2352/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715330290.684903:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b163100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942471744:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330290.684930:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330290.684953:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa180 going to sleep for 11 seconds 00000100:00100000:2.0:1715330290.685000:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942471744 00000100:00100000:2.0:1715330290.685004:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942471744 00000100:00100000:2.0:1715330290.685035:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2836 00000100:00100000:2.0:1715330290.685040:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b160700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+23:8587:x1798653942471744:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1715330290.685349:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b160700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+24:8587:x1798653942471744:12345-0@lo:1000:osp_up1-0.0 Request processed in 308us (417us total) trans 4294968408 rc 0/0 00000100:00100000:2.0:1715330290.685355:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2836 00000100:00100000:0.0:1715330290.685417:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b163100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942471744:0@lo:1000:osp_up1-0.0 00000004:00200000:3.0:1715330290.685461:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x14d8:0x0]: returning size 4096 00010000:00010000:3.0:1715330290.685488:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d8d38 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xaa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.685495:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d8d38 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0xaa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.685501:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d8d38 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xaa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.685506:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457e400 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330290.685509:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d8d38 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xaa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.685518:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d8d38 lrc: 4/0,0 mode: EX/EX res: [0x200000400:0xaa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.685528:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xaa:0x0].0x0 (ffff88012dcc3600) 00010000:00010000:3.0:1715330290.685530:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330290.685533:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d8d38 lrc: 2/0,0 mode: --/EX res: [0x200000400:0xaa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.685538:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d8d38 lrc: 0/0,0 mode: --/EX res: [0x200000400:0xaa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.685551:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457dd40/0xd895711d66d8d3f lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xaa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8d46 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.685557:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457dd40/0xd895711d66d8d3f lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xaa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8d46 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.685561:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457dd40/0xd895711d66d8d3f lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xaa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8d46 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.685583:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1715330290.685589:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0xaa:0x0] 00010000:00010000:3.0:1715330290.685595:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d8d31 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14d8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.685599:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d8d31 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x14d8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.685604:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d8d31 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14d8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.685608:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457e1c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330290.685611:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d8d31 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14d8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.685615:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d8d31 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x14d8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.685621:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14d8:0x0].0x0 (ffff88008b122200) 00010000:00010000:3.0:1715330290.685623:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330290.685626:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d8d31 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x14d8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.685630:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d8d31 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x14d8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.685639:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e880/0xd895711d66d8d23 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x14d8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8d2a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.685644:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e880/0xd895711d66d8d23 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x14d8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8d2a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.685649:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e880/0xd895711d66d8d23 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14d8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8d2a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.685783:0:7124:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1715330290.685788:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457dd40/0xd895711d66d8d3f lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xaa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d8d46 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.685794:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457dd40 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:2.0:1715330290.685797:0:7124:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457dd40/0xd895711d66d8d3f lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xaa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d8d46 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1715330290.685803:0:7124:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457dd40/0xd895711d66d8d3f lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xaa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d8d46 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.685820:0:7124:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457dd40/0xd895711d66d8d3f lrc: 2/0,0 mode: --/EX res: [0x240000401:0xaa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8d46 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.685824:0:7124:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1715330290.685841:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457dd40/0xd895711d66d8d3f lrc: 1/0,0 mode: --/EX res: [0x240000401:0xaa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8d46 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.685846:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457dd40/0xd895711d66d8d3f lrc: 0/0,0 mode: --/EX res: [0x240000401:0xaa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8d46 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.685863:0:7124:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1715330290.685865:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e880/0xd895711d66d8d23 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x14d8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d8d2a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.685870:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457e880 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:2.0:1715330290.685872:0:7124:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e880/0xd895711d66d8d23 lrc: 5/0,0 mode: EX/EX res: [0x200000402:0x14d8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d8d2a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1715330290.685877:0:7124:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e880/0xd895711d66d8d23 lrc: 5/0,0 mode: EX/EX res: [0x200000402:0x14d8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d8d2a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.685884:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715330290.685908:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00000100:00100000:3.0:1715330290.685922:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942471808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1715330290.685944:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1715330290.686337:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:3.0:1715330290.686342:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66f40/0xd895711d66d8d07 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8d0e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.686348:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66f40/0xd895711d66d8d07 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8d0e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.686357:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66f40/0xd895711d66d8d07 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8d0e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.686366:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1715330290.686368:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:3.0:1715330290.686372:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67180/0xd895711d66d8d15 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x4b4526f7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8d1c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.686377:0:7135:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67180/0xd895711d66d8d15 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x4b4526f7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8d1c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.686429:0:9415:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715330290.686434:0:9415:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66f40/0xd895711d66d8d07 lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d8d0e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.686439:0:9415:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66f40 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330290.686442:0:9415:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66f40/0xd895711d66d8d07 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d8d0e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330290.686447:0:9415:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66f40/0xd895711d66d8d07 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d8d0e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.686477:0:9415:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66f40/0xd895711d66d8d07 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8d0e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.686481:0:9415:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330290.686497:0:9415:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66f40/0xd895711d66d8d07 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8d0e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.686502:0:9415:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66f40/0xd895711d66d8d07 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8d0e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.686520:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330290.686521:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330290.686523:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330290.686568:0:7124:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e880/0xd895711d66d8d23 lrc: 4/0,0 mode: --/EX res: [0x200000402:0x14d8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8d2a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.686574:0:7124:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1715330290.686594:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e880/0xd895711d66d8d23 lrc: 1/0,0 mode: --/EX res: [0x200000402:0x14d8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8d2a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.686600:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e880/0xd895711d66d8d23 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x14d8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8d2a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330290.686610:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330290.686611:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330290.686613:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330290.686619:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942471808 00000100:00100000:2.0:1715330290.686620:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d647800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942471936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330290.686623:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942471808 00000100:00100000:2.0:1715330290.686639:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330290.686642:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1340 00000100:00100000:0.0:1715330290.686646:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+24:3688:x1798653942471808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330290.686654:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330290.686665:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfeac0/0xd895711d66d8d46 lrc: 0/0,0 mode: --/EX res: [0x240000401:0xaa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d8d3f expref: 24 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.686678:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xaa:0x0].0x0 (ffff88009396dd00) 00010000:00010000:0.0:1715330290.686684:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330290.686711:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942471872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1715330290.686717:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+60:16983:x1798653938042368:12345-192.168.204.49@tcp:36:rm.0 Request processed in 17254us (17418us total) trans 4294983491 rc 0/0 00000100:00100000:3.0:1715330290.686722:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23457 00000100:00100000:3.0:1715330290.686758:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942471936 00000100:00100000:3.0:1715330290.686761:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942471936 00000100:00100000:3.0:1715330290.686780:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1341 00000100:00100000:3.0:1715330290.686785:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+24:3689:x1798653942471936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1715330290.686792:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1715330290.686827:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330290.686843:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+24:3688:x1798653942471808:12345-0@lo:103:ldlm_bl.0 Request processed in 195us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330290.686847:0:10673:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942471872 00000100:00100000:0.0:1715330290.686848:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1340 00000100:00100000:1.0:1715330290.686850:0:10673:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942471872 00000100:00100000:1.0:1715330290.686874:0:10673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1342 00000100:00100000:1.0:1715330290.686877:0:10673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d644a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+24:3690:x1798653942471872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330290.686883:0:10673:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330290.686892:0:10673:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a3600/0xd895711d66d8d2a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x14d8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d8d23 expref: 24 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330290.686900:0:10673:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14d8:0x0].0x0 (ffff88009ef57f00) 00010000:00010000:1.0:1715330290.686905:0:10673:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330290.686923:0:10673:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d644a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+23:3690:x1798653942471872:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330290.686927:0:10673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1342 00000100:00100000:1.0:1715330290.686947:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942471872:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1715330290.686981:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a1f80/0xd895711d66d8d0e lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d8d07 expref: 22 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.686991:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88009ef57100) 00010000:00010000:3.0:1715330290.686995:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330290.687003:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942471808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1715330290.687013:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+21:3689:x1798653942471936:12345-0@lo:103:ldlm_bl.0 Request processed in 228us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330290.687016:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d647800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942471936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1715330290.687018:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1341 00000100:00100000:0.0:1715330290.691250:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330290.691415:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938042624 00000100:00100000:2.0:1715330290.691422:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938042624 00000100:00100000:2.0:1715330290.691485:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5060 00000100:00100000:2.0:1715330290.691491:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ef1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+60:16983:x1798653938042624:12345-192.168.204.49@tcp:35:rm.0 00000040:00080000:2.0:1715330290.691684:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].370, 344 off559304 00000040:00080000:2.0:1715330290.691712:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].369, 424 off602648 00000004:00080000:2.0:1715330290.691714:0:15159:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88009396c480 with version 696 00000004:00080000:0.0:1715330290.691748:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 696 rpc_version 696 00000020:00100000:0.0:1715330290.691770:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1715330290.691777:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008b160000 x1798653942472064/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1304/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715330290.691794:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b160000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942472064:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330290.691828:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330290.691845:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa180 going to sleep for 11 seconds 00000100:00100000:2.0:1715330290.691859:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942472064 00000100:00100000:2.0:1715330290.691862:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942472064 00000100:00100000:2.0:1715330290.691890:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2837 00000100:00100000:2.0:1715330290.691893:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b160a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+21:8587:x1798653942472064:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1715330290.692003:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b160a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+22:8587:x1798653942472064:12345-0@lo:1000:osp_up1-0.0 Request processed in 108us (172us total) trans 4294968409 rc 0/0 00000100:00100000:2.0:1715330290.692009:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2837 00000100:00100000:0.0:1715330290.692086:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b160000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942472064:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1715330290.692172:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ef1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+61:16983:x1798653938042624:12345-192.168.204.49@tcp:35:rm.0 Request processed in 680us (930us total) trans 4294983492 rc 0/0 00000100:00100000:2.0:1715330290.692178:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5060 00000100:00100000:0.0:1715330290.695121:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330290.695178:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938042752 00000100:00100000:3.0:1715330290.695184:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938042752 00000100:00100000:3.0:1715330290.695214:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23458 00000100:00100000:3.0:1715330290.695220:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b160380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+61:16983:x1798653938042752:12345-192.168.204.49@tcp:36:rm.0 00010000:00010000:3.0:1715330290.695258:0:7135:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1715330290.695276:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd8c0/0xd895711d66c5357 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x138f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bf7c2b expref: 61 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.695294:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457db00/0xd895711d66c528c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x138f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bf7bfa expref: 60 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.695309:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457fa80/0xd895711d66c524d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x138f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bf7bde expref: 59 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.695317:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x138f:0x0].0x0 (ffff88008b374d00) 00010000:00010000:3.0:1715330290.695329:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c900/0xd895711d66c5231 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bf7bd7 expref: 58 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.695335:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:3.0:1715330290.695337:0:7135:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330290.695355:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c6c0/0xd895711d66d8d4d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.695364:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c6c0/0xd895711d66d8d4d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.695370:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c6c0/0xd895711d66d8d4d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.695380:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f600/0xd895711d66d8d54 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x82986a8e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.695386:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f600/0xd895711d66d8d54 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x82986a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.695391:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f600/0xd895711d66d8d54 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x82986a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.696071:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f180/0xd895711d66d8d5b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x138f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.696080:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f180/0xd895711d66d8d5b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x138f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.696086:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f180/0xd895711d66d8d5b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x138f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.696103:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cd80/0xd895711d66d8d62 lrc: 3/0,1 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.696108:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cd80/0xd895711d66d8d62 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.696113:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cd80/0xd895711d66d8d62 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.696138:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457d680/0xd895711d66d8d69 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.696143:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457d680/0xd895711d66d8d69 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.696150:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457d680/0xd895711d66d8d69 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT0 00000100:00100000:3.0:1715330290.696166:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4ea300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942472128:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1715330290.696337:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330290.696518:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4333840 going to sleep for 11 seconds 00000100:00100000:0.0:1715330290.696572:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942472128 00000100:00100000:0.0:1715330290.696577:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942472128 00000100:00100000:0.0:1715330290.696608:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2838 00000100:00100000:0.0:1715330290.696613:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+22:7135:x1798653942472128:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330290.696623:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330290.696635:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a2640/0xd895711d66d8d70 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d8d69 expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.696647:0:9408:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a2640/0xd895711d66d8d70 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d8d69 expref: 23 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.696654:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a2640/0xd895711d66d8d70 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8d69 expref: 23 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.696659:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88009edfa500) 00010000:00010000:0.0:1715330290.696661:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715330290.696663:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a2640, rc 0) 00000100:00100000:0.0:1715330290.696697:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+23:7135:x1798653942472128:12345-0@lo:101:mdt00_002.0 Request processed in 82us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330290.696702:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2838 00000100:00100000:3.0:1715330290.696808:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4ea300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942472128:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1715330290.696817:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457d680/0xd895711d66d8d69 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8d70 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.696824:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457d680/0xd895711d66d8d69 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8d70 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330290.697299:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4ea300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942472192:0@lo:403:mdt00_002.0 00000100:00100000:3.0:1715330290.697324:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330290.697332:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4333840 going to sleep for 11 seconds 00000100:00100000:2.0:1715330290.697388:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942472192 00000100:00100000:2.0:1715330290.697391:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942472192 00000100:00100000:2.0:1715330290.697435:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2839 00000100:00100000:2.0:1715330290.697440:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+23:7135:x1798653942472192:12345-0@lo:403:mdt00_002.0 00000100:00100000:2.0:1715330290.699368:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+23:7135:x1798653942472192:12345-0@lo:403:mdt00_002.0 Request processed in 1925us (2041us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330290.699375:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2839 00000100:00100000:3.0:1715330290.699435:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4ea300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942472192:0@lo:403:mdt00_002.0 00000040:00080000:3.0:1715330290.700312:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].371, 936 off560240 00000040:00080000:3.0:1715330290.700435:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].370, 1016 off603664 00000004:00080000:3.0:1715330290.700439:0:7135:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8800b4333840 with version 697 00000004:00080000:0.0:1715330290.701558:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 697 rpc_version 697 00000020:00100000:0.0:1715330290.701582:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1715330290.701589:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008b161500 x1798653942472320/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1976/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715330290.701605:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b161500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942472320:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330290.701640:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330290.701784:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa180 going to sleep for 11 seconds 00000100:00100000:2.0:1715330290.701835:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942472320 00000100:00100000:2.0:1715330290.701841:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942472320 00000100:00100000:2.0:1715330290.701863:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2840 00000100:00100000:2.0:1715330290.701868:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b162300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+23:8587:x1798653942472320:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1715330290.702081:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b162300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+24:8587:x1798653942472320:12345-0@lo:1000:osp_up1-0.0 Request processed in 211us (439us total) trans 4294968410 rc 0/0 00000100:00100000:2.0:1715330290.702087:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2840 00000100:00100000:1.0:1715330290.702123:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b161500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942472320:0@lo:1000:osp_up1-0.0 00000004:00200000:3.0:1715330290.702163:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x138f:0x0]: returning size 4096 00010000:00010000:3.0:1715330290.702181:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cd80/0xd895711d66d8d62 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.702189:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cd80/0xd895711d66d8d62 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.702195:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cd80/0xd895711d66d8d62 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.702200:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457cd80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330290.702203:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cd80/0xd895711d66d8d62 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.702213:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cd80/0xd895711d66d8d62 lrc: 4/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.702224:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff88008b122600) 00010000:00010000:3.0:1715330290.702226:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330290.702229:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cd80/0xd895711d66d8d62 lrc: 2/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.702234:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cd80/0xd895711d66d8d62 lrc: 0/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.702248:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457d680/0xd895711d66d8d69 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8d70 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.702254:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457d680/0xd895711d66d8d69 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8d70 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.702259:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457d680/0xd895711d66d8d69 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8d70 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330290.702271:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1715330290.702277:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:3.0:1715330290.702281:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f180/0xd895711d66d8d5b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x138f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.702285:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f180/0xd895711d66d8d5b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x138f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.702289:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f180/0xd895711d66d8d5b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x138f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.702292:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457f180 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330290.702295:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f180/0xd895711d66d8d5b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x138f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.702298:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f180/0xd895711d66d8d5b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x138f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.702304:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x138f:0x0].0x0 (ffff88008b122a00) 00010000:00010000:3.0:1715330290.702305:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330290.702307:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f180/0xd895711d66d8d5b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x138f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.702311:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f180/0xd895711d66d8d5b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x138f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.702411:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c6c0/0xd895711d66d8d4d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.702416:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c6c0/0xd895711d66d8d4d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.702420:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c6c0/0xd895711d66d8d4d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.702424:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c6c0/0xd895711d66d8d4d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.702428:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457c6c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330290.702430:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c6c0/0xd895711d66d8d4d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.702434:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c6c0/0xd895711d66d8d4d lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.702440:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:3.0:1715330290.702442:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330290.702445:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c6c0/0xd895711d66d8d4d lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.702449:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c6c0/0xd895711d66d8d4d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00000004:00010000:3.0:1715330290.702456:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008b160380 reply state ffff88012fbba000 transno 4294983493 ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f600/0xd895711d66d8d54 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x82986a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.702472:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f600/0xd895711d66d8d54 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x82986a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330290.702478:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x82986a8e (ffff88008b122300) 00010000:00010000:3.0:1715330290.702480:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330290.702483:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330290.702538:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b160380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+59:16983:x1798653938042752:12345-192.168.204.49@tcp:36:rm.0 Request processed in 7315us (7420us total) trans 4294983493 rc 0/0 00000100:00100000:3.0:1715330290.702544:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23458 00010000:00010000:0.0:1715330290.702589:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715330290.702595:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457d680/0xd895711d66d8d69 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d8d70 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.702604:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457d680 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330290.702608:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457d680/0xd895711d66d8d69 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d8d70 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330290.702613:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457d680/0xd895711d66d8d69 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d8d70 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.702631:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457d680/0xd895711d66d8d69 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8d70 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.702635:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330290.702647:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457d680/0xd895711d66d8d69 lrc: 1/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8d70 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.702652:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457d680/0xd895711d66d8d69 lrc: 0/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8d70 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.702674:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330290.702675:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330290.702677:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330290.702725:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1715330290.702746:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f579880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942472384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330290.702770:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330290.703136:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942472384 00000100:00100000:0.0:1715330290.703139:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942472384 00000100:00100000:0.0:1715330290.703160:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1343 00000100:00100000:0.0:1715330290.703164:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d644e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+24:3690:x1798653942472384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330290.703171:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330290.703182:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a2640/0xd895711d66d8d70 lrc: 0/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d8d69 expref: 24 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330290.703191:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff88009edfa500) 00010000:00010000:0.0:1715330290.703197:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330290.703218:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d644e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+23:3690:x1798653942472384:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330290.703223:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1343 00000100:00100000:1.0:1715330290.703328:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f579880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942472384:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330291.154947:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330291.543518:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f57b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3688:1798653942472448:0@lo:400:kworker.0 00000100:00100000:2.0:1715330291.543571:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330291.543587:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f57a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942472704:0@lo:400:kworker.0 00000100:00100000:2.0:1715330291.543609:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330291.543620:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942472960:0@lo:400:kworker.0 00000100:00100000:2.0:1715330291.543635:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330291.543644:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d62aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942473216:0@lo:400:kworker.0 00000100:00100000:2.0:1715330291.543658:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330291.543672:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1715330291.543677:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f57b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3688:1798653942472512:0@lo:400:kworker.0 00000100:00100000:2.0:1715330291.543694:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330291.543704:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f57a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3688:1798653942472768:0@lo:400:kworker.0 00000100:00100000:2.0:1715330291.543717:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330291.543723:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d62b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3688:1798653942473024:0@lo:400:kworker.0 00000100:00100000:2.0:1715330291.543754:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330291.543772:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f579180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3691:1798653942472640:0@lo:400:kworker.0 00000100:00100000:2.0:1715330291.543787:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330291.543796:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f579880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942472896:0@lo:400:kworker.0 00000100:00100000:2.0:1715330291.543808:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330291.543816:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942473152:0@lo:400:kworker.0 00000100:00100000:2.0:1715330291.543828:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330291.543837:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1715330291.543842:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f578000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942472576:0@lo:400:kworker.0 00000100:00100000:2.0:1715330291.543854:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330291.543863:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f579500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3691:1798653942472832:0@lo:400:kworker.0 00000100:00100000:2.0:1715330291.543875:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330291.543882:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3691:1798653942473088:0@lo:400:kworker.0 00000100:00100000:2.0:1715330291.543894:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330291.543913:0:7129:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942472448 00000100:00100000:2.0:1715330291.543919:0:7129:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942472448 00000100:00100000:2.0:1715330291.543955:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1715330291.543960:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3688:x1798653942472448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330291.543994:0:7129:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3688:x1798653942472448:12345-0@lo:400:kworker.0 Request processed in 34us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330291.544000:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1715330291.544022:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942472512 00000100:00100000:2.0:1715330291.544025:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942472512 00000100:00100000:2.0:1715330291.544038:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942472768 00000100:00100000:2.0:1715330291.544040:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942472768 00000100:00100000:2.0:1715330291.544046:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942473024 00000100:00100000:2.0:1715330291.544048:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942473024 00000100:00100000:2.0:1715330291.544054:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942472640 00000100:00100000:2.0:1715330291.544055:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942472640 00000100:00100000:2.0:1715330291.544060:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942472832 00000100:00100000:2.0:1715330291.544063:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942472832 00000100:00100000:2.0:1715330291.544069:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942473088 00000100:00100000:2.0:1715330291.544071:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942473088 00000100:00100000:2.0:1715330291.544079:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1715330291.544083:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3688:x1798653942472512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330291.544107:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3688:x1798653942472512:12345-0@lo:400:kworker.0 Request processed in 23us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330291.544112:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1715330291.544119:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1715330291.544123:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1798653942472768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330291.544138:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1798653942472768:12345-0@lo:400:kworker.0 Request processed in 14us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330291.544142:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1715330291.544148:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1715330291.544150:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3688:x1798653942473024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330291.544163:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3688:x1798653942473024:12345-0@lo:400:kworker.0 Request processed in 12us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330291.544167:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1715330291.544172:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1715330291.544175:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3691:x1798653942472640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330291.544190:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3691:x1798653942472640:12345-0@lo:400:kworker.0 Request processed in 14us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330291.544194:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1715330291.544199:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1715330291.544208:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3691:x1798653942472832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330291.544226:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3691:x1798653942472832:12345-0@lo:400:kworker.0 Request processed in 23us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330291.544233:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1715330291.544241:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1715330291.544244:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3691:x1798653942473088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330291.544258:0:17206:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942472960 00000100:00100000:3.0:1715330291.544263:0:17206:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942472960 00000100:00100000:3.0:1715330291.544281:0:17206:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942473216 00000100:00100000:3.0:1715330291.544283:0:17206:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942473216 00000100:00100000:0.0:1715330291.544287:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942472704 00000100:00100000:0.0:1715330291.544290:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942472704 00000100:00100000:3.0:1715330291.544291:0:17206:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942472896 00000100:00100000:3.0:1715330291.544292:0:17206:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942472896 00000100:00100000:3.0:1715330291.544298:0:17206:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942473152 00000100:00100000:3.0:1715330291.544299:0:17206:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942473152 00000100:00100000:3.0:1715330291.544306:0:17206:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1715330291.544308:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942472576 00000100:00100000:0.0:1715330291.544309:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942472576 00000100:00100000:3.0:1715330291.544310:0:17206:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942472960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330291.544320:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2841 00000100:00100000:0.0:1715330291.544325:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+23:3688:x1798653942472704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330291.544333:0:17206:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942472960:12345-0@lo:400:kworker.0 Request processed in 23us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330291.544336:0:17206:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1715330291.544344:0:17206:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1715330291.544347:0:17206:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942473216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330291.544354:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+23:3688:x1798653942472704:12345-0@lo:400:kworker.0 Request processed in 29us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330291.544358:0:17206:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942473216:12345-0@lo:400:kworker.0 Request processed in 10us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330291.544359:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2841 00000100:00100000:3.0:1715330291.544361:0:17206:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1715330291.544365:0:17206:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1715330291.544366:0:17206:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942472896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330291.544368:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2842 00000100:00100000:0.0:1715330291.544371:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+21:3691:x1798653942472576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330291.544375:0:17206:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942472896:12345-0@lo:400:kworker.0 Request processed in 8us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330291.544378:0:17206:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1715330291.544382:0:17206:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1715330291.544384:0:17206:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942473152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330291.544392:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+21:3691:x1798653942472576:12345-0@lo:400:kworker.0 Request processed in 20us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330291.544394:0:17206:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942473152:12345-0@lo:400:kworker.0 Request processed in 10us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330291.544396:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2842 00000100:00100000:3.0:1715330291.544397:0:17206:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:0.0:1715330291.544412:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330261 00000100:00080000:0.0:1715330291.544414:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330261 00000100:00080000:0.0:1715330291.544416:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330261 00000100:00080000:0.0:1715330291.544418:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330261 00000100:00100000:0.0:1715330291.544800:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f578000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942472576:0@lo:400:kworker.0 00000100:00100000:0.0:1715330291.544809:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f579500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3691:1798653942472832:0@lo:400:kworker.0 00000100:00100000:0.0:1715330291.544816:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f579180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3691:1798653942472640:0@lo:400:kworker.0 00000100:00100000:0.0:1715330291.544822:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f579880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942472896:0@lo:400:kworker.0 00000100:00100000:0.0:1715330291.544829:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942473152:0@lo:400:kworker.0 00000100:00100000:0.0:1715330291.544852:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f57b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3688:1798653942472512:0@lo:400:kworker.0 00000100:00100000:0.0:1715330291.544858:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f57a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3688:1798653942472768:0@lo:400:kworker.0 00000100:00100000:0.0:1715330291.544864:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d62b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3688:1798653942473024:0@lo:400:kworker.0 00000100:00100000:0.0:1715330291.544870:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f57b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3688:1798653942472448:0@lo:400:kworker.0 00000100:00100000:0.0:1715330291.544877:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f57a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942472704:0@lo:400:kworker.0 00000100:00100000:0.0:1715330291.544883:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942472960:0@lo:400:kworker.0 00000100:00100000:0.0:1715330291.544890:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d62aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942473216:0@lo:400:kworker.0 00000100:00100000:2.0:1715330291.545705:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3691:x1798653942473088:12345-0@lo:400:kworker.0 Request processed in 1459us (1808us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330291.545712:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1715330291.545798:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3691:1798653942473088:0@lo:400:kworker.0 00000100:00100000:2.0:1715330291.570939:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d647100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942473280:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1715330291.570993:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330291.571123:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942473280 00000100:00100000:3.0:1715330291.571131:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942473280 00000100:00100000:3.0:1715330291.571167:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1715330291.571174:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942473280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1715330291.571200:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 17055168 pending 0 free 3923546112 avail 3692023808 00000100:00100000:3.0:1715330291.571243:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942473280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330291.571250:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1715330291.571322:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d647100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942473280:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1715330291.587233:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1715330291.587407:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d647800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942473344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1715330291.587466:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330291.587525:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942473344 00000100:00100000:3.0:1715330291.587532:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942473344 00000100:00100000:3.0:1715330291.587572:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1715330291.587579:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942473344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1715330291.587600:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 17055168 pending 0 free 3923546112 avail 3692023808 00000100:00100000:3.0:1715330291.587635:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942473344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330291.587642:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1715330291.587655:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d647800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942473344:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1715330292.156994:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330292.988595:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d62aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942473408:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1715330292.988649:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330292.988690:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942473408 00000100:00100000:0.0:1715330292.988696:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942473408 00000100:00100000:0.0:1715330292.988722:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2843 00000100:00100000:0.0:1715330292.988728:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d629880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+21:3691:x1798653942473408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1715330292.988771:0:23404:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444077568 avail 1314615296 00000100:00100000:0.0:1715330292.988802:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d629880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+21:3691:x1798653942473408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330292.988808:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2843 00000100:00100000:0.0:1715330292.988844:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d62aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942473408:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1715330293.158955:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330294.162161:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330294.232371:0:7116:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67180/0xd895711d66d8d15 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x4b4526f7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d8d1c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1715330294.232392:0:7116:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67180/0xd895711d66d8d15 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x4b4526f7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d8d1c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330294.232446:0:7116:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67180/0xd895711d66d8d15 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x4b4526f7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8d1c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330294.232451:0:7116:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330294.232617:0:8267:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a3180/0xd895711d66d8cc1 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x4b3326f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d8cc8 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330294.232625:0:8267:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a3180/0xd895711d66d8cc1 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x4b3326f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d8cc8 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330294.232642:0:8267:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a3180/0xd895711d66d8cc1 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x4b3326f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8cc8 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330294.232646:0:8267:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1715330294.232865:0:7116:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67180/0xd895711d66d8d15 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x4b4526f7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8d1c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330294.232881:0:7116:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a2400/0xd895711d66d8c6d lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x4b3326ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d8c74 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1715330294.232886:0:7116:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a2400/0xd895711d66d8c6d lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x4b3326ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d8c74 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330294.232898:0:7116:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a2400/0xd895711d66d8c6d lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x4b3326ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8c74 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330294.232902:0:7116:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1715330294.232951:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942473472:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:0.0:1715330294.233014:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1715330294.233066:0:8267:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a3180/0xd895711d66d8cc1 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x4b3326f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8cc8 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330294.233082:0:8267:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d8ae5 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d8aec expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330294.233087:0:8267:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d8ae5 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d8aec expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330294.233100:0:8267:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d8ae5 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8aec expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330294.233105:0:8267:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1715330294.233125:0:7116:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88009d7a2400/0xd895711d66d8c6d lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x4b3326ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8c74 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330294.233136:0:7116:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67cc0/0xd895711d66d8c19 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d8c20 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1715330294.233141:0:7116:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67cc0/0xd895711d66d8c19 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f4526ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d8c20 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330294.233152:0:7116:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67cc0/0xd895711d66d8c19 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x6f4526ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8c20 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330294.233156:0:7116:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1715330294.233160:0:7116:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67cc0/0xd895711d66d8c19 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x6f4526ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8c20 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330294.233168:0:7116:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c000/0xd895711d66d8bc5 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x5d4526ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d8bcc expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1715330294.233173:0:7116:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c000/0xd895711d66d8bc5 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x5d4526ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d8bcc expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330294.233183:0:7116:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c000/0xd895711d66d8bc5 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x5d4526ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8bcc expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330294.233187:0:7116:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1715330294.233190:0:7116:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c000/0xd895711d66d8bc5 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x5d4526ef bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8bcc expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330294.233199:0:7116:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db661c0/0xd895711d66d8b71 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x393326f7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d8b78 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1715330294.233204:0:7116:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db661c0/0xd895711d66d8b71 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x393326f7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d8b78 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330294.233215:0:7116:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db661c0/0xd895711d66d8b71 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x393326f7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8b78 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330294.233219:0:7116:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1715330294.233221:0:7116:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db661c0/0xd895711d66d8b71 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x393326f7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8b78 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330294.233231:0:7116:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db64900/0xd895711d66d8a91 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x8a3c26f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d8a98 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1715330294.233236:0:7116:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db64900/0xd895711d66d8a91 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x8a3c26f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d8a98 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330294.233246:0:7116:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db64900/0xd895711d66d8a91 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x8a3c26f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8a98 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330294.233251:0:7116:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1715330294.233253:0:7116:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db64900/0xd895711d66d8a91 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x8a3c26f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8a98 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330294.233262:0:7116:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff600/0xd895711d66d8a05 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f3326f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d8a0c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1715330294.233270:0:7116:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff600/0xd895711d66d8a05 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6f3326f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d8a0c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330294.233280:0:7116:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff600/0xd895711d66d8a05 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x6f3326f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8a0c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330294.233284:0:7116:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1715330294.233286:0:7116:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bff600/0xd895711d66d8a05 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x6f3326f1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8a0c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1715330294.233294:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983493 is committed 00000001:00080000:2.0:1715330294.233315:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983488 is committed 00010000:00010000:2.0:1715330294.233399:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d8a52 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x813c26f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00000100:00100000:3.0:1715330294.233411:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942473472 00010000:00010000:2.0:1715330294.233415:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d8a52 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x813c26f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT0 00000100:00100000:3.0:1715330294.233418:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942473472 00010000:00010000:2.0:1715330294.233421:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d8a52 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x813c26f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330294.233425:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db65d40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330294.233428:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d8a52 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x813c26f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330294.233433:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d8a52 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x813c26f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330294.233444:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x813c26f3 (ffff88008b374400) 00010000:00010000:2.0:1715330294.233447:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330294.233450:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d8a52 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x813c26f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330294.233454:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d8a52 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x813c26f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00000100:00100000:3.0:1715330294.233459:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1344 00000100:00100000:3.0:1715330294.233464:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d62aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+23:3688:x1798653942473472:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:2.0:1715330294.233468:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d8b32 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x5d4e26bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330294.233471:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d8b32 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x5d4e26bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330294.233475:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330294.233475:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d8b32 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x5d4e26bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330294.233478:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457eac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330294.233480:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d8b32 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x5d4e26bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330294.233483:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d8b32 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x5d4e26bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330294.233488:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x5d4e26bf (ffff88011d537500) 00010000:00010000:3.0:1715330294.233489:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457ed00/0xd895711d66d8d1c lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x4b4526f7 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d8d15 expref: 23 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330294.233489:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330294.233491:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d8b32 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x5d4e26bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330294.233494:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d8b32 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x5d4e26bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330294.233499:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x4b4526f7 (ffff88008b122400) 00010000:00010000:2.0:1715330294.233503:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f600/0xd895711d66d8d54 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x82986a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330294.233504:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330294.233506:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f600/0xd895711d66d8d54 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x82986a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330294.233512:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f600/0xd895711d66d8d54 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x82986a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330294.233515:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457f600 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330294.233516:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f600/0xd895711d66d8d54 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x82986a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330294.233519:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f600/0xd895711d66d8d54 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x82986a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330294.233525:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x82986a8e (ffff88008b122300) 00010000:00010000:2.0:1715330294.233526:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330294.233527:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f600/0xd895711d66d8d54 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x82986a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00000100:00100000:3.0:1715330294.233529:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d62aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+22:3688:x1798653942473472:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 65us (517us total) trans 0 rc 0/0 00010000:00010000:2.0:1715330294.233531:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f600/0xd895711d66d8d54 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x82986a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00000100:00100000:3.0:1715330294.233535:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1344 00000100:00100000:2.0:1715330294.233547:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942473600:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:2.0:1715330294.233572:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330294.233583:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942473856:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:2.0:1715330294.233594:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330294.233606:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1715330294.233609:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d647800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942473664:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1715330294.233621:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330294.233629:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942473920:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:2.0:1715330294.233641:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330294.233659:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942473600 00000100:00100000:2.0:1715330294.233662:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942473600 00000100:00100000:2.0:1715330294.233678:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942473856 00000100:00100000:2.0:1715330294.233679:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942473856 00000100:00100000:2.0:1715330294.233687:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942473664 00000100:00100000:2.0:1715330294.233689:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942473664 00000100:00100000:2.0:1715330294.233697:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942473920 00000100:00100000:2.0:1715330294.233698:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942473920 00000100:00100000:2.0:1715330294.233704:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1345 00000100:00100000:2.0:1715330294.233707:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+24:3690:x1798653942473600:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:2.0:1715330294.233713:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330294.233721:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67840/0xd895711d66d8c74 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x4b3326ef bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d8c6d expref: 24 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330294.233728:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x4b3326ef (ffff88011d537300) 00010000:00010000:2.0:1715330294.233749:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330294.233767:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+23:3690:x1798653942473600:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 59us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330294.233770:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1346 00000100:00100000:2.0:1715330294.233773:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1345 00000100:00100000:3.0:1715330294.233774:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+23:3690:x1798653942473856:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1715330294.233780:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1715330294.233782:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1347 00000100:00100000:2.0:1715330294.233784:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+15:3690:x1798653942473664:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1715330294.233789:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f840/0xd895711d66d8b78 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x393326f7 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d8b71 expref: 22 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330294.233790:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330294.233796:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x393326f7 (ffff88009ef57900) 00010000:00010000:2.0:1715330294.233798:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0d80/0xd895711d66d8aec lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d8ae5 expref: 15 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330294.233800:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330294.233804:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x6f4526f6 (ffff88009bbb0100) 00010000:00010000:2.0:1715330294.233810:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715330294.233815:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+21:3690:x1798653942473856:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 42us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330294.233820:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+14:3690:x1798653942473664:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 35us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330294.233824:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1346 00000100:00100000:2.0:1715330294.233826:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1347 00000100:00100000:2.0:1715330294.233832:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1348 00000100:00100000:2.0:1715330294.233835:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+20:3690:x1798653942473920:12345-0@lo:103:jbd2/dm-0-8.0 00000100:00100000:0.0:1715330294.233873:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942473728:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:0.0:1715330294.233893:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330294.233899:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942473984:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:0.0:1715330294.233909:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330294.233925:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942473472:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:0.0:1715330294.233937:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1715330294.233941:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d647b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942473536:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1715330294.233952:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330294.233956:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942473792:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:0.0:1715330294.233965:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1715330294.235239:0:8267:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d8ae5 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x6f4526f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8aec expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330294.235262:0:8267:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc240/0xd895711d66d89b1 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x8a4526bf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d89b8 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330294.235269:0:8267:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc240/0xd895711d66d89b1 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x8a4526bf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d89b8 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330294.235295:0:8267:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc240/0xd895711d66d89b1 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x8a4526bf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d89b8 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330294.235301:0:8267:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330294.235311:0:8267:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfc240/0xd895711d66d89b1 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x8a4526bf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d89b8 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1715330294.235322:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968410 is committed 00000001:00080000:1.0:1715330294.235347:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968407 is committed 00000100:00100000:1.0:1715330294.235412:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d647100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942474048:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1715330294.235451:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1715330294.235607:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330294.235620:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfed00/0xd895711d66d8a98 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x8a3c26f1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d8a91 expref: 9 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330294.235631:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x8a3c26f1 (ffff88009d5fa200) 00010000:00010000:2.0:1715330294.235636:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330294.235658:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+8:3690:x1798653942473920:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 1822us (2015us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330294.235932:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1348 00000100:00100000:3.0:1715330294.235939:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942473728 00000100:00100000:3.0:1715330294.235945:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942473728 00000100:00100000:3.0:1715330294.235962:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942473984 00000100:00100000:3.0:1715330294.235964:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942473984 00000100:00100000:3.0:1715330294.235970:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942473536 00000100:00100000:3.0:1715330294.235971:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942473536 00000100:00100000:2.0:1715330294.235972:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942473792 00000100:00100000:2.0:1715330294.235974:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942473792 00000100:00100000:3.0:1715330294.235979:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942474048 00000100:00100000:3.0:1715330294.235980:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942474048 00000100:00100000:2.0:1715330294.235983:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1349 00000100:00100000:2.0:1715330294.235987:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d62b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+10:3688:x1798653942473728:12345-0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1715330294.235988:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1350 00000100:00100000:3.0:1715330294.235991:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d629180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+10:3688:x1798653942473984:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:2.0:1715330294.235994:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330294.235995:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330294.236001:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a06c0/0xd895711d66d8c20 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x6f4526ef bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d8c19 expref: 10 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330294.236002:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c240/0xd895711d66d8a0c lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x6f3326f1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d8a05 expref: 10 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330294.236009:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x6f4526ef (ffff88009bbb0700) 00010000:00010000:3.0:1715330294.236010:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x6f3326f1 (ffff88009ef57a00) 00010000:00010000:3.0:1715330294.236016:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330294.236016:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715330294.236033:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d629180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+8:3688:x1798653942473984:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 41us (2123us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330294.236033:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d62b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+8:3688:x1798653942473728:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 46us (2140us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330294.236037:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1349 00000100:00100000:3.0:1715330294.236039:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1350 00000100:00100000:3.0:1715330294.236047:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1351 00000100:00100000:2.0:1715330294.236049:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1352 00000100:00100000:3.0:1715330294.236050:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d62b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+15:3688:x1798653942473536:12345-0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1715330294.236052:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d62ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+6:3688:x1798653942473792:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1715330294.236055:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330294.236055:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330294.236062:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457df80/0xd895711d66d8bcc lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x5d4526ef bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d8bc5 expref: 6 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330294.236064:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f3c0/0xd895711d66d8cc8 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x4b3326f6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d8cc1 expref: 15 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330294.236069:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x5d4526ef (ffff88011d537100) 00010000:00010000:3.0:1715330294.236071:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x4b3326f6 (ffff88008b122e00) 00010000:00010000:2.0:1715330294.236073:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330294.236077:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330294.236087:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d62ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942473792:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 34us (2121us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330294.236088:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d62b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+14:3688:x1798653942473536:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 39us (2137us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330294.236091:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1352 00000100:00100000:3.0:1715330294.236093:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1351 00000100:00100000:2.0:1715330294.236098:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1353 00000100:00100000:2.0:1715330294.236100:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+13:3689:x1798653942474048:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1715330294.236104:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330294.236111:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d89b8 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x8a4526bf bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d89b1 expref: 13 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330294.236117:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x8a4526bf (ffff88008b374600) 00010000:00010000:2.0:1715330294.236121:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330294.237212:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+12:3689:x1798653942474048:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 1108us (1759us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330294.237220:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1353 00000100:00100000:2.0:1715330294.237265:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d647800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942473664:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1715330294.237275:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942473920:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:2.0:1715330294.237283:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942473600:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:2.0:1715330294.237289:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942473856:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:0.0:1715330294.237695:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d647b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942473536:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1715330294.237705:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942473792:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:0.0:1715330294.237711:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942473728:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:0.0:1715330294.237718:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942473984:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1715330294.239714:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d647100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942474048:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1715330294.451004:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942474112:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1715330294.451078:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330294.451198:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942474112 00000100:00100000:1.0:1715330294.451206:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942474112 00000100:00100000:1.0:1715330294.451243:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2844 00000100:00100000:1.0:1715330294.451248:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942474112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1715330294.451282:0:24873:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445109760 avail 1315647488 00000100:00100000:1.0:1715330294.451318:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942474112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330294.451324:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2844 00000100:00100000:2.0:1715330294.451428:0:3690:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968410 gen 2 00000004:00080000:2.0:1715330294.451434:0:3690:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968394 committed transno 4294968410 00000020:00080000:2.0:1715330294.451440:0:3690:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88012f49f480 refcount 2 committed 0 result 0 batchid 376 00000020:00080000:2.0:1715330294.451444:0:3690:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009d5fab00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88012f49fb40 00000020:00080000:2.0:1715330294.451446:0:3690:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].360 00000020:00080000:2.0:1715330294.451448:0:3690:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009d5fa400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88009d6d9600 00000020:00080000:2.0:1715330294.451450:0:3690:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].360 00000004:00080000:2.0:1715330294.451553:0:3690:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968395 committed transno 4294968410 00000020:00080000:2.0:1715330294.451556:0:3690:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88012f49fcc0 refcount 2 committed 0 result 0 batchid 377 00000020:00080000:2.0:1715330294.451558:0:3690:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009d5fa600 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88012f49fd80 00000020:00080000:2.0:1715330294.451560:0:3690:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].361 00000020:00080000:2.0:1715330294.451561:0:3690:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009d5faf00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88009d6d8600 00000020:00080000:2.0:1715330294.451563:0:3690:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].361 00000004:00080000:2.0:1715330294.451602:0:3690:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968396 committed transno 4294968410 00000020:00080000:2.0:1715330294.451605:0:3690:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff880091ffcd80 refcount 2 committed 0 result 0 batchid 378 00000020:00080000:2.0:1715330294.451606:0:3690:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008b374e00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff880091ffc300 00000020:00080000:2.0:1715330294.451609:0:3690:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].362 00000020:00080000:2.0:1715330294.451610:0:3690:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009ef57400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88009d6a5400 00000020:00080000:2.0:1715330294.451612:0:3690:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].362 00000004:00080000:2.0:1715330294.451627:0:3690:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968400 committed transno 4294968410 00000020:00080000:2.0:1715330294.451629:0:3690:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff880091ffc9c0 refcount 2 committed 0 result 0 batchid 379 00000020:00080000:2.0:1715330294.451630:0:3690:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008b374a00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff880091ffcc00 00000020:00080000:2.0:1715330294.451632:0:3690:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].363 00000020:00080000:2.0:1715330294.451633:0:3690:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88011d537400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88009d6a4800 00000020:00080000:2.0:1715330294.451635:0:3690:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].363 00000004:00080000:2.0:1715330294.451647:0:3690:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968401 committed transno 4294968410 00000020:00080000:2.0:1715330294.451650:0:3690:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff880134435900 refcount 2 committed 0 result 0 batchid 380 00000020:00080000:2.0:1715330294.451652:0:3690:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800b4184800 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff880134435e40 00000020:00080000:2.0:1715330294.451654:0:3690:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].364 00000020:00080000:2.0:1715330294.451655:0:3690:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800b4184000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88009d6a9600 00000020:00080000:2.0:1715330294.451658:0:3690:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].364 00000004:00080000:2.0:1715330294.451673:0:3690:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968402 committed transno 4294968410 00000020:00080000:2.0:1715330294.451675:0:3690:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8800b4333b40 refcount 2 committed 0 result 0 batchid 381 00000020:00080000:2.0:1715330294.451677:0:3690:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008b122700 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8800b4333900 00000020:00080000:2.0:1715330294.451679:0:3690:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].365 00000020:00080000:2.0:1715330294.451680:0:3690:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880129edfd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88012da59e00 00000020:00080000:2.0:1715330294.451682:0:3690:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].365 00000004:00080000:2.0:1715330294.451696:0:3690:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968403 committed transno 4294968410 00000020:00080000:2.0:1715330294.451698:0:3690:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff880091ffab40 refcount 2 committed 0 result 0 batchid 382 00000020:00080000:2.0:1715330294.451700:0:3690:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009edfac00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff880091ffae40 00000020:00080000:2.0:1715330294.451702:0:3690:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].366 00000020:00080000:2.0:1715330294.451704:0:3690:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009edfa200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88011dad0e00 00000020:00080000:2.0:1715330294.451705:0:3690:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].366 00000004:00080000:2.0:1715330294.451721:0:3690:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968404 committed transno 4294968410 00000020:00080000:2.0:1715330294.451723:0:3690:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88012f49f540 refcount 2 committed 0 result 0 batchid 383 00000020:00080000:2.0:1715330294.451725:0:3690:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009d5fa100 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88012f49f240 00000020:00080000:2.0:1715330294.451726:0:3690:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].367 00000020:00080000:2.0:1715330294.451727:0:3690:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009d5fa300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88009d6d8200 00000020:00080000:3.0:1715330294.452108:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 382 committed batchid 375 00000020:00080000:3.0:1715330294.452166:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 375 00000020:00080000:2.0:1715330294.452289:0:3690:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].368 00000004:00080000:2.0:1715330294.452318:0:3690:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968408 committed transno 4294968410 00000020:00080000:2.0:1715330294.452322:0:3690:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8800b4333000 refcount 2 committed 0 result 0 batchid 384 00000020:00080000:2.0:1715330294.452324:0:3690:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008b122500 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8800b43336c0 00000020:00080000:2.0:1715330294.452326:0:3690:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].368 00000020:00080000:2.0:1715330294.452328:0:3690:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008b122c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88009b952400 00000020:00080000:2.0:1715330294.452330:0:3690:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].369 00000020:00080000:3.0:1715330294.452331:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 383 committed batchid 375 00000004:00080000:2.0:1715330294.452344:0:3690:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968409 committed transno 4294968410 00000020:00080000:3.0:1715330294.452345:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 384 committed batchid 375 00000020:00080000:2.0:1715330294.452346:0:3690:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88009396cb40 refcount 2 committed 0 result 0 batchid 385 00000020:00080000:2.0:1715330294.452348:0:3690:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880129edf600 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88009396c480 00000020:00080000:2.0:1715330294.452350:0:3690:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].369 00000020:00080000:3.0:1715330294.452351:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 375 00000020:00080000:2.0:1715330294.452352:0:3690:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88011d537600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88008d764600 00000020:00080000:2.0:1715330294.452354:0:3690:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].370 00000020:00080000:3.0:1715330294.452364:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 385 committed batchid 375 00000004:00080000:2.0:1715330294.452370:0:3690:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968410 committed transno 4294968410 00000020:00080000:3.0:1715330294.452372:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 375 00000020:00080000:2.0:1715330294.452372:0:3690:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8800b4333780 refcount 2 committed 0 result 0 batchid 386 00000020:00080000:2.0:1715330294.452374:0:3690:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88012dcc3200 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8800b4333840 00000020:00080000:2.0:1715330294.452376:0:3690:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].370 00000020:00080000:2.0:1715330294.452378:0:3690:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88012dcc3a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88009b952600 00000020:00080000:2.0:1715330294.452379:0:3690:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].371 00000020:00080000:3.0:1715330294.452390:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 386 committed batchid 375 00000020:00080000:3.0:1715330294.452405:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 375 00000100:00100000:2.0:1715330294.452408:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942474112:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1715330295.163026:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330295.282898:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1715330295.282923:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942474176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1715330295.282992:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330295.287664:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942474176 00000100:00100000:0.0:1715330295.287682:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942474176 00000100:00100000:0.0:1715330295.287742:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1715330295.287750:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942474176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1715330295.287784:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 17022400 pending 0 free 3923513344 avail 3691991040 00000100:00080000:1.0:1715330295.287848:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330265 00000100:00100000:0.0:1715330295.287855:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942474176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (4863us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330295.287861:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1715330295.287908:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942474176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1715330295.299096:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942474240:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1715330295.299161:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330295.299244:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942474240 00000100:00100000:0.0:1715330295.299251:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942474240 00000100:00100000:0.0:1715330295.299288:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1715330295.299294:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942474240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1715330295.299314:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 17022400 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1715330295.299364:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942474240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330295.299371:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1715330295.299461:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942474240:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1715330295.299515:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330265 00000100:00100000:0.0:1715330295.651901:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330295.651934:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330295.651961:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330295.651981:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330295.652000:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330295.652033:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938042880 00000100:00100000:0.0:1715330295.652040:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938042880 00000100:00100000:0.0:1715330295.652074:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938042944 00000100:00100000:0.0:1715330295.652075:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938042944 00000100:00100000:0.0:1715330295.652085:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 254 00000100:00100000:0.0:1715330295.652090:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d62b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+9:2011:x1798653938042880:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:0.0:1715330295.652148:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d62b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+9:2011:x1798653938042880:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 58us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330295.652154:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 254 00000100:00100000:0.0:1715330295.652169:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 255 00000100:00100000:0.0:1715330295.652172:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+6:2011:x1798653938042944:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:0.0:1715330295.652192:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+6:2011:x1798653938042944:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 19us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330295.652196:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 255 00000100:00100000:0.0:1715330295.652211:0:9398:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938043008 00000100:00100000:0.0:1715330295.652214:0:9398:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938043008 00000100:00100000:0.0:1715330295.652229:0:9398:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938043072 00000100:00100000:0.0:1715330295.652230:0:9398:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938043072 00000100:00100000:0.0:1715330295.652241:0:9398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 178 00000100:00100000:0.0:1715330295.652243:0:9398:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d628a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72de1896-1df4-4b3a-930a-9116d2c66168+7:2011:x1798653938043008:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:0.0:1715330295.652261:0:9398:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d628a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72de1896-1df4-4b3a-930a-9116d2c66168+7:2011:x1798653938043008:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 16us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330295.652265:0:9398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 178 00000100:00100000:0.0:1715330295.652272:0:9398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 179 00000100:00100000:0.0:1715330295.652275:0:9398:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72de1896-1df4-4b3a-930a-9116d2c66168+6:2011:x1798653938043072:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:0.0:1715330295.652288:0:9398:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72de1896-1df4-4b3a-930a-9116d2c66168+6:2011:x1798653938043072:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 13us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330295.652292:0:9398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 179 00000100:00080000:0.0:1715330295.652360:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330265 00000100:00080000:0.0:1715330295.652363:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330265 00000100:00080000:0.0:1715330295.652364:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330265 00000100:00080000:0.0:1715330295.652365:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330265 00000100:00100000:1.0:1715330295.652606:0:7130:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938042816 00000100:00100000:1.0:1715330295.652610:0:7130:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938042816 00000100:00100000:1.0:1715330295.652632:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 331 00000100:00100000:1.0:1715330295.652636:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2011:x1798653938042816:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:1.0:1715330295.652660:0:7130:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2011:x1798653938042816:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 24us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330295.652664:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 331 00000100:00080000:0.0:1715330295.652910:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330265 00010000:00010000:1.0:1715330296.166987:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330296.547460:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3688:1798653942474496:0@lo:400:kworker.0 00000100:00100000:2.0:1715330296.547513:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330296.547529:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942474752:0@lo:400:kworker.0 00000100:00100000:0.0:1715330296.547536:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942474432:0@lo:400:kworker.0 00000100:00100000:2.0:1715330296.547549:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330296.547562:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942475008:0@lo:400:kworker.0 00000100:00100000:0.0:1715330296.547565:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330296.547575:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330296.547579:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3691:1798653942474688:0@lo:400:kworker.0 00000100:00100000:2.0:1715330296.547590:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1715330296.547594:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330296.547596:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3688:1798653942474304:0@lo:400:kworker.0 00000100:00100000:0.0:1715330296.547603:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3691:1798653942474944:0@lo:400:kworker.0 00000100:00100000:0.0:1715330296.547616:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330296.547632:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1715330296.547637:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3691:1798653942474368:0@lo:400:kworker.0 00000100:00100000:0.0:1715330296.547651:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330296.547660:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3691:1798653942474624:0@lo:400:kworker.0 00000100:00100000:0.0:1715330296.547671:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330296.547678:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3691:1798653942474880:0@lo:400:kworker.0 00000100:00100000:0.0:1715330296.547689:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330296.547706:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942474432 00000100:00100000:0.0:1715330296.547711:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942474432 00000100:00100000:0.0:1715330296.547750:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2845 00000100:00100000:0.0:1715330296.547755:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d628700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:3691:x1798653942474432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330296.547789:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d628700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:3691:x1798653942474432:12345-0@lo:400:kworker.0 Request processed in 35us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330296.547795:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2845 00000100:00100000:0.0:1715330296.547810:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942474496 00000100:00100000:0.0:1715330296.547812:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942474496 00000100:00100000:0.0:1715330296.547823:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942474688 00000100:00100000:0.0:1715330296.547824:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942474688 00000100:00100000:0.0:1715330296.547833:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942474944 00000100:00100000:0.0:1715330296.547834:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942474944 00000100:00100000:0.0:1715330296.547839:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942474368 00000100:00100000:0.0:1715330296.547841:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942474368 00000100:00100000:0.0:1715330296.547846:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942474624 00000100:00100000:0.0:1715330296.547847:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942474624 00000100:00100000:0.0:1715330296.547853:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942474880 00000100:00100000:0.0:1715330296.547854:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942474880 00000100:00100000:0.0:1715330296.547860:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1715330296.547863:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3688:x1798653942474496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330296.547879:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3688:x1798653942474496:12345-0@lo:400:kworker.0 Request processed in 15us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330296.547883:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1715330296.547889:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1715330296.547891:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3691:x1798653942474688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330296.547904:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3691:x1798653942474688:12345-0@lo:400:kworker.0 Request processed in 11us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330296.547907:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1715330296.547912:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1715330296.547915:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d62bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3691:x1798653942474944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330296.547926:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d62bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3691:x1798653942474944:12345-0@lo:400:kworker.0 Request processed in 11us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330296.547929:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1715330296.547934:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1715330296.547936:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d62a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3691:x1798653942474368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330296.547948:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d62a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3691:x1798653942474368:12345-0@lo:400:kworker.0 Request processed in 11us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330296.547952:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1715330296.547957:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1715330296.547959:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3691:x1798653942474624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330296.547967:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330296.547971:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3691:x1798653942474624:12345-0@lo:400:kworker.0 Request processed in 11us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330296.547975:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1715330296.547979:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1715330296.547981:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942474560:0@lo:400:kworker.0 00000100:00100000:0.0:1715330296.547982:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d62aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3691:x1798653942474880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330296.547996:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d62aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3691:x1798653942474880:12345-0@lo:400:kworker.0 Request processed in 14us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330296.547999:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1715330296.548000:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330296.548009:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942474816:0@lo:400:kworker.0 00000100:00080000:0.0:1715330296.548012:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330266 00000100:00080000:0.0:1715330296.548014:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330266 00000100:00100000:2.0:1715330296.548024:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330296.548029:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3691:1798653942474368:0@lo:400:kworker.0 00000100:00100000:2.0:1715330296.548032:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942475072:0@lo:400:kworker.0 00000100:00100000:0.0:1715330296.548036:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3691:1798653942474624:0@lo:400:kworker.0 00000100:00100000:0.0:1715330296.548041:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3691:1798653942474880:0@lo:400:kworker.0 00000100:00100000:2.0:1715330296.548044:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330296.548046:0:3691:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983488 gen 2 00000004:00080000:0.0:1715330296.548050:0:3691:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983441 committed transno 4294983488 00000020:00080000:0.0:1715330296.548055:0:3691:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff880091cb2d80 refcount 2 committed 0 result 0 batchid 383 00000020:00080000:0.0:1715330296.548058:0:3691:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008b374b00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880091cb26c0 00000100:00100000:2.0:1715330296.548060:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3688:1798653942474496:0@lo:400:kworker.0 00000020:00080000:0.0:1715330296.548061:0:3691:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008b374c00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88006eff6800 00000004:00080000:0.0:1715330296.548077:0:3691:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983442 committed transno 4294983488 00000020:00080000:0.0:1715330296.548079:0:3691:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff880091cb2f00 refcount 2 committed 0 result 0 batchid 384 00000100:00100000:2.0:1715330296.548081:0:17200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942474752 00000020:00080000:0.0:1715330296.548081:0:3691:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008b374700 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880091cb2b40 00000100:00100000:2.0:1715330296.548083:0:17200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942474752 00000020:00080000:0.0:1715330296.548084:0:3691:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].386 00000020:00080000:0.0:1715330296.548086:0:3691:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008b374100 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88006eff6a00 00000020:00080000:0.0:1715330296.548088:0:3691:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].384 00000004:00080000:0.0:1715330296.548097:0:3691:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983443 committed transno 4294983488 00000020:00080000:0.0:1715330296.548099:0:3691:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff880091ffa240 refcount 2 committed 0 result 0 batchid 385 00000100:00100000:2.0:1715330296.548100:0:17200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942475008 00000020:00080000:0.0:1715330296.548101:0:3691:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008b374900 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880091cb2180 00000100:00100000:2.0:1715330296.548102:0:17200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942475008 00000020:00080000:0.0:1715330296.548103:0:3691:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008b374000 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88006eff6000 00000100:00100000:2.0:1715330296.548112:0:17200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942474816 00000004:00080000:0.0:1715330296.548112:0:3691:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983462 committed transno 4294983488 00000100:00100000:2.0:1715330296.548114:0:17200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942474816 00000020:00080000:0.0:1715330296.548114:0:3691:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff88012f49f780 refcount 2 committed 0 result 0 batchid 386 00000020:00080000:0.0:1715330296.548116:0:3691:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009d5fa900 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff88012f49f0c0 00000020:00080000:0.0:1715330296.548118:0:3691:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].387 00000020:00080000:0.0:1715330296.548119:0:3691:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009d5fa700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88008d40b000 00000100:00100000:2.0:1715330296.548120:0:17200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942475072 00000100:00100000:2.0:1715330296.548121:0:17200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942475072 00000020:00080000:0.0:1715330296.548121:0:3691:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].385 00000100:00100000:2.0:1715330296.548129:0:17200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1715330296.548133:0:17200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942474752:12345-0@lo:400:kworker.0 00000004:00080000:0.0:1715330296.548144:0:3691:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983472 committed transno 4294983488 00000020:00080000:0.0:1715330296.548147:0:3691:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff880091ffa900 refcount 2 committed 0 result 0 batchid 387 00000020:00080000:0.0:1715330296.548149:0:3691:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009bbb0d00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880091ffacc0 00000020:00080000:0.0:1715330296.548151:0:3691:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].388 00000020:00080000:0.0:1715330296.548153:0:3691:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009bbb0600 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88011dad0200 00000020:00080000:0.0:1715330296.548155:0:3691:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].386 00000004:00080000:0.0:1715330296.548168:0:3691:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983488 committed transno 4294983488 00000020:00080000:0.0:1715330296.548170:0:3691:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff880134435a80 refcount 2 committed 0 result 0 batchid 388 00000020:00080000:0.0:1715330296.548172:0:3691:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88011d537800 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880134435300 00000020:00080000:0.0:1715330296.548175:0:3691:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].389 00000020:00080000:0.0:1715330296.548176:0:3691:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88011d537000 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88008d764200 00000020:00080000:0.0:1715330296.548178:0:3691:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].387 00000100:00100000:0.0:1715330296.548191:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942474432:0@lo:400:kworker.0 00000100:00100000:0.0:1715330296.548200:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3691:1798653942474688:0@lo:400:kworker.0 00000100:00100000:0.0:1715330296.548205:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3691:1798653942474944:0@lo:400:kworker.0 00000100:00100000:0.0:1715330296.548225:0:17197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1715330296.548228:0:17197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942475008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330296.548320:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942474560 00000100:00100000:1.0:1715330296.548323:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942474560 00000100:00100000:1.0:1715330296.548339:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2846 00000100:00100000:1.0:1715330296.548342:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b161500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942474560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330296.548446:0:17200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942474752:12345-0@lo:400:kworker.0 Request processed in 312us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330296.548452:0:17200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1715330296.548463:0:17200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1715330296.548467:0:17200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b160000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942474816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330296.548587:0:17197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942475008:12345-0@lo:400:kworker.0 Request processed in 358us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330296.548593:0:17197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1715330296.548602:0:17197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1715330296.548605:0:17197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b163100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942475072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330296.548620:0:17197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b163100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942475072:12345-0@lo:400:kworker.0 Request processed in 15us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330296.548624:0:17197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000020:00080000:0.0:1715330296.548635:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 388 committed batchid 382 00000020:00080000:0.0:1715330296.548679:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 382 00000100:00100000:0.0:1715330296.548724:0:7129:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942474304 00000100:00100000:0.0:1715330296.548727:0:7129:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942474304 00000100:00100000:0.0:1715330296.548761:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1715330296.548765:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3688:x1798653942474304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330296.548788:0:7129:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3688:x1798653942474304:12345-0@lo:400:kworker.0 Request processed in 22us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330296.548793:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00080000:0.0:1715330296.548810:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330266 00000100:00080000:0.0:1715330296.548813:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330266 00000100:00100000:1.0:1715330296.549016:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b161500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942474560:12345-0@lo:400:kworker.0 Request processed in 672us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330296.549022:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2846 00000100:00100000:1.0:1715330296.549049:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3688:1798653942474304:0@lo:400:kworker.0 00000100:00100000:1.0:1715330296.549055:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942474560:0@lo:400:kworker.0 00000100:00100000:1.0:1715330296.549062:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942475072:0@lo:400:kworker.0 00000100:00100000:1.0:1715330296.549069:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942474752:0@lo:400:kworker.0 00000100:00100000:1.0:1715330296.549077:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942475008:0@lo:400:kworker.0 00000100:00100000:2.0:1715330296.549078:0:17200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b160000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942474816:12345-0@lo:400:kworker.0 Request processed in 609us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330296.549084:0:17200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1715330296.549091:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942474816:0@lo:400:kworker.0 00000100:00100000:0.0:1715330296.580690:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1715330296.580706:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942475136:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1715330296.580767:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330296.580922:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942475136 00000100:00100000:1.0:1715330296.580929:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942475136 00000100:00100000:1.0:1715330296.580954:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1715330296.580959:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942475136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1715330296.580981:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 17055168 pending 0 free 3923546112 avail 3692023808 00000100:00100000:1.0:1715330296.581012:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942475136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330296.581017:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1715330296.581170:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942475136:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1715330296.598073:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942475200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1715330296.598128:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330296.598206:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942475200 00000100:00100000:0.0:1715330296.598214:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942475200 00000100:00100000:0.0:1715330296.598240:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1715330296.598246:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b161180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942475200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1715330296.598265:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 17055168 pending 0 free 3923546112 avail 3692023808 00000100:00100000:0.0:1715330296.598296:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b161180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942475200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330296.598302:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1715330296.598383:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942475200:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1715330296.856526:0:27421:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 60h: striped directory with missing stripes can be accessed ========================================================== 04:38:16 (1715330296) 00010000:00010000:3.0:1715330297.171895:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330297.323463:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330297.323532:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938043136 00000100:00100000:1.0:1715330297.323540:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938043136 00000100:00100000:1.0:1715330297.323590:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23459 00000100:00100000:1.0:1715330297.323597:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+9:17737:x1798653938043136:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:1.0:1715330297.323613:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330297.323630:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d8d77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb814 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.323679:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d8d7e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330297.323690:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d8d7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330297.323699:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d8d7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00200000:1.0:1715330297.323752:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 270336 00000004:00200000:1.0:1715330297.323755:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1715330297.323770:0:7135:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d8d7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330297.323787:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d8d77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb814 expref: 11 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.323799:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d8d7e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb814 expref: 10 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.323809:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:1.0:1715330297.323812:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1715330297.323814:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfdf80, rc 0) 00000100:00100000:1.0:1715330297.323853:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+10:17737:x1798653938043136:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 257us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330297.323860:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23459 00000100:00080000:0.0:1715330297.323987:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330267 00000100:00100000:0.0:1715330297.328155:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330297.328178:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938043200 00000100:00100000:2.0:1715330297.328533:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938043200 00000100:00100000:2.0:1715330297.328577:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23460 00000100:00100000:2.0:1715330297.328584:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+10:17737:x1798653938043200:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:2.0:1715330297.328599:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330297.328615:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d8d85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb81b expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.328664:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d8d8c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.328674:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d8d8c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.328683:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d8d8c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.328693:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d8d93 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6088611d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.328698:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d8d93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.328703:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d8d93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.328762:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d8d8c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.328767:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d8d8c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.328772:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d8d8c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.328777:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64480 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330297.328780:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d8d8c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.328786:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d8d8c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.328794:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:2.0:1715330297.328797:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330297.328800:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d8d8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.328805:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d8d8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.328813:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d8d93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.328818:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d8d93 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.328822:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d8d93 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.328827:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66400 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330297.328829:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d8d93 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.328834:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d8d93 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.328839:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6088611d (ffff88008d68ef00) 00010000:00010000:2.0:1715330297.328841:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330297.328843:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d8d93 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.328847:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d8d93 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.328871:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d8d85 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb81b expref: 11 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.328877:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d8d85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb81b expref: 11 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.328884:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db673c0, rc 0) 00000100:00100000:2.0:1715330297.328924:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+10:17737:x1798653938043200:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 340us (775us total) trans 0 rc 301/301 00000100:00100000:2.0:1715330297.328930:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23460 00000100:00100000:0.0:1715330297.338938:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330297.340809:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938043328 00000100:00100000:1.0:1715330297.340818:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938043328 00000100:00100000:1.0:1715330297.340862:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23461 00000100:00100000:1.0:1715330297.340869:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+10:17737:x1798653938043328:12345-192.168.204.49@tcp:36:lfs.0 00010000:00010000:1.0:1715330297.340908:0:7135:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330297.340927:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66d8d7e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb814 expref: 10 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.340939:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:1.0:1715330297.340942:0:7135:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330297.340995:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66d8d9a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330297.341010:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66d8d9a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330297.341016:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66d8d9a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330297.341025:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d8da1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330297.341030:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d8da1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330297.341035:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d8da1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:02000000:1.0:1715330297.341463:0:7135:0:(lod_object.c:4399:lod_xattr_set_lmv()) *** cfs_fail_loc=188, val=0*** 00000040:00080000:1.0:1715330297.343260:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].372, 1760 off562000 00000040:00080000:1.0:1715330297.343319:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].371, 1928 off605592 00000004:00080000:1.0:1715330297.343323:0:7135:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8800b4b2f240 with version 698 00000004:00080000:0.0:1715330297.343562:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 698 rpc_version 698 00000020:00100000:0.0:1715330297.343587:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1715330297.343594:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008d7f3b80 x1798653942475328/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 2552/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715330297.343614:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f3b80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942475328:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330297.343662:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330297.343678:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009d7e3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.343726:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942475328 00000100:00100000:1.0:1715330297.350337:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942475328 00000100:00100000:1.0:1715330297.350393:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2847 00000100:00100000:1.0:1715330297.350400:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:8587:x1798653942475328:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330297.350559:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:8587:x1798653942475328:12345-0@lo:1000:osp_up1-0.0 Request processed in 159us (6896us total) trans 4294968411 rc 0/0 00000100:00100000:1.0:1715330297.350565:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2847 00000100:00100000:1.0:1715330297.350617:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f3b80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942475328:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1715330297.350710:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d8da8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x151c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330297.350721:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d8da8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x151c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330297.350749:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d8da8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x151c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330297.350764:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66d8daf lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330297.350769:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66d8daf lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330297.350774:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66d8daf lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330297.350798:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd680/0xd895711d66d8db6 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330297.350802:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd680/0xd895711d66d8db6 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330297.350810:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd680/0xd895711d66d8db6 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT0 00000100:00100000:1.0:1715330297.350830:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942475392:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1715330297.350859:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330297.350871:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4b2f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.350894:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942475392 00000100:00100000:1.0:1715330297.350897:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942475392 00000100:00100000:1.0:1715330297.350911:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2848 00000100:00100000:1.0:1715330297.350915:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7135:x1798653942475392:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330297.350924:0:24873:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330297.350934:0:24873:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d8dbd lrc: 2/0,0 mode: --/PW res: [0x240000401:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d8db6 expref: -99 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.350948:0:24873:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d8dbd lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d8db6 expref: 7 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.350956:0:24873:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d8dbd lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8db6 expref: 7 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.350961:0:24873:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xcc:0x0].0x0 (ffff88008b122900) 00010000:00010000:1.0:1715330297.350964:0:24873:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330297.350966:0:24873:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bffa80, rc 0) 00000100:00100000:1.0:1715330297.350983:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7135:x1798653942475392:12345-0@lo:101:mdt00_002.0 Request processed in 68us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330297.350987:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2848 00000100:00100000:1.0:1715330297.351008:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7135:1798653942475392:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330297.351015:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd680/0xd895711d66d8db6 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8dbd expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.351022:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd680/0xd895711d66d8db6 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8dbd expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330297.351036:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008d7f1880 reply state ffff88009d6e3000 transno 4294983494 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66d8daf lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330297.351043:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66d8daf lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330297.351048:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff88008b122a00) 00010000:00010000:1.0:1715330297.351050:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330297.351052:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1715330297.351056:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd680/0xd895711d66d8db6 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8dbd expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.351062:0:7135:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd680/0xd895711d66d8db6 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8dbd expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330297.351069:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0xcc:0x0] 00000004:00010000:1.0:1715330297.351072:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008d7f1880 reply state ffff88009d6e3000 transno 4294983494 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d8da8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x151c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330297.351078:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d8da8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x151c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330297.351085:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151c:0x0].0x0 (ffff88008b122200) 00010000:00010000:1.0:1715330297.351087:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330297.351088:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1715330297.351091:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x151c:0x0]: returning size 4096 00010000:00010000:1.0:1715330297.351098:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66d8d9a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330297.351102:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66d8d9a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330297.351106:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66d8d9a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330297.351110:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66d8d9a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330297.351114:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfe1c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330297.351117:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66d8d9a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330297.351122:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66d8d9a lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330297.351128:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:1.0:1715330297.351129:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330297.351132:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66d8d9a lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330297.351152:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66d8d9a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00000004:00010000:1.0:1715330297.351158:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008d7f1880 reply state ffff88009d6e3000 transno 4294983494 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d8da1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330297.351167:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d8da1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330297.351171:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6088611d (ffff88008b122300) 00010000:00010000:1.0:1715330297.351172:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330297.351173:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00000100:00100000:1.0:1715330297.351221:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+11:17737:x1798653938043328:12345-192.168.204.49@tcp:36:lfs.0 Request processed in 10351us (12289us total) trans 4294983494 rc 0/0 00000100:00100000:1.0:1715330297.351226:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23461 00000100:00100000:0.0:1715330297.361901:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330297.363433:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938043392 00000100:00100000:1.0:1715330297.363444:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938043392 00000100:00100000:1.0:1715330297.365267:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23462 00000100:00100000:1.0:1715330297.365276:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f578e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+11:17567:x1798653938043392:12345-192.168.204.49@tcp:101:bash.0 00010000:00010000:1.0:1715330297.365296:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330297.365314:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d8dc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb822 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.365377:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d8dcb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330297.365388:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d8dcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330297.365397:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d8dcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00200000:1.0:1715330297.365433:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 270336 00000004:00200000:1.0:1715330297.365436:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1715330297.365450:0:7135:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d8dcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330297.365470:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d8dc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb822 expref: 13 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.365482:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d8dcb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb822 expref: 12 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.365489:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:1.0:1715330297.365491:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1715330297.365493:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfd440, rc 0) 00000100:00100000:1.0:1715330297.365541:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f578e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+12:17567:x1798653938043392:12345-192.168.204.49@tcp:101:bash.0 Request processed in 266us (3650us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330297.365547:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23462 00000100:00100000:1.0:1715330297.377864:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330297.378636:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938043456 00000100:00100000:3.0:1715330297.378644:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938043456 00000100:00100000:3.0:1715330297.378681:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23463 00000100:00100000:3.0:1715330297.378688:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+12:17567:x1798653938043456:12345-192.168.204.49@tcp:101:bash.0 00010000:00010000:3.0:1715330297.378705:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330297.378722:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457df80/0xd895711d66d8dd2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb829 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.378791:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f600/0xd895711d66d8dd9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.378805:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f600/0xd895711d66d8dd9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.378814:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f600/0xd895711d66d8dd9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.378822:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d8de0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6088611d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.378827:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d8de0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.378831:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d8de0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.378890:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c000/0xd895711d66d8de7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x151c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.378896:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c000/0xd895711d66d8de7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x151c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.378901:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c000/0xd895711d66d8de7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x151c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00000004:00200000:3.0:1715330297.378965:0:25569:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x151c:0x0]: returning size 4096 00000004:00200000:3.0:1715330297.378969:0:25569:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1715330297.378985:0:25569:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c000/0xd895711d66d8de7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x151c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.378993:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f600/0xd895711d66d8dd9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.378998:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f600/0xd895711d66d8dd9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.379006:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f600/0xd895711d66d8dd9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.379010:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457f600 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330297.379014:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f600/0xd895711d66d8dd9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.379020:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f600/0xd895711d66d8dd9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.379028:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:3.0:1715330297.379031:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330297.379033:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f600/0xd895711d66d8dd9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.379038:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f600/0xd895711d66d8dd9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.379045:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d8de0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.379049:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d8de0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.379053:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d8de0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.379056:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457eac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330297.379058:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d8de0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.379062:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d8de0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.379071:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6088611d (ffff88008b122300) 00010000:00010000:3.0:1715330297.379072:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330297.379074:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d8de0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.379078:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d8de0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.379097:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457df80/0xd895711d66d8dd2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb829 expref: 14 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.379106:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c000/0xd895711d66d8de7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x151c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb829 expref: 13 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.379112:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151c:0x0].0x0 (ffff88008b122200) 00010000:00010000:3.0:1715330297.379114:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1715330297.379115:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013457c000, rc 0) 00000100:00100000:3.0:1715330297.382245:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+13:17567:x1798653938043456:12345-192.168.204.49@tcp:101:bash.0 Request processed in 3551us (4381us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330297.382256:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23463 00000100:00100000:1.0:1715330297.387453:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330297.387750:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938043520 00000100:00100000:3.0:1715330297.387760:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938043520 00000100:00100000:3.0:1715330297.388207:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23464 00000100:00100000:3.0:1715330297.388213:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+13:17567:x1798653938043520:12345-192.168.204.49@tcp:101:bash.0 00010000:00010000:3.0:1715330297.388229:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330297.388247:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d8dee lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb830 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.388294:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d8df5 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.388304:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d8df5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.388311:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d8df5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00000004:00200000:3.0:1715330297.388358:0:25569:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0xcc:0x0]: returning size 4096 00000004:00200000:3.0:1715330297.388362:0:25569:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1715330297.388391:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d8dee lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb830 expref: 15 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.388404:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d8df5 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb830 expref: 14 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.388410:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff88008b122a00) 00010000:00010000:3.0:1715330297.388413:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1715330297.388415:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013457e880, rc 0) 00000100:00100000:3.0:1715330297.388809:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+14:17567:x1798653938043520:12345-192.168.204.49@tcp:101:bash.0 Request processed in 594us (1361us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330297.388816:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23464 00000100:00100000:0.0:1715330297.393857:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330297.394159:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938043648 00000100:00100000:3.0:1715330297.394172:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938043648 00000100:00100000:2.0:1715330297.394284:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23465 00000100:00100000:2.0:1715330297.394291:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+14:17567:x1798653938043648:12345-192.168.204.49@tcp:101:bash.0 00010000:00010000:2.0:1715330297.394308:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330297.394312:0:25569:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1715330297.394333:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d8df5 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb830 expref: 14 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.394359:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff88008b122a00) 00010000:00010000:2.0:1715330297.394363:0:25569:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330297.394376:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d8dfc lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb837 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.394475:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d8e03 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.394485:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d8e03 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.394493:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d8e03 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.394501:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d8e0a lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.394505:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d8e0a lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.394510:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d8e0a lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00000004:00080000:2.0:1715330297.394753:0:25569:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9c8:0x0], index 0: 0 00010000:00010000:2.0:1715330297.394840:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d8e11 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x151d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.394847:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d8e11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x151d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.394856:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d8e11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x151d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.394878:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d8e03 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.394883:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d8e03 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.394887:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d8e03 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.394891:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330297.394894:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d8e03 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.394899:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d8e03 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.394904:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff88008b122a00) 00010000:00010000:2.0:1715330297.394906:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330297.394909:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d8e03 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.394913:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d8e03 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00000004:00010000:2.0:1715330297.394922:0:25569:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012f57a680 reply state ffff880093aac000 transno 4294983495 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d8e0a lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.394928:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d8e0a lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.394933:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x30 (ffff88008d68e700) 00010000:00010000:2.0:1715330297.394935:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330297.394937:0:25569:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1715330297.394954:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d8dfc lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb837 expref: 16 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.394964:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d8e11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x151d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb837 expref: 15 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.394969:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151d:0x0].0x0 (ffff88008d68ef00) 00010000:00010000:2.0:1715330297.394971:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330297.394973:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db65b00, rc 0) 00000100:00100000:2.0:1715330297.395028:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+16:17567:x1798653938043648:12345-192.168.204.49@tcp:101:bash.0 Request processed in 737us (1182us total) trans 4294983495 rc 0/0 00000100:00100000:2.0:1715330297.395035:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23465 00000100:00100000:1.0:1715330297.401715:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330297.401763:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938043712 00000100:00100000:0.0:1715330297.401773:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938043712 00000100:00100000:0.0:1715330297.401868:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5187 00000100:00100000:0.0:1715330297.401876:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72de1896-1df4-4b3a-930a-9116d2c66168+7:17567:x1798653938043712:12345-192.168.204.49@tcp:101:bash.0 00010000:00010000:0.0:1715330297.401898:0:9633:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330297.401921:0:9633:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d7a3180/0xd895711d66d8e1f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb83e expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1715330297.401952:0:9633:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1715330297.401975:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330297.401977:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330297.401989:0:9633:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7a3180/0xd895711d66d8e1f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb83e expref: 8 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.402003:0:9633:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d7a3180/0xd895711d66d8e1f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb83e expref: 8 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.402013:0:9633:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a3180, rc 0) 00000100:00100000:0.0:1715330297.402065:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72de1896-1df4-4b3a-930a-9116d2c66168+8:17567:x1798653938043712:12345-192.168.204.49@tcp:101:bash.0 Request processed in 189us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330297.402071:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5187 00000100:00080000:1.0:1715330297.402288:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330267 00000100:00100000:1.0:1715330297.405569:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330297.405659:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938043840 00000100:00100000:3.0:1715330297.405671:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938043840 00000100:00100000:3.0:1715330297.405721:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5061 00000100:00100000:3.0:1715330297.405728:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+16:17567:x1798653938043840:12345-192.168.204.49@tcp:35:bash.0 00000100:00100000:3.0:1715330297.406007:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:17567:x1798653938043840:12345-192.168.204.49@tcp:35:bash.0 Request processed in 278us (449us total) trans 4294983496 rc 0/0 00000100:00100000:3.0:1715330297.406013:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5061 00000100:00100000:2.0:1715330297.411248:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330297.411361:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938043968 00000100:00100000:0.0:1715330297.411371:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938043968 00000100:00100000:0.0:1715330297.411474:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23466 00000100:00100000:0.0:1715330297.411482:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+17:17567:x1798653938043968:12345-192.168.204.49@tcp:101:bash.0 00010000:00010000:0.0:1715330297.411508:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330297.411529:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1f80/0xd895711d66d8e26 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb845 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.411636:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a18c0/0xd895711d66d8e2d lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330297.411654:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a18c0/0xd895711d66d8e2d lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330297.411665:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a18c0/0xd895711d66d8e2d lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330297.411677:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66d8e34 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330297.411682:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66d8e34 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330297.411687:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66d8e34 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00000004:00080000:0.0:1715330297.412000:0:25569:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9c8:0x0], index 1: 0 00010000:00010000:0.0:1715330297.412116:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1680/0xd895711d66d8e3b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x151e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330297.412123:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1680/0xd895711d66d8e3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x151e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330297.412129:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1680/0xd895711d66d8e3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x151e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330297.412155:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a18c0/0xd895711d66d8e2d lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330297.412161:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a18c0/0xd895711d66d8e2d lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330297.412167:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a18c0/0xd895711d66d8e2d lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330297.412176:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a18c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330297.412180:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a18c0/0xd895711d66d8e2d lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330297.412187:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a18c0/0xd895711d66d8e2d lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330297.412197:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff88008b122a00) 00010000:00010000:0.0:1715330297.412200:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330297.412205:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a18c0/0xd895711d66d8e2d lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330297.412210:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a18c0/0xd895711d66d8e2d lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00000004:00010000:0.0:1715330297.412228:0:25569:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008b162680 reply state ffff88009d513000 transno 4294983497 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66d8e34 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330297.412237:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66d8e34 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330297.412242:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x31 (ffff8800ad981300) 00010000:00010000:0.0:1715330297.412244:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330297.412246:0:25569:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1715330297.412268:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1f80/0xd895711d66d8e26 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb845 expref: 20 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.412280:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1680/0xd895711d66d8e3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x151e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb845 expref: 19 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.412286:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151e:0x0].0x0 (ffff8800ad981600) 00010000:00010000:0.0:1715330297.412289:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715330297.412291:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a1680, rc 0) 00000100:00100000:0.0:1715330297.412998:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+20:17567:x1798653938043968:12345-192.168.204.49@tcp:101:bash.0 Request processed in 1514us (1757us total) trans 4294983497 rc 0/0 00000100:00100000:0.0:1715330297.413006:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23466 00000100:00100000:0.0:1715330297.418015:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330297.418087:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938044032 00000100:00100000:2.0:1715330297.418099:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938044032 00000100:00080000:1.0:1715330297.418157:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330267 00000100:00100000:2.0:1715330297.418416:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5188 00000100:00100000:2.0:1715330297.418425:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72de1896-1df4-4b3a-930a-9116d2c66168+6:17567:x1798653938044032:12345-192.168.204.49@tcp:101:bash.0 00010000:00010000:2.0:1715330297.418447:0:9633:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330297.418470:0:9633:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011db64d80/0xd895711d66d8e49 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb84c expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1715330297.418491:0:9633:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1715330297.418514:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330297.418516:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330297.418526:0:9633:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db64d80/0xd895711d66d8e49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb84c expref: 7 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.418547:0:9633:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011db64d80/0xd895711d66d8e49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb84c expref: 7 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.418558:0:9633:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db64d80, rc 0) 00000100:00100000:2.0:1715330297.418760:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72de1896-1df4-4b3a-930a-9116d2c66168+7:17567:x1798653938044032:12345-192.168.204.49@tcp:101:bash.0 Request processed in 305us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330297.418767:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5188 00000100:00100000:0.0:1715330297.420966:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330297.421170:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938044160 00000100:00100000:3.0:1715330297.421177:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938044160 00000100:00100000:3.0:1715330297.421250:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5062 00000100:00100000:3.0:1715330297.421255:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+20:17567:x1798653938044160:12345-192.168.204.49@tcp:35:bash.0 00000100:00100000:3.0:1715330297.421634:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+21:17567:x1798653938044160:12345-192.168.204.49@tcp:35:bash.0 Request processed in 377us (673us total) trans 4294983498 rc 0/0 00000100:00100000:3.0:1715330297.421642:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5062 00000100:00100000:0.0:1715330297.425119:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330297.425175:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938044288 00000100:00100000:2.0:1715330297.425184:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938044288 00000100:00100000:2.0:1715330297.425231:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23467 00000100:00100000:2.0:1715330297.425238:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+21:17567:x1798653938044288:12345-192.168.204.49@tcp:101:bash.0 00010000:00010000:2.0:1715330297.425264:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330297.425291:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d8e50 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb853 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.425399:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d8e57 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.425413:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d8e57 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.425422:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d8e57 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.425434:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d8e5e lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.425439:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d8e5e lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.425445:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d8e5e lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00000004:00080000:2.0:1715330297.425684:0:25569:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9c9:0x0], index 0: 0 00010000:00010000:2.0:1715330297.425801:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d8e65 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x151f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.425807:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d8e65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x151f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.425813:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d8e65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x151f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.425835:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d8e57 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.425840:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d8e57 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.425845:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d8e57 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.425850:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db65440 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330297.425852:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d8e57 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.425858:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d8e57 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.425867:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff88008b122a00) 00010000:00010000:2.0:1715330297.425869:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330297.425873:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d8e57 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.425881:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d8e57 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00000004:00010000:2.0:1715330297.425908:0:25569:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012f57b800 reply state ffff880093aae000 transno 4294983499 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d8e5e lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.425916:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d8e5e lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.425921:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x35 (ffff88008d68e900) 00010000:00010000:2.0:1715330297.425923:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330297.425925:0:25569:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1715330297.425943:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d8e50 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb853 expref: 24 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.425955:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d8e65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x151f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb853 expref: 23 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.425961:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151f:0x0].0x0 (ffff88008d68e000) 00010000:00010000:2.0:1715330297.425963:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330297.425964:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db64240, rc 0) 00000100:00100000:2.0:1715330297.426016:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+24:17567:x1798653938044288:12345-192.168.204.49@tcp:101:bash.0 Request processed in 779us (909us total) trans 4294983499 rc 0/0 00000100:00100000:2.0:1715330297.426022:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23467 00000100:00100000:0.0:1715330297.429117:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330297.429187:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938044352 00000100:00100000:2.0:1715330297.429196:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938044352 00000100:00100000:2.0:1715330297.429284:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5189 00000100:00100000:2.0:1715330297.429290:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f579880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72de1896-1df4-4b3a-930a-9116d2c66168+8:17567:x1798653938044352:12345-192.168.204.49@tcp:101:bash.0 00010000:00010000:2.0:1715330297.429307:0:9633:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330297.429332:0:9633:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011db67600/0xd895711d66d8e73 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb85a expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1715330297.429376:0:9633:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1715330297.429395:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330297.429397:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330297.429407:0:9633:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db67600/0xd895711d66d8e73 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb85a expref: 9 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.429420:0:9633:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011db67600/0xd895711d66d8e73 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb85a expref: 9 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.429431:0:9633:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db67600, rc 0) 00000100:00100000:2.0:1715330297.429658:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f579880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72de1896-1df4-4b3a-930a-9116d2c66168+9:17567:x1798653938044352:12345-192.168.204.49@tcp:101:bash.0 Request processed in 367us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330297.429665:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5189 00000100:00100000:0.0:1715330297.432410:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330297.432527:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938044480 00000100:00100000:3.0:1715330297.432536:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938044480 00000100:00100000:3.0:1715330297.432584:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5063 00000100:00100000:3.0:1715330297.432596:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f579180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+24:17567:x1798653938044480:12345-192.168.204.49@tcp:35:bash.0 00000100:00100000:3.0:1715330297.432900:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f579180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+25:17567:x1798653938044480:12345-192.168.204.49@tcp:35:bash.0 Request processed in 307us (497us total) trans 4294983500 rc 0/0 00000100:00100000:3.0:1715330297.432908:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5063 00000100:00100000:0.0:1715330297.435433:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330297.435502:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938044608 00000100:00100000:2.0:1715330297.435509:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938044608 00000100:00100000:2.0:1715330297.435573:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23468 00000100:00100000:2.0:1715330297.435580:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f579500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+25:17567:x1798653938044608:12345-192.168.204.49@tcp:101:bash.0 00010000:00010000:2.0:1715330297.435602:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330297.435622:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d8e7a lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb861 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.435710:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d8e81 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.435723:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d8e81 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.435941:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d8e81 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.435955:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d8e88 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.435961:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d8e88 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.435967:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d8e88 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00000004:00080000:2.0:1715330297.436217:0:25569:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9c9:0x0], index 1: 0 00010000:00010000:2.0:1715330297.436323:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d8e8f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1520:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.436330:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d8e8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1520:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.436336:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d8e8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1520:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.436375:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d8e81 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.436381:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d8e81 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.436387:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d8e81 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.436392:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64000 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330297.436395:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d8e81 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.436402:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d8e81 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.436412:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff88008b122a00) 00010000:00010000:2.0:1715330297.436414:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330297.436419:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d8e81 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.436423:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d8e81 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00000004:00010000:2.0:1715330297.436814:0:25569:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012f579500 reply state ffff880093aa9000 transno 4294983501 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d8e88 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.436823:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d8e88 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.436828:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x36 (ffff88008d68e100) 00010000:00010000:2.0:1715330297.436831:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330297.436833:0:25569:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1715330297.436854:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d8e7a lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb861 expref: 28 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.436866:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d8e8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1520:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb861 expref: 27 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.436872:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1520:0x0].0x0 (ffff88008d68e500) 00010000:00010000:2.0:1715330297.436874:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330297.436876:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db66640, rc 0) 00000100:00100000:2.0:1715330297.436928:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f579500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+28:17567:x1798653938044608:12345-192.168.204.49@tcp:101:bash.0 Request processed in 1346us (1500us total) trans 4294983501 rc 0/0 00000100:00100000:2.0:1715330297.437248:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23468 00000100:00100000:0.0:1715330297.443180:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330297.443255:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938044672 00000100:00100000:2.0:1715330297.443266:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938044672 00000100:00100000:2.0:1715330297.443327:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5190 00000100:00100000:2.0:1715330297.443337:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f578000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72de1896-1df4-4b3a-930a-9116d2c66168+7:17567:x1798653938044672:12345-192.168.204.49@tcp:101:bash.0 00010000:00010000:2.0:1715330297.443367:0:9633:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330297.443391:0:9633:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011db65440/0xd895711d66d8e9d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb868 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1715330297.443416:0:9633:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1715330297.443441:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330297.443443:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330297.443455:0:9633:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db65440/0xd895711d66d8e9d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb868 expref: 8 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.443579:0:9633:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011db65440/0xd895711d66d8e9d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb868 expref: 8 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.443590:0:9633:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db65440, rc 0) 00000100:00100000:2.0:1715330297.443655:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f578000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72de1896-1df4-4b3a-930a-9116d2c66168+8:17567:x1798653938044672:12345-192.168.204.49@tcp:101:bash.0 Request processed in 319us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330297.443663:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5190 00000100:00100000:0.0:1715330297.451659:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330297.451974:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938044800 00000100:00100000:3.0:1715330297.451985:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938044800 00000100:00100000:3.0:1715330297.452057:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5064 00000100:00100000:3.0:1715330297.452066:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7ec2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+28:17567:x1798653938044800:12345-192.168.204.49@tcp:35:bash.0 00000100:00100000:3.0:1715330297.452368:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7ec2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+29:17567:x1798653938044800:12345-192.168.204.49@tcp:35:bash.0 Request processed in 302us (723us total) trans 4294983502 rc 0/0 00000100:00100000:3.0:1715330297.452376:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5064 00000100:00100000:0.0:1715330297.456684:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330297.456800:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938044928 00000100:00100000:2.0:1715330297.456809:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938044928 00000100:00100000:2.0:1715330297.456865:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23469 00000100:00100000:2.0:1715330297.456873:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7ec1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+29:17567:x1798653938044928:12345-192.168.204.49@tcp:101:bash.0 00010000:00010000:2.0:1715330297.456902:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330297.456925:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d8ea4 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb86f expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.457019:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d8eab lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.457032:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d8eab lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.457041:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d8eab lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.457052:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d8eb2 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.457056:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d8eb2 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.457060:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d8eb2 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00000004:00080000:2.0:1715330297.457311:0:25569:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9ca:0x0], index 0: 0 00010000:00010000:2.0:1715330297.457430:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66d8eb9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1521:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.457437:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66d8eb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1521:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.457443:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66d8eb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1521:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.457465:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d8eab lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.457474:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d8eab lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.457479:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d8eab lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.457484:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66400 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330297.457487:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d8eab lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.457493:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d8eab lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.457501:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff88008b122a00) 00010000:00010000:2.0:1715330297.457504:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330297.457507:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d8eab lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.457512:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d8eab lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00000004:00010000:2.0:1715330297.457578:0:25569:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800a7ec1500 reply state ffff880093aad000 transno 4294983503 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d8eb2 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.457586:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d8eb2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.457590:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x39 (ffff88008d68e600) 00010000:00010000:2.0:1715330297.457592:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330297.457594:0:25569:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1715330297.457612:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d8ea4 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb86f expref: 32 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.457627:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66d8eb9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1521:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb86f expref: 31 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.457633:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1521:0x0].0x0 (ffff88008d68e400) 00010000:00010000:2.0:1715330297.457635:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330297.457637:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db66d00, rc 0) 00000100:00100000:2.0:1715330297.457697:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7ec1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+32:17567:x1798653938044928:12345-192.168.204.49@tcp:101:bash.0 Request processed in 824us (1023us total) trans 4294983503 rc 0/0 00000100:00100000:2.0:1715330297.457704:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23469 00000100:00100000:0.0:1715330297.462641:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330297.462975:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938044992 00000100:00100000:2.0:1715330297.462986:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938044992 00000100:00100000:2.0:1715330297.463116:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5191 00000100:00100000:2.0:1715330297.463131:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7ec3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72de1896-1df4-4b3a-930a-9116d2c66168+9:17567:x1798653938044992:12345-192.168.204.49@tcp:101:bash.0 00010000:00010000:2.0:1715330297.463157:0:9633:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330297.463189:0:9633:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011db65200/0xd895711d66d8ec7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb876 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1715330297.463220:0:9633:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1715330297.463248:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330297.463250:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330297.463260:0:9633:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db65200/0xd895711d66d8ec7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb876 expref: 10 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.463279:0:9633:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011db65200/0xd895711d66d8ec7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb876 expref: 10 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.463294:0:9633:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db65200, rc 0) 00000100:00100000:2.0:1715330297.464017:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7ec3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72de1896-1df4-4b3a-930a-9116d2c66168+10:17567:x1798653938044992:12345-192.168.204.49@tcp:101:bash.0 Request processed in 885us (1383us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330297.464024:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5191 00000100:00100000:0.0:1715330297.467205:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330297.467401:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938045120 00000100:00100000:3.0:1715330297.467410:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938045120 00000100:00100000:3.0:1715330297.467843:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5065 00000100:00100000:3.0:1715330297.467851:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7ec0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+32:17567:x1798653938045120:12345-192.168.204.49@tcp:35:bash.0 00000100:00100000:3.0:1715330297.468428:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7ec0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+33:17567:x1798653938045120:12345-192.168.204.49@tcp:35:bash.0 Request processed in 576us (1229us total) trans 4294983504 rc 0/0 00000100:00100000:3.0:1715330297.468435:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5065 00000100:00100000:0.0:1715330297.472142:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330297.472256:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938045248 00000100:00100000:3.0:1715330297.472266:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938045248 00000100:00100000:3.0:1715330297.472319:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23470 00000100:00100000:3.0:1715330297.472326:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7ec0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+33:17567:x1798653938045248:12345-192.168.204.49@tcp:101:bash.0 00010000:00010000:3.0:1715330297.472360:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330297.472381:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457dd40/0xd895711d66d8ece lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb87d expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.472484:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d8ed5 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.472499:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d8ed5 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.472510:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d8ed5 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.472523:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d8edc lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.472529:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d8edc lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.472534:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d8edc lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00000004:00080000:3.0:1715330297.472839:0:25569:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9ca:0x0], index 1: 0 00010000:00010000:3.0:1715330297.472947:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d8ee3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1522:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.472954:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d8ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1522:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.472959:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d8ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1522:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.472981:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d8ed5 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.472986:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d8ed5 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.472990:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d8ed5 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.472995:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457e640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330297.472998:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d8ed5 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.473003:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d8ed5 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.473011:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff88008b122a00) 00010000:00010000:3.0:1715330297.473013:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330297.473016:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d8ed5 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.473020:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d8ed5 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00000004:00010000:3.0:1715330297.473046:0:25569:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800a7ec0e00 reply state ffff880093b96000 transno 4294983505 ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d8edc lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.473053:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d8edc lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.473058:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x3031 (ffff88009ef25200) 00010000:00010000:3.0:1715330297.473059:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330297.473061:0:25569:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330297.473079:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457dd40/0xd895711d66d8ece lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb87d expref: 36 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.473089:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d8ee3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1522:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb87d expref: 35 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.473094:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1522:0x0].0x0 (ffff88009ef25b00) 00010000:00010000:3.0:1715330297.473096:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330297.473098:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013457e880, rc 0) 00000100:00100000:3.0:1715330297.473378:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7ec0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+36:17567:x1798653938045248:12345-192.168.204.49@tcp:101:bash.0 Request processed in 1051us (1246us total) trans 4294983505 rc 0/0 00000100:00100000:3.0:1715330297.473385:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23470 00000100:00100000:2.0:1715330297.476625:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330297.477248:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938045312 00000100:00100000:0.0:1715330297.477258:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938045312 00000100:00100000:0.0:1715330297.477316:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5192 00000100:00100000:0.0:1715330297.477324:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72de1896-1df4-4b3a-930a-9116d2c66168+8:17567:x1798653938045312:12345-192.168.204.49@tcp:101:bash.0 00010000:00010000:0.0:1715330297.477352:0:9633:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330297.477377:0:9633:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d7a0480/0xd895711d66d8ef1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb884 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1715330297.477401:0:9633:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1715330297.477423:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330297.477426:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330297.477436:0:9633:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d7a0480/0xd895711d66d8ef1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb884 expref: 9 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.477451:0:9633:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d7a0480/0xd895711d66d8ef1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb884 expref: 9 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.477461:0:9633:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a0480, rc 0) 00000100:00100000:0.0:1715330297.477524:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72de1896-1df4-4b3a-930a-9116d2c66168+9:17567:x1798653938045312:12345-192.168.204.49@tcp:101:bash.0 Request processed in 201us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330297.477531:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5192 00000100:00100000:0.0:1715330297.480150:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330297.480240:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938045440 00000100:00100000:3.0:1715330297.480249:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938045440 00000100:00100000:3.0:1715330297.480301:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5066 00000100:00100000:3.0:1715330297.480309:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+36:17567:x1798653938045440:12345-192.168.204.49@tcp:35:bash.0 00000100:00100000:3.0:1715330297.482396:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+37:17567:x1798653938045440:12345-192.168.204.49@tcp:35:bash.0 Request processed in 2083us (2248us total) trans 4294983506 rc 0/0 00000100:00100000:3.0:1715330297.482408:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5066 00000100:00100000:1.0:1715330297.490208:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330297.490294:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938045568 00000100:00100000:3.0:1715330297.490303:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938045568 00000100:00100000:3.0:1715330297.490362:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23471 00000100:00100000:3.0:1715330297.490369:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+37:17738:x1798653938045568:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:3.0:1715330297.490397:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330297.490418:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d8ef8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb88b expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715330297.490588:0:25569:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x151c:0x0]: returning size 4096 00010000:00010000:3.0:1715330297.490666:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d8ef8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb88b expref: 39 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.490672:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d8ef8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb88b expref: 39 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.490679:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013457d680, rc 0) 00000100:00100000:3.0:1715330297.490724:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+38:17738:x1798653938045568:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 357us (530us total) trans 4294983507 rc 301/301 00000100:00100000:3.0:1715330297.490754:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23471 00000100:00100000:0.0:1715330297.493147:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330297.493288:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938045632 00000100:00100000:3.0:1715330297.493804:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938045632 00000100:00100000:3.0:1715330297.493852:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5067 00000100:00100000:3.0:1715330297.493870:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+38:17738:x1798653938045632:12345-192.168.204.49@tcp:33:lfs.0 00000004:00200000:3.0:1715330297.494010:0:15159:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x151c:0x0]: returning size 4096 00000004:00200000:3.0:1715330297.494015:0:15159:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:3.0:1715330297.494101:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+38:17738:x1798653938045632:12345-192.168.204.49@tcp:33:lfs.0 Request processed in 233us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330297.494108:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5067 00000100:00100000:0.0:1715330297.495994:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330297.496098:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938045760 00000100:00100000:1.0:1715330297.496107:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938045760 00000100:00100000:1.0:1715330297.496153:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5068 00000100:00100000:1.0:1715330297.496159:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7ec1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+38:17738:x1798653938045760:12345-192.168.204.49@tcp:35:lfs.0 00000100:00100000:1.0:1715330297.496361:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7ec1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+39:17738:x1798653938045760:12345-192.168.204.49@tcp:35:lfs.0 Request processed in 201us (372us total) trans 4294983508 rc 0/0 00000100:00100000:1.0:1715330297.496368:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5068 00000100:00100000:0.0:1715330297.505173:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330297.505233:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938045888 00000100:00100000:3.0:1715330297.505244:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938045888 00000100:00100000:3.0:1715330297.505327:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23472 00000100:00100000:3.0:1715330297.505333:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7ec2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+39:17739:x1798653938045888:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:3.0:1715330297.505370:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330297.505393:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457df80/0xd895711d66d8f06 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb892 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.505565:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d8f0d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x151c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.505579:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d8f0d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x151c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.505589:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d8f0d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x151c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00000004:00200000:3.0:1715330297.505598:0:25569:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x151c:0x0]: returning size 4096 00010000:00010000:3.0:1715330297.505690:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457df80/0xd895711d66d8f06 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb892 expref: 42 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.505704:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d8f0d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x151c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb892 expref: 41 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.505712:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151c:0x0].0x0 (ffff88008b122200) 00010000:00010000:3.0:1715330297.505715:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1715330297.505717:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013457eac0, rc 0) 00000100:00100000:3.0:1715330297.505795:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7ec2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+41:17739:x1798653938045888:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 461us (630us total) trans 4294983509 rc 0/0 00000100:00100000:3.0:1715330297.505805:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23472 00000100:00100000:0.0:1715330297.511950:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330297.512573:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938045952 00000100:00100000:2.0:1715330297.512583:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938045952 00000100:00100000:2.0:1715330297.512652:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1354 00000100:00100000:0.0:1715330297.512656:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330297.512660:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7ec3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+41:2014:x1798653938045952:12345-192.168.204.49@tcp:103:lfs.0 00010000:00010000:2.0:1715330297.512675:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330297.512701:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d8dcb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb822 expref: 41 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.512754:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00000100:00100000:3.0:1715330297.512759:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938046080 00010000:00010000:2.0:1715330297.512759:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715330297.512763:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938046080 00000100:00100000:3.0:1715330297.512787:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5069 00000100:00100000:3.0:1715330297.512791:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7ec2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+41:17739:x1798653938046080:12345-192.168.204.49@tcp:35:lfs.0 00000100:00100000:2.0:1715330297.512803:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7ec3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+41:2014:x1798653938045952:12345-192.168.204.49@tcp:103:lfs.0 Request processed in 144us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330297.512814:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1354 00000100:00100000:3.0:1715330297.512958:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7ec2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+41:17739:x1798653938046080:12345-192.168.204.49@tcp:35:lfs.0 Request processed in 166us (301us total) trans 4294983510 rc 0/0 00000100:00100000:3.0:1715330297.512964:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5069 00000100:00100000:0.0:1715330297.514787:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330297.514997:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938046144 00000100:00100000:2.0:1715330297.515005:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938046144 00000100:00100000:2.0:1715330297.515056:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1355 00000100:00100000:2.0:1715330297.515063:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+41:2011:x1798653938046144:12345-192.168.204.49@tcp:103:lfs.0 00010000:00010000:2.0:1715330297.515085:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1715330297.515106:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d8f0d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x151c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb892 expref: 41 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.515133:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c000/0xd895711d66d8de7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x151c:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb829 expref: 40 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.515143:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151c:0x0].0x0 (ffff88008b122200) 00010000:00010000:2.0:1715330297.515148:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330297.515202:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+39:2011:x1798653938046144:12345-192.168.204.49@tcp:103:lfs.0 Request processed in 138us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330297.515209:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1355 00000100:00100000:0.0:1715330297.518210:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330297.518327:0:7148:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938046272 00000100:00100000:3.0:1715330297.518337:0:7148:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938046272 00000100:00100000:3.0:1715330297.518399:0:7148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 0 00000100:00100000:3.0:1715330297.518406:0:7148:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7ec1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:72de1896-1df4-4b3a-930a-9116d2c66168+6:17739:x1798653938046272:12345-192.168.204.49@tcp:36:lfs.0 00000100:00080000:0.0:1715330297.518483:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330267 00010000:00010000:3.0:1715330297.518760:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f600/0xd895711d66d8f1b lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.518769:0:7148:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f600/0xd895711d66d8f1b lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7148 initiator: MDT1 00010000:00010000:3.0:1715330297.518778:0:7148:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f600/0xd895711d66d8f1b lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7148 initiator: MDT1 00000100:00100000:3.0:1715330297.519135:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4eaa00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942475456:0@lo:101:mdt_io00_002.0 00000100:00100000:3.0:1715330297.519180:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.519193:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63540 going to sleep for 11 seconds 00000100:00100000:0.0:1715330297.519237:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942475456 00000100:00100000:0.0:1715330297.519241:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942475456 00000100:00100000:0.0:1715330297.519270:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2849 00000100:00100000:0.0:1715330297.519275:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:7148:x1798653942475456:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:0.0:1715330297.519283:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330297.519297:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a33c0/0xd895711d66d8f22 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d8f1b expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.519319:0:23404:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a33c0/0xd895711d66d8f22 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d8f1b expref: 13 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.519330:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a33c0/0xd895711d66d8f22 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8f1b expref: 13 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.519336:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff8800ad981400) 00010000:00010000:0.0:1715330297.519338:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330297.519351:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a33c0, rc 0) 00000100:00100000:0.0:1715330297.519387:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+13:7148:x1798653942475456:12345-0@lo:101:mdt_io00_002.0 Request processed in 111us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330297.519392:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2849 00000100:00100000:3.0:1715330297.519504:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4eaa00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942475456:0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1715330297.519772:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f600/0xd895711d66d8f1b lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8f22 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.519780:0:7148:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f600/0xd895711d66d8f1b lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8f22 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330297.519796:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1715330297.519821:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4eaa00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942475520:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.519840:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.520239:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63e40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.520290:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942475520 00000100:00100000:1.0:1715330297.520294:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942475520 00000100:00100000:1.0:1715330297.520931:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2850 00000100:00100000:1.0:1715330297.520937:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+13:7148:x1798653942475520:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1715330297.521004:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+13:7148:x1798653942475520:12345-0@lo:1000:mdt_io00_002.0 Request processed in 66us (1162us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330297.521009:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2850 00000100:00100000:3.0:1715330297.521085:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4eaa00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942475520:0@lo:1000:mdt_io00_002.0 00000004:00080000:3.0:1715330297.521107:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1715330297.521127:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4eaa00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942475584:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.521145:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.521168:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63e40 going to sleep for 11 seconds 00000100:00100000:0.0:1715330297.521625:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942475584 00000100:00100000:0.0:1715330297.521629:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942475584 00000100:00100000:0.0:1715330297.521657:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2851 00000100:00100000:0.0:1715330297.521661:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+13:7148:x1798653942475584:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1715330297.521723:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+13:7148:x1798653942475584:12345-0@lo:1000:mdt_io00_002.0 Request processed in 61us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330297.521729:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2851 00000100:00100000:3.0:1715330297.521880:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4eaa00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942475584:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.521914:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f579180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942475648:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.521930:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.521937:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63e40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.522078:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942475648 00000100:00100000:1.0:1715330297.522082:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942475648 00000100:00100000:1.0:1715330297.522094:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2852 00000100:00100000:1.0:1715330297.522101:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+13:7148:x1798653942475648:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1715330297.522142:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+13:7148:x1798653942475648:12345-0@lo:1000:mdt_io00_002.0 Request processed in 44us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330297.522147:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2852 00000100:00100000:3.0:1715330297.522338:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f579180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942475648:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.522379:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f579180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942475712:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.522396:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.524866:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63e40 going to sleep for 11 seconds 00000100:00100000:0.0:1715330297.525084:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942475712 00000100:00100000:0.0:1715330297.525092:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942475712 00000100:00100000:0.0:1715330297.525129:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2853 00000100:00100000:0.0:1715330297.525135:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+13:7148:x1798653942475712:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1715330297.525246:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+13:7148:x1798653942475712:12345-0@lo:1000:mdt_io00_002.0 Request processed in 111us (2848us total) trans 0 rc 1/1 00000100:00100000:0.0:1715330297.525253:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2853 00000100:00100000:3.0:1715330297.525321:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f579180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942475712:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.525399:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012faef800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942475776:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.525422:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.525431:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63e40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.525483:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942475776 00000100:00100000:1.0:1715330297.525487:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942475776 00000100:00100000:1.0:1715330297.525516:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2854 00000100:00100000:1.0:1715330297.525520:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f579180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+13:7148:x1798653942475776:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1715330297.526360:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f579180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+13:7148:x1798653942475776:12345-0@lo:1000:mdt_io00_002.0 Request processed in 838us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330297.526366:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2854 00000100:00100000:3.0:1715330297.526439:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012faef800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942475776:0@lo:1000:mdt_io00_002.0 00010000:00010000:3.0:1715330297.526487:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f3c0/0xd895711d66d8f29 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.526495:0:7148:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f3c0/0xd895711d66d8f29 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 7148 initiator: MDT1 00010000:00010000:3.0:1715330297.526503:0:7148:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f3c0/0xd895711d66d8f29 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 7148 initiator: MDT1 00000100:00100000:3.0:1715330297.526511:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012faef800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942475840:0@lo:101:mdt_io00_002.0 00000100:00100000:3.0:1715330297.526532:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.526555:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63540 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.526807:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942475840 00000100:00100000:1.0:1715330297.526811:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942475840 00000100:00100000:0.0:1715330297.527965:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2855 00000100:00100000:0.0:1715330297.527971:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+13:7148:x1798653942475840:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:0.0:1715330297.527984:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330297.528001:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1b00/0xd895711d66d8f30 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d8f29 expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.528022:0:23404:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1b00/0xd895711d66d8f30 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d8f29 expref: 14 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.528035:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1b00/0xd895711d66d8f30 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8f29 expref: 14 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.528042:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:0.0:1715330297.528045:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330297.528047:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a1b00, rc 0) 00000100:00100000:0.0:1715330297.528358:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:7148:x1798653942475840:12345-0@lo:101:mdt_io00_002.0 Request processed in 386us (1825us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330297.528364:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2855 00000100:00100000:3.0:1715330297.528541:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012faef800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942475840:0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1715330297.528556:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f3c0/0xd895711d66d8f29 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8f30 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.528564:0:7148:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f3c0/0xd895711d66d8f29 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8f30 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330297.528579:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1715330297.528602:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c240/0xd895711d66d8f37 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.528607:0:7148:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c240/0xd895711d66d8f37 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7148 initiator: MDT1 00010000:00010000:3.0:1715330297.528612:0:7148:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c240/0xd895711d66d8f37 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7148 initiator: MDT1 00000100:00100000:3.0:1715330297.528621:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942475904:0@lo:101:mdt_io00_002.0 00000100:00100000:3.0:1715330297.528640:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.528831:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63540 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.528869:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942475904 00000100:00100000:1.0:1715330297.528874:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942475904 00000100:00100000:1.0:1715330297.528897:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2856 00000100:00100000:1.0:1715330297.528901:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:7148:x1798653942475904:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1715330297.528911:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330297.528922:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d8f3e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d8f37 expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.528933:0:9407:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d8da1 lrc: 2/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330297.528940:0:9407:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d8f3e lrc: 4/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d8f37 expref: 15 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.528951:0:9407:0:(ldlm_request.c:381:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d8da1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 7135 initiator: MDT0 00080000:00080000:1.0:1715330297.528972:0:9407:0:(osd_handler.c:2696:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:1.0:1715330297.529427:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d8f3e lrc: 3/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8f37 expref: 15 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.529435:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6088611d (ffff88008b122300) 00010000:00010000:1.0:1715330297.529437:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330297.529440:0:9407:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d8f3e lrc: 3/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8f37 expref: 15 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.529445:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfc240, rc 0) 00000100:00100000:1.0:1715330297.530351:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+15:7148:x1798653942475904:12345-0@lo:101:mdt_io00_002.0 Request processed in 1439us (1699us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330297.530358:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2856 00000100:00100000:3.0:1715330297.530476:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942475904:0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1715330297.530489:0:7148:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c240/0xd895711d66d8f37 lrc: 4/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8f3e expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.530497:0:7148:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c240/0xd895711d66d8f37 lrc: 4/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8f3e expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.534178:0:7116:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd680/0xd895711d66d8db6 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d8dbd expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330297.534198:0:7116:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd680/0xd895711d66d8db6 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d8dbd expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.534241:0:7116:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd680/0xd895711d66d8db6 lrc: 2/0,0 mode: --/PW res: [0x240000401:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8dbd expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.534246:0:7116:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1715330297.534809:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d8da1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.534822:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d8da1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.534829:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d8da1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.534834:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfd200 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330297.534839:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d8da1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.534845:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d8da1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.534859:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6088611d (ffff88008b122300) 00010000:00010000:2.0:1715330297.534861:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330297.534867:0:3674:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d8f3e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8f37 expref: 14 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.534875:0:3674:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d8f3e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d8f37 expref: 14 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.534883:0:3674:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d8f3e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d8f37 expref: 14 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.534919:0:3674:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d8f3e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8f37 expref: 14 pid: 9407 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330297.534933:0:3674:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3674:1798653942476032:0@lo:105: 00000100:00100000:2.0:1715330297.534981:0:3674:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330297.535008:0:3674:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa600 going to sleep for 11 seconds 00010000:00010000:0.0:1715330297.535098:0:7116:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfd680/0xd895711d66d8db6 lrc: 0/0,0 mode: --/PW res: [0x240000401:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8dbd expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1715330297.535155:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983510 is committed 00000020:00080000:0.0:1715330297.535194:0:7116:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 386 batchid updated 00000020:00080000:0.0:1715330297.535198:0:7116:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 385 batchid updated 00000020:00080000:0.0:1715330297.535200:0:7116:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 384 batchid updated 00000020:00080000:0.0:1715330297.535203:0:7116:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 383 batchid updated 00000020:00080000:0.0:1715330297.535207:0:7116:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 382 batchid updated 00000100:00100000:0.0:1715330297.535291:0:9413:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942476032 00000100:00100000:0.0:1715330297.535299:0:9413:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942476032 00000100:00100000:2.0:1715330297.535339:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1715330297.535352:0:9413:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1167 00000100:00100000:0.0:1715330297.535360:0:9413:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:3674:x1798653942476032:12345-0@lo:105: 00000100:00100000:2.0:1715330297.535363:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a7ec2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942475968:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1715330297.535370:0:9413:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c240/0xd895711d66d8f37 lrc: 5/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8f3e expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.535379:0:9413:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c240/0xd895711d66d8f37 lrc: 5/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8f3e expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000020:00080000:3.0:1715330297.535383:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 386 00010000:00010000:0.0:1715330297.535387:0:9413:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c240/0xd895711d66d8f37 lrc: 5/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8f3e expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330297.535388:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1715330297.535393:0:9413:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c240/0xd895711d66d8f37 lrc: 5/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d8f3e expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.535398:0:9413:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c240/0xd895711d66d8f37 lrc: 6/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d8f3e expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.535406:0:9413:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c240/0xd895711d66d8f37 lrc: 6/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d8f3e expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330297.535430:0:7163:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88011db63540 with version 699 00010000:00010000:0.0:1715330297.535431:0:9413:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88013457c240) 00000020:00080000:3.0:1715330297.535504:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 376 cancel update log [0x240000401:0x3:0x0].360: rc = 0 00000004:00080000:1.0:1715330297.535539:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 699 rpc_version 699 00000020:00100000:1.0:1715330297.535564:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000020:00080000:3.0:1715330297.535569:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 376 cancel update log [0x200000400:0x3:0x0].360: rc = 0 00000100:00100000:1.0:1715330297.535571:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012b55dc00 x1798653942476160/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000004:00080000:3.0:1715330297.535584:0:7163:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88011db63f00 with version 700 00000020:00080000:3.0:1715330297.535586:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 377 cancel update log [0x240000401:0x3:0x0].361: rc = 0 00000100:00100000:1.0:1715330297.535592:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55dc00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942476160:0@lo:1000:osp_up1-0.0 00000020:00080000:3.0:1715330297.535598:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 377 cancel update log [0x200000400:0x3:0x0].361: rc = 0 00000004:00080000:3.0:1715330297.535609:0:7163:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88011db63780 with version 701 00000020:00080000:3.0:1715330297.535610:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 378 cancel update log [0x240000401:0x3:0x0].362: rc = 0 00000020:00080000:3.0:1715330297.535620:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 378 cancel update log [0x200000400:0x3:0x0].362: rc = 0 00000004:00080000:3.0:1715330297.535634:0:7163:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88011db63000 with version 702 00000020:00080000:3.0:1715330297.535635:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 379 cancel update log [0x240000401:0x3:0x0].363: rc = 0 00000020:00080000:3.0:1715330297.535645:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 379 cancel update log [0x200000400:0x3:0x0].363: rc = 0 00000004:00080000:3.0:1715330297.535655:0:7163:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88011db63600 with version 703 00000020:00080000:3.0:1715330297.535657:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 380 cancel update log [0x240000401:0x3:0x0].364: rc = 0 00000020:00080000:3.0:1715330297.535666:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 380 cancel update log [0x200000400:0x3:0x0].364: rc = 0 00000004:00080000:3.0:1715330297.535681:0:7163:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88011db63840 with version 704 00000020:00080000:3.0:1715330297.535683:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 381 cancel update log [0x240000401:0x3:0x0].365: rc = 0 00000020:00080000:3.0:1715330297.535693:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 381 cancel update log [0x200000400:0x3:0x0].365: rc = 0 00000100:00100000:2.0:1715330297.535703:0:3674:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3674:1798653942476032:0@lo:105: 00000004:00080000:3.0:1715330297.535707:0:7163:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880091cb56c0 with version 705 00000020:00080000:3.0:1715330297.535709:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 382 cancel update log [0x240000401:0x3:0x0].366: rc = 0 00010000:00010000:2.0:1715330297.535716:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d8da1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 7135 initiator: MDT0 00000020:00080000:3.0:1715330297.535720:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 382 cancel update log [0x200000400:0x3:0x0].366: rc = 0 00010000:00010000:2.0:1715330297.535722:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d8da1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 7135 initiator: MDT0 00000004:00080000:3.0:1715330297.535756:0:7163:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880091cb5a80 with version 706 00010000:00010000:2.0:1715330297.535756:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d8da8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x151c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00000020:00080000:3.0:1715330297.535758:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 383 cancel update log [0x240000401:0x3:0x0].367: rc = 0 00010000:00010000:2.0:1715330297.535761:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d8da8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x151c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.535766:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d8da8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x151c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.535770:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfcd80 already unused, calling callback (ffffffffa0ee8730) 00000020:00080000:3.0:1715330297.535773:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 383 cancel update log [0x200000400:0x3:0x0].368: rc = 0 00010000:00010000:2.0:1715330297.535773:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d8da8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x151c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.535777:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d8da8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x151c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00000004:00080000:3.0:1715330297.535783:0:7163:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880091cb5300 with version 707 00000020:00080000:3.0:1715330297.535785:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 384 cancel update log [0x240000401:0x3:0x0].368: rc = 0 00010000:00010000:2.0:1715330297.535785:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151c:0x0].0x0 (ffff88008b122200) 00010000:00010000:2.0:1715330297.535787:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330297.535790:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d8da8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x151c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.535794:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d8da8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x151c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00000020:00080000:3.0:1715330297.535796:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 384 cancel update log [0x200000400:0x3:0x0].369: rc = 0 00010000:00010000:2.0:1715330297.535807:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66d8daf lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00000004:00080000:3.0:1715330297.535808:0:7163:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880091cb5240 with version 708 00000020:00080000:3.0:1715330297.535809:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 385 cancel update log [0x240000401:0x3:0x0].369: rc = 0 00010000:00010000:2.0:1715330297.535811:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66d8daf lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.535815:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66d8daf lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00000020:00080000:3.0:1715330297.535819:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 385 cancel update log [0x200000400:0x3:0x0].370: rc = 0 00010000:00010000:2.0:1715330297.535819:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfe640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330297.535821:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66d8daf lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.535825:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66d8daf lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.535829:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff88008b122a00) 00010000:00010000:2.0:1715330297.535830:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00080000:3.0:1715330297.535831:0:7163:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880091cb5180 with version 709 00010000:00010000:2.0:1715330297.535832:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66d8daf lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00000020:00080000:3.0:1715330297.535833:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 386 cancel update log [0x240000401:0x3:0x0].370: rc = 0 00010000:00010000:2.0:1715330297.535839:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66d8daf lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00000020:00080000:3.0:1715330297.535843:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 386 cancel update log [0x200000400:0x3:0x0].371: rc = 0 00000020:00080000:3.0:1715330297.535848:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 386 00010000:00010000:2.0:1715330297.535852:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d8e0a lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.535856:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d8e0a lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.535860:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d8e0a lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.535862:0:7148:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c240/0xd895711d66d8f37 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8f3e expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.535863:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db67a80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330297.535865:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d8e0a lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.535869:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d8e0a lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.535870:0:7148:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c240/0xd895711d66d8f37 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8f3e expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.535874:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x30 (ffff88008d68e700) 00010000:00010000:2.0:1715330297.535875:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330297.535877:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d8e0a lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.535881:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d8e0a lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00000004:00080000:3.0:1715330297.535887:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1715330297.535891:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66d8e34 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.535895:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66d8e34 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.535898:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66d8e34 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.535902:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a1440 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330297.535904:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66d8e34 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.535908:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66d8e34 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.535912:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x31 (ffff8800ad981300) 00010000:00010000:2.0:1715330297.535914:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330297.535915:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66d8e34 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.535917:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f840/0xd895711d66d8f45 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x151c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.535918:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66d8e34 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.535922:0:7148:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f840/0xd895711d66d8f45 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x151c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7148 initiator: MDT1 00010000:00010000:2.0:1715330297.535928:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d8e5e lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.535930:0:7148:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f840/0xd895711d66d8f45 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x151c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7148 initiator: MDT1 00010000:00010000:2.0:1715330297.535932:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d8e5e lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.535936:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d8e5e lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.535939:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64fc0 already unused, calling callback (ffffffffa0ee8730) 00000100:00100000:3.0:1715330297.535941:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942476224:0@lo:101:mdt_io00_002.0 00010000:00010000:2.0:1715330297.535941:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d8e5e lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.535945:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d8e5e lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.535949:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x35 (ffff88008d68e900) 00010000:00010000:2.0:1715330297.535950:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330297.535953:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d8e5e lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.535956:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d8e5e lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.535964:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d8e88 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.535968:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d8e88 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.535972:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d8e88 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.535976:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66ac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330297.535978:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d8e88 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.535982:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d8e88 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.535987:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x36 (ffff88008d68e100) 00010000:00010000:2.0:1715330297.535989:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330297.535990:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d8e88 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.535994:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d8e88 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.536004:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d8eb2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.536008:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d8eb2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.536015:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d8eb2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.536019:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64480 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330297.536021:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d8eb2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.536025:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d8eb2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.536030:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x39 (ffff88008d68e600) 00010000:00010000:2.0:1715330297.536031:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330297.536033:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d8eb2 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.536037:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d8eb2 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.536046:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d8edc lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.536051:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d8edc lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.536054:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d8edc lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.536057:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457c480 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330297.536058:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d8edc lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.536062:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d8edc lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.536066:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x3031 (ffff88009ef25200) 00010000:00010000:2.0:1715330297.536068:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330297.536070:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d8edc lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.536073:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d8edc lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00000100:00100000:2.0:1715330297.536091:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942475968 00000100:00100000:2.0:1715330297.536096:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942475968 00000100:00100000:2.0:1715330297.536134:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1356 00000100:00100000:2.0:1715330297.536140:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+7:3689:x1798653942475968:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:2.0:1715330297.536150:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330297.536164:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d8dbd lrc: 0/0,0 mode: --/PW res: [0x240000401:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d8db6 expref: 7 pid: 24873 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330297.536167:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1715330297.536174:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xcc:0x0].0x0 (ffff88008b122900) 00010000:00010000:2.0:1715330297.536179:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330297.536188:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4b2f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.536204:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942476160 00000100:00100000:2.0:1715330297.536207:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+6:3689:x1798653942475968:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 65us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330297.536208:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942476160 00000100:00100000:2.0:1715330297.536213:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1356 00000100:00100000:1.0:1715330297.536231:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2857 00000100:00100000:1.0:1715330297.536235:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:8587:x1798653942476160:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1715330297.536239:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a7ec2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942475968:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:1.0:1715330297.536373:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:8587:x1798653942476160:12345-0@lo:1000:osp_up1-0.0 Request processed in 135us (206us total) trans 4294968412 rc 0/0 00000100:00100000:1.0:1715330297.536379:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2857 00000100:00100000:0.0:1715330297.536431:0:9413:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:3674:x1798653942476032:12345-0@lo:105: Request processed in 1070us (1448us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330297.536438:0:9413:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1167 00000100:00080000:0.0:1715330297.536463:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000-osp-MDT0001 older than 1715330267 00000100:00100000:3.0:1715330297.538433:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.538451:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091cb5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1715330297.538462:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942476224 00000100:00100000:3.0:1715330297.538467:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942476224 00000100:00100000:3.0:1715330297.538491:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2858 00000100:00100000:3.0:1715330297.538496:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+15:7148:x1798653942476224:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1715330297.538509:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330297.538522:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ed00/0xd895711d66d8f4c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x151c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d8f45 expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.538541:0:9407:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ed00/0xd895711d66d8f4c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x151c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d8f45 expref: 16 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.538550:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ed00/0xd895711d66d8f4c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x151c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8f45 expref: 16 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.538555:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151c:0x0].0x0 (ffff88009ef25400) 00010000:00010000:3.0:1715330297.538558:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:3.0:1715330297.538560:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013457ed00, rc 0) 00000100:00100000:3.0:1715330297.538580:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+16:7148:x1798653942476224:12345-0@lo:101:mdt_io00_002.0 Request processed in 84us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330297.538587:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2858 00000100:00100000:3.0:1715330297.538614:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942476224:0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1715330297.538627:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f840/0xd895711d66d8f45 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x151c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8f4c expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.538635:0:7148:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f840/0xd895711d66d8f45 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x151c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8f4c expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330297.538650:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x151c:0x0] 00000100:00100000:3.0:1715330297.538683:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942476288:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.538706:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.538715:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008d667480 going to sleep for 11 seconds 00000100:00100000:2.0:1715330297.538799:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942476288 00000100:00100000:2.0:1715330297.538803:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942476288 00000100:00100000:2.0:1715330297.538826:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2859 00000100:00100000:2.0:1715330297.538831:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+16:7148:x1798653942476288:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330297.539067:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+16:7148:x1798653942476288:12345-0@lo:1000:mdt_io00_002.0 Request processed in 51us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330297.539075:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2859 00000100:00100000:1.0:1715330297.539145:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55dc00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942476160:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1715330297.539163:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 700 rpc_version 700 00000100:00100000:3.0:1715330297.539187:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942476288:0@lo:1000:mdt_io00_002.0 00000020:00100000:1.0:1715330297.539187:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1715330297.539193:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012b55f800 x1798653942476416/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000004:00080000:3.0:1715330297.539206:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x151c:0x0] 00000100:00100000:1.0:1715330297.539212:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55f800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942476416:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1715330297.539225:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942476480:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.539247:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.539273:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008d6679c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.539281:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.539301:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942476480 00000100:00100000:3.0:1715330297.539304:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942476480 00000100:00100000:1.0:1715330297.539304:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4b2f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1715330297.539322:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942476416 00000100:00100000:3.0:1715330297.539324:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942476416 00000100:00100000:3.0:1715330297.539337:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2860 00000100:00100000:3.0:1715330297.539350:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+16:7148:x1798653942476480:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330297.539368:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2861 00000100:00100000:2.0:1715330297.539374:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:8587:x1798653942476416:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1715330297.539401:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+16:7148:x1798653942476480:12345-0@lo:1000:mdt_io00_002.0 Request processed in 59us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330297.539406:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2860 00000100:00100000:3.0:1715330297.539427:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942476480:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330297.539485:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:8587:x1798653942476416:12345-0@lo:1000:osp_up1-0.0 Request processed in 110us (204us total) trans 4294968413 rc 0/0 00000100:00100000:2.0:1715330297.539491:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2861 00000100:00100000:1.0:1715330297.539521:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55f800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942476416:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1715330297.539527:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 701 rpc_version 701 00000020:00100000:1.0:1715330297.539537:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1715330297.539541:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012b55c000 x1798653942476608/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1715330297.539551:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55c000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942476608:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330297.539574:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330297.539595:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4b2f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1715330297.539870:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942476672:0@lo:403:mdt_io00_002.0 00000100:00100000:3.0:1715330297.539895:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.547601:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008d667480 going to sleep for 11 seconds 00000100:00100000:2.0:1715330297.547979:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942476608 00000100:00100000:2.0:1715330297.547986:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942476608 00000100:00100000:2.0:1715330297.548129:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942476672 00000100:00100000:2.0:1715330297.548133:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942476672 00000100:00100000:2.0:1715330297.548456:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2862 00000100:00100000:2.0:1715330297.548463:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:8587:x1798653942476608:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1715330297.548542:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2863 00000100:00100000:3.0:1715330297.548547:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+16:7148:x1798653942476672:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1715330297.548769:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:8587:x1798653942476608:12345-0@lo:1000:osp_up1-0.0 Request processed in 306us (9193us total) trans 4294968414 rc 0/0 00000100:00100000:2.0:1715330297.548776:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2862 00000100:00100000:0.0:1715330297.549082:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55c000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942476608:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1715330297.549093:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 702 rpc_version 702 00000020:00100000:0.0:1715330297.549112:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1715330297.549117:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a7ec0000 x1798653942476800/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715330297.549134:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a7ec0000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942476800:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330297.549163:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330297.549183:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009d7e3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.549253:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942476800 00000100:00100000:1.0:1715330297.549258:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942476800 00000100:00100000:1.0:1715330297.549279:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2864 00000100:00100000:1.0:1715330297.549283:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7ec1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:8587:x1798653942476800:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330297.549361:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7ec1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:8587:x1798653942476800:12345-0@lo:1000:osp_up1-0.0 Request processed in 77us (197us total) trans 4294968415 rc 0/0 00000100:00100000:1.0:1715330297.549366:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2864 00000100:00100000:1.0:1715330297.549393:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a7ec0000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942476800:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1715330297.549398:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 703 rpc_version 703 00000020:00100000:1.0:1715330297.549407:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1715330297.549410:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012b55c700 x1798653942476928/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1715330297.549420:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55c700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942476928:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330297.549442:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330297.549448:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4b2f480 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.549456:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942476928 00000100:00100000:1.0:1715330297.549458:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942476928 00000100:00100000:1.0:1715330297.549467:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2865 00000100:00100000:1.0:1715330297.549471:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:8587:x1798653942476928:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330297.549515:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:8587:x1798653942476928:12345-0@lo:1000:osp_up1-0.0 Request processed in 43us (71us total) trans 4294968416 rc 0/0 00000100:00100000:1.0:1715330297.549520:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2865 00000100:00100000:1.0:1715330297.549538:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55c700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942476928:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1715330297.549542:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 704 rpc_version 704 00000020:00100000:1.0:1715330297.549549:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1715330297.549553:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012b55ed80 x1798653942477056/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1715330297.549563:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55ed80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942477056:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330297.549581:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330297.549587:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4b2f480 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.549594:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942477056 00000100:00100000:1.0:1715330297.549596:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942477056 00000100:00100000:1.0:1715330297.549605:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2866 00000100:00100000:1.0:1715330297.549608:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:8587:x1798653942477056:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330297.549649:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:8587:x1798653942477056:12345-0@lo:1000:osp_up1-0.0 Request processed in 39us (67us total) trans 4294968417 rc 0/0 00000100:00100000:1.0:1715330297.549653:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2866 00000100:00100000:1.0:1715330297.549671:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55ed80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942477056:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1715330297.549676:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 705 rpc_version 705 00000020:00100000:1.0:1715330297.549683:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1715330297.549686:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008d48ca80 x1798653942477184/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1715330297.549695:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48ca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942477184:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330297.549710:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330297.549717:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4b2f480 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.549723:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942477184 00000100:00100000:1.0:1715330297.549725:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942477184 00000100:00100000:1.0:1715330297.549751:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2867 00000100:00100000:1.0:1715330297.549754:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:8587:x1798653942477184:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330297.549797:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:8587:x1798653942477184:12345-0@lo:1000:osp_up1-0.0 Request processed in 42us (86us total) trans 4294968418 rc 0/0 00000100:00100000:1.0:1715330297.549805:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2867 00000100:00100000:1.0:1715330297.549823:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48ca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942477184:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1715330297.549828:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 706 rpc_version 706 00000020:00100000:1.0:1715330297.549836:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1715330297.549839:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008d48ed80 x1798653942477312/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1715330297.549848:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48ed80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942477312:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330297.549865:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330297.549871:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4b2f480 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.549878:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942477312 00000100:00100000:1.0:1715330297.549880:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942477312 00000100:00100000:1.0:1715330297.549889:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2868 00000100:00100000:1.0:1715330297.549892:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:8587:x1798653942477312:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330297.549932:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:8587:x1798653942477312:12345-0@lo:1000:osp_up1-0.0 Request processed in 39us (66us total) trans 4294968419 rc 0/0 00000100:00100000:1.0:1715330297.549937:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2868 00000100:00100000:1.0:1715330297.549954:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48ed80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942477312:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1715330297.549959:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 707 rpc_version 707 00000020:00100000:1.0:1715330297.549966:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1715330297.549970:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008d48df80 x1798653942477440/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1715330297.549978:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48df80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942477440:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330297.549993:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.550259:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+16:7148:x1798653942476672:12345-0@lo:403:mdt_io00_002.0 Request processed in 1710us (10362us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330297.550265:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2863 00000100:00100000:1.0:1715330297.554483:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4b2f480 going to sleep for 11 seconds 00000100:00100000:2.0:1715330297.555050:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942477440 00000100:00100000:2.0:1715330297.555059:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942477440 00000100:00100000:3.0:1715330297.555199:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2869 00000100:00100000:3.0:1715330297.555206:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:8587:x1798653942477440:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1715330297.555352:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:8587:x1798653942477440:12345-0@lo:1000:osp_up1-0.0 Request processed in 136us (5347us total) trans 4294968420 rc 0/0 00000100:00100000:3.0:1715330297.555359:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2869 00000100:00100000:0.0:1715330297.555619:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48df80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942477440:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1715330297.555628:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 708 rpc_version 708 00000020:00100000:0.0:1715330297.555644:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1715330297.555649:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a7ec1f80 x1798653942477568/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715330297.555664:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a7ec1f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942477568:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330297.555688:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330297.555852:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942477568 00000100:00100000:2.0:1715330297.555855:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942477568 00000100:00100000:0.0:1715330297.555858:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009d7e3240 going to sleep for 11 seconds 00000100:00100000:2.0:1715330297.555869:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2870 00000100:00100000:2.0:1715330297.555873:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7ec2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:8587:x1798653942477568:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1715330297.555874:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942476672:0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1715330297.555982:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7ec2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:8587:x1798653942477568:12345-0@lo:1000:osp_up1-0.0 Request processed in 108us (292us total) trans 4294968421 rc 0/0 00000100:00100000:2.0:1715330297.555988:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2870 00000100:00100000:0.0:1715330297.556074:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a7ec1f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942477568:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1715330297.556079:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 709 rpc_version 709 00000020:00100000:0.0:1715330297.556087:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1715330297.556091:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a7ec3480 x1798653942477696/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715330297.556100:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a7ec3480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942477696:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330297.556115:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330297.556122:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009d7e3240 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.556157:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942477696 00000100:00100000:1.0:1715330297.556161:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942477696 00000100:00100000:1.0:1715330297.556176:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2871 00000100:00100000:1.0:1715330297.556180:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7ec2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:8587:x1798653942477696:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330297.556236:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7ec2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:8587:x1798653942477696:12345-0@lo:1000:osp_up1-0.0 Request processed in 55us (119us total) trans 4294968422 rc 0/0 00000100:00100000:1.0:1715330297.556241:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2871 00000100:00100000:0.0:1715330297.556249:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a7ec3480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942477696:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1715330297.556568:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc7a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942477760:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.556587:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.556608:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008d6679c0 going to sleep for 11 seconds 00000100:00100000:3.0:1715330297.556618:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942477760 00000100:00100000:3.0:1715330297.556620:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942477760 00000100:00100000:3.0:1715330297.556644:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2872 00000100:00100000:3.0:1715330297.556648:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+16:7148:x1798653942477760:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.556684:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+16:7148:x1798653942477760:12345-0@lo:1000:mdt_io00_002.0 Request processed in 35us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330297.556688:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2872 00000100:00100000:3.0:1715330297.556706:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc7a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942477760:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.556728:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc7a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942477824:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.556761:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.556767:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008d6679c0 going to sleep for 11 seconds 00000100:00100000:3.0:1715330297.556774:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942477824 00000100:00100000:3.0:1715330297.556776:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942477824 00000100:00100000:3.0:1715330297.556785:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2873 00000100:00100000:3.0:1715330297.556788:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+16:7148:x1798653942477824:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.556815:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+16:7148:x1798653942477824:12345-0@lo:1000:mdt_io00_002.0 Request processed in 26us (54us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330297.556820:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2873 00000100:00100000:3.0:1715330297.556834:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc7a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942477824:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.557257:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc7a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942477888:0@lo:403:mdt_io00_002.0 00000100:00100000:3.0:1715330297.557281:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.557299:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008d667480 going to sleep for 11 seconds 00000100:00100000:2.0:1715330297.557318:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942477888 00000100:00100000:2.0:1715330297.557323:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942477888 00000100:00100000:2.0:1715330297.557355:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2874 00000100:00100000:2.0:1715330297.557360:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+16:7148:x1798653942477888:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1715330297.561010:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+16:7148:x1798653942477888:12345-0@lo:403:mdt_io00_002.0 Request processed in 3643us (3722us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330297.561023:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2874 00000100:00100000:3.0:1715330297.561040:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc7a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942477888:0@lo:403:mdt_io00_002.0 00000100:00100000:3.0:1715330297.561599:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc7a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942477952:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.561630:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.561658:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008d6679c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715330297.561704:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942477952 00000100:00100000:2.0:1715330297.561710:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942477952 00000100:00100000:2.0:1715330297.561750:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2875 00000100:00100000:2.0:1715330297.561755:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+16:7148:x1798653942477952:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330297.561812:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+16:7148:x1798653942477952:12345-0@lo:1000:mdt_io00_002.0 Request processed in 57us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330297.561817:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2875 00000100:00100000:3.0:1715330297.561861:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc7a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942477952:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.561889:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc7a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942478016:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.561904:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.561910:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008d6679c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715330297.563641:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942478016 00000100:00100000:2.0:1715330297.563649:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942478016 00000100:00100000:2.0:1715330297.563690:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2876 00000100:00100000:2.0:1715330297.563696:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+16:7148:x1798653942478016:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330297.564030:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+16:7148:x1798653942478016:12345-0@lo:1000:mdt_io00_002.0 Request processed in 92us (1882us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330297.564038:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2876 00000100:00100000:3.0:1715330297.564476:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc7a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942478016:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.564523:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc7a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942478080:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.564547:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.564571:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008d6679c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330297.564658:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942478080 00000100:00100000:0.0:1715330297.564662:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942478080 00000100:00100000:0.0:1715330297.564693:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2877 00000100:00100000:0.0:1715330297.564698:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+16:7148:x1798653942478080:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1715330297.564773:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+16:7148:x1798653942478080:12345-0@lo:1000:mdt_io00_002.0 Request processed in 74us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330297.564779:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2877 00000100:00100000:3.0:1715330297.569958:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc7a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942478080:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.570035:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc7a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942478144:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.570084:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.570117:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008d6679c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715330297.570181:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942478144 00000100:00100000:2.0:1715330297.570187:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942478144 00000100:00100000:2.0:1715330297.570232:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2878 00000100:00100000:2.0:1715330297.570238:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+16:7148:x1798653942478144:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330297.570312:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+16:7148:x1798653942478144:12345-0@lo:1000:mdt_io00_002.0 Request processed in 73us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330297.570318:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2878 00000100:00100000:3.0:1715330297.571426:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc7a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942478144:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.571460:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc7a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942478208:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.571479:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.571504:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008d6679c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330297.571724:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942478208 00000100:00100000:0.0:1715330297.571729:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942478208 00000100:00100000:0.0:1715330297.571908:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2879 00000100:00100000:0.0:1715330297.571913:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+16:7148:x1798653942478208:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1715330297.571978:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+16:7148:x1798653942478208:12345-0@lo:1000:mdt_io00_002.0 Request processed in 63us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330297.571984:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2879 00000100:00100000:3.0:1715330297.572041:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc7a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942478208:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.572537:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc7a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942478272:0@lo:403:mdt_io00_002.0 00000100:00100000:3.0:1715330297.572572:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.572582:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008d667480 going to sleep for 11 seconds 00000100:00100000:2.0:1715330297.572816:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942478272 00000100:00100000:2.0:1715330297.572820:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942478272 00000100:00100000:2.0:1715330297.573442:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2880 00000100:00100000:2.0:1715330297.573448:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+16:7148:x1798653942478272:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1715330297.578800:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+16:7148:x1798653942478272:12345-0@lo:403:mdt_io00_002.0 Request processed in 5345us (6220us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330297.578813:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2880 00000100:00100000:3.0:1715330297.578935:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc7a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942478272:0@lo:403:mdt_io00_002.0 00000100:00100000:3.0:1715330297.579670:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc7a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942478336:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.579704:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.580932:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008d6679c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715330297.580977:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942478336 00000100:00100000:2.0:1715330297.580986:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942478336 00000100:00100000:2.0:1715330297.581618:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2881 00000100:00100000:2.0:1715330297.581626:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+16:7148:x1798653942478336:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330297.581707:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+16:7148:x1798653942478336:12345-0@lo:1000:mdt_io00_002.0 Request processed in 82us (2002us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330297.581713:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2881 00000100:00100000:3.0:1715330297.581780:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc7a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942478336:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.581844:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc7a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942478400:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.581864:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.581874:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008d667f00 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.581928:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942478400 00000100:00100000:1.0:1715330297.581932:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942478400 00000100:00100000:1.0:1715330297.582275:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2882 00000100:00100000:1.0:1715330297.582280:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+16:7148:x1798653942478400:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1715330297.582334:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+16:7148:x1798653942478400:12345-0@lo:1000:mdt_io00_002.0 Request processed in 52us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330297.582347:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2882 00000100:00100000:3.0:1715330297.582578:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc7a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942478400:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.582600:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc7a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942478464:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.582616:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.582656:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008d667b40 going to sleep for 11 seconds 00000100:00100000:0.0:1715330297.582692:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942478464 00000100:00100000:0.0:1715330297.582696:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942478464 00000100:00100000:0.0:1715330297.582755:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2883 00000100:00100000:0.0:1715330297.582760:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+16:7148:x1798653942478464:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1715330297.582813:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+16:7148:x1798653942478464:12345-0@lo:1000:mdt_io00_002.0 Request processed in 52us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330297.582821:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2883 00000100:00100000:3.0:1715330297.582876:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc7a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942478464:0@lo:1000:mdt_io00_002.0 00000040:00080000:3.0:1715330297.583564:0:7148:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].388, 2464 off585768 00000040:00080000:3.0:1715330297.583614:0:7148:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].390, 2544 off641128 00000004:00080000:3.0:1715330297.583618:0:7148:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88008d667480 with version 742 00000004:00080000:0.0:1715330297.583700:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 742 rpc_version 742 00000020:00100000:0.0:1715330297.583725:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1715330297.583748:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a7ec0700 x1798653942478592/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715330297.583761:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a7ec0700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942478592:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330297.583792:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330297.583802:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009d7e3240 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.583843:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942478592 00000100:00100000:1.0:1715330297.583848:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942478592 00000100:00100000:1.0:1715330297.583865:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2884 00000100:00100000:1.0:1715330297.583869:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b160e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+16:8278:x1798653942478592:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1715330297.584725:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b160e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+17:8278:x1798653942478592:12345-0@lo:1000:osp_up0-1.0 Request processed in 853us (930us total) trans 4294983511 rc 0/0 00000100:00100000:1.0:1715330297.584757:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2884 00000100:00100000:2.0:1715330297.584848:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a7ec0700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942478592:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1715330297.584972:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c6c0/0xd895711d66d8f53 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x18c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.584984:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c6c0/0xd895711d66d8f53 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x18c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT1 00010000:00010000:3.0:1715330297.584994:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c6c0/0xd895711d66d8f53 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x18c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT1 00010000:00010000:3.0:1715330297.585007:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f180/0xd895711d66d8f5a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.585012:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f180/0xd895711d66d8f5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT1 00010000:00010000:3.0:1715330297.585016:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f180/0xd895711d66d8f5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT1 00010000:00010000:3.0:1715330297.585035:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457cd80/0xd895711d66d8f61 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.585040:0:7148:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457cd80/0xd895711d66d8f61 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7148 initiator: MDT1 00010000:00010000:3.0:1715330297.585050:0:7148:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457cd80/0xd895711d66d8f61 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7148 initiator: MDT1 00000100:00100000:3.0:1715330297.585060:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc7a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942478656:0@lo:101:mdt_io00_002.0 00000100:00100000:3.0:1715330297.585083:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.585570:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008d667000 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.585660:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942478656 00000100:00100000:1.0:1715330297.585664:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942478656 00000100:00100000:1.0:1715330297.586482:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2885 00000100:00100000:1.0:1715330297.586489:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+17:7148:x1798653942478656:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1715330297.586504:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330297.586519:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfed00/0xd895711d66d8f68 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d8f61 expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.586539:0:9408:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfed00/0xd895711d66d8f68 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d8f61 expref: 18 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.586549:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfed00/0xd895711d66d8f68 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8f61 expref: 18 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.586555:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff880093b42c00) 00010000:00010000:1.0:1715330297.586558:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330297.586560:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfed00, rc 0) 00000100:00100000:1.0:1715330297.587093:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+18:7148:x1798653942478656:12345-0@lo:101:mdt_io00_002.0 Request processed in 603us (2009us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330297.587099:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2885 00000100:00100000:3.0:1715330297.587156:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc7a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942478656:0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1715330297.587167:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457cd80/0xd895711d66d8f61 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8f68 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.587175:0:7148:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457cd80/0xd895711d66d8f61 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8f68 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1715330297.587190:0:7148:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800a7ec1180 reply state ffff880093b94000 transno 4294968423 ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f180/0xd895711d66d8f5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT1 00010000:00010000:3.0:1715330297.587197:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f180/0xd895711d66d8f5a lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT1 00010000:00010000:3.0:1715330297.587202:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff88009ef25100) 00010000:00010000:3.0:1715330297.587204:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330297.587206:0:7148:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330297.587210:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457cd80/0xd895711d66d8f61 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8f68 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.587215:0:7148:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457cd80/0xd895711d66d8f61 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8f68 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330297.587222:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00000004:00010000:3.0:1715330297.587228:0:7148:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800a7ec1180 reply state ffff880093b94000 transno 4294968423 ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c6c0/0xd895711d66d8f53 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x18c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT1 00010000:00010000:3.0:1715330297.587233:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c6c0/0xd895711d66d8f53 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x18c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT1 00010000:00010000:3.0:1715330297.587238:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18c:0x0].0x0 (ffff88009ef25900) 00010000:00010000:3.0:1715330297.587239:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330297.587240:0:7148:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00080000:3.0:1715330297.587246:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x151c:0x0] 00010000:00010000:3.0:1715330297.587250:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f840/0xd895711d66d8f45 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x151c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8f4c expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.587255:0:7148:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f840/0xd895711d66d8f45 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x151c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8f4c expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330297.587261:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1715330297.587264:0:7148:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f3c0/0xd895711d66d8f29 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8f30 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.587270:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f3c0/0xd895711d66d8f29 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8f30 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.587274:0:7148:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f3c0/0xd895711d66d8f29 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8f30 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.587284:0:7148:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1715330297.587286:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1715330297.587288:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c240/0xd895711d66d8f37 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8f3e expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.587293:0:7148:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c240/0xd895711d66d8f37 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d8f3e expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.587364:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715330297.587369:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f3c0/0xd895711d66d8f29 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d8f30 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.587375:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457f3c0 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330297.587379:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f3c0/0xd895711d66d8f29 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d8f30 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330297.587385:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f3c0/0xd895711d66d8f29 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d8f30 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.587404:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f3c0/0xd895711d66d8f29 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8f30 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.587408:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330297.587425:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f3c0/0xd895711d66d8f29 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8f30 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.587433:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f3c0/0xd895711d66d8f29 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8f30 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.587441:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330297.587443:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330297.587444:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330297.587448:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1715330297.587456:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942478720:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330297.587480:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1715330297.588075:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1715330297.588081:0:7148:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f600/0xd895711d66d8f1b lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d8f22 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.588086:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f600/0xd895711d66d8f1b lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8f22 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.588091:0:7148:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f600/0xd895711d66d8f1b lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d8f22 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.588098:0:7148:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1715330297.588142:0:7148:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7ec1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:72de1896-1df4-4b3a-930a-9116d2c66168+8:17739:x1798653938046272:12345-192.168.204.49@tcp:36:lfs.0 Request processed in 69735us (69939us total) trans 4294968423 rc 0/0 00000100:00100000:3.0:1715330297.588148:0:7148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 0 00010000:00010000:1.0:1715330297.588193:0:7123:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715330297.588197:0:7123:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f600/0xd895711d66d8f1b lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d8f22 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.588202:0:7123:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457f600 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330297.588205:0:7123:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f600/0xd895711d66d8f1b lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d8f22 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330297.588210:0:7123:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f600/0xd895711d66d8f1b lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d8f22 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.588224:0:7123:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f600/0xd895711d66d8f1b lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8f22 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.588228:0:7123:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330297.588237:0:7123:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f600/0xd895711d66d8f1b lrc: 1/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8f22 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.588242:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f600/0xd895711d66d8f1b lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8f22 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.588255:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330297.588256:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330297.588257:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330297.588263:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942478784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330297.588280:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330297.588608:0:10673:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942478720 00000100:00100000:2.0:1715330297.588613:0:10673:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942478720 00000100:00100000:2.0:1715330297.589455:0:10673:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942478784 00000100:00100000:2.0:1715330297.589459:0:10673:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942478784 00000100:00100000:2.0:1715330297.589482:0:10673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1357 00000100:00100000:2.0:1715330297.589487:0:10673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+19:3688:x1798653942478720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715330297.589494:0:10673:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1715330297.589502:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1358 00000100:00100000:3.0:1715330297.589507:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+19:3690:x1798653942478784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715330297.589508:0:10673:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1b00/0xd895711d66d8f30 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d8f29 expref: 19 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.589515:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330297.589522:0:10673:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:3.0:1715330297.589525:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a33c0/0xd895711d66d8f22 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d8f1b expref: 18 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.589525:0:10673:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330297.589534:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff8800ad981400) 00010000:00010000:3.0:1715330297.589540:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330297.589547:0:10673:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+17:3688:x1798653942478720:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (2066us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330297.589552:0:10673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1357 00000100:00100000:3.0:1715330297.589562:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+16:3690:x1798653942478784:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (1280us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330297.589566:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1358 00000100:00100000:1.0:1715330297.589612:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942478720:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1715330297.589723:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942478784:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1715330297.597086:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330297.597179:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938046336 00000100:00100000:3.0:1715330297.597188:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938046336 00000100:00100000:3.0:1715330297.597299:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23473 00000100:00100000:3.0:1715330297.597307:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+15:17739:x1798653938046336:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:3.0:1715330297.597328:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330297.597353:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c900/0xd895711d66d8f6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb899 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.597403:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457fa80/0xd895711d66d8f76 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.597413:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457fa80/0xd895711d66d8f76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.597422:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457fa80/0xd895711d66d8f76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00000004:00200000:3.0:1715330297.597458:0:25569:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 270336 00000004:00200000:3.0:1715330297.597460:0:25569:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1715330297.597475:0:25569:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88013457fa80/0xd895711d66d8f76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.597493:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c900/0xd895711d66d8f6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb899 expref: 17 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.597520:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457fa80/0xd895711d66d8f76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb899 expref: 16 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.597527:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:3.0:1715330297.597529:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1715330297.597532:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013457fa80, rc 0) 00000100:00100000:3.0:1715330297.598840:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+16:17739:x1798653938046336:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 1531us (1759us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330297.598846:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23473 00000100:00100000:0.0:1715330297.609061:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330297.609126:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938046464 00000100:00100000:3.0:1715330297.609135:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938046464 00000100:00100000:3.0:1715330297.609187:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23474 00000100:00100000:3.0:1715330297.609195:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b161f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+16:17739:x1798653938046464:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:3.0:1715330297.609222:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330297.609239:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457db00/0xd895711d66d8f7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb8a0 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.609301:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d8f84 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.609312:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d8f84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.609321:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d8f84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.609329:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d8f8b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6088611d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.609335:0:25569:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d8f3e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8f37 expref: 15 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.609350:0:25569:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d8f8b lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.609375:0:25569:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d8f3e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd895711d66d8f37 expref: 15 pid: 9407 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330297.609396:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc7a300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:25569:1798653942478848:0@lo:104: 00000100:00100000:3.0:1715330297.609434:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.609461:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008d667240 going to sleep for 11 seconds 00000100:00100000:0.0:1715330297.609486:0:7118:0:(service.c:168:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1715330297.609496:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942478848 00000100:00100000:0.0:1715330297.609499:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942478848 00000100:00100000:0.0:1715330297.609695:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1168 00000100:00100000:0.0:1715330297.609699:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fad9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:25569:x1798653942478848:12345-0@lo:104: 00010000:00010000:0.0:1715330297.609708:0:7118:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c240/0xd895711d66d8f37 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d8f3e expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.609867:0:7118:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1715330297.609871:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fad9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:25569:x1798653942478848:12345-0@lo:104: Request processed in 172us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330297.609877:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1168 00010000:00010000:1.0:1715330297.609947:0:9415:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715330297.609954:0:9415:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c240/0xd895711d66d8f37 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d8f3e expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.609960:0:9415:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457c240 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330297.609964:0:9415:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c240/0xd895711d66d8f37 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd895711d66d8f3e expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330297.609971:0:9415:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c240/0xd895711d66d8f37 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd895711d66d8f3e expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.609989:0:9415:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c240/0xd895711d66d8f37 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d8f3e expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.609994:0:9415:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1715330297.610081:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc7a300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:25569:1798653942478848:0@lo:104: 00010000:00010000:3.0:1715330297.610093:0:25569:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d8f8b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330297.610297:0:9415:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c240/0xd895711d66d8f37 lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d8f3e expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.610303:0:9415:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c240/0xd895711d66d8f37 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d8f3e expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330297.610311:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1715330297.610320:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942478912:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330297.610326:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330297.610328:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330297.610330:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330297.610349:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330297.610561:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942478912 00000100:00100000:1.0:1715330297.610564:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942478912 00010000:00010000:1.0:1715330297.610577:0:10674:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d8f3e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd895711d66d8f37 expref: 16 pid: 9407 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330297.610601:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1543 00000100:00100000:1.0:1715330297.610605:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+16:3690:x1798653942478912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330297.610613:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:2.0:1715330297.611893:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983511 is committed 00010000:00010000:1.0:1715330297.612109:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d8f3e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd895711d66d8f37 expref: 15 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.612122:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6088611d (ffff88008b122300) 00010000:00010000:1.0:1715330297.612126:0:10674:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d8f8b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330297.612133:0:10674:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d8f8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330297.612138:0:10674:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d8f8b lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330297.612191:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330297.612222:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+14:3690:x1798653942478912:12345-0@lo:103:ldlm_bl.0 Request processed in 1615us (1880us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330297.612228:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1543 00000100:00100000:2.0:1715330297.612250:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942478912:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1715330297.612288:0:25569:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d8f8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.612294:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d8f8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00000100:00100000:3.0:1715330297.612394:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c2300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:25569:1798653942478976:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1715330297.612420:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.612439:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008d667c00 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.612487:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942478976 00000100:00100000:1.0:1715330297.612491:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942478976 00000100:00100000:1.0:1715330297.612550:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2886 00000100:00100000:1.0:1715330297.612555:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:25569:x1798653942478976:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1715330297.612605:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:25569:x1798653942478976:12345-0@lo:1000:mdt00_005.0 Request processed in 49us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330297.612609:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2886 00000100:00100000:3.0:1715330297.612704:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c2300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:25569:1798653942478976:0@lo:1000:mdt00_005.0 00010000:00010000:3.0:1715330297.612761:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d200/0xd895711d66d8f92 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x18c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.612769:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d200/0xd895711d66d8f92 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.612775:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d200/0xd895711d66d8f92 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.612826:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d8f84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.612832:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d8f84 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.612836:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d8f84 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.612840:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457e1c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330297.612843:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d8f84 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.612847:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d8f84 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.612854:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:3.0:1715330297.612857:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330297.612859:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d8f84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.612864:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d8f84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.612931:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d8f8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.612936:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d8f8b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.612940:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d8f8b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.612943:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457e400 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330297.612946:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d8f8b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.612950:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d8f8b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.612956:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6088611d (ffff88008b122300) 00010000:00010000:3.0:1715330297.612957:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330297.612959:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d8f8b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.612963:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d8f8b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.612990:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457db00/0xd895711d66d8f7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8a0 expref: 18 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.612998:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d200/0xd895711d66d8f92 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x18c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8a0 expref: 17 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.613003:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18c:0x0].0x0 (ffff88009ef25d00) 00010000:00010000:3.0:1715330297.613004:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1715330297.613006:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013457d200, rc 0) 00000100:00100000:3.0:1715330297.613044:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b161f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+17:17739:x1798653938046464:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 3850us (3991us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330297.613049:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23474 00000100:00100000:0.0:1715330297.618271:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330297.618998:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938046592 00000100:00100000:3.0:1715330297.619007:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938046592 00000100:00100000:3.0:1715330297.619052:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23475 00000100:00100000:3.0:1715330297.619059:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b161880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+8:17739:x1798653938046592:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:3.0:1715330297.619081:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330297.619099:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013457ef40/0xd895711d66d8f99 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x18c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb8a7 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715330297.620040:0:25569:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x18c:0x0]: returning size 4096 00010000:00010000:3.0:1715330297.620117:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457ef40/0xd895711d66d8f99 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x18c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8a7 expref: 10 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.620127:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457ef40/0xd895711d66d8f99 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x18c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8a7 expref: 10 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.620137:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013457ef40, rc 0) 00000100:00100000:3.0:1715330297.620192:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b161880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+9:17739:x1798653938046592:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 1132us (1928us total) trans 4294968424 rc 301/301 00000100:00100000:3.0:1715330297.620198:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23475 00000100:00100000:0.0:1715330297.622589:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330297.622845:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938046656 00000100:00100000:3.0:1715330297.622851:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938046656 00000100:00100000:3.0:1715330297.622875:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23476 00000100:00100000:3.0:1715330297.622880:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b163b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+9:17739:x1798653938046656:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:3.0:1715330297.622894:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330297.622907:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013457cfc0/0xd895711d66d8fa7 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb8ae expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.622942:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457db00/0xd895711d66d8fae lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.622952:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457db00/0xd895711d66d8fae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330297.622965:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013457db00/0xd895711d66d8fae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00000004:00200000:3.0:1715330297.622992:0:25569:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000400:0xc9:0x0]: returning size 4096 00000004:00200000:3.0:1715330297.622995:0:25569:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:3.0:1715330297.623017:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457cfc0/0xd895711d66d8fa7 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8ae expref: 11 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.623028:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457db00/0xd895711d66d8fae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8ae expref: 10 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.623035:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff88009ef25100) 00010000:00010000:3.0:1715330297.623037:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1715330297.623039:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013457db00, rc 0) 00000100:00100000:3.0:1715330297.623081:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b163b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+10:17739:x1798653938046656:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 199us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330297.623086:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23476 00000100:00100000:0.0:1715330297.624594:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330297.625029:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938046720 00000100:00100000:2.0:1715330297.625034:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938046720 00000100:00100000:2.0:1715330297.625069:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23477 00000100:00100000:2.0:1715330297.625074:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b163800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:17739:x1798653938046720:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:2.0:1715330297.625085:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330297.625097:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d8fb5 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb8b5 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.625126:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d8fbc lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.625134:0:7135:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfed00/0xd895711d66d8f68 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d8f61 expref: 13 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.625140:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d8fbc lrc: 4/1,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.625163:0:7135:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfed00/0xd895711d66d8f68 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd895711d66d8f61 expref: 13 pid: 9408 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330297.625174:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d56300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7135:1798653942479040:0@lo:104: 00000100:00100000:2.0:1715330297.625205:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330297.625229:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a8556600 going to sleep for 11 seconds 00000100:00100000:0.0:1715330297.625323:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942479040 00000100:00100000:0.0:1715330297.625326:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942479040 00000100:00100000:0.0:1715330297.625354:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1169 00000100:00100000:0.0:1715330297.625359:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:7135:x1798653942479040:12345-0@lo:104: 00010000:00010000:0.0:1715330297.625367:0:7118:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457cd80/0xd895711d66d8f61 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d8f68 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.625397:0:7118:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1715330297.625401:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:7135:x1798653942479040:12345-0@lo:104: Request processed in 42us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330297.625406:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1169 00010000:00010000:3.0:1715330297.625447:0:7124:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1715330297.625453:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457cd80/0xd895711d66d8f61 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d8f68 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.625458:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457cd80 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:3.0:1715330297.625462:0:7124:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457cd80/0xd895711d66d8f61 lrc: 4/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd895711d66d8f68 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1715330297.625469:0:7124:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457cd80/0xd895711d66d8f61 lrc: 4/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd895711d66d8f68 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.625487:0:7124:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457cd80/0xd895711d66d8f61 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d8f68 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.625492:0:7124:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1715330297.625515:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457cd80/0xd895711d66d8f61 lrc: 1/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d8f68 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.625521:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457cd80/0xd895711d66d8f61 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d8f68 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.625534:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715330297.625535:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715330297.625537:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330297.625556:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d56300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7135:1798653942479040:0@lo:104: 00010000:00010000:3.0:1715330297.625567:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d8fbc lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000100:00100000:3.0:1715330297.625583:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1715330297.625590:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942479104:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1715330297.625610:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330297.625727:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942479104 00000100:00100000:0.0:1715330297.625804:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942479104 00010000:00010000:0.0:1715330297.625818:0:10674:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfed00/0xd895711d66d8f68 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd895711d66d8f61 expref: 14 pid: 9408 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330297.625833:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1544 00000100:00100000:0.0:1715330297.625836:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+14:3689:x1798653942479104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330297.625842:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330297.626153:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfed00/0xd895711d66d8f68 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd895711d66d8f61 expref: 14 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.626322:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff880093b42c00) 00010000:00010000:0.0:1715330297.626326:0:10674:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d8fbc lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330297.626331:0:10674:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d8fbc lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330297.626336:0:10674:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d8fbc lrc: 4/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330297.626389:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330297.626420:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d8fbc lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.626426:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d8fbc lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00200000:2.0:1715330297.626452:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0xcc:0x0]: returning size 4096 00000004:00200000:2.0:1715330297.626455:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:2.0:1715330297.626475:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d8fb5 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8b5 expref: 19 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.626497:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d8fbc lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8b5 expref: 18 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.626503:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff880093b42c00) 00010000:00010000:2.0:1715330297.626505:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1715330297.626506:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db66ac0, rc 0) 00000100:00100000:2.0:1715330297.626530:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b163800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+18:17739:x1798653938046720:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 1456us (1939us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330297.626535:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23477 00000100:00100000:0.0:1715330297.626775:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+13:3689:x1798653942479104:12345-0@lo:103:ldlm_bl.0 Request processed in 937us (1163us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330297.626781:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1544 00000100:00100000:3.0:1715330297.626884:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942479104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330297.629443:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330297.629907:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938046784 00000100:00100000:2.0:1715330297.629913:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938046784 00000100:00100000:2.0:1715330297.630039:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23478 00000100:00100000:2.0:1715330297.630044:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b162a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+10:17739:x1798653938046784:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:2.0:1715330297.630056:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330297.630070:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64fc0/0xd895711d66d8fc3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb8bc expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.630111:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67a80/0xd895711d66d8fca lrc: 3/1,0 mode: --/PR res: [0x240000402:0x18c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.630123:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67a80/0xd895711d66d8fca lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330297.630130:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67a80/0xd895711d66d8fca lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000004:00200000:2.0:1715330297.630216:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x18c:0x0]: returning size 4096 00000004:00200000:2.0:1715330297.630219:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00000004:00010000:2.0:1715330297.630232:0:7135:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67a80/0xd895711d66d8fca lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330297.630246:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64fc0/0xd895711d66d8fc3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8bc expref: 12 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.630258:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67a80/0xd895711d66d8fca lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x18c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8bc expref: 11 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.630264:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18c:0x0].0x0 (ffff88009ef25900) 00010000:00010000:2.0:1715330297.630266:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1715330297.630267:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db67a80, rc 0) 00000100:00100000:2.0:1715330297.630522:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b162a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+11:17739:x1798653938046784:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 477us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330297.630527:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23478 00000100:00100000:0.0:1715330297.633245:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330297.633315:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938046848 00000100:00100000:1.0:1715330297.633321:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938046848 00000100:00100000:1.0:1715330297.633394:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5070 00000100:00100000:1.0:1715330297.633399:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b160700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+11:17739:x1798653938046848:12345-192.168.204.49@tcp:37:lfs.0 00000100:00100000:1.0:1715330297.637192:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b160700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+11:17739:x1798653938046848:12345-192.168.204.49@tcp:37:lfs.0 Request processed in 3786us (3944us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330297.637204:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5070 00000100:00100000:0.0:1715330297.640285:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330297.640335:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938046912 00000100:00100000:1.0:1715330297.640353:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938046912 00000100:00100000:1.0:1715330297.640397:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5071 00000100:00100000:1.0:1715330297.640402:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ef0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+18:17739:x1798653938046912:12345-192.168.204.49@tcp:37:lfs.0 00000100:00100000:1.0:1715330297.644814:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ef0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+18:17739:x1798653938046912:12345-192.168.204.49@tcp:37:lfs.0 Request processed in 4402us (4527us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330297.644826:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5071 00000100:00100000:0.0:1715330297.652575:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330297.652637:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938046976 00000100:00100000:2.0:1715330297.652646:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938046976 00000100:00100000:2.0:1715330297.652696:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23479 00000100:00100000:2.0:1715330297.652704:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b160a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+18:17739:x1798653938046976:12345-192.168.204.49@tcp:34:lfs.0 00010000:00010000:2.0:1715330297.652803:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d8fd1 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.652820:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d8fd1 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.652829:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d8fd1 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.652839:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d8fd8 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.652844:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d8fd8 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.652848:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d8fd8 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.652890:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d8fdf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1521:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.652895:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d8fdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1521:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.652899:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d8fdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1521:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00010000:2.0:1715330297.652930:0:7135:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d8fdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1521:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.652940:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d8fd1 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.652945:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d8fd1 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.652949:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d8fd1 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.652957:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d8fd1 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.652962:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db67840 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330297.652965:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d8fd1 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.652970:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d8fd1 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.652979:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff880093b42c00) 00010000:00010000:2.0:1715330297.652981:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330297.652985:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d8fd1 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.652989:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d8fd1 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.653016:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d8fd8 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.653020:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d8fd8 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.653025:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d8fd8 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.653029:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db65d40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330297.653032:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d8fd8 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.653036:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d8fd8 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.653045:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x39 (ffff88009396da00) 00010000:00010000:2.0:1715330297.653047:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330297.653049:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d8fd8 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.653052:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d8fd8 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.653064:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d8fdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1521:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.653068:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d8fdf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1521:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.653072:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d8fdf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1521:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.653076:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64900 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330297.653078:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d8fdf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1521:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.653081:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d8fdf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1521:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.653086:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1521:0x0].0x0 (ffff88008d68e400) 00010000:00010000:2.0:1715330297.653088:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330297.653089:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d8fdf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1521:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.653093:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d8fdf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1521:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00000100:00100000:2.0:1715330297.653140:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b160a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+18:17739:x1798653938046976:12345-192.168.204.49@tcp:34:lfs.0 Request processed in 437us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330297.653147:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23479 00000100:00100000:0.0:1715330297.655601:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330297.655682:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938047104 00000100:00100000:3.0:1715330297.655689:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938047104 00000100:00100000:3.0:1715330297.655755:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23480 00000100:00100000:3.0:1715330297.655762:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+18:17739:x1798653938047104:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:3.0:1715330297.655774:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330297.655787:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d8fe6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1521:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb8c3 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.655860:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d8fed lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1521:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.655870:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d8fed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1521:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.655877:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d8fed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1521:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00000004:00200000:3.0:1715330297.655885:0:25569:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1521:0x0]: returning size 2 00010000:00010000:3.0:1715330297.655954:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d8fe6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1521:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8c3 expref: 21 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.655979:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d8fed lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1521:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8c3 expref: 20 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.655985:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1521:0x0].0x0 (ffff88008d68e400) 00010000:00010000:3.0:1715330297.655988:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1715330297.655989:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013457e1c0, rc 0) 00000100:00100000:3.0:1715330297.656016:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+20:17739:x1798653938047104:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 255us (420us total) trans 4294983512 rc 0/0 00000100:00100000:3.0:1715330297.656021:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23480 00000100:00100000:0.0:1715330297.661430:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330297.661494:0:17200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938047168 00000100:00100000:3.0:1715330297.661502:0:17200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938047168 00000100:00100000:3.0:1715330297.661532:0:17200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5193 00000100:00100000:3.0:1715330297.661538:0:17200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b161500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:72de1896-1df4-4b3a-930a-9116d2c66168+10:2011:x1798653938047168:12345-192.168.204.49@tcp:1:lfs.0 00010000:00010000:3.0:1715330297.661574:0:17200:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88013457c240/0xd895711d66d8ffb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.661604:0:17200:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011db65200/0xd895711d66d8ec7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb876 expref: 10 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.661617:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1715330297.661618:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1715330297.661621:0:17200:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013457c240/0xd895711d66d8ffb lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.661645:0:17200:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011db65200/0xd895711d66d8ec7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb876 expref: 10 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.661657:0:17200:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011db65200/0xd895711d66d8ec7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb876 expref: 10 pid: 9633 timeout: 372 lvb_type: 0 00000100:00100000:3.0:1715330297.661668:0:17200:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:17200:1798653942479168:192.168.204.49@tcp:104: 00000100:00100000:3.0:1715330297.662381:0:17200:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008d667c00 going to sleep for 11 seconds 00000100:00100000:3.0:1715330297.663605:0:17200:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:17200:1798653942479168:192.168.204.49@tcp:104: 00010000:00010000:3.0:1715330297.663622:0:17200:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88013457c240/0xd895711d66d8ffb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330297.664886:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330297.665765:0:9404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938047232 00000100:00100000:2.0:1715330297.665774:0:9404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938047232 00002000:00100000:2.0:1715330297.665816:0:9404:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9ca:0x0] (0->1) req@ffff88008b160700 x1798653938047232/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:508/0 lens 496/0 e 0 to 0 dl 1715330308 ref 1 fl New:/200/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 00002000:00100000:2.0:1715330297.665825:0:9404:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b160700 with x1798653938047232 ext(0->1) 00010000:00010000:2.0:1715330297.665834:0:9404:0:(ldlm_extent.c:692:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011db65200/0xd895711d66d8ec7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb876 expref: 11 pid: 9633 timeout: 372 lvb_type: 0 00010000:00010000:2.0:1715330297.665846:0:9404:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011db65200/0xd895711d66d8ec7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb876 expref: 11 pid: 9633 timeout: 372 lvb_type: 0 00002000:00010000:2.0:1715330297.665852:0:9404:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008b160700 00000100:00100000:2.0:1715330297.665877:0:9404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 0 00000100:00100000:2.0:1715330297.665884:0:9404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b160700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:72de1896-1df4-4b3a-930a-9116d2c66168+11:2012:x1798653938047232:12345-192.168.204.49@tcp:4:bash.0 00000100:00100000:2.0:1715330297.668713:0:9404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b160700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:72de1896-1df4-4b3a-930a-9116d2c66168+13:2012:x1798653938047232:12345-192.168.204.49@tcp:4:bash.0 Request processed in 2820us (3827us total) trans 4294969880 rc 0/0 00000100:00100000:2.0:1715330297.668726:0:9404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 0 00002000:00100000:2.0:1715330297.668754:0:9404:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9ca:0x0] (0->1) req@ffff88008b160700 x1798653938047232/t4294969880(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:508/0 lens 496/448 e 0 to 0 dl 1715330308 ref 1 fl Complete:H/200/0 rc 0/0 job:'bash.0' uid:0 gid:0 00002000:00100000:2.0:1715330297.668764:0:9404:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b160700 with x1798653938047232 ext(0->1) 00010000:00010000:2.0:1715330297.668773:0:9404:0:(ldlm_extent.c:692:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011db65200/0xd895711d66d8ec7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb876 expref: 13 pid: 9633 timeout: 372 lvb_type: 0 00010000:00010000:2.0:1715330297.668785:0:9404:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011db65200/0xd895711d66d8ec7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb876 expref: 13 pid: 9633 timeout: 372 lvb_type: 0 00002000:00010000:2.0:1715330297.668791:0:9404:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008b160700 00000100:00100000:0.0:1715330297.672474:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330297.672592:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938047296 00000100:00100000:2.0:1715330297.672602:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938047296 00010000:00010000:2.0:1715330297.672641:0:10674:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011db65200/0xd895711d66d8ec7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb876 expref: 13 pid: 9633 timeout: 372 lvb_type: 0 00000100:00100000:2.0:1715330297.672687:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1545 00000100:00100000:2.0:1715330297.672694:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:72de1896-1df4-4b3a-930a-9116d2c66168+13:2014:x1798653938047296:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1715330297.672709:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1715330297.672727:0:10674:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x9ca:0x0] updating lvb size from disk: 0 -> 2 00002000:00010000:2.0:1715330297.672759:0:10674:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x9ca:0x0] updating lvb mtime from disk: 0 -> 1715330297 00002000:00010000:2.0:1715330297.672761:0:10674:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000401:0x9ca:0x0] updating lvb ctime from disk: 0 -> 1715330297 00002000:00010000:2.0:1715330297.672763:0:10674:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000401:0x9ca:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1715330297.672769:0:10674:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011db65200/0xd895711d66d8ec7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb876 expref: 13 pid: 9633 timeout: 372 lvb_type: 0 00010000:00010000:2.0:1715330297.672780:0:10674:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011db65200/0xd895711d66d8ec7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb876 expref: 13 pid: 9633 timeout: 372 lvb_type: 0 00010000:00010000:2.0:1715330297.672808:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011db65200/0xd895711d66d8ec7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb876 expref: 13 pid: 9633 timeout: 372 lvb_type: 0 00010000:00010000:2.0:1715330297.673379:0:10674:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330297.673382:0:10674:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330297.673388:0:10674:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013457c240/0xd895711d66d8ffb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.673403:0:10674:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013457c240/0xd895711d66d8ffb lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.673591:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330297.673678:0:17200:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88013457c240/0xd895711d66d8ffb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.673688:0:17200:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013457c240/0xd895711d66d8ffb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.673705:0:17200:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88013457c240/0xd895711d66d8ffb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.673716:0:17200:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88013457c240/0xd895711d66d8ffb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.673724:0:17200:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88013457c240/0xd895711d66d8ffb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.673991:0:17200:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457c240 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330297.673996:0:17200:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88013457c240/0xd895711d66d8ffb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.674005:0:17200:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88013457c240/0xd895711d66d8ffb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.674020:0:17200:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88013457c240/0xd895711d66d8ffb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.674026:0:17200:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013457c240/0xd895711d66d8ffb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330297.674089:0:17200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b161500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:72de1896-1df4-4b3a-930a-9116d2c66168+12:2011:x1798653938047168:12345-192.168.204.49@tcp:1:lfs.0 Request processed in 12549us (12664us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330297.674099:0:17200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5193 00000100:00100000:2.0:1715330297.674294:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:72de1896-1df4-4b3a-930a-9116d2c66168+11:2014:x1798653938047296:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 1599us (1831us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330297.674301:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1545 00000100:00100000:0.0:1715330297.676572:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330297.676829:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330297.676967:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938047360 00000100:00100000:3.0:1715330297.676975:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938047424 00000100:00100000:2.0:1715330297.676977:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938047360 00000100:00100000:0.0:1715330297.676977:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330297.676980:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938047424 00000100:00100000:2.0:1715330297.676997:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938047488 00000100:00100000:2.0:1715330297.676999:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938047488 00000100:00100000:0.0:1715330297.677024:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330297.677025:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1359 00000100:00100000:3.0:1715330297.677030:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1360 00000100:00100000:2.0:1715330297.677031:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+12:2011:x1798653938047488:12345-192.168.204.49@tcp:103:lfs.0 00000100:00100000:3.0:1715330297.677035:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72de1896-1df4-4b3a-930a-9116d2c66168+20:2011:x1798653938047424:12345-192.168.204.49@tcp:103:lfs.0 00010000:00010000:2.0:1715330297.677045:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330297.677070:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457db00/0xd895711d66d8fae lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8ae expref: 12 pid: 25569 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330297.677074:0:7148:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938047616 00000100:00100000:1.0:1715330297.677079:0:7148:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938047616 00010000:00010000:2.0:1715330297.677086:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff88009ef25100) 00010000:00010000:2.0:1715330297.677090:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330297.677121:0:7148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1 00000100:00100000:1.0:1715330297.677126:0:7148:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:72de1896-1df4-4b3a-930a-9116d2c66168+21:17739:x1798653938047616:12345-192.168.204.49@tcp:36:lfs.0 00000100:00100000:2.0:1715330297.677129:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+11:2011:x1798653938047488:12345-192.168.204.49@tcp:103:lfs.0 Request processed in 98us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330297.677135:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1359 00000100:00100000:2.0:1715330297.677163:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1361 00000100:00100000:2.0:1715330297.677167:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ab78bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:72de1896-1df4-4b3a-930a-9116d2c66168+10:2011:x1798653938047360:12345-192.168.204.49@tcp:103:lfs.0 00010000:00010000:2.0:1715330297.677172:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330297.677172:0:7148:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330297.677181:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67a80/0xd895711d66d8fca lrc: 0/0,0 mode: --/PR res: [0x240000402:0x18c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8bc expref: 10 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.677187:0:7148:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66d8eb9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1521:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb86f expref: 21 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.677190:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18c:0x0].0x0 (ffff88009ef25900) 00010000:00010000:2.0:1715330297.677193:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330297.677202:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1521:0x0].0x0 (ffff88008d68e400) 00000100:00100000:2.0:1715330297.677204:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ab78bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:72de1896-1df4-4b3a-930a-9116d2c66168+9:2011:x1798653938047360:12345-192.168.204.49@tcp:103:lfs.0 Request processed in 37us (641us total) trans 0 rc 0/0 00010000:00010000:1.0:1715330297.677206:0:7148:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330297.677209:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1361 00010000:00010000:1.0:1715330297.677232:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d9002 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:1.0:1715330297.677242:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d9002 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:1.0:1715330297.677249:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d9002 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00000004:00080000:1.0:1715330297.677271:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x18c:0x0] 00000100:00100000:1.0:1715330297.677320:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48ea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942479232:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1715330297.677371:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330297.677387:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4b2fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.677403:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942479232 00000100:00100000:1.0:1715330297.677406:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942479232 00000100:00100000:1.0:1715330297.677428:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2887 00000100:00100000:1.0:1715330297.677431:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:7148:x1798653942479232:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1715330297.677492:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:7148:x1798653942479232:12345-0@lo:1000:mdt_io00_002.0 Request processed in 59us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330297.677497:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2887 00000100:00100000:1.0:1715330297.677543:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48ea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942479232:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1715330297.678035:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48ea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942479296:0@lo:403:mdt_io00_002.0 00000100:00100000:1.0:1715330297.678063:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330297.678073:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4b2f780 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.678085:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942479296 00000100:00100000:1.0:1715330297.678088:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942479296 00000100:00100000:1.0:1715330297.678104:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2888 00000100:00100000:1.0:1715330297.678108:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:7148:x1798653942479296:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:1.0:1715330297.679784:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:7148:x1798653942479296:12345-0@lo:403:mdt_io00_002.0 Request processed in 1668us (1713us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330297.679794:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2888 00000100:00100000:1.0:1715330297.679846:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48ea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942479296:0@lo:403:mdt_io00_002.0 00010000:00010000:3.0:1715330297.680035:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330297.680063:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d8fbc lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8b5 expref: 20 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.680081:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff880093b42c00) 00010000:00010000:3.0:1715330297.680090:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715330297.680123:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72de1896-1df4-4b3a-930a-9116d2c66168+19:2011:x1798653938047424:12345-192.168.204.49@tcp:103:lfs.0 Request processed in 3087us (3294us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330297.680130:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1360 00000100:00100000:1.0:1715330297.681709:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48ea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942479360:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1715330297.681781:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330297.681817:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4b2fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1715330297.681880:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942479360 00000100:00100000:2.0:1715330297.681887:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942479360 00000100:00100000:2.0:1715330297.681924:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2889 00000100:00100000:2.0:1715330297.681930:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:7148:x1798653942479360:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330297.682068:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:7148:x1798653942479360:12345-0@lo:1000:mdt_io00_002.0 Request processed in 137us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330297.682076:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2889 00000100:00100000:3.0:1715330297.682225:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48ea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942479360:0@lo:1000:mdt_io00_002.0 00010000:00010000:3.0:1715330297.682281:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d9009 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.682290:0:7148:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d9009 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.682299:0:7148:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d9009 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7148 initiator: MDT0 00000100:00100000:3.0:1715330297.682309:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c2300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942479424:0@lo:101:mdt_io00_002.0 00000100:00100000:3.0:1715330297.682331:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.682354:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008d667c00 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.682372:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942479424 00000100:00100000:1.0:1715330297.682376:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942479424 00000100:00100000:1.0:1715330297.682401:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2890 00000100:00100000:1.0:1715330297.682405:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:7148:x1798653942479424:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1715330297.682414:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330297.682429:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d9010 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d9009 expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.682450:0:9408:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f180/0xd895711d66d8f5a lrc: 2/0,1 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT1 00010000:00010000:1.0:1715330297.682458:0:9408:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d9010 lrc: 4/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d9009 expref: 18 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.682469:0:9408:0:(ldlm_request.c:381:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f180/0xd895711d66d8f5a lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 7148 initiator: MDT1 00080000:00080000:1.0:1715330297.682488:0:9408:0:(osd_handler.c:2696:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00010000:1.0:1715330297.682530:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d9010 lrc: 3/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9009 expref: 18 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.682540:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff88009ef25100) 00010000:00010000:1.0:1715330297.682542:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330297.682545:0:9408:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d9010 lrc: 3/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9009 expref: 18 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.682549:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bff600, rc 0) 00000100:00100000:1.0:1715330297.682579:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+18:7148:x1798653942479424:12345-0@lo:101:mdt_io00_002.0 Request processed in 173us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330297.682583:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2890 00000100:00100000:3.0:1715330297.682889:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c2300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942479424:0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1715330297.682901:0:7148:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d9009 lrc: 4/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9010 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.682909:0:7148:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d9009 lrc: 4/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9010 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.683923:0:8267:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f840/0xd895711d66d8f45 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x151c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d8f4c expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330297.683935:0:8267:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f840/0xd895711d66d8f45 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x151c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d8f4c expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.683965:0:8267:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f840/0xd895711d66d8f45 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x151c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8f4c expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.683970:0:8267:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1715330297.684044:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c6c0/0xd895711d66d8f53 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x18c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT1 00010000:00010000:2.0:1715330297.684051:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c6c0/0xd895711d66d8f53 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x18c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT1 00010000:00010000:2.0:1715330297.684057:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c6c0/0xd895711d66d8f53 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x18c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT1 00010000:00010000:2.0:1715330297.684063:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457c6c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330297.684065:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c6c0/0xd895711d66d8f53 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x18c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT1 00010000:00010000:2.0:1715330297.684075:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c6c0/0xd895711d66d8f53 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x18c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7148 initiator: MDT1 00010000:00010000:2.0:1715330297.684090:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18c:0x0].0x0 (ffff88009ef25900) 00010000:00010000:2.0:1715330297.684092:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330297.684095:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c6c0/0xd895711d66d8f53 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x18c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT1 00010000:00010000:2.0:1715330297.684100:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c6c0/0xd895711d66d8f53 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x18c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT1 00010000:00010000:2.0:1715330297.684116:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f180/0xd895711d66d8f5a lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 7148 initiator: MDT1 00010000:00010000:2.0:1715330297.684121:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f180/0xd895711d66d8f5a lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 7148 initiator: MDT1 00010000:00010000:2.0:1715330297.684126:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f180/0xd895711d66d8f5a lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 7148 initiator: MDT1 00010000:00010000:2.0:1715330297.684131:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457f180 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330297.684133:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f180/0xd895711d66d8f5a lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 7148 initiator: MDT1 00010000:00010000:2.0:1715330297.684137:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f180/0xd895711d66d8f5a lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 7148 initiator: MDT1 00010000:00010000:2.0:1715330297.684143:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff88009ef25100) 00010000:00010000:2.0:1715330297.684145:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330297.684149:0:3675:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d9010 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9009 expref: 17 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.684159:0:3675:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d9010 lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d9009 expref: 17 pid: 9408 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330297.684162:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942479488:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1715330297.684200:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.684228:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942479488 00000100:00100000:3.0:1715330297.684233:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942479488 00000100:00100000:3.0:1715330297.684262:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1362 00000100:00100000:3.0:1715330297.684267:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+13:3689:x1798653942479488:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1715330297.684277:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330297.684292:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ed00/0xd895711d66d8f4c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x151c:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d8f45 expref: 13 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.684301:0:9416:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151c:0x0].0x0 (ffff88009ef25400) 00010000:00010000:3.0:1715330297.684308:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715330297.684331:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+12:3689:x1798653942479488:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 63us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330297.684336:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1362 00010000:00010000:2.0:1715330297.684363:0:3675:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d9010 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d9009 expref: 17 pid: 9408 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330297.684375:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942479488:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1715330297.684386:0:3675:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d9010 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9009 expref: 17 pid: 9408 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330297.684395:0:3675:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d55880 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0001_UUID:3675:1798653942479552:0@lo:105: 00000100:00100000:2.0:1715330297.684421:0:3675:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1715330297.684597:0:8267:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f840/0xd895711d66d8f45 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x151c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d8f4c expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330297.685125:0:3675:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a8556b40 going to sleep for 11 seconds 00000100:00100000:3.0:1715330297.685197:0:9413:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942479552 00000100:00100000:3.0:1715330297.685202:0:9413:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942479552 00000100:00100000:3.0:1715330297.685232:0:9413:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1170 00000100:00100000:3.0:1715330297.685237:0:9413:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:3675:x1798653942479552:12345-0@lo:105: 00010000:00010000:3.0:1715330297.685246:0:9413:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d9009 lrc: 5/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9010 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.685255:0:9413:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d9009 lrc: 5/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9010 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.685266:0:9413:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d9009 lrc: 5/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9010 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.685272:0:9413:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d9009 lrc: 5/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d9010 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.685278:0:9413:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d9009 lrc: 6/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d9010 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.685284:0:9413:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d9009 lrc: 6/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d9010 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.685311:0:9413:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88013457c900) 00000100:00100000:3.0:1715330297.685335:0:9413:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:3675:x1798653942479552:12345-0@lo:105: Request processed in 98us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330297.685350:0:9413:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1170 00000100:00100000:2.0:1715330297.685482:0:3675:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d55880 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0001_UUID:3675:1798653942479552:0@lo:105: 00010000:00010000:2.0:1715330297.685495:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f180/0xd895711d66d8f5a lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 7148 initiator: MDT1 00010000:00010000:2.0:1715330297.685500:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f180/0xd895711d66d8f5a lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 7148 initiator: MDT1 00010000:00010000:2.0:1715330297.685521:0:7148:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d9009 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9010 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.685528:0:7148:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d9009 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9010 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715330297.685550:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00010000:00010000:2.0:1715330297.685573:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db661c0/0xd895711d66d9017 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.685578:0:7148:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db661c0/0xd895711d66d9017 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.685587:0:7148:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db661c0/0xd895711d66d9017 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7148 initiator: MDT0 00000100:00100000:2.0:1715330297.685598:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d55880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942479616:0@lo:101:mdt_io00_002.0 00000100:00100000:2.0:1715330297.685622:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330297.685645:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a8556b40 going to sleep for 11 seconds 00000100:00100000:3.0:1715330297.685698:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942479616 00000100:00100000:3.0:1715330297.685702:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942479616 00000001:00080000:0.0:1715330297.685775:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968424 is committed 00000001:00080000:0.0:1715330297.685792:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968422 is committed 00000020:00080000:0.0:1715330297.685812:0:8267:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0001: 388 batchid updated 00000100:00080000:0.0:1715330297.685830:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001-osp-MDT0000 older than 1715330267 00000020:00080000:0.0:1715330297.685842:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 388 00000004:00080000:0.0:1715330297.685911:0:8285:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88009d7e30c0 with version 743 00000020:00080000:0.0:1715330297.685929:0:8285:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 384 cancel update log [0x200000401:0x3:0x0].386: rc = 0 00000004:00080000:2.0:1715330297.685950:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 743 rpc_version 743 00000020:00100000:2.0:1715330297.685969:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1715330297.685975:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880091d57480 x1798653942479744/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1715330297.685987:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d57480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942479744:0@lo:1000:osp_up0-1.0 00000020:00080000:0.0:1715330297.686003:0:8285:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 384 cancel update log [0x240000400:0x3:0x0].384: rc = 0 00000100:00100000:2.0:1715330297.686013:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1715330297.686026:0:8285:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88009d7e3cc0 with version 744 00000020:00080000:0.0:1715330297.686028:0:8285:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 386 cancel update log [0x200000401:0x3:0x0].387: rc = 0 00000020:00080000:0.0:1715330297.686044:0:8285:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 386 cancel update log [0x240000400:0x3:0x0].385: rc = 0 00000004:00080000:0.0:1715330297.686060:0:8285:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88009d7e3e40 with version 745 00000020:00080000:0.0:1715330297.686062:0:8285:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 387 cancel update log [0x200000401:0x3:0x0].388: rc = 0 00000100:00100000:2.0:1715330297.686285:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1715330297.686308:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942479744 00000100:00100000:3.0:1715330297.686311:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942479744 00000100:00100000:1.0:1715330297.686326:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2891 00000100:00100000:3.0:1715330297.686332:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2892 00000100:00100000:1.0:1715330297.686333:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7148:x1798653942479616:12345-0@lo:101:mdt_io00_002.0 00000100:00100000:3.0:1715330297.686336:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:8278:x1798653942479744:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1715330297.686356:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330297.686373:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd8c0/0xd895711d66d901e lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d9017 expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.686391:0:9408:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd8c0/0xd895711d66d901e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d9017 expref: 7 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.686401:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd8c0/0xd895711d66d901e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9017 expref: 7 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.686407:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x39 (ffff880093b42500) 00010000:00010000:1.0:1715330297.686409:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330297.686411:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfd8c0, rc 0) 00000100:00100000:1.0:1715330297.686440:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7148:x1798653942479616:12345-0@lo:101:mdt_io00_002.0 Request processed in 107us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330297.686445:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2891 00000100:00100000:3.0:1715330297.686452:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+13:8278:x1798653942479744:12345-0@lo:1000:osp_up0-1.0 Request processed in 115us (437us total) trans 4294983513 rc 0/0 00000100:00100000:3.0:1715330297.686458:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2892 00000100:00100000:3.0:1715330297.686497:0:7148:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968422 gen 2 00000004:00080000:3.0:1715330297.686502:0:7148:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968411 committed transno 4294968422 00000020:00080000:3.0:1715330297.686507:0:7148:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8800b4b2f180 refcount 2 committed 0 result 0 batchid 387 00000020:00080000:3.0:1715330297.686510:0:7148:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008b122e00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8800b4b2f240 00000020:00080000:3.0:1715330297.686513:0:7148:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].371 00000020:00080000:3.0:1715330297.686514:0:7148:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008b122400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88008d737200 00000020:00080000:3.0:1715330297.686517:0:7148:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].372 00000004:00080000:3.0:1715330297.686539:0:7148:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968412 committed transno 4294968422 00000004:00080000:3.0:1715330297.686554:0:7148:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968413 committed transno 4294968422 00000004:00080000:3.0:1715330297.686564:0:7148:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968414 committed transno 4294968422 00000004:00080000:3.0:1715330297.686575:0:7148:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968415 committed transno 4294968422 00000004:00080000:3.0:1715330297.686588:0:7148:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968416 committed transno 4294968422 00000004:00080000:3.0:1715330297.686599:0:7148:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968417 committed transno 4294968422 00000004:00080000:3.0:1715330297.686612:0:7148:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968418 committed transno 4294968422 00000004:00080000:3.0:1715330297.686625:0:7148:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968419 committed transno 4294968422 00000004:00080000:3.0:1715330297.686638:0:7148:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968420 committed transno 4294968422 00000004:00080000:3.0:1715330297.686652:0:7148:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968421 committed transno 4294968422 00000004:00080000:3.0:1715330297.686663:0:7148:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968422 committed transno 4294968422 00000100:00100000:3.0:1715330297.686676:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d55880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942479616:0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1715330297.686686:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db661c0/0xd895711d66d9017 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d901e expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.686695:0:7148:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db661c0/0xd895711d66d9017 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d901e expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330297.686707:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00000020:00080000:3.0:1715330297.686713:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 387 committed batchid 386 00000020:00080000:3.0:1715330297.686747:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 386 00010000:00010000:3.0:1715330297.686767:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d9025 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.686778:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d9025 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.686785:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d9025 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.686795:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f600/0xd895711d66d902c lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.686799:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f600/0xd895711d66d902c lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.686804:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f600/0xd895711d66d902c lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.686836:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f3c0/0xd895711d66d9033 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1521:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.686846:0:7148:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d8fed lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1521:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8c3 expref: 18 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.686853:0:7148:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f3c0/0xd895711d66d9033 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1521:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.686872:0:7148:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d8fed lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1521:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8c3 expref: 18 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.686884:0:7148:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d8fed lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1521:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8c3 expref: 18 pid: 25569 timeout: 372 lvb_type: 0 00000100:00100000:3.0:1715330297.686895:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c0000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:7148:1798653942479808:192.168.204.49@tcp:104: 00000100:00100000:3.0:1715330297.686939:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008d667c00 going to sleep for 11 seconds 00000100:00100000:2.0:1715330297.687008:0:8278:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983511 gen 2 00000004:00080000:2.0:1715330297.687012:0:8278:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983511 committed transno 4294983511 00000020:00080000:2.0:1715330297.687015:0:8278:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff88008d6679c0 refcount 2 committed 0 result 0 batchid 389 00000020:00080000:2.0:1715330297.687018:0:8278:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009ef25200 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff88008d667480 00000020:00080000:2.0:1715330297.687021:0:8278:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].390 00000020:00080000:2.0:1715330297.687023:0:8278:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009ef25500 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88009396e800 00000020:00080000:2.0:1715330297.687025:0:8278:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].388 00000100:00100000:2.0:1715330297.687046:0:8278:0:(client.c:3000:ptlrpc_free_committed()) @@@ stopping search req@ffff880091d57480 x1798653942479744/t4294983513(4294983513) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1715330313 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 00000100:00100000:2.0:1715330297.687059:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d57480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942479744:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1715330297.687065:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 744 rpc_version 744 00000020:00100000:2.0:1715330297.687075:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1715330297.687079:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880091d56a00 x1798653942479936/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1715330297.687090:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d56a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942479936:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1715330297.687110:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330297.687120:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1715330297.687129:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942479936 00000100:00100000:2.0:1715330297.687131:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942479936 00000100:00100000:2.0:1715330297.687147:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2893 00000100:00100000:2.0:1715330297.687151:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+13:8278:x1798653942479936:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1715330297.687218:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:8278:x1798653942479936:12345-0@lo:1000:osp_up0-1.0 Request processed in 65us (106us total) trans 4294983514 rc 0/0 00000100:00100000:2.0:1715330297.687224:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2893 00000100:00100000:2.0:1715330297.687246:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d56a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942479936:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1715330297.687252:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 745 rpc_version 745 00000020:00100000:2.0:1715330297.687260:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1715330297.687263:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880091d55500 x1798653942480064/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1715330297.687273:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d55500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942480064:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1715330297.687292:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330297.687300:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1715330297.687309:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942480064 00000100:00100000:2.0:1715330297.687311:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942480064 00000100:00100000:2.0:1715330297.687322:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2894 00000100:00100000:2.0:1715330297.687326:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:8278:x1798653942480064:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1715330297.687394:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+15:8278:x1798653942480064:12345-0@lo:1000:osp_up0-1.0 Request processed in 66us (100us total) trans 4294983515 rc 0/0 00000100:00100000:2.0:1715330297.687399:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2894 00000100:00100000:2.0:1715330297.687418:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d55500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942480064:0@lo:1000:osp_up0-1.0 00000020:00080000:0.0:1715330297.687679:0:8285:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 387 cancel update log [0x240000400:0x3:0x0].386: rc = 0 00000004:00080000:0.0:1715330297.687709:0:8285:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88009d7e3780 with version 746 00000020:00080000:0.0:1715330297.687723:0:8285:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 388 cancel update log [0x200000401:0x3:0x0].389: rc = 0 00000004:00080000:2.0:1715330297.687744:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 746 rpc_version 746 00000020:00100000:2.0:1715330297.687756:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000020:00080000:0.0:1715330297.687758:0:8285:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 388 cancel update log [0x240000400:0x3:0x0].387: rc = 0 00000100:00100000:2.0:1715330297.687760:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880091d56300 x1798653942480192/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000020:00080000:0.0:1715330297.687765:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 389 committed batchid 388 00000100:00100000:2.0:1715330297.687771:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d56300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942480192:0@lo:1000:osp_up0-1.0 00000020:00080000:0.0:1715330297.687780:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 388 00000100:00100000:2.0:1715330297.687792:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330297.687808:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435300 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.687849:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942480192 00000100:00100000:1.0:1715330297.687854:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942480192 00000100:00100000:1.0:1715330297.687885:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2895 00000100:00100000:1.0:1715330297.687890:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+15:8278:x1798653942480192:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1715330297.687971:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+16:8278:x1798653942480192:12345-0@lo:1000:osp_up0-1.0 Request processed in 79us (176us total) trans 4294983516 rc 0/0 00000100:00100000:1.0:1715330297.687977:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2895 00000100:00100000:2.0:1715330297.688771:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d56300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942480192:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1715330297.690279:0:7148:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.204.49@tcp) returned -22 from blocking AST (req@ffff88008b0c0000 x1798653942479808) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d8fed lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1521:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8c3 expref: 18 pid: 25569 timeout: 372 lvb_type: 0 00010000:00010000:3.0:1715330297.690294:0:7148:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d8fed lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1521:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8c3 expref: 18 pid: 25569 timeout: 372 lvb_type: 0 00010000:00010000:3.0:1715330297.690315:0:7148:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d8fed lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1521:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8c3 expref: 18 pid: 25569 timeout: 372 lvb_type: 0 00000100:00100000:3.0:1715330297.690346:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c0000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:7148:1798653942479808:192.168.204.49@tcp:104: 00010000:00010000:3.0:1715330297.690363:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1521:0x0].0x0 (ffff88008d68e400) 00010000:00010000:3.0:1715330297.690367:0:7148:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f3c0/0xd895711d66d9033 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1521:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.690376:0:7148:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f3c0/0xd895711d66d9033 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1521:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.690381:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f3c0/0xd895711d66d9033 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1521:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.690393:0:7148:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f3c0/0xd895711d66d9033 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1521:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.690400:0:7148:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f3c0/0xd895711d66d9033 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1521:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.690404:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f3c0/0xd895711d66d9033 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1521:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00000100:00100000:3.0:1715330297.690517:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c0000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942480256:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.690553:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.691020:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008d667180 going to sleep for 11 seconds 00000100:00100000:2.0:1715330297.691073:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942480256 00000100:00100000:2.0:1715330297.691080:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942480256 00000100:00100000:2.0:1715330297.691298:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2896 00000100:00100000:2.0:1715330297.691305:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7148:x1798653942480256:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330297.691561:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7148:x1798653942480256:12345-0@lo:1000:mdt_io00_002.0 Request processed in 255us (1006us total) trans 0 rc -2/-2 00000100:00100000:2.0:1715330297.691568:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2896 00000100:00100000:3.0:1715330297.691625:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c0000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942480256:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.691676:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c0000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942480320:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.691695:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.691712:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008d667180 going to sleep for 11 seconds 00000100:00100000:2.0:1715330297.691882:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942480320 00000100:00100000:2.0:1715330297.691886:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942480320 00000100:00100000:2.0:1715330297.691955:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2897 00000100:00100000:2.0:1715330297.691959:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7148:x1798653942480320:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330297.692109:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7148:x1798653942480320:12345-0@lo:1000:mdt_io00_002.0 Request processed in 147us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330297.692115:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2897 00000100:00100000:3.0:1715330297.692163:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c0000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942480320:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.692250:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c0000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942480384:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.692269:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.692278:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008d667180 going to sleep for 11 seconds 00000100:00100000:2.0:1715330297.692326:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942480384 00000100:00100000:2.0:1715330297.692330:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942480384 00000100:00100000:2.0:1715330297.692353:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2898 00000100:00100000:2.0:1715330297.692357:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7148:x1798653942480384:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330297.692403:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7148:x1798653942480384:12345-0@lo:1000:mdt_io00_002.0 Request processed in 45us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330297.692409:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2898 00000100:00100000:3.0:1715330297.692547:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c0000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942480384:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.692602:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c0000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942480448:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.692622:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.693078:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008d667840 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.693229:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942480448 00000100:00100000:1.0:1715330297.693234:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942480448 00000100:00100000:1.0:1715330297.693265:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2899 00000100:00100000:1.0:1715330297.693270:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7148:x1798653942480448:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1715330297.693882:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7148:x1798653942480448:12345-0@lo:1000:mdt_io00_002.0 Request processed in 609us (1257us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330297.693889:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2899 00000100:00100000:3.0:1715330297.694052:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c0000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942480448:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.694124:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c0000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942480512:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.694148:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330297.694498:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942480512 00000100:00100000:3.0:1715330297.694499:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008d667840 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.694503:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942480512 00000100:00080000:0.0:1715330297.694647:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330267 00000100:00100000:1.0:1715330297.694671:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2900 00000100:00100000:1.0:1715330297.694675:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:7148:x1798653942480512:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1715330297.694761:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:7148:x1798653942480512:12345-0@lo:1000:mdt_io00_002.0 Request processed in 84us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330297.694767:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2900 00000100:00100000:3.0:1715330297.694796:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c0000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942480512:0@lo:1000:mdt_io00_002.0 00000040:00080000:3.0:1715330297.695181:0:7148:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].373, 1264 off563264 00000040:00080000:3.0:1715330297.695224:0:7148:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].372, 1344 off606936 00000100:00100000:3.0:1715330297.695241:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c0000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942480576:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.695260:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.695280:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008d667000 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.695323:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942480576 00000100:00100000:1.0:1715330297.695327:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942480576 00000100:00100000:1.0:1715330297.695363:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2901 00000100:00100000:1.0:1715330297.695367:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:7148:x1798653942480576:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1715330297.695445:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7148:x1798653942480576:12345-0@lo:1000:mdt_io00_002.0 Request processed in 77us (184us total) trans 4294969881 rc 0/0 00000100:00100000:1.0:1715330297.695454:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2901 00000100:00100000:3.0:1715330297.695468:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c0000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942480576:0@lo:1000:mdt_io00_002.0 00000004:00080000:3.0:1715330297.695475:0:7148:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88008d667a80 with version 710 00000004:00080000:0.0:1715330297.695507:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 710 rpc_version 710 00000020:00100000:0.0:1715330297.695530:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1715330297.695537:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008d4e9180 x1798653942480704/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3088/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715330297.695549:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e9180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942480704:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330297.695575:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330297.695584:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009d7e3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.695616:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942480704 00000100:00100000:1.0:1715330297.695619:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942480704 00000100:00100000:1.0:1715330297.695641:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2902 00000100:00100000:1.0:1715330297.695644:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:8587:x1798653942480704:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330297.696015:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:8587:x1798653942480704:12345-0@lo:1000:osp_up1-0.0 Request processed in 369us (438us total) trans 4294968425 rc 0/0 00000100:00100000:1.0:1715330297.696021:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2902 00000100:00100000:0.0:1715330297.696056:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e9180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942480704:0@lo:1000:osp_up1-0.0 00000004:00010000:3.0:1715330297.696106:0:7148:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008d4e8000 reply state ffff88009d6e4000 transno 4294983517 ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f3c0/0xd895711d66d9033 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1521:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.696124:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f3c0/0xd895711d66d9033 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1521:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.696132:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1521:0x0].0x0 (ffff88008d68e400) 00010000:00010000:3.0:1715330297.696134:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:3.0:1715330297.696138:0:7148:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330297.696145:0:7148:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d9025 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.696151:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d9025 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.696161:0:7148:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d9025 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.696167:0:7148:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d9025 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.696172:0:7148:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457c240 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330297.696176:0:7148:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d9025 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.696182:0:7148:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d9025 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.696192:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff88009ef25a00) 00010000:00010000:3.0:1715330297.696194:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330297.696197:0:7148:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d9025 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.696205:0:7148:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d9025 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00000004:00010000:3.0:1715330297.696220:0:7148:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008d4e8000 reply state ffff88009d6e4000 transno 4294983517 ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f600/0xd895711d66d902c lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.696227:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f600/0xd895711d66d902c lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.696231:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x39 (ffff88009ef25f00) 00010000:00010000:3.0:1715330297.696233:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330297.696235:0:7148:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00080000:3.0:1715330297.696238:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00010000:00010000:3.0:1715330297.696243:0:7148:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d9009 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9010 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.696249:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d9009 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9010 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.696254:0:7148:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d9009 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9010 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.696274:0:7148:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1715330297.696277:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00010000:00010000:3.0:1715330297.696280:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db661c0/0xd895711d66d9017 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d901e expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.696286:0:7148:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db661c0/0xd895711d66d9017 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d901e expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.696316:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715330297.696322:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d9009 lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d9010 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.696328:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457c900 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330297.696331:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d9009 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d9010 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330297.696337:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d9009 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d9010 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330297.696365:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x18c:0x0] 00010000:00010000:1.0:1715330297.696366:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d9009 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9010 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.696370:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1715330297.696372:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d9002 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.696376:0:7148:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d9002 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.696381:0:7148:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d9002 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.696384:0:7148:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfc240 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330297.696387:0:7148:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d9002 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.696391:0:7148:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d9002 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7148 initiator: MDT0 00010000:00010000:1.0:1715330297.696395:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d9009 lrc: 1/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9010 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.696398:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880093b42e00) 00010000:00010000:3.0:1715330297.696400:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330297.696401:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d9009 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9010 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.696402:0:7148:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d9002 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.696406:0:7148:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66d9002 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:1.0:1715330297.696426:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330297.696428:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330297.696429:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330297.696472:0:7148:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:72de1896-1df4-4b3a-930a-9116d2c66168+19:17739:x1798653938047616:12345-192.168.204.49@tcp:36:lfs.0 Request processed in 19343us (19445us total) trans 4294983517 rc 0/0 00000100:00100000:2.0:1715330297.696473:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942480768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1715330297.696478:0:7148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1 00000100:00100000:2.0:1715330297.696503:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.696594:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942480768 00000100:00100000:3.0:1715330297.696597:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942480768 00000100:00100000:3.0:1715330297.696630:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1363 00000100:00100000:3.0:1715330297.696634:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+8:3690:x1798653942480768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1715330297.696643:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330297.696657:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d9010 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d9009 expref: 8 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.696666:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff88009ef25100) 00010000:00010000:3.0:1715330297.696673:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715330297.696693:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+7:3690:x1798653942480768:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330297.696698:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1363 00000100:00100000:2.0:1715330297.696753:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942480768:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330297.699151:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330297.699230:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938047680 00000100:00100000:2.0:1715330297.699237:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938047680 00000100:00100000:2.0:1715330297.699286:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23481 00000100:00100000:2.0:1715330297.699293:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+19:17739:x1798653938047680:12345-192.168.204.49@tcp:34:lfs.0 00010000:00010000:2.0:1715330297.699372:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d903a lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.699387:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d903a lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.699398:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d903a lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.699408:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d9041 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.699414:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d9041 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.699419:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d9041 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.699464:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d9048 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1520:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.699471:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d9048 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1520:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.699477:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d9048 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1520:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00010000:2.0:1715330297.699516:0:7135:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d9048 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1520:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.699527:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d903a lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.699532:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d903a lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.699537:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d903a lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.699542:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d903a lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.699548:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db67cc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330297.699551:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d903a lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.699557:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d903a lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.699566:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff88009396d200) 00010000:00010000:2.0:1715330297.699568:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330297.699572:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d903a lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.699577:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d903a lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.699593:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d9041 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.699598:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d9041 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.699602:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d9041 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.699606:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db67180 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330297.699608:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d9041 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.699613:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d9041 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.699618:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x36 (ffff88009396d700) 00010000:00010000:2.0:1715330297.699620:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330297.699622:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d9041 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.699626:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d9041 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.699634:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d9048 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1520:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.699639:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d9048 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1520:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.699643:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d9048 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1520:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.699647:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66f40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330297.699649:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d9048 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1520:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.699657:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d9048 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1520:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.699662:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1520:0x0].0x0 (ffff88008d68e500) 00010000:00010000:2.0:1715330297.699664:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330297.699666:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d9048 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1520:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.699670:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d9048 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1520:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00000100:00100000:2.0:1715330297.699761:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+19:17739:x1798653938047680:12345-192.168.204.49@tcp:34:lfs.0 Request processed in 467us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330297.699768:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23481 00000100:00100000:0.0:1715330297.702138:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330297.702191:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938047808 00000100:00100000:2.0:1715330297.702200:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938047808 00000100:00100000:2.0:1715330297.702252:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23482 00000100:00100000:2.0:1715330297.702259:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+19:17739:x1798653938047808:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:2.0:1715330297.702279:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330297.702298:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db646c0/0xd895711d66d904f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1520:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb8ca expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.702403:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9056 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1520:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.702415:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9056 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1520:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.702425:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9056 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1520:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00200000:2.0:1715330297.702439:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1520:0x0]: returning size 2 00010000:00010000:2.0:1715330297.702531:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db646c0/0xd895711d66d904f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1520:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8ca expref: 22 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.702548:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9056 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1520:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8ca expref: 21 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.702557:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1520:0x0].0x0 (ffff88008d68e500) 00010000:00010000:2.0:1715330297.702559:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1715330297.702562:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db66ac0, rc 0) 00000100:00100000:2.0:1715330297.702617:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+21:17739:x1798653938047808:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 358us (494us total) trans 4294983518 rc 0/0 00000100:00100000:2.0:1715330297.702625:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23482 00000100:00100000:0.0:1715330297.706510:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330297.707246:0:17200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938047872 00000100:00100000:3.0:1715330297.707256:0:17200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938047872 00000100:00100000:3.0:1715330297.707304:0:17200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5194 00000100:00100000:3.0:1715330297.707312:0:17200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:72de1896-1df4-4b3a-930a-9116d2c66168+9:2012:x1798653938047872:12345-192.168.204.49@tcp:1:lfs.0 00010000:00010000:3.0:1715330297.707508:0:17200:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013457ed00/0xd895711d66d9064 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.707527:0:17200:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011db65440/0xd895711d66d8e9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb868 expref: 9 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.707535:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1715330297.707813:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1715330297.707816:0:17200:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013457ed00/0xd895711d66d9064 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.707857:0:17200:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011db65440/0xd895711d66d8e9d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb868 expref: 9 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.707869:0:17200:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011db65440/0xd895711d66d8e9d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb868 expref: 9 pid: 9633 timeout: 372 lvb_type: 0 00000100:00100000:3.0:1715330297.707882:0:17200:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f578700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:17200:1798653942480832:192.168.204.49@tcp:104: 00000100:00100000:3.0:1715330297.707948:0:17200:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008d667000 going to sleep for 11 seconds 00000100:00100000:3.0:1715330297.711829:0:17200:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f578700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:17200:1798653942480832:192.168.204.49@tcp:104: 00010000:00010000:3.0:1715330297.711861:0:17200:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88013457ed00/0xd895711d66d9064 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330297.712668:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330297.712935:0:9404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938047936 00000100:00100000:2.0:1715330297.712945:0:9404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938047936 00002000:00100000:2.0:1715330297.713182:0:9404:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x9c9:0x0] (0->1) req@ffff88008d4e9c00 x1798653938047936/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:508/0 lens 496/0 e 0 to 0 dl 1715330308 ref 1 fl New:/200/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 00002000:00100000:2.0:1715330297.713192:0:9404:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d4e9c00 with x1798653938047936 ext(0->1) 00010000:00010000:2.0:1715330297.713201:0:9404:0:(ldlm_extent.c:692:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011db65440/0xd895711d66d8e9d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb868 expref: 10 pid: 9633 timeout: 372 lvb_type: 0 00010000:00010000:2.0:1715330297.713215:0:9404:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011db65440/0xd895711d66d8e9d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb868 expref: 10 pid: 9633 timeout: 372 lvb_type: 0 00002000:00010000:2.0:1715330297.713222:0:9404:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008d4e9c00 00000100:00100000:2.0:1715330297.713261:0:9404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1 00000100:00100000:2.0:1715330297.713268:0:9404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:72de1896-1df4-4b3a-930a-9116d2c66168+10:2012:x1798653938047936:12345-192.168.204.49@tcp:4:bash.0 00000100:00100000:0.0:1715330297.714565:0:9404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:72de1896-1df4-4b3a-930a-9116d2c66168+12:2012:x1798653938047936:12345-192.168.204.49@tcp:4:bash.0 Request processed in 1290us (1893us total) trans 4294969881 rc 0/0 00000100:00100000:0.0:1715330297.714576:0:9404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1 00002000:00100000:0.0:1715330297.714584:0:9404:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x9c9:0x0] (0->1) req@ffff88008d4e9c00 x1798653938047936/t4294969881(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:508/0 lens 496/448 e 0 to 0 dl 1715330308 ref 1 fl Complete:H/200/0 rc 0/0 job:'bash.0' uid:0 gid:0 00002000:00100000:0.0:1715330297.714591:0:9404:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d4e9c00 with x1798653938047936 ext(0->1) 00010000:00010000:0.0:1715330297.714598:0:9404:0:(ldlm_extent.c:692:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011db65440/0xd895711d66d8e9d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb868 expref: 12 pid: 9633 timeout: 372 lvb_type: 0 00010000:00010000:0.0:1715330297.714609:0:9404:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011db65440/0xd895711d66d8e9d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb868 expref: 12 pid: 9633 timeout: 372 lvb_type: 0 00002000:00010000:0.0:1715330297.714615:0:9404:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008d4e9c00 00000100:00100000:0.0:1715330297.718252:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330297.718323:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938048000 00000100:00100000:2.0:1715330297.718333:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938048000 00010000:00010000:2.0:1715330297.718381:0:9416:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011db65440/0xd895711d66d8e9d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb868 expref: 12 pid: 9633 timeout: 372 lvb_type: 0 00000100:00100000:2.0:1715330297.718427:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1546 00000100:00100000:2.0:1715330297.718435:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+12:2011:x1798653938048000:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1715330297.718449:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1715330297.718467:0:9416:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0x9c9:0x0] updating lvb size from disk: 0 -> 2 00002000:00010000:2.0:1715330297.718470:0:9416:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x9c9:0x0] updating lvb mtime from disk: 0 -> 1715330297 00002000:00010000:2.0:1715330297.718472:0:9416:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0x9c9:0x0] updating lvb ctime from disk: 0 -> 1715330297 00002000:00010000:2.0:1715330297.718473:0:9416:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0x9c9:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1715330297.718478:0:9416:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011db65440/0xd895711d66d8e9d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb868 expref: 12 pid: 9633 timeout: 372 lvb_type: 0 00010000:00010000:2.0:1715330297.718490:0:9416:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011db65440/0xd895711d66d8e9d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb868 expref: 12 pid: 9633 timeout: 372 lvb_type: 0 00010000:00010000:2.0:1715330297.718521:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011db65440/0xd895711d66d8e9d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb868 expref: 12 pid: 9633 timeout: 372 lvb_type: 0 00010000:00010000:2.0:1715330297.718558:0:9416:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330297.718560:0:9416:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330297.718565:0:9416:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013457ed00/0xd895711d66d9064 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.718575:0:9416:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013457ed00/0xd895711d66d9064 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.718599:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330297.718652:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+11:2011:x1798653938048000:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 217us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330297.718660:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1546 00010000:00010000:3.0:1715330297.718843:0:17200:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88013457ed00/0xd895711d66d9064 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.718853:0:17200:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013457ed00/0xd895711d66d9064 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.718870:0:17200:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013457ed00/0xd895711d66d9064 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.718877:0:17200:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88013457ed00/0xd895711d66d9064 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.718884:0:17200:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013457ed00/0xd895711d66d9064 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.718891:0:17200:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457ed00 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330297.718895:0:17200:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013457ed00/0xd895711d66d9064 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.718903:0:17200:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013457ed00/0xd895711d66d9064 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.718920:0:17200:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013457ed00/0xd895711d66d9064 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.718925:0:17200:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013457ed00/0xd895711d66d9064 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330297.718981:0:17200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:72de1896-1df4-4b3a-930a-9116d2c66168+10:2012:x1798653938047872:12345-192.168.204.49@tcp:1:lfs.0 Request processed in 11669us (12481us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330297.718989:0:17200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5194 00000100:00100000:0.0:1715330297.722122:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330297.722495:0:7148:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938048128 00000100:00100000:3.0:1715330297.722505:0:7148:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938048128 00000100:00100000:3.0:1715330297.722569:0:7148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 2 00000100:00100000:3.0:1715330297.722577:0:7148:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:72de1896-1df4-4b3a-930a-9116d2c66168+21:17739:x1798653938048128:12345-192.168.204.49@tcp:36:lfs.0 00010000:00010000:3.0:1715330297.722633:0:7148:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330297.722663:0:7148:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d8e8f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1520:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb861 expref: 21 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.722681:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1520:0x0].0x0 (ffff88008d68e500) 00010000:00010000:3.0:1715330297.722686:0:7148:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330297.722709:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d906b lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.722721:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d906b lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.722752:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d906b lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00000100:00100000:3.0:1715330297.722822:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f578700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942480896:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.723244:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.723279:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008d667000 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.723363:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942480896 00000100:00100000:1.0:1715330297.723368:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942480896 00000100:00100000:1.0:1715330297.723405:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2903 00000100:00100000:1.0:1715330297.723410:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7148:x1798653942480896:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1715330297.723599:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7148:x1798653942480896:12345-0@lo:1000:mdt_io00_002.0 Request processed in 188us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330297.723606:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2903 00000100:00100000:3.0:1715330297.723676:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f578700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942480896:0@lo:1000:mdt_io00_002.0 00000004:00080000:3.0:1715330297.723703:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x18c:0x0] 00000100:00100000:3.0:1715330297.723726:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f578700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942480960:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.723769:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.723783:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008d667000 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.723856:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942480960 00000100:00100000:1.0:1715330297.723859:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942480960 00000100:00100000:1.0:1715330297.723877:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2904 00000100:00100000:1.0:1715330297.723881:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f579180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7148:x1798653942480960:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1715330297.723924:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f579180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7148:x1798653942480960:12345-0@lo:1000:mdt_io00_002.0 Request processed in 43us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330297.723929:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2904 00000100:00100000:3.0:1715330297.723993:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f578700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942480960:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.724444:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f578700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942481024:0@lo:403:mdt_io00_002.0 00000100:00100000:3.0:1715330297.724467:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.724847:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008d6673c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715330297.724889:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942481024 00000100:00100000:2.0:1715330297.724893:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942481024 00000100:00100000:2.0:1715330297.725326:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2905 00000100:00100000:2.0:1715330297.725332:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7148:x1798653942481024:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1715330297.728890:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7148:x1798653942481024:12345-0@lo:403:mdt_io00_002.0 Request processed in 3546us (4410us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330297.728907:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2905 00000100:00100000:3.0:1715330297.729047:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f578700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942481024:0@lo:403:mdt_io00_002.0 00010000:00010000:3.0:1715330297.729786:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c000/0xd895711d66d9072 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.729796:0:7148:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c000/0xd895711d66d9072 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.729805:0:7148:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c000/0xd895711d66d9072 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7148 initiator: MDT0 00000100:00100000:3.0:1715330297.729823:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4e680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942481088:0@lo:101:mdt_io00_002.0 00000100:00100000:3.0:1715330297.729858:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.729885:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008d6673c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715330297.730159:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942481088 00000100:00100000:2.0:1715330297.730166:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942481088 00000100:00100000:2.0:1715330297.730195:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2906 00000100:00100000:2.0:1715330297.730201:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7148:x1798653942481088:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:2.0:1715330297.730216:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330297.730234:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db646c0/0xd895711d66d9079 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d9072 expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.730257:0:23404:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db646c0/0xd895711d66d9079 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d9072 expref: 8 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.730269:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db646c0/0xd895711d66d9079 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9072 expref: 8 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.730276:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff88009396dc00) 00010000:00010000:2.0:1715330297.730280:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330297.730282:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db646c0, rc 0) 00000100:00100000:2.0:1715330297.730305:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:7148:x1798653942481088:12345-0@lo:101:mdt_io00_002.0 Request processed in 104us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330297.730310:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2906 00000100:00100000:3.0:1715330297.730500:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4e680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942481088:0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1715330297.730512:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c000/0xd895711d66d9072 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9079 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.730521:0:7148:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c000/0xd895711d66d9072 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9079 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330297.730533:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00010000:00010000:3.0:1715330297.730549:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457ed00/0xd895711d66d9080 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.730553:0:7148:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457ed00/0xd895711d66d9080 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.730560:0:7148:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457ed00/0xd895711d66d9080 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7148 initiator: MDT0 00000100:00100000:3.0:1715330297.730568:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4e680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942481152:0@lo:101:mdt_io00_002.0 00000100:00100000:3.0:1715330297.730586:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.731349:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008d6673c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.731403:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942481152 00000100:00100000:1.0:1715330297.731408:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942481152 00000100:00100000:1.0:1715330297.731445:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2907 00000100:00100000:1.0:1715330297.731451:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:7148:x1798653942481152:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1715330297.731460:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330297.731474:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfeac0/0xd895711d66d9087 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d9080 expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.731490:0:9408:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfeac0/0xd895711d66d9087 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d9080 expref: 9 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.731500:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfeac0/0xd895711d66d9087 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9080 expref: 9 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.731506:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x36 (ffff880093b42800) 00010000:00010000:1.0:1715330297.731508:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330297.731510:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfeac0, rc 0) 00000100:00100000:1.0:1715330297.731535:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7148:x1798653942481152:12345-0@lo:101:mdt_io00_002.0 Request processed in 85us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330297.731540:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2907 00000100:00100000:3.0:1715330297.731604:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4e680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942481152:0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1715330297.731614:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457ed00/0xd895711d66d9080 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9087 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.731621:0:7148:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457ed00/0xd895711d66d9080 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9087 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330297.731633:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00010000:00010000:3.0:1715330297.731648:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d908e lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.731654:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d908e lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.731661:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d908e lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.731670:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457df80/0xd895711d66d9095 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.731675:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457df80/0xd895711d66d9095 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.731680:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457df80/0xd895711d66d9095 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.731713:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d909c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1520:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.731724:0:7148:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9056 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1520:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8ca expref: 20 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.731800:0:7148:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d909c lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1520:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.731823:0:7148:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9056 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1520:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8ca expref: 20 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.731835:0:7148:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9056 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1520:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8ca expref: 20 pid: 7135 timeout: 372 lvb_type: 0 00000100:00100000:3.0:1715330297.731845:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4e680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:7148:1798653942481216:192.168.204.49@tcp:104: 00000100:00100000:3.0:1715330297.732161:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008d6673c0 going to sleep for 11 seconds 00010000:00010000:3.0:1715330297.736070:0:7148:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.204.49@tcp) returned -22 from blocking AST (req@ffff88012fa4e680 x1798653942481216) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9056 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1520:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8ca expref: 20 pid: 7135 timeout: 372 lvb_type: 0 00010000:00010000:3.0:1715330297.736094:0:7148:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9056 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1520:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8ca expref: 20 pid: 7135 timeout: 372 lvb_type: 0 00010000:00010000:3.0:1715330297.736119:0:7148:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9056 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1520:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8ca expref: 20 pid: 7135 timeout: 372 lvb_type: 0 00000100:00100000:3.0:1715330297.736136:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4e680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:7148:1798653942481216:192.168.204.49@tcp:104: 00010000:00010000:3.0:1715330297.736159:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1520:0x0].0x0 (ffff88008d68e500) 00010000:00010000:3.0:1715330297.736164:0:7148:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d909c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1520:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.736172:0:7148:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d909c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1520:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.736178:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d909c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1520:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.736197:0:7148:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d909c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1520:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.736204:0:7148:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d909c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1520:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.736209:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d909c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1520:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00000100:00100000:3.0:1715330297.736359:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4e680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942481280:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.736407:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.736436:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008d667000 going to sleep for 11 seconds 00000100:00100000:2.0:1715330297.736472:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942481280 00000100:00100000:2.0:1715330297.736480:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942481280 00000100:00100000:2.0:1715330297.736523:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2908 00000100:00100000:2.0:1715330297.736530:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7148:x1798653942481280:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330297.736670:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7148:x1798653942481280:12345-0@lo:1000:mdt_io00_002.0 Request processed in 140us (261us total) trans 0 rc -2/-2 00000100:00100000:2.0:1715330297.736677:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2908 00000100:00100000:3.0:1715330297.736697:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4e680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942481280:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.736752:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4e680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942481344:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.736771:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.736788:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008d667000 going to sleep for 11 seconds 00000100:00100000:2.0:1715330297.736916:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942481344 00000100:00100000:2.0:1715330297.736919:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942481344 00000100:00100000:2.0:1715330297.736943:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2909 00000100:00100000:2.0:1715330297.736947:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f578700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7148:x1798653942481344:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330297.736997:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f578700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7148:x1798653942481344:12345-0@lo:1000:mdt_io00_002.0 Request processed in 48us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330297.737002:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2909 00000100:00100000:3.0:1715330297.737062:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4e680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942481344:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.737286:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4e680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942481408:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.737307:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.737322:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008d667000 going to sleep for 11 seconds 00000100:00100000:2.0:1715330297.737409:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942481408 00000100:00100000:2.0:1715330297.737413:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942481408 00000100:00100000:2.0:1715330297.738349:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2910 00000100:00100000:2.0:1715330297.738355:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7148:x1798653942481408:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330297.738421:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7148:x1798653942481408:12345-0@lo:1000:mdt_io00_002.0 Request processed in 66us (1112us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330297.738427:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2910 00000100:00100000:3.0:1715330297.738506:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4e680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942481408:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.738594:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344c8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942481472:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.738618:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.738640:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a8556b40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.741173:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942481472 00000100:00100000:1.0:1715330297.741187:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942481472 00000100:00100000:1.0:1715330297.741232:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2911 00000100:00100000:1.0:1715330297.741238:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:7148:x1798653942481472:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1715330297.741387:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:7148:x1798653942481472:12345-0@lo:1000:mdt_io00_002.0 Request processed in 147us (2767us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330297.741394:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2911 00000100:00100000:0.0:1715330297.741487:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344c8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942481472:0@lo:1000:mdt_io00_002.0 00000040:00080000:0.0:1715330297.742998:0:7148:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].374, 1264 off564528 00000040:00080000:0.0:1715330297.743110:0:7148:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].373, 1344 off608280 00000100:00100000:0.0:1715330297.743176:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55ed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942481536:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1715330297.743477:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330297.743520:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009d7e3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1715330297.743537:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942481536 00000100:00100000:3.0:1715330297.743544:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942481536 00000100:00100000:3.0:1715330297.743588:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2912 00000100:00100000:3.0:1715330297.743594:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:7148:x1798653942481536:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.743715:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7148:x1798653942481536:12345-0@lo:1000:mdt_io00_002.0 Request processed in 121us (238us total) trans 4294969882 rc 0/0 00000100:00100000:3.0:1715330297.743722:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2912 00000100:00100000:0.0:1715330297.743817:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55ed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942481536:0@lo:1000:mdt_io00_002.0 00000004:00080000:0.0:1715330297.743827:0:7148:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88008d667f00 with version 711 00000004:00080000:2.0:1715330297.743913:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 711 rpc_version 711 00000020:00100000:2.0:1715330297.743937:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1715330297.743944:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012cc7a300 x1798653942481664/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3088/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1715330297.743957:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc7a300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942481664:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1715330297.743994:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.744252:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942481664 00000100:00100000:2.0:1715330297.744254:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435f00 going to sleep for 11 seconds 00000100:00100000:3.0:1715330297.744256:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942481664 00000100:00100000:3.0:1715330297.744463:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2913 00000100:00100000:3.0:1715330297.744467:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:8587:x1798653942481664:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1715330297.744717:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:8587:x1798653942481664:12345-0@lo:1000:osp_up1-0.0 Request processed in 248us (722us total) trans 4294968426 rc 0/0 00000100:00100000:3.0:1715330297.744725:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2913 00000100:00100000:2.0:1715330297.745146:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc7a300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942481664:0@lo:1000:osp_up1-0.0 00000004:00010000:0.0:1715330297.745210:0:7148:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012faef800 reply state ffff88012fbd9000 transno 4294983519 ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d909c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1520:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:0.0:1715330297.745227:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d909c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1520:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:0.0:1715330297.745236:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1520:0x0].0x0 (ffff88008d68e500) 00010000:00010000:0.0:1715330297.745239:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:0.0:1715330297.745243:0:7148:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1715330297.745252:0:7148:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d908e lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:0.0:1715330297.745256:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d908e lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:0.0:1715330297.745261:0:7148:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d908e lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:0.0:1715330297.745267:0:7148:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d908e lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:0.0:1715330297.745272:0:7148:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457eac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330297.745275:0:7148:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d908e lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:0.0:1715330297.745280:0:7148:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d908e lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7148 initiator: MDT0 00010000:00010000:0.0:1715330297.745288:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff88009ef25100) 00010000:00010000:0.0:1715330297.745289:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330297.745291:0:7148:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d908e lrc: 3/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:0.0:1715330297.745299:0:7148:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d908e lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00000004:00010000:0.0:1715330297.745315:0:7148:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012faef800 reply state ffff88012fbd9000 transno 4294983519 ns: mdt-lustre-MDT0000_UUID lock: ffff88013457df80/0xd895711d66d9095 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:0.0:1715330297.745320:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457df80/0xd895711d66d9095 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:0.0:1715330297.745325:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x36 (ffff880129edf600) 00010000:00010000:0.0:1715330297.745326:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330297.745328:0:7148:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00080000:0.0:1715330297.745331:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00010000:00010000:0.0:1715330297.745344:0:7148:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c000/0xd895711d66d9072 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9079 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.745350:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c000/0xd895711d66d9072 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9079 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.745355:0:7148:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c000/0xd895711d66d9072 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9079 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.745367:0:7148:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1715330297.745370:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00010000:00010000:0.0:1715330297.745374:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457ed00/0xd895711d66d9080 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9087 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.745379:0:7148:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457ed00/0xd895711d66d9080 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9087 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1715330297.745453:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x18c:0x0] 00010000:00010000:0.0:1715330297.745459:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d906b lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:0.0:1715330297.745463:0:7148:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d906b lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:0.0:1715330297.745467:0:7148:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d906b lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:0.0:1715330297.745470:0:7148:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457c480 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330297.745472:0:7148:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d906b lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:0.0:1715330297.745476:0:7148:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d906b lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7148 initiator: MDT0 00010000:00010000:0.0:1715330297.745481:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff88009ef25300) 00010000:00010000:0.0:1715330297.745483:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330297.745484:0:7148:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d906b lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:0.0:1715330297.745488:0:7148:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d906b lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00000100:00100000:0.0:1715330297.745567:0:7148:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:72de1896-1df4-4b3a-930a-9116d2c66168+21:17739:x1798653938048128:12345-192.168.204.49@tcp:36:lfs.0 Request processed in 22988us (23455us total) trans 4294983519 rc 0/0 00000100:00100000:0.0:1715330297.745573:0:7148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 2 00010000:00010000:1.0:1715330297.746430:0:7123:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715330297.746437:0:7123:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c000/0xd895711d66d9072 lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d9079 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.746444:0:7123:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457c000 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330297.746449:0:7123:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c000/0xd895711d66d9072 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d9079 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330297.746455:0:7123:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c000/0xd895711d66d9072 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d9079 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.746488:0:7123:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c000/0xd895711d66d9072 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9079 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.746493:0:7123:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330297.746521:0:7123:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c000/0xd895711d66d9072 lrc: 1/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9079 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.746528:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c000/0xd895711d66d9072 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9079 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.746546:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330297.746548:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330297.746549:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330297.746592:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1715330297.746605:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942481728:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1715330297.746646:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330297.747799:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942481728 00000100:00100000:0.0:1715330297.747807:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942481728 00000100:00100000:0.0:1715330297.747855:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1364 00000100:00100000:0.0:1715330297.747862:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+10:3690:x1798653942481728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330297.747876:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330297.747894:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db646c0/0xd895711d66d9079 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d9072 expref: 10 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.747912:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff88009396dc00) 00010000:00010000:0.0:1715330297.747921:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330297.747949:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+9:3690:x1798653942481728:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (1303us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330297.747956:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1364 00000100:00100000:3.0:1715330297.748033:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942481728:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330297.750893:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330297.750958:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938048192 00000100:00100000:3.0:1715330297.750968:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938048192 00000100:00100000:3.0:1715330297.751025:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23483 00000100:00100000:3.0:1715330297.751033:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+21:17739:x1798653938048192:12345-192.168.204.49@tcp:34:lfs.0 00010000:00010000:3.0:1715330297.751111:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457dd40/0xd895711d66d90a3 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.751126:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457dd40/0xd895711d66d90a3 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.751138:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457dd40/0xd895711d66d90a3 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.751148:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d90aa lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.751153:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d90aa lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.751158:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d90aa lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.751209:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d90b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1522:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.751216:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d90b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1522:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.751222:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d90b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1522:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00000004:00010000:3.0:1715330297.751264:0:25569:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d90b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1522:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.751274:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457dd40/0xd895711d66d90a3 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.751279:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457dd40/0xd895711d66d90a3 lrc: 2/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.751284:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457dd40/0xd895711d66d90a3 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.751289:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457dd40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330297.751293:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457dd40/0xd895711d66d90a3 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.751299:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457dd40/0xd895711d66d90a3 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.751309:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff88008779db00) 00010000:00010000:3.0:1715330297.751312:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330297.751316:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457dd40/0xd895711d66d90a3 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.751321:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457dd40/0xd895711d66d90a3 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.751334:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d90aa lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.751350:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d90aa lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.751355:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d90aa lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.751359:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457e640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330297.751361:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d90aa lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.751366:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d90aa lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.751371:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x3031 (ffff88008779d100) 00010000:00010000:3.0:1715330297.751373:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330297.751375:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d90aa lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.751379:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d90aa lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.751389:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d90b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1522:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.751394:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d90b1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1522:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.751398:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d90b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1522:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.751402:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457c240 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330297.751404:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d90b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1522:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.751408:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d90b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1522:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.751417:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1522:0x0].0x0 (ffff88009ef25b00) 00010000:00010000:3.0:1715330297.751419:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330297.751421:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d90b1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1522:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.751425:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d90b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1522:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00000100:00100000:3.0:1715330297.751507:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+21:17739:x1798653938048192:12345-192.168.204.49@tcp:34:lfs.0 Request processed in 474us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330297.751514:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23483 00000100:00100000:0.0:1715330297.755495:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330297.755599:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938048320 00000100:00100000:2.0:1715330297.755608:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938048320 00000100:00100000:2.0:1715330297.755657:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23484 00000100:00100000:2.0:1715330297.755664:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+21:17739:x1798653938048320:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:2.0:1715330297.755684:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330297.755704:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d90b8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1522:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb8d1 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.755821:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d90bf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1522:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.755832:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d90bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1522:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.755842:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d90bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1522:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00200000:2.0:1715330297.755851:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1522:0x0]: returning size 3 00010000:00010000:2.0:1715330297.755933:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d90b8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1522:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8d1 expref: 24 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.755952:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d90bf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1522:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8d1 expref: 23 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.755963:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1522:0x0].0x0 (ffff88009ef25b00) 00010000:00010000:2.0:1715330297.755966:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1715330297.755968:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db67180, rc 0) 00000100:00100000:2.0:1715330297.756021:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+23:17739:x1798653938048320:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 358us (536us total) trans 4294983520 rc 0/0 00000100:00100000:2.0:1715330297.756026:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23484 00000100:00100000:0.0:1715330297.758507:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330297.758584:0:17200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938048384 00000100:00100000:3.0:1715330297.758592:0:17200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938048384 00000100:00100000:3.0:1715330297.758630:0:17200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5195 00000100:00100000:3.0:1715330297.758636:0:17200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:72de1896-1df4-4b3a-930a-9116d2c66168+10:2014:x1798653938048384:12345-192.168.204.49@tcp:1:lfs.0 00010000:00010000:3.0:1715330297.758680:0:17200:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013457c000/0xd895711d66d90cd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.758696:0:17200:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d7a0480/0xd895711d66d8ef1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb884 expref: 10 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.758704:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1715330297.758705:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1715330297.758708:0:17200:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013457c000/0xd895711d66d90cd lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.758762:0:17200:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d7a0480/0xd895711d66d8ef1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb884 expref: 10 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.758779:0:17200:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d7a0480/0xd895711d66d8ef1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb884 expref: 10 pid: 9633 timeout: 372 lvb_type: 0 00000100:00100000:3.0:1715330297.758793:0:17200:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344c8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:17200:1798653942481792:192.168.204.49@tcp:104: 00000100:00100000:3.0:1715330297.758859:0:17200:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63600 going to sleep for 11 seconds 00000100:00100000:3.0:1715330297.761700:0:17200:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344c8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:17200:1798653942481792:192.168.204.49@tcp:104: 00010000:00010000:3.0:1715330297.761756:0:17200:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88013457c000/0xd895711d66d90cd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330297.762223:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330297.762323:0:9404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938048448 00000100:00100000:2.0:1715330297.762330:0:9404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938048448 00002000:00100000:2.0:1715330297.762378:0:9404:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x9ca:0x0] (0->2) req@ffff88012b55e300 x1798653938048448/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:508/0 lens 496/0 e 0 to 0 dl 1715330308 ref 1 fl New:/200/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 00002000:00100000:2.0:1715330297.762386:0:9404:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b55e300 with x1798653938048448 ext(0->2) 00010000:00010000:2.0:1715330297.762394:0:9404:0:(ldlm_extent.c:692:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d7a0480/0xd895711d66d8ef1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb884 expref: 11 pid: 9633 timeout: 372 lvb_type: 0 00010000:00010000:2.0:1715330297.762405:0:9404:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d7a0480/0xd895711d66d8ef1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb884 expref: 11 pid: 9633 timeout: 372 lvb_type: 0 00002000:00010000:2.0:1715330297.762410:0:9404:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b55e300 00000100:00100000:2.0:1715330297.762441:0:9404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 2 00000100:00100000:2.0:1715330297.762447:0:9404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:72de1896-1df4-4b3a-930a-9116d2c66168+11:2011:x1798653938048448:12345-192.168.204.49@tcp:4:bash.0 00000100:00100000:2.0:1715330297.763262:0:9404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:72de1896-1df4-4b3a-930a-9116d2c66168+13:2011:x1798653938048448:12345-192.168.204.49@tcp:4:bash.0 Request processed in 812us (1040us total) trans 4294969883 rc 0/0 00000100:00100000:2.0:1715330297.763270:0:9404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 2 00002000:00100000:2.0:1715330297.763275:0:9404:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x9ca:0x0] (0->2) req@ffff88012b55e300 x1798653938048448/t4294969883(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:508/0 lens 496/448 e 0 to 0 dl 1715330308 ref 1 fl Complete:H/200/0 rc 0/0 job:'bash.0' uid:0 gid:0 00002000:00100000:2.0:1715330297.763287:0:9404:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b55e300 with x1798653938048448 ext(0->2) 00010000:00010000:2.0:1715330297.763291:0:9404:0:(ldlm_extent.c:692:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d7a0480/0xd895711d66d8ef1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb884 expref: 13 pid: 9633 timeout: 372 lvb_type: 0 00010000:00010000:2.0:1715330297.763301:0:9404:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d7a0480/0xd895711d66d8ef1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb884 expref: 13 pid: 9633 timeout: 372 lvb_type: 0 00002000:00010000:2.0:1715330297.763307:0:9404:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b55e300 00000100:00100000:0.0:1715330297.765854:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330297.766077:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938048512 00000100:00100000:3.0:1715330297.766087:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938048512 00010000:00010000:3.0:1715330297.766122:0:9416:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d7a0480/0xd895711d66d8ef1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb884 expref: 13 pid: 9633 timeout: 372 lvb_type: 0 00000100:00100000:3.0:1715330297.766182:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1547 00000100:00100000:3.0:1715330297.766189:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ab78b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+13:2013:x1798653938048512:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1715330297.766203:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1715330297.766219:0:9416:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0x9ca:0x0] updating lvb size from disk: 0 -> 3 00002000:00010000:3.0:1715330297.766221:0:9416:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x9ca:0x0] updating lvb mtime from disk: 0 -> 1715330297 00002000:00010000:3.0:1715330297.766223:0:9416:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0x9ca:0x0] updating lvb ctime from disk: 0 -> 1715330297 00002000:00010000:3.0:1715330297.766225:0:9416:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0x9ca:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1715330297.766230:0:9416:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d7a0480/0xd895711d66d8ef1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb884 expref: 13 pid: 9633 timeout: 372 lvb_type: 0 00010000:00010000:3.0:1715330297.766244:0:9416:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d7a0480/0xd895711d66d8ef1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb884 expref: 13 pid: 9633 timeout: 372 lvb_type: 0 00010000:00010000:3.0:1715330297.766272:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d7a0480/0xd895711d66d8ef1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb884 expref: 13 pid: 9633 timeout: 372 lvb_type: 0 00010000:00010000:3.0:1715330297.766477:0:9416:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330297.766480:0:9416:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330297.766484:0:9416:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013457c000/0xd895711d66d90cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.766493:0:9416:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013457c000/0xd895711d66d90cd lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.766608:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715330297.766662:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ab78b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+12:2013:x1798653938048512:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 472us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330297.766668:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1547 00010000:00010000:0.0:1715330297.766766:0:17200:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88013457c000/0xd895711d66d90cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.766774:0:17200:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013457c000/0xd895711d66d90cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.766789:0:17200:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013457c000/0xd895711d66d90cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.766795:0:17200:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88013457c000/0xd895711d66d90cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.766802:0:17200:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013457c000/0xd895711d66d90cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.766808:0:17200:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457c000 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330297.766812:0:17200:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013457c000/0xd895711d66d90cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.766819:0:17200:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013457c000/0xd895711d66d90cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.766831:0:17200:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013457c000/0xd895711d66d90cd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.766835:0:17200:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013457c000/0xd895711d66d90cd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330297.766877:0:17200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:72de1896-1df4-4b3a-930a-9116d2c66168+11:2014:x1798653938048384:12345-192.168.204.49@tcp:1:lfs.0 Request processed in 8241us (8378us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330297.766884:0:17200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5195 00000100:00100000:0.0:1715330297.769507:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330297.771317:0:7148:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938048640 00000100:00100000:2.0:1715330297.771329:0:7148:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938048640 00000100:00100000:2.0:1715330297.771751:0:7148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 3 00000100:00100000:2.0:1715330297.771759:0:7148:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:72de1896-1df4-4b3a-930a-9116d2c66168+23:17739:x1798653938048640:12345-192.168.204.49@tcp:36:lfs.0 00010000:00010000:2.0:1715330297.771811:0:7148:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330297.771839:0:7148:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d8ee3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1522:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb87d expref: 23 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.771862:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1522:0x0].0x0 (ffff88009ef25b00) 00010000:00010000:2.0:1715330297.771865:0:7148:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330297.771887:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d90d4 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.771897:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d90d4 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.771905:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d90d4 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00000100:00100000:2.0:1715330297.771959:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f0700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942481856:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330297.772010:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330297.772594:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435d80 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.772699:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942481856 00000100:00100000:1.0:1715330297.772704:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942481856 00000100:00100000:1.0:1715330297.772812:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2914 00000100:00100000:1.0:1715330297.772817:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7148:x1798653942481856:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1715330297.773116:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7148:x1798653942481856:12345-0@lo:1000:mdt_io00_002.0 Request processed in 298us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330297.773122:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2914 00000100:00100000:2.0:1715330297.773246:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f0700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942481856:0@lo:1000:mdt_io00_002.0 00000004:00080000:2.0:1715330297.773280:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x18c:0x0] 00000100:00100000:2.0:1715330297.773305:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f0700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942481920:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330297.773326:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330297.773351:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435d80 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.773406:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942481920 00000100:00100000:1.0:1715330297.773409:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942481920 00000100:00100000:1.0:1715330297.773482:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2915 00000100:00100000:1.0:1715330297.773486:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d629880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7148:x1798653942481920:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330297.773630:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f0700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942481920:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1715330297.773876:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d629880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7148:x1798653942481920:12345-0@lo:1000:mdt_io00_002.0 Request processed in 52us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330297.773884:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2915 00000100:00100000:2.0:1715330297.774585:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d628700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942481984:0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1715330297.774615:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330297.774638:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435e40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.774726:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942481984 00000100:00100000:1.0:1715330297.774744:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942481984 00000100:00100000:1.0:1715330297.775013:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2916 00000100:00100000:1.0:1715330297.775018:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d629180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7148:x1798653942481984:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:1.0:1715330297.777610:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d629180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7148:x1798653942481984:12345-0@lo:403:mdt_io00_002.0 Request processed in 2582us (2985us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330297.777622:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2916 00000100:00100000:2.0:1715330297.777706:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d628700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942481984:0@lo:403:mdt_io00_002.0 00010000:00010000:2.0:1715330297.778401:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67a80/0xd895711d66d90db lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.778411:0:7148:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67a80/0xd895711d66d90db lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.778421:0:7148:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67a80/0xd895711d66d90db lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7148 initiator: MDT0 00000100:00100000:2.0:1715330297.778437:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d628700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942482048:0@lo:101:mdt_io00_002.0 00000100:00100000:2.0:1715330297.778474:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330297.778530:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435e40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.778621:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942482048 00000100:00100000:1.0:1715330297.778627:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942482048 00000100:00100000:1.0:1715330297.779099:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2917 00000100:00100000:1.0:1715330297.779105:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:7148:x1798653942482048:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1715330297.779123:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330297.779141:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d90e2 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d90db expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.779164:0:9408:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d90e2 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d90db expref: 10 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.779176:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d90e2 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d90db expref: 10 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.779183:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff880093b42a00) 00010000:00010000:1.0:1715330297.779186:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330297.779189:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bff180, rc 0) 00000100:00100000:1.0:1715330297.779223:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7148:x1798653942482048:12345-0@lo:101:mdt_io00_002.0 Request processed in 118us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330297.779229:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2917 00000100:00100000:2.0:1715330297.779513:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d628700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942482048:0@lo:101:mdt_io00_002.0 00010000:00010000:2.0:1715330297.779525:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67a80/0xd895711d66d90db lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d90e2 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.779537:0:7148:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67a80/0xd895711d66d90db lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d90e2 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715330297.779550:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00010000:00010000:2.0:1715330297.779565:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66d00/0xd895711d66d90e9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.779571:0:7148:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66d00/0xd895711d66d90e9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.779577:0:7148:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66d00/0xd895711d66d90e9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7148 initiator: MDT0 00000100:00100000:2.0:1715330297.779586:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d628700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942482112:0@lo:101:mdt_io00_002.0 00000100:00100000:2.0:1715330297.779604:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330297.779613:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435e40 going to sleep for 11 seconds 00000100:00100000:3.0:1715330297.779675:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942482112 00000100:00100000:3.0:1715330297.779679:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942482112 00000100:00100000:3.0:1715330297.779701:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2918 00000100:00100000:3.0:1715330297.779705:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d62b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:7148:x1798653942482112:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1715330297.779712:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330297.779722:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c000/0xd895711d66d90f0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d90e9 expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.779767:0:23404:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c000/0xd895711d66d90f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d90e9 expref: 11 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.779777:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c000/0xd895711d66d90f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d90e9 expref: 11 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.779782:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x3031 (ffff88008779db00) 00010000:00010000:3.0:1715330297.779784:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330297.779786:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013457c000, rc 0) 00000100:00100000:3.0:1715330297.779809:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d62b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:7148:x1798653942482112:12345-0@lo:101:mdt_io00_002.0 Request processed in 103us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330297.779814:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2918 00000100:00100000:2.0:1715330297.779957:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d628700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942482112:0@lo:101:mdt_io00_002.0 00010000:00010000:2.0:1715330297.779965:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66d00/0xd895711d66d90e9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d90f0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.779972:0:7148:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66d00/0xd895711d66d90e9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d90f0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715330297.779981:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00010000:00010000:2.0:1715330297.779995:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d90f7 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.780001:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d90f7 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.780008:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d90f7 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.780018:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d90fe lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.780023:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d90fe lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.780029:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d90fe lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.780061:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d9105 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1522:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.780071:0:7148:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d90bf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1522:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8d1 expref: 22 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.780078:0:7148:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d9105 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1522:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.780097:0:7148:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d90bf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1522:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8d1 expref: 22 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.780108:0:7148:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d90bf lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1522:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8d1 expref: 22 pid: 7135 timeout: 372 lvb_type: 0 00000100:00100000:2.0:1715330297.780118:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d628700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:7148:1798653942482176:192.168.204.49@tcp:104: 00000100:00100000:2.0:1715330297.780832:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435e40 going to sleep for 11 seconds 00010000:00010000:2.0:1715330297.784430:0:7148:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.204.49@tcp) returned -22 from blocking AST (req@ffff88007d628700 x1798653942482176) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d90bf lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1522:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8d1 expref: 22 pid: 7135 timeout: 372 lvb_type: 0 00010000:00010000:2.0:1715330297.784450:0:7148:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d90bf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1522:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8d1 expref: 22 pid: 7135 timeout: 372 lvb_type: 0 00010000:00010000:2.0:1715330297.784475:0:7148:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d90bf lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1522:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8d1 expref: 22 pid: 7135 timeout: 372 lvb_type: 0 00000100:00100000:2.0:1715330297.784505:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d628700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:7148:1798653942482176:192.168.204.49@tcp:104: 00010000:00010000:2.0:1715330297.784526:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1522:0x0].0x0 (ffff88009ef25b00) 00010000:00010000:2.0:1715330297.784531:0:7148:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d9105 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1522:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.784538:0:7148:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d9105 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1522:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.784544:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d9105 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1522:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.784560:0:7148:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d9105 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1522:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.784566:0:7148:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d9105 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1522:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.784571:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d9105 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1522:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00000100:00100000:2.0:1715330297.784702:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d628700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942482240:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330297.784769:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330297.784792:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435d80 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.785141:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942482240 00000100:00100000:1.0:1715330297.785156:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942482240 00000100:00100000:1.0:1715330297.785432:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2919 00000100:00100000:1.0:1715330297.785440:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d62ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:7148:x1798653942482240:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1715330297.785580:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d62ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:7148:x1798653942482240:12345-0@lo:1000:mdt_io00_002.0 Request processed in 141us (812us total) trans 0 rc -2/-2 00000100:00100000:1.0:1715330297.785587:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2919 00000100:00100000:2.0:1715330297.785601:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d628700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942482240:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330297.785642:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d628700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942482304:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330297.785664:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330297.786402:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435d80 going to sleep for 11 seconds 00000100:00100000:3.0:1715330297.786503:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942482304 00000100:00100000:3.0:1715330297.786507:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942482304 00000100:00100000:3.0:1715330297.786543:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2920 00000100:00100000:3.0:1715330297.786548:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d62b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:7148:x1798653942482304:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.787143:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d62b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:7148:x1798653942482304:12345-0@lo:1000:mdt_io00_002.0 Request processed in 594us (1477us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330297.787149:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2920 00000100:00100000:2.0:1715330297.787719:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d628700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942482304:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330297.787858:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d628700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942482368:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330297.787890:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330297.787900:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435d80 going to sleep for 11 seconds 00000100:00100000:3.0:1715330297.788069:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942482368 00000100:00100000:3.0:1715330297.788074:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942482368 00000100:00100000:3.0:1715330297.788105:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2921 00000100:00100000:3.0:1715330297.788109:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d629880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:7148:x1798653942482368:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.788158:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d629880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:7148:x1798653942482368:12345-0@lo:1000:mdt_io00_002.0 Request processed in 48us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330297.788164:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2921 00000100:00100000:2.0:1715330297.788296:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d628700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942482368:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330297.788383:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d628700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942482432:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330297.788405:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330297.788453:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435a80 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.788491:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942482432 00000100:00100000:1.0:1715330297.788495:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942482432 00000100:00100000:1.0:1715330297.791158:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2922 00000100:00100000:1.0:1715330297.791171:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d629180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7148:x1798653942482432:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1715330297.791427:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d629180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7148:x1798653942482432:12345-0@lo:1000:mdt_io00_002.0 Request processed in 259us (3020us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330297.791434:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2922 00000100:00100000:2.0:1715330297.791531:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d628700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942482432:0@lo:1000:mdt_io00_002.0 00000040:00080000:2.0:1715330297.792019:0:7148:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].375, 1264 off565792 00000040:00080000:2.0:1715330297.792068:0:7148:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].374, 1344 off609624 00000100:00100000:2.0:1715330297.792102:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d628700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942482496:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330297.792139:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330297.792151:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa240 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.792289:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942482496 00000100:00100000:1.0:1715330297.792295:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942482496 00000100:00100000:1.0:1715330297.792328:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2923 00000100:00100000:1.0:1715330297.792331:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7148:x1798653942482496:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1715330297.792423:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7148:x1798653942482496:12345-0@lo:1000:mdt_io00_002.0 Request processed in 90us (283us total) trans 4294969884 rc 0/0 00000100:00100000:1.0:1715330297.792428:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2923 00000100:00100000:2.0:1715330297.792565:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d628700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942482496:0@lo:1000:mdt_io00_002.0 00000004:00080000:2.0:1715330297.792572:0:7148:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8801344356c0 with version 712 00000004:00080000:0.0:1715330297.793213:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 712 rpc_version 712 00000020:00100000:0.0:1715330297.793234:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1715330297.793239:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012b55e680 x1798653942482624/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3088/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715330297.793253:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55e680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942482624:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330297.793284:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330297.793304:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008d667180 going to sleep for 11 seconds 00000100:00100000:3.0:1715330297.793355:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942482624 00000100:00100000:3.0:1715330297.793359:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942482624 00000100:00100000:3.0:1715330297.793389:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2924 00000100:00100000:3.0:1715330297.793394:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:8587:x1798653942482624:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1715330297.793629:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:8587:x1798653942482624:12345-0@lo:1000:osp_up1-0.0 Request processed in 234us (344us total) trans 4294968427 rc 0/0 00000100:00100000:3.0:1715330297.793635:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2924 00000100:00100000:0.0:1715330297.793777:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55e680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942482624:0@lo:1000:osp_up1-0.0 00000004:00010000:2.0:1715330297.793826:0:7148:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012b55c380 reply state ffff88011dbe9000 transno 4294983521 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d9105 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1522:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.793844:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d9105 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1522:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.793852:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1522:0x0].0x0 (ffff88009ef25b00) 00010000:00010000:2.0:1715330297.793855:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:2.0:1715330297.793860:0:7148:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1715330297.793868:0:7148:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d90f7 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.793874:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d90f7 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.793879:0:7148:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d90f7 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.793886:0:7148:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d90f7 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.793892:0:7148:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db65200 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330297.793895:0:7148:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d90f7 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.793901:0:7148:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d90f7 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.793909:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff88009396d500) 00010000:00010000:2.0:1715330297.793911:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330297.793914:0:7148:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d90f7 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.793919:0:7148:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d90f7 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00000004:00010000:2.0:1715330297.793938:0:7148:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012b55c380 reply state ffff88011dbe9000 transno 4294983521 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d90fe lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.793945:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d90fe lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.793949:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x3031 (ffff88009396df00) 00010000:00010000:2.0:1715330297.793952:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330297.793953:0:7148:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00080000:2.0:1715330297.793957:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00010000:00010000:2.0:1715330297.793962:0:7148:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67a80/0xd895711d66d90db lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d90e2 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.793968:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67a80/0xd895711d66d90db lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d90e2 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.793973:0:7148:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67a80/0xd895711d66d90db lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d90e2 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.793992:0:7148:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1715330297.793995:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00010000:00010000:2.0:1715330297.793998:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66d00/0xd895711d66d90e9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d90f0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.794003:0:7148:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66d00/0xd895711d66d90e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d90f0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715330297.794071:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x18c:0x0] 00010000:00010000:2.0:1715330297.794076:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d90d4 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.794080:0:7148:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d90d4 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.794085:0:7148:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d90d4 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.794088:0:7148:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db67cc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330297.794090:0:7148:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d90d4 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.794095:0:7148:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d90d4 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.794101:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff88009396da00) 00010000:00010000:2.0:1715330297.794102:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330297.794104:0:7148:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d90d4 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.794107:0:7148:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d90d4 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00000100:00100000:2.0:1715330297.794168:0:7148:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:72de1896-1df4-4b3a-930a-9116d2c66168+23:17739:x1798653938048640:12345-192.168.204.49@tcp:36:lfs.0 Request processed in 22408us (24667us total) trans 4294983521 rc 0/0 00000100:00100000:2.0:1715330297.794175:0:7148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 3 00010000:00010000:1.0:1715330297.794224:0:9415:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715330297.794230:0:9415:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67a80/0xd895711d66d90db lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d90e2 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.794236:0:9415:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db67a80 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330297.794239:0:9415:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67a80/0xd895711d66d90db lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d90e2 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330297.794250:0:9415:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67a80/0xd895711d66d90db lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d90e2 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.794269:0:9415:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67a80/0xd895711d66d90db lrc: 2/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d90e2 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.794273:0:9415:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330297.794289:0:9415:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67a80/0xd895711d66d90db lrc: 1/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d90e2 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.794294:0:9415:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db67a80/0xd895711d66d90db lrc: 0/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d90e2 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.794309:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330297.794310:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330297.794311:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330297.795034:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942482688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1715330297.795069:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330297.796231:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942482688 00000100:00100000:0.0:1715330297.796240:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942482688 00000100:00100000:0.0:1715330297.796284:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1365 00000100:00100000:0.0:1715330297.796291:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+12:3688:x1798653942482688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330297.796305:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330297.796326:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d90e2 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d90db expref: 12 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.796355:0:9416:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff880093b42a00) 00010000:00010000:0.0:1715330297.796362:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330297.796391:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+11:3688:x1798653942482688:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (1322us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330297.796397:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1365 00000100:00100000:2.0:1715330297.796511:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942482688:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330297.797314:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330297.797395:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938048704 00000100:00100000:3.0:1715330297.797399:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938048704 00000100:00100000:3.0:1715330297.797679:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23485 00000100:00100000:3.0:1715330297.797685:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+23:17739:x1798653938048704:12345-192.168.204.49@tcp:34:lfs.0 00010000:00010000:3.0:1715330297.798015:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d910c lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.798029:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d910c lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.798039:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d910c lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.798049:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d9113 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.798055:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d9113 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.798060:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d9113 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.798109:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457dd40/0xd895711d66d911a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x151e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.798115:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457dd40/0xd895711d66d911a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x151e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.798120:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457dd40/0xd895711d66d911a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x151e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00000004:00010000:3.0:1715330297.798162:0:25569:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88013457dd40/0xd895711d66d911a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x151e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.798172:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d910c lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.798176:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d910c lrc: 2/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.798181:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d910c lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.798186:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457c240 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330297.798189:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d910c lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.798195:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d910c lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.798202:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff88008779d100) 00010000:00010000:3.0:1715330297.798205:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330297.798208:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d910c lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.798212:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d910c lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.798497:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d9113 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.798502:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d9113 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.798506:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d9113 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.798511:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457e640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330297.798513:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d9113 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.798517:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d9113 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.798524:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x31 (ffff88008779d400) 00010000:00010000:3.0:1715330297.798526:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330297.798528:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d9113 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.798532:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d9113 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.798541:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457dd40/0xd895711d66d911a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x151e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.798545:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457dd40/0xd895711d66d911a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x151e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.798549:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457dd40/0xd895711d66d911a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x151e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.798552:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457dd40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330297.798553:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457dd40/0xd895711d66d911a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x151e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.798557:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457dd40/0xd895711d66d911a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x151e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.798560:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151e:0x0].0x0 (ffff8800ad981600) 00010000:00010000:3.0:1715330297.798562:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330297.798565:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457dd40/0xd895711d66d911a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x151e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330297.798568:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457dd40/0xd895711d66d911a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x151e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00000100:00100000:3.0:1715330297.798882:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+23:17739:x1798653938048704:12345-192.168.204.49@tcp:34:lfs.0 Request processed in 1194us (1567us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330297.798890:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23485 00000100:00100000:2.0:1715330297.801928:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330297.802308:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938048832 00000100:00100000:0.0:1715330297.802319:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938048832 00000100:00100000:0.0:1715330297.802370:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23486 00000100:00100000:0.0:1715330297.802378:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+23:17739:x1798653938048832:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:0.0:1715330297.802399:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330297.802421:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a33c0/0xd895711d66d9121 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x151e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb8d8 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.802517:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66d9128 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x151e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330297.802529:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66d9128 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x151e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330297.802539:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66d9128 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x151e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00000004:00200000:0.0:1715330297.802548:0:25569:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x151e:0x0]: returning size 2 00010000:00010000:0.0:1715330297.802635:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a33c0/0xd895711d66d9121 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x151e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8d8 expref: 26 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.802650:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66d9128 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x151e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8d8 expref: 25 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.802657:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151e:0x0].0x0 (ffff8800ad981600) 00010000:00010000:0.0:1715330297.802660:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1715330297.802662:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a0900, rc 0) 00000100:00100000:0.0:1715330297.802708:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+25:17739:x1798653938048832:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 330us (791us total) trans 4294983522 rc 0/0 00000100:00100000:0.0:1715330297.802713:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23486 00000100:00100000:0.0:1715330297.811789:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330297.811859:0:17200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938048896 00000100:00100000:2.0:1715330297.811868:0:17200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938048896 00000100:00100000:2.0:1715330297.811919:0:17200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5196 00000100:00100000:2.0:1715330297.811927:0:17200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:72de1896-1df4-4b3a-930a-9116d2c66168+11:2011:x1798653938048896:12345-192.168.204.49@tcp:1:lfs.0 00010000:00010000:2.0:1715330297.811975:0:17200:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011db67840/0xd895711d66d9136 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.811993:0:17200:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011db64d80/0xd895711d66d8e49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb84c expref: 11 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.812006:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1715330297.812012:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1715330297.812015:0:17200:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db67840/0xd895711d66d9136 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.812229:0:17200:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011db64d80/0xd895711d66d8e49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb84c expref: 11 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.812242:0:17200:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011db64d80/0xd895711d66d8e49 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb84c expref: 11 pid: 9633 timeout: 372 lvb_type: 0 00000100:00100000:2.0:1715330297.812256:0:17200:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:17200:1798653942482752:192.168.204.49@tcp:104: 00000100:00100000:2.0:1715330297.812348:0:17200:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa900 going to sleep for 11 seconds 00000100:00100000:0.0:1715330297.815137:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330297.815399:0:9404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938048960 00000100:00100000:3.0:1715330297.815407:0:9404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938048960 00002000:00100000:3.0:1715330297.815445:0:9404:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x9c8:0x0] (0->1) req@ffff8800877ef480 x1798653938048960/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:508/0 lens 496/0 e 0 to 0 dl 1715330308 ref 1 fl New:/200/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 00002000:00100000:3.0:1715330297.815454:0:9404:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800877ef480 with x1798653938048960 ext(0->1) 00010000:00010000:3.0:1715330297.815463:0:9404:0:(ldlm_extent.c:692:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011db64d80/0xd895711d66d8e49 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb84c expref: 12 pid: 9633 timeout: 372 lvb_type: 0 00010000:00010000:3.0:1715330297.815475:0:9404:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011db64d80/0xd895711d66d8e49 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb84c expref: 12 pid: 9633 timeout: 372 lvb_type: 0 00002000:00010000:3.0:1715330297.815481:0:9404:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800877ef480 00000100:00100000:3.0:1715330297.815499:0:9404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 3 00000100:00100000:3.0:1715330297.815504:0:9404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:72de1896-1df4-4b3a-930a-9116d2c66168+12:2011:x1798653938048960:12345-192.168.204.49@tcp:4:bash.0 00000100:00100000:3.0:1715330297.816726:0:9404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:72de1896-1df4-4b3a-930a-9116d2c66168+14:2011:x1798653938048960:12345-192.168.204.49@tcp:4:bash.0 Request processed in 1217us (1595us total) trans 4294969885 rc 0/0 00000100:00100000:3.0:1715330297.816757:0:9404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 3 00002000:00100000:3.0:1715330297.816764:0:9404:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x9c8:0x0] (0->1) req@ffff8800877ef480 x1798653938048960/t4294969885(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:508/0 lens 496/448 e 0 to 0 dl 1715330308 ref 1 fl Complete:H/200/0 rc 0/0 job:'bash.0' uid:0 gid:0 00002000:00100000:3.0:1715330297.816777:0:9404:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800877ef480 with x1798653938048960 ext(0->1) 00010000:00010000:3.0:1715330297.816783:0:9404:0:(ldlm_extent.c:692:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011db64d80/0xd895711d66d8e49 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb84c expref: 14 pid: 9633 timeout: 372 lvb_type: 0 00010000:00010000:3.0:1715330297.816795:0:9404:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011db64d80/0xd895711d66d8e49 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb84c expref: 14 pid: 9633 timeout: 372 lvb_type: 0 00002000:00010000:3.0:1715330297.816800:0:9404:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800877ef480 00000100:00100000:2.0:1715330297.817137:0:17200:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:17200:1798653942482752:192.168.204.49@tcp:104: 00010000:00010000:2.0:1715330297.817162:0:17200:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88011db67840/0xd895711d66d9136 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330297.820449:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330297.821175:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938049024 00000100:00100000:1.0:1715330297.821185:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938049024 00010000:00010000:1.0:1715330297.821223:0:7122:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011db64d80/0xd895711d66d8e49 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb84c expref: 14 pid: 9633 timeout: 372 lvb_type: 0 00000100:00100000:1.0:1715330297.821249:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1548 00000100:00100000:1.0:1715330297.821256:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72de1896-1df4-4b3a-930a-9116d2c66168+14:2013:x1798653938049024:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1715330297.821271:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1715330297.821288:0:7122:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0x9c8:0x0] updating lvb size from disk: 0 -> 2 00002000:00010000:1.0:1715330297.821291:0:7122:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x9c8:0x0] updating lvb mtime from disk: 0 -> 1715330297 00002000:00010000:1.0:1715330297.821293:0:7122:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0x9c8:0x0] updating lvb ctime from disk: 0 -> 1715330297 00002000:00010000:1.0:1715330297.821295:0:7122:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0x9c8:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1715330297.821301:0:7122:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011db64d80/0xd895711d66d8e49 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb84c expref: 14 pid: 9633 timeout: 372 lvb_type: 0 00010000:00010000:1.0:1715330297.821312:0:7122:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011db64d80/0xd895711d66d8e49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb84c expref: 14 pid: 9633 timeout: 372 lvb_type: 0 00010000:00010000:1.0:1715330297.821349:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011db64d80/0xd895711d66d8e49 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb84c expref: 14 pid: 9633 timeout: 372 lvb_type: 0 00010000:00010000:1.0:1715330297.821906:0:7122:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330297.821909:0:7122:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330297.821914:0:7122:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011db67840/0xd895711d66d9136 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.821924:0:7122:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db67840/0xd895711d66d9136 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.821986:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330297.822077:0:17200:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88011db67840/0xd895711d66d9136 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.822086:0:17200:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011db67840/0xd895711d66d9136 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.822102:0:17200:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011db67840/0xd895711d66d9136 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.822113:0:17200:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88011db67840/0xd895711d66d9136 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.822119:0:17200:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88011db67840/0xd895711d66d9136 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.822125:0:17200:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db67840 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330297.822129:0:17200:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88011db67840/0xd895711d66d9136 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.822136:0:17200:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88011db67840/0xd895711d66d9136 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.822148:0:17200:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88011db67840/0xd895711d66d9136 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.822154:0:17200:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011db67840/0xd895711d66d9136 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330297.822253:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72de1896-1df4-4b3a-930a-9116d2c66168+13:2013:x1798653938049024:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 995us (1812us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330297.822260:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1548 00000100:00100000:2.0:1715330297.823520:0:17200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:72de1896-1df4-4b3a-930a-9116d2c66168+12:2011:x1798653938048896:12345-192.168.204.49@tcp:1:lfs.0 Request processed in 11591us (11739us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330297.823529:0:17200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5196 00000100:00100000:0.0:1715330297.826839:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330297.826958:0:7148:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938049152 00000100:00100000:2.0:1715330297.826967:0:7148:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938049152 00000100:00100000:2.0:1715330297.827017:0:7148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 4 00000100:00100000:2.0:1715330297.827024:0:7148:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:72de1896-1df4-4b3a-930a-9116d2c66168+25:17739:x1798653938049152:12345-192.168.204.49@tcp:36:lfs.0 00010000:00010000:2.0:1715330297.827078:0:7148:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330297.827106:0:7148:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1680/0xd895711d66d8e3b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x151e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb845 expref: 25 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.827123:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151e:0x0].0x0 (ffff8800ad981600) 00010000:00010000:2.0:1715330297.827127:0:7148:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330297.827149:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d913d lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.827161:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d913d lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.827169:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d913d lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00000100:00100000:2.0:1715330297.827225:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7b4700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942482816:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330297.827273:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330297.827288:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa180 going to sleep for 11 seconds 00000100:00100000:0.0:1715330297.827389:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942482816 00000100:00100000:0.0:1715330297.827392:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942482816 00000100:00100000:0.0:1715330297.827578:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2925 00000100:00100000:0.0:1715330297.827583:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d645500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:7148:x1798653942482816:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1715330297.827659:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d645500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:7148:x1798653942482816:12345-0@lo:1000:mdt_io00_002.0 Request processed in 75us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330297.827666:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2925 00000100:00100000:2.0:1715330297.827777:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7b4700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942482816:0@lo:1000:mdt_io00_002.0 00000004:00080000:2.0:1715330297.827805:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x18c:0x0] 00000100:00100000:2.0:1715330297.827825:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d645180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942482880:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330297.827843:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330297.828388:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa180 going to sleep for 11 seconds 00000100:00100000:3.0:1715330297.828438:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942482880 00000100:00100000:3.0:1715330297.828443:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942482880 00000100:00100000:3.0:1715330297.828682:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2926 00000100:00100000:3.0:1715330297.828687:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d645f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:7148:x1798653942482880:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.828824:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d645f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:7148:x1798653942482880:12345-0@lo:1000:mdt_io00_002.0 Request processed in 136us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330297.828830:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2926 00000100:00100000:2.0:1715330297.828877:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d645180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942482880:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330297.829308:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d645180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942482944:0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1715330297.829346:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330297.829357:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa780 going to sleep for 11 seconds 00000100:00100000:3.0:1715330297.829582:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942482944 00000100:00100000:3.0:1715330297.829585:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942482944 00000100:00100000:3.0:1715330297.829614:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2927 00000100:00100000:3.0:1715330297.829619:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d644380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:7148:x1798653942482944:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:3.0:1715330297.831210:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d644380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:7148:x1798653942482944:12345-0@lo:403:mdt_io00_002.0 Request processed in 1589us (1872us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330297.831220:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2927 00000100:00100000:3.0:1715330297.831259:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d645180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942482944:0@lo:403:mdt_io00_002.0 00010000:00010000:3.0:1715330297.831945:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d9144 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.831959:0:7148:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d9144 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.831968:0:7148:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d9144 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7148 initiator: MDT0 00000100:00100000:3.0:1715330297.831984:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344c9f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942483008:0@lo:101:mdt_io00_002.0 00000100:00100000:3.0:1715330297.832013:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.832027:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63000 going to sleep for 11 seconds 00000100:00100000:3.0:1715330297.832037:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942483008 00000100:00100000:3.0:1715330297.832042:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942483008 00000100:00100000:3.0:1715330297.832067:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2928 00000100:00100000:3.0:1715330297.832073:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:7148:x1798653942483008:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1715330297.832088:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330297.832105:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e1c0/0xd895711d66d914b lrc: 2/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d9144 expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.832127:0:9407:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e1c0/0xd895711d66d914b lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d9144 expref: 12 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.832144:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e1c0/0xd895711d66d914b lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9144 expref: 12 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.832152:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff88009ef25300) 00010000:00010000:3.0:1715330297.832154:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330297.832157:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013457e1c0, rc 0) 00000100:00100000:3.0:1715330297.832174:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:7148:x1798653942483008:12345-0@lo:101:mdt_io00_002.0 Request processed in 101us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330297.832178:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2928 00000100:00100000:3.0:1715330297.832198:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344c9f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942483008:0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1715330297.832209:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d9144 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d914b expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.832217:0:7148:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d9144 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d914b expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330297.832229:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00010000:00010000:3.0:1715330297.832243:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f180/0xd895711d66d9152 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.832248:0:7148:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f180/0xd895711d66d9152 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.832254:0:7148:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f180/0xd895711d66d9152 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7148 initiator: MDT0 00000100:00100000:3.0:1715330297.832262:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344c9f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942483072:0@lo:101:mdt_io00_002.0 00000100:00100000:3.0:1715330297.832279:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.832287:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63000 going to sleep for 11 seconds 00000100:00100000:3.0:1715330297.832320:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942483072 00000100:00100000:3.0:1715330297.832323:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942483072 00000100:00100000:3.0:1715330297.832348:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2929 00000100:00100000:3.0:1715330297.832352:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:7148:x1798653942483072:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1715330297.832359:0:24873:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330297.832369:0:24873:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c6c0/0xd895711d66d9159 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d9152 expref: -99 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.832381:0:24873:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c6c0/0xd895711d66d9159 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d9152 expref: 13 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.832393:0:24873:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c6c0/0xd895711d66d9159 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9152 expref: 13 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.832399:0:24873:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x31 (ffff88009b9a4600) 00010000:00010000:3.0:1715330297.832401:0:24873:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330297.832403:0:24873:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013457c6c0, rc 0) 00000100:00100000:3.0:1715330297.832423:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:7148:x1798653942483072:12345-0@lo:101:mdt_io00_002.0 Request processed in 70us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330297.832428:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2929 00000100:00100000:3.0:1715330297.832448:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344c9f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942483072:0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1715330297.832834:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f180/0xd895711d66d9152 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9159 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.832841:0:7148:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f180/0xd895711d66d9152 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9159 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330297.832851:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00010000:00010000:3.0:1715330297.832863:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d9160 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.832869:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d9160 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.832876:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d9160 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.832884:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457db00/0xd895711d66d9167 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.832888:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457db00/0xd895711d66d9167 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.832893:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457db00/0xd895711d66d9167 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.832923:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d916e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x151e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.832933:0:7148:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66d9128 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x151e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8d8 expref: 24 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.832940:0:7148:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d916e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x151e:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.832957:0:7148:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66d9128 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x151e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8d8 expref: 24 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.832968:0:7148:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66d9128 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x151e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8d8 expref: 24 pid: 25569 timeout: 372 lvb_type: 0 00000100:00100000:3.0:1715330297.832977:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344c9f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:7148:1798653942483136:192.168.204.49@tcp:104: 00000100:00100000:3.0:1715330297.833024:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63000 going to sleep for 11 seconds 00010000:00010000:3.0:1715330297.836296:0:7148:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.204.49@tcp) returned -22 from blocking AST (req@ffff8801344c9f80 x1798653942483136) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66d9128 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x151e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8d8 expref: 24 pid: 25569 timeout: 372 lvb_type: 0 00010000:00010000:3.0:1715330297.836316:0:7148:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66d9128 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x151e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8d8 expref: 24 pid: 25569 timeout: 372 lvb_type: 0 00010000:00010000:3.0:1715330297.836350:0:7148:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66d9128 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x151e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8d8 expref: 24 pid: 25569 timeout: 372 lvb_type: 0 00000100:00100000:3.0:1715330297.836370:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344c9f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:7148:1798653942483136:192.168.204.49@tcp:104: 00010000:00010000:3.0:1715330297.836391:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151e:0x0].0x0 (ffff8800ad981600) 00010000:00010000:3.0:1715330297.836396:0:7148:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d916e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x151e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.836404:0:7148:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d916e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x151e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.836410:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d916e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x151e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.836427:0:7148:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d916e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x151e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.836435:0:7148:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d916e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x151e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.836439:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d916e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x151e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00000100:00100000:3.0:1715330297.836572:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344c9f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942483200:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.836615:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330297.838422:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942483200 00000100:00100000:2.0:1715330297.838433:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942483200 00000100:00100000:3.0:1715330297.838553:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63780 going to sleep for 11 seconds 00000100:00100000:2.0:1715330297.838615:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2930 00000100:00100000:2.0:1715330297.838624:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:7148:x1798653942483200:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330297.838789:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:7148:x1798653942483200:12345-0@lo:1000:mdt_io00_002.0 Request processed in 165us (2173us total) trans 0 rc -2/-2 00000100:00100000:2.0:1715330297.838796:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2930 00000100:00100000:3.0:1715330297.838926:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344c9f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942483200:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.838987:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344c9f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942483264:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.839012:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.839033:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63780 going to sleep for 11 seconds 00000100:00100000:0.0:1715330297.839073:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942483264 00000100:00100000:0.0:1715330297.839077:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942483264 00000100:00100000:0.0:1715330297.839106:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2931 00000100:00100000:0.0:1715330297.839110:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:7148:x1798653942483264:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1715330297.839158:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:7148:x1798653942483264:12345-0@lo:1000:mdt_io00_002.0 Request processed in 47us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330297.839164:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2931 00000100:00100000:3.0:1715330297.839232:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344c9f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942483264:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.839308:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344c9f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942483328:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.839327:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.839346:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63780 going to sleep for 11 seconds 00000100:00100000:0.0:1715330297.839380:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942483328 00000100:00100000:0.0:1715330297.839383:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942483328 00000100:00100000:0.0:1715330297.840269:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2932 00000100:00100000:0.0:1715330297.840274:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:7148:x1798653942483328:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1715330297.840316:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:7148:x1798653942483328:12345-0@lo:1000:mdt_io00_002.0 Request processed in 43us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330297.840322:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2932 00000100:00100000:3.0:1715330297.840372:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344c9f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942483328:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.840444:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e8700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942483392:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.840461:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.840629:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63e40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.840708:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942483392 00000100:00100000:1.0:1715330297.840712:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942483392 00000100:00100000:1.0:1715330297.840729:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2933 00000100:00100000:1.0:1715330297.840751:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7148:x1798653942483392:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1715330297.840806:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7148:x1798653942483392:12345-0@lo:1000:mdt_io00_002.0 Request processed in 55us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330297.840810:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2933 00000100:00100000:3.0:1715330297.840985:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e8700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942483392:0@lo:1000:mdt_io00_002.0 00000040:00080000:3.0:1715330297.841275:0:7148:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].376, 1264 off567056 00000040:00080000:3.0:1715330297.841326:0:7148:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].375, 1344 off610968 00000100:00100000:3.0:1715330297.841358:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e8700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942483456:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.841379:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.841388:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63900 going to sleep for 11 seconds 00000100:00100000:0.0:1715330297.841439:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942483456 00000100:00100000:0.0:1715330297.841444:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942483456 00000100:00100000:0.0:1715330297.841459:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2934 00000100:00100000:0.0:1715330297.841463:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7148:x1798653942483456:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1715330297.841549:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:7148:x1798653942483456:12345-0@lo:1000:mdt_io00_002.0 Request processed in 85us (168us total) trans 4294969886 rc 0/0 00000100:00100000:0.0:1715330297.841554:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2934 00000100:00100000:3.0:1715330297.841695:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e8700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942483456:0@lo:1000:mdt_io00_002.0 00000004:00080000:3.0:1715330297.841702:0:7148:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88011db636c0 with version 713 00000004:00080000:0.0:1715330297.841967:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 713 rpc_version 713 00000020:00100000:0.0:1715330297.841989:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1715330297.841996:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88007d635180 x1798653942483584/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3088/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715330297.842007:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d635180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942483584:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330297.842033:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330297.842350:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008d667000 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.842396:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942483584 00000100:00100000:1.0:1715330297.842400:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942483584 00000100:00100000:1.0:1715330297.842746:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2935 00000100:00100000:1.0:1715330297.842751:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:8587:x1798653942483584:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330297.843053:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:8587:x1798653942483584:12345-0@lo:1000:osp_up1-0.0 Request processed in 300us (1018us total) trans 4294968428 rc 0/0 00000100:00100000:1.0:1715330297.843058:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2935 00000100:00100000:0.0:1715330297.843132:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d635180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942483584:0@lo:1000:osp_up1-0.0 00000004:00010000:3.0:1715330297.843186:0:7148:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007d635c00 reply state ffff88011dbeb000 transno 4294983523 ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d916e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x151e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.843202:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d916e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x151e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.843210:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151e:0x0].0x0 (ffff8800ad981600) 00010000:00010000:3.0:1715330297.843213:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:3.0:1715330297.843216:0:7148:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330297.843223:0:7148:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d9160 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.843228:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d9160 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.843234:0:7148:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d9160 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.843240:0:7148:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d9160 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.843246:0:7148:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457f840 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330297.843249:0:7148:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d9160 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.843256:0:7148:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d9160 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.843264:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff88009b9a4a00) 00010000:00010000:3.0:1715330297.843266:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330297.843269:0:7148:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d9160 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.843274:0:7148:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d9160 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00000004:00010000:3.0:1715330297.843292:0:7148:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007d635c00 reply state ffff88011dbeb000 transno 4294983523 ns: mdt-lustre-MDT0000_UUID lock: ffff88013457db00/0xd895711d66d9167 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.843298:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457db00/0xd895711d66d9167 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.843302:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x31 (ffff88008b233e00) 00010000:00010000:3.0:1715330297.843304:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330297.843306:0:7148:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00080000:3.0:1715330297.843309:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00010000:00010000:3.0:1715330297.843316:0:7148:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d9144 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d914b expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.843326:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d9144 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d914b expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.843331:0:7148:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d9144 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d914b expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.843357:0:7148:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1715330297.843360:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00010000:00010000:3.0:1715330297.843364:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f180/0xd895711d66d9152 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9159 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.843369:0:7148:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f180/0xd895711d66d9152 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9159 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330297.843445:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x18c:0x0] 00010000:00010000:3.0:1715330297.843453:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d913d lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.843457:0:7148:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d913d lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.843462:0:7148:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d913d lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.843466:0:7148:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64fc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330297.843468:0:7148:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d913d lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.843473:0:7148:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d913d lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.843482:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff88009396d800) 00010000:00010000:3.0:1715330297.843484:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330297.843486:0:7148:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d913d lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.843490:0:7148:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d913d lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00000100:00100000:3.0:1715330297.843556:0:7148:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:72de1896-1df4-4b3a-930a-9116d2c66168+25:17739:x1798653938049152:12345-192.168.204.49@tcp:36:lfs.0 Request processed in 16530us (16727us total) trans 4294983523 rc 0/0 00000100:00100000:3.0:1715330297.843562:0:7148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 4 00010000:00010000:0.0:1715330297.843667:0:7124:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715330297.843674:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d9144 lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d914b expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.843680:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457c900 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330297.843684:0:7124:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d9144 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d914b expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330297.843689:0:7124:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d9144 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d914b expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.843711:0:7124:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d9144 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d914b expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.843716:0:7124:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330297.843754:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d9144 lrc: 1/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d914b expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.843760:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d9144 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d914b expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.843777:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330297.843778:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330297.843780:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330297.843819:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1715330297.843830:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942483648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1715330297.843862:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330297.843886:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942483648 00000100:00100000:2.0:1715330297.843890:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942483648 00000100:00100000:2.0:1715330297.843915:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1366 00000100:00100000:2.0:1715330297.843919:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d647100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+14:3688:x1798653942483648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715330297.843930:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330297.843943:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e1c0/0xd895711d66d914b lrc: 0/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d9144 expref: 14 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.843951:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff88009ef25300) 00010000:00010000:2.0:1715330297.843957:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330297.843973:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d647100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+13:3688:x1798653942483648:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330297.843977:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1366 00000100:00100000:2.0:1715330297.843996:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942483648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330297.846615:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330297.846715:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938049216 00000100:00100000:2.0:1715330297.846722:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938049216 00000100:00100000:2.0:1715330297.846776:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23487 00000100:00100000:2.0:1715330297.846783:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+25:17739:x1798653938049216:12345-192.168.204.49@tcp:34:lfs.0 00010000:00010000:2.0:1715330297.846853:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d9175 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.846866:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d9175 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.846875:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d9175 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.846885:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d917c lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.846889:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d917c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.846893:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d917c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.846940:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d9183 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x151f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.846947:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d9183 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x151f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.846952:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d9183 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x151f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00010000:2.0:1715330297.846993:0:7135:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d9183 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x151f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.847003:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d9175 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.847008:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d9175 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.847015:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d9175 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.847021:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d9175 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.847026:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64480 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330297.847029:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d9175 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.847035:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d9175 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.847043:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff88009396d700) 00010000:00010000:2.0:1715330297.847046:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330297.847049:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d9175 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.847053:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d9175 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.847069:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d917c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.847073:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d917c lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.847077:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d917c lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.847080:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db673c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330297.847082:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d917c lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.847090:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d917c lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.847095:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x35 (ffff88009396d400) 00010000:00010000:2.0:1715330297.847097:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330297.847099:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d917c lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.847103:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d917c lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.847112:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d9183 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x151f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.847117:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d9183 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x151f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.847121:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d9183 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x151f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.847125:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66400 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330297.847127:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d9183 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x151f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.847131:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d9183 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x151f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.847137:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151f:0x0].0x0 (ffff88008d68e000) 00010000:00010000:2.0:1715330297.847139:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330297.847141:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d9183 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x151f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.847145:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d9183 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x151f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00000100:00100000:2.0:1715330297.847212:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+25:17739:x1798653938049216:12345-192.168.204.49@tcp:34:lfs.0 Request processed in 428us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330297.847218:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23487 00000100:00100000:0.0:1715330297.850232:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330297.850321:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938049344 00000100:00100000:2.0:1715330297.850329:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938049344 00000100:00100000:2.0:1715330297.850412:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23488 00000100:00100000:2.0:1715330297.850418:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+25:17739:x1798653938049344:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:2.0:1715330297.850437:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330297.850456:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d918a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x151f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb8df expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.850548:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d9191 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x151f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.850560:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d9191 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x151f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.850570:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d9191 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x151f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00000004:00200000:2.0:1715330297.850581:0:25569:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x151f:0x0]: returning size 2 00010000:00010000:2.0:1715330297.850673:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d918a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x151f:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8df expref: 28 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.850691:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d9191 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x151f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8df expref: 27 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.850698:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151f:0x0].0x0 (ffff88008d68e000) 00010000:00010000:2.0:1715330297.850700:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1715330297.850703:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db64000, rc 0) 00000100:00100000:2.0:1715330297.851467:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+27:17739:x1798653938049344:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 1046us (1242us total) trans 4294983524 rc 0/0 00000100:00100000:2.0:1715330297.851474:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23488 00000100:00100000:0.0:1715330297.854861:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330297.855355:0:17200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938049408 00000100:00100000:2.0:1715330297.855364:0:17200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938049408 00000100:00100000:2.0:1715330297.855664:0:17200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5197 00000100:00100000:2.0:1715330297.855671:0:17200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:72de1896-1df4-4b3a-930a-9116d2c66168+11:2012:x1798653938049408:12345-192.168.204.49@tcp:1:lfs.0 00010000:00010000:2.0:1715330297.855721:0:17200:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011db67840/0xd895711d66d919f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.855856:0:17200:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011db67600/0xd895711d66d8e73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb85a expref: 11 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.855865:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1715330297.855867:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1715330297.855869:0:17200:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db67840/0xd895711d66d919f lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.855901:0:17200:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011db67600/0xd895711d66d8e73 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb85a expref: 11 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.855913:0:17200:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011db67600/0xd895711d66d8e73 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb85a expref: 11 pid: 9633 timeout: 372 lvb_type: 0 00000100:00100000:2.0:1715330297.855925:0:17200:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d647b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:17200:1798653942483712:192.168.204.49@tcp:104: 00000100:00100000:2.0:1715330297.855975:0:17200:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa900 going to sleep for 11 seconds 00000100:00100000:2.0:1715330297.858694:0:17200:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d647b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:17200:1798653942483712:192.168.204.49@tcp:104: 00010000:00010000:2.0:1715330297.858718:0:17200:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88011db67840/0xd895711d66d919f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330297.858998:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330297.859312:0:9404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938049472 00000100:00100000:3.0:1715330297.859319:0:9404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938049472 00002000:00100000:3.0:1715330297.859361:0:9404:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9c9:0x0] (0->1) req@ffff88007d637100 x1798653938049472/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:508/0 lens 496/0 e 0 to 0 dl 1715330308 ref 1 fl New:/200/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 00002000:00100000:3.0:1715330297.859370:0:9404:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88007d637100 with x1798653938049472 ext(0->1) 00010000:00010000:3.0:1715330297.859377:0:9404:0:(ldlm_extent.c:692:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011db67600/0xd895711d66d8e73 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb85a expref: 12 pid: 9633 timeout: 372 lvb_type: 0 00010000:00010000:3.0:1715330297.859388:0:9404:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011db67600/0xd895711d66d8e73 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb85a expref: 12 pid: 9633 timeout: 372 lvb_type: 0 00002000:00010000:3.0:1715330297.859393:0:9404:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88007d637100 00000100:00100000:3.0:1715330297.859411:0:9404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 4 00000100:00100000:3.0:1715330297.859416:0:9404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:72de1896-1df4-4b3a-930a-9116d2c66168+12:2012:x1798653938049472:12345-192.168.204.49@tcp:4:bash.0 00000100:00100000:3.0:1715330297.861015:0:9404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:72de1896-1df4-4b3a-930a-9116d2c66168+14:2012:x1798653938049472:12345-192.168.204.49@tcp:4:bash.0 Request processed in 1590us (2011us total) trans 4294969882 rc 0/0 00000100:00100000:3.0:1715330297.861029:0:9404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 4 00002000:00100000:3.0:1715330297.861038:0:9404:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9c9:0x0] (0->1) req@ffff88007d637100 x1798653938049472/t4294969882(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:508/0 lens 496/448 e 0 to 0 dl 1715330308 ref 1 fl Complete:H/200/0 rc 0/0 job:'bash.0' uid:0 gid:0 00002000:00100000:3.0:1715330297.861045:0:9404:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88007d637100 with x1798653938049472 ext(0->1) 00010000:00010000:3.0:1715330297.861052:0:9404:0:(ldlm_extent.c:692:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011db67600/0xd895711d66d8e73 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb85a expref: 14 pid: 9633 timeout: 372 lvb_type: 0 00010000:00010000:3.0:1715330297.861067:0:9404:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011db67600/0xd895711d66d8e73 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb85a expref: 14 pid: 9633 timeout: 372 lvb_type: 0 00002000:00010000:3.0:1715330297.861072:0:9404:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88007d637100 00000100:00100000:0.0:1715330297.864312:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330297.864379:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938049536 00000100:00100000:2.0:1715330297.864387:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938049536 00010000:00010000:2.0:1715330297.864425:0:9416:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011db67600/0xd895711d66d8e73 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb85a expref: 14 pid: 9633 timeout: 372 lvb_type: 0 00000100:00100000:2.0:1715330297.864462:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1549 00000100:00100000:2.0:1715330297.864469:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d634a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+14:2012:x1798653938049536:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1715330297.864482:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1715330297.864499:0:9416:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x9c9:0x0] updating lvb size from disk: 0 -> 2 00002000:00010000:2.0:1715330297.864502:0:9416:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x9c9:0x0] updating lvb mtime from disk: 0 -> 1715330297 00002000:00010000:2.0:1715330297.864503:0:9416:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000401:0x9c9:0x0] updating lvb ctime from disk: 0 -> 1715330297 00002000:00010000:2.0:1715330297.864505:0:9416:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000401:0x9c9:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1715330297.864510:0:9416:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011db67600/0xd895711d66d8e73 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb85a expref: 14 pid: 9633 timeout: 372 lvb_type: 0 00010000:00010000:2.0:1715330297.864520:0:9416:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011db67600/0xd895711d66d8e73 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb85a expref: 14 pid: 9633 timeout: 372 lvb_type: 0 00010000:00010000:2.0:1715330297.864546:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011db67600/0xd895711d66d8e73 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb85a expref: 14 pid: 9633 timeout: 372 lvb_type: 0 00010000:00010000:2.0:1715330297.864577:0:9416:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330297.864579:0:9416:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330297.864584:0:9416:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011db67840/0xd895711d66d919f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.864593:0:9416:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db67840/0xd895711d66d919f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.864618:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330297.864675:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d634a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+13:2012:x1798653938049536:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 206us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330297.864682:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1549 00010000:00010000:2.0:1715330297.864707:0:17200:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88011db67840/0xd895711d66d919f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.864715:0:17200:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011db67840/0xd895711d66d919f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.864728:0:17200:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011db67840/0xd895711d66d919f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.864755:0:17200:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88011db67840/0xd895711d66d919f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.864762:0:17200:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88011db67840/0xd895711d66d919f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.864767:0:17200:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db67840 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330297.864770:0:17200:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88011db67840/0xd895711d66d919f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.864781:0:17200:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88011db67840/0xd895711d66d919f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.864792:0:17200:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88011db67840/0xd895711d66d919f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.864798:0:17200:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011db67840/0xd895711d66d919f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330297.865024:0:17200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:72de1896-1df4-4b3a-930a-9116d2c66168+12:2012:x1798653938049408:12345-192.168.204.49@tcp:1:lfs.0 Request processed in 9352us (10174us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330297.865032:0:17200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5197 00000100:00100000:0.0:1715330297.870863:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330297.871477:0:7148:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938049664 00000100:00100000:3.0:1715330297.871486:0:7148:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938049664 00000100:00100000:3.0:1715330297.871805:0:7148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5 00000100:00100000:3.0:1715330297.871813:0:7148:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:72de1896-1df4-4b3a-930a-9116d2c66168+27:17739:x1798653938049664:12345-192.168.204.49@tcp:36:lfs.0 00010000:00010000:3.0:1715330297.872026:0:7148:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330297.872051:0:7148:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d8e65 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x151f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb853 expref: 27 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.872079:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151f:0x0].0x0 (ffff88008d68e000) 00010000:00010000:3.0:1715330297.872083:0:7148:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330297.872106:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d91a6 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.872117:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d91a6 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.872124:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d91a6 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00000100:00100000:3.0:1715330297.872791:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c0e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942483776:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.872848:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.872878:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63900 going to sleep for 11 seconds 00000100:00100000:2.0:1715330297.872935:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942483776 00000100:00100000:2.0:1715330297.872940:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942483776 00000100:00100000:2.0:1715330297.873044:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2936 00000100:00100000:2.0:1715330297.873049:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:7148:x1798653942483776:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330297.873129:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:7148:x1798653942483776:12345-0@lo:1000:mdt_io00_002.0 Request processed in 79us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330297.873136:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2936 00000100:00100000:3.0:1715330297.873157:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c0e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942483776:0@lo:1000:mdt_io00_002.0 00000004:00080000:3.0:1715330297.873180:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x18c:0x0] 00000100:00100000:3.0:1715330297.873201:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c0e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942483840:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.873218:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.873237:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63900 going to sleep for 11 seconds 00000100:00100000:2.0:1715330297.873358:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942483840 00000100:00100000:2.0:1715330297.873361:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942483840 00000100:00100000:2.0:1715330297.873518:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2937 00000100:00100000:2.0:1715330297.873522:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:7148:x1798653942483840:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330297.873578:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:7148:x1798653942483840:12345-0@lo:1000:mdt_io00_002.0 Request processed in 55us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330297.873586:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2937 00000100:00100000:3.0:1715330297.873629:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c0e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942483840:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.874092:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c0e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942483904:0@lo:403:mdt_io00_002.0 00000100:00100000:3.0:1715330297.874115:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.874123:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63480 going to sleep for 11 seconds 00000100:00100000:2.0:1715330297.874170:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942483904 00000100:00100000:2.0:1715330297.874173:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942483904 00000100:00100000:2.0:1715330297.874196:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2938 00000100:00100000:2.0:1715330297.874199:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:7148:x1798653942483904:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1715330297.877529:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:7148:x1798653942483904:12345-0@lo:403:mdt_io00_002.0 Request processed in 3320us (3404us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330297.877543:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2938 00000100:00100000:3.0:1715330297.877625:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c0e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942483904:0@lo:403:mdt_io00_002.0 00010000:00010000:3.0:1715330297.878304:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d91ad lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.878314:0:7148:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d91ad lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.878322:0:7148:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d91ad lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7148 initiator: MDT0 00000100:00100000:3.0:1715330297.878348:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c0e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942483968:0@lo:101:mdt_io00_002.0 00000100:00100000:3.0:1715330297.878377:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.878481:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63480 going to sleep for 11 seconds 00000100:00100000:2.0:1715330297.878530:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942483968 00000100:00100000:2.0:1715330297.878536:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942483968 00000100:00100000:2.0:1715330297.878570:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2939 00000100:00100000:2.0:1715330297.878576:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:7148:x1798653942483968:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:2.0:1715330297.878595:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330297.878612:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64fc0/0xd895711d66d91b4 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d91ad expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.878635:0:23404:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64fc0/0xd895711d66d91b4 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d91ad expref: 14 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.878647:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64fc0/0xd895711d66d91b4 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d91ad expref: 14 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.878654:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff88009396d500) 00010000:00010000:2.0:1715330297.878657:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330297.878660:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db64fc0, rc 0) 00000100:00100000:2.0:1715330297.878691:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:7148:x1798653942483968:12345-0@lo:101:mdt_io00_002.0 Request processed in 115us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330297.878702:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2939 00000100:00100000:3.0:1715330297.878727:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c0e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942483968:0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1715330297.878766:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d91ad lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d91b4 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.878776:0:7148:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d91ad lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d91b4 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330297.878788:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00010000:00010000:3.0:1715330297.878805:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457cd80/0xd895711d66d91bb lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.878810:0:7148:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457cd80/0xd895711d66d91bb lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.878815:0:7148:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457cd80/0xd895711d66d91bb lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7148 initiator: MDT0 00000100:00100000:3.0:1715330297.878824:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c0e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942484032:0@lo:101:mdt_io00_002.0 00000100:00100000:3.0:1715330297.879440:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.879457:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63480 going to sleep for 11 seconds 00000100:00100000:2.0:1715330297.879506:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942484032 00000100:00100000:2.0:1715330297.879510:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942484032 00000100:00100000:2.0:1715330297.879561:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2940 00000100:00100000:2.0:1715330297.879565:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:7148:x1798653942484032:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:2.0:1715330297.879573:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330297.879582:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d91c2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d91bb expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.879594:0:23404:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d91c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d91bb expref: 15 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.879601:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d91c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d91bb expref: 15 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.879607:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x35 (ffff88009396d800) 00010000:00010000:2.0:1715330297.879609:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330297.879611:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db64d80, rc 0) 00000100:00100000:2.0:1715330297.879641:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:7148:x1798653942484032:12345-0@lo:101:mdt_io00_002.0 Request processed in 75us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330297.879646:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2940 00000100:00100000:3.0:1715330297.879660:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c0e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942484032:0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1715330297.879669:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457cd80/0xd895711d66d91bb lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d91c2 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.879675:0:7148:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457cd80/0xd895711d66d91bb lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d91c2 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330297.879684:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00010000:00010000:3.0:1715330297.879701:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cfc0/0xd895711d66d91c9 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.879708:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cfc0/0xd895711d66d91c9 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.879716:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cfc0/0xd895711d66d91c9 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.879725:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d91d0 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.879807:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d91d0 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.879814:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d91d0 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.879847:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d91d7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x151f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.879857:0:7148:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d9191 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x151f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8df expref: 26 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.879863:0:7148:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d91d7 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x151f:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.879883:0:7148:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d9191 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x151f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8df expref: 26 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.879895:0:7148:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d9191 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x151f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8df expref: 26 pid: 25569 timeout: 372 lvb_type: 0 00000100:00100000:3.0:1715330297.879905:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c0e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:7148:1798653942484096:192.168.204.49@tcp:104: 00000100:00100000:3.0:1715330297.879955:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63480 going to sleep for 11 seconds 00010000:00010000:3.0:1715330297.882761:0:7148:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.204.49@tcp) returned -22 from blocking AST (req@ffff88008b0c0e00 x1798653942484096) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d9191 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x151f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8df expref: 26 pid: 25569 timeout: 372 lvb_type: 0 00010000:00010000:3.0:1715330297.882785:0:7148:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d9191 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x151f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8df expref: 26 pid: 25569 timeout: 372 lvb_type: 0 00010000:00010000:3.0:1715330297.882804:0:7148:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d9191 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x151f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8df expref: 26 pid: 25569 timeout: 372 lvb_type: 0 00000100:00100000:3.0:1715330297.882819:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c0e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:7148:1798653942484096:192.168.204.49@tcp:104: 00010000:00010000:3.0:1715330297.882835:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151f:0x0].0x0 (ffff88008d68e000) 00010000:00010000:3.0:1715330297.882839:0:7148:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d91d7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x151f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.882847:0:7148:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d91d7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x151f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.882851:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d91d7 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x151f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.883428:0:7148:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d91d7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x151f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.883438:0:7148:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d91d7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x151f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.883443:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d91d7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x151f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00000100:00100000:2.0:1715330297.884353:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d647b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942484160:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330297.884403:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330297.884605:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa900 going to sleep for 11 seconds 00000100:00100000:0.0:1715330297.884648:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942484160 00000100:00100000:0.0:1715330297.884654:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942484160 00000100:00100000:0.0:1715330297.884833:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2941 00000100:00100000:0.0:1715330297.884841:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d647800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:7148:x1798653942484160:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1715330297.885143:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d647800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:7148:x1798653942484160:12345-0@lo:1000:mdt_io00_002.0 Request processed in 302us (739us total) trans 0 rc -2/-2 00000100:00100000:0.0:1715330297.885150:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2941 00000100:00100000:2.0:1715330297.885256:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d647b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942484160:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330297.885291:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d647b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942484224:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330297.885309:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330297.885318:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa900 going to sleep for 11 seconds 00000100:00100000:0.0:1715330297.885370:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942484224 00000100:00100000:0.0:1715330297.885373:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942484224 00000100:00100000:0.0:1715330297.885393:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2942 00000100:00100000:0.0:1715330297.885397:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d644a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:7148:x1798653942484224:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1715330297.885445:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d644a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:7148:x1798653942484224:12345-0@lo:1000:mdt_io00_002.0 Request processed in 47us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330297.885450:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2942 00000100:00100000:2.0:1715330297.885596:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d647b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942484224:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330297.885665:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d647b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942484288:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330297.885682:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330297.885866:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa900 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.885922:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942484288 00000100:00100000:1.0:1715330297.885926:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942484288 00000100:00100000:1.0:1715330297.885949:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2943 00000100:00100000:1.0:1715330297.885953:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d644e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:7148:x1798653942484288:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1715330297.885995:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d644e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:7148:x1798653942484288:12345-0@lo:1000:mdt_io00_002.0 Request processed in 41us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330297.886000:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2943 00000100:00100000:2.0:1715330297.886018:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d647b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942484288:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330297.886081:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d647b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942484352:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330297.886101:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330297.886120:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa240 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.886166:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942484352 00000100:00100000:1.0:1715330297.886169:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942484352 00000100:00100000:1.0:1715330297.886190:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2944 00000100:00100000:1.0:1715330297.886193:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d645180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7148:x1798653942484352:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1715330297.886242:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d645180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7148:x1798653942484352:12345-0@lo:1000:mdt_io00_002.0 Request processed in 47us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330297.886247:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2944 00000100:00100000:2.0:1715330297.886298:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d647b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942484352:0@lo:1000:mdt_io00_002.0 00000040:00080000:2.0:1715330297.886540:0:7148:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].377, 1264 off568320 00000040:00080000:2.0:1715330297.886573:0:7148:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].376, 1344 off612312 00000100:00100000:2.0:1715330297.886586:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d647b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942484416:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330297.886599:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330297.886614:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435a80 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.886631:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942484416 00000100:00100000:1.0:1715330297.886634:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942484416 00000100:00100000:1.0:1715330297.886654:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2945 00000100:00100000:1.0:1715330297.886658:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:7148:x1798653942484416:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1715330297.886752:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7148:x1798653942484416:12345-0@lo:1000:mdt_io00_002.0 Request processed in 93us (151us total) trans 4294969883 rc 0/0 00000100:00100000:1.0:1715330297.886761:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2945 00000100:00100000:2.0:1715330297.886824:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d647b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942484416:0@lo:1000:mdt_io00_002.0 00000004:00080000:2.0:1715330297.886833:0:7148:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880091ffacc0 with version 714 00000004:00080000:0.0:1715330297.886873:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 714 rpc_version 714 00000020:00100000:0.0:1715330297.886896:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1715330297.886902:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88007d636a00 x1798653942484544/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3088/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715330297.886915:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d636a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942484544:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330297.886941:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330297.886960:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009d7e3900 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.886970:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942484544 00000100:00100000:1.0:1715330297.886972:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942484544 00000100:00100000:1.0:1715330297.886983:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2946 00000100:00100000:1.0:1715330297.886986:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:8587:x1798653942484544:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330297.887190:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:8587:x1798653942484544:12345-0@lo:1000:osp_up1-0.0 Request processed in 202us (249us total) trans 4294968429 rc 0/0 00000100:00100000:1.0:1715330297.887194:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2946 00000100:00100000:0.0:1715330297.887234:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d636a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942484544:0@lo:1000:osp_up1-0.0 00000004:00010000:2.0:1715330297.887265:0:7148:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007d636d80 reply state ffff88009d47d000 transno 4294983525 ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d91d7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x151f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.887281:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d91d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x151f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.887289:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151f:0x0].0x0 (ffff88008d68e000) 00010000:00010000:2.0:1715330297.887292:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:2.0:1715330297.887295:0:7148:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1715330297.887302:0:7148:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cfc0/0xd895711d66d91c9 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.887307:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cfc0/0xd895711d66d91c9 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.887312:0:7148:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cfc0/0xd895711d66d91c9 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.887318:0:7148:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cfc0/0xd895711d66d91c9 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.887323:0:7148:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457cfc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330297.887326:0:7148:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cfc0/0xd895711d66d91c9 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.887333:0:7148:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cfc0/0xd895711d66d91c9 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.887351:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff88008b233700) 00010000:00010000:2.0:1715330297.887352:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330297.887354:0:7148:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cfc0/0xd895711d66d91c9 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.887360:0:7148:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cfc0/0xd895711d66d91c9 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00000004:00010000:2.0:1715330297.887373:0:7148:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007d636d80 reply state ffff88009d47d000 transno 4294983525 ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d91d0 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.887377:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d91d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.887380:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x35 (ffff88008b233000) 00010000:00010000:2.0:1715330297.887381:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330297.887382:0:7148:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00080000:2.0:1715330297.887385:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00010000:00010000:2.0:1715330297.887389:0:7148:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d91ad lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d91b4 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.887393:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d91ad lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d91b4 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.887396:0:7148:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d91ad lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d91b4 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.887412:0:7148:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1715330297.887415:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00010000:00010000:2.0:1715330297.887419:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457cd80/0xd895711d66d91bb lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d91c2 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.887425:0:7148:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457cd80/0xd895711d66d91bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d91c2 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.887431:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715330297.887436:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d91ad lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d91b4 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.887442:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457c900 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330297.887445:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d91ad lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d91b4 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330297.887451:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d91ad lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d91b4 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.887470:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d91ad lrc: 2/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d91b4 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.887476:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000004:00080000:2.0:1715330297.887481:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x18c:0x0] 00010000:00010000:2.0:1715330297.887488:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d91a6 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.887493:0:7148:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d91a6 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.887498:0:7148:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d91a6 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:1.0:1715330297.887502:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d91ad lrc: 1/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d91b4 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.887503:0:7148:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457e1c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330297.887505:0:7148:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d91a6 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:1.0:1715330297.887508:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c900/0xd895711d66d91ad lrc: 0/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d91b4 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.887510:0:7148:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d91a6 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.887517:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff88008b233a00) 00010000:00010000:2.0:1715330297.887518:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330297.887520:0:7148:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d91a6 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.887525:0:7148:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d91a6 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:1.0:1715330297.887527:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330297.887528:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330297.887530:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330297.887577:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942484608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1715330297.887605:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330297.887701:0:7148:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:72de1896-1df4-4b3a-930a-9116d2c66168+27:17739:x1798653938049664:12345-192.168.204.49@tcp:36:lfs.0 Request processed in 15887us (16847us total) trans 4294983525 rc 0/0 00000100:00100000:2.0:1715330297.887708:0:7148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5 00000100:00100000:0.0:1715330297.887763:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942484608 00000100:00100000:0.0:1715330297.887766:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942484608 00000100:00100000:0.0:1715330297.887790:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1367 00000100:00100000:0.0:1715330297.887794:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+16:3690:x1798653942484608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330297.887803:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330297.887815:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64fc0/0xd895711d66d91b4 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d91ad expref: 16 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.887831:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff88009396d500) 00010000:00010000:0.0:1715330297.887838:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330297.887858:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+15:3690:x1798653942484608:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330297.887863:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1367 00000100:00100000:3.0:1715330297.887945:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942484608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330297.890784:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330297.890884:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938049728 00000100:00100000:2.0:1715330297.890891:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938049728 00000100:00100000:2.0:1715330297.890922:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23489 00000100:00100000:2.0:1715330297.890927:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+27:17739:x1798653938049728:12345-192.168.204.49@tcp:34:lfs.0 00010000:00010000:2.0:1715330297.890984:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d91de lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.890996:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d91de lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.891004:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d91de lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.891015:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d91e5 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.891020:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d91e5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.891025:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d91e5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.891066:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d91ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0x151d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.891073:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d91ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x151d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.891078:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d91ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x151d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00000004:00010000:2.0:1715330297.891114:0:25569:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d91ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x151d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.891123:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d91de lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.891128:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d91de lrc: 2/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.891132:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d91de lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.891138:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64000 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330297.891141:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d91de lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.891146:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d91de lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.891153:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff88009b9a4a00) 00010000:00010000:2.0:1715330297.891156:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330297.891158:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d91de lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.891163:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d91de lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.891176:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d91e5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.891179:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d91e5 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.891182:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d91e5 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.891186:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64240 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330297.891188:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d91e5 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.891193:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d91e5 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.891198:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x30 (ffff88008779d400) 00010000:00010000:2.0:1715330297.891200:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330297.891203:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d91e5 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.891207:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d91e5 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.891216:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d91ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x151d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.891220:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d91ec lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x151d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.891225:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d91ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x151d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.891229:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db67cc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330297.891231:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d91ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x151d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.891235:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d91ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x151d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.891240:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151d:0x0].0x0 (ffff88008d68ef00) 00010000:00010000:2.0:1715330297.891241:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330297.891243:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d91ec lrc: 2/0,0 mode: --/PR res: [0x200000402:0x151d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.891247:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d91ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0x151d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00000100:00100000:2.0:1715330297.891302:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+27:17739:x1798653938049728:12345-192.168.204.49@tcp:34:lfs.0 Request processed in 374us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330297.891309:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23489 00000100:00100000:0.0:1715330297.893415:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330297.893565:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938049856 00000100:00100000:2.0:1715330297.893571:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938049856 00000100:00100000:2.0:1715330297.893614:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23490 00000100:00100000:2.0:1715330297.893620:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+27:17739:x1798653938049856:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:2.0:1715330297.893636:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330297.893651:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d91f3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x151d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb8e6 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.893874:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d91fa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x151d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.893885:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d91fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x151d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.893895:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d91fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x151d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00200000:2.0:1715330297.893905:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x151d:0x0]: returning size 2 00010000:00010000:2.0:1715330297.893994:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d91f3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x151d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8e6 expref: 30 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.894010:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d91fa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x151d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8e6 expref: 29 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.894017:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151d:0x0].0x0 (ffff88008d68ef00) 00010000:00010000:2.0:1715330297.894018:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1715330297.894021:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db67a80, rc 0) 00000100:00100000:2.0:1715330297.894069:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+29:17739:x1798653938049856:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 449us (658us total) trans 4294983526 rc 0/0 00000100:00100000:2.0:1715330297.894077:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23490 00000100:00100000:0.0:1715330297.897207:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330297.897265:0:17200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938049920 00000100:00100000:2.0:1715330297.897274:0:17200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938049920 00000100:00100000:2.0:1715330297.897310:0:17200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5198 00000100:00100000:2.0:1715330297.897317:0:17200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:72de1896-1df4-4b3a-930a-9116d2c66168+12:2011:x1798653938049920:12345-192.168.204.49@tcp:1:lfs.0 00010000:00010000:2.0:1715330297.897369:0:17200:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011db67180/0xd895711d66d9208 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.897386:0:17200:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d7a3180/0xd895711d66d8e1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb83e expref: 12 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.897392:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1715330297.897393:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1715330297.897396:0:17200:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db67180/0xd895711d66d9208 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.897426:0:17200:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d7a3180/0xd895711d66d8e1f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb83e expref: 12 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.897437:0:17200:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d7a3180/0xd895711d66d8e1f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb83e expref: 12 pid: 9633 timeout: 372 lvb_type: 0 00000100:00100000:2.0:1715330297.897449:0:17200:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba65500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:17200:1798653942484672:192.168.204.49@tcp:104: 00000100:00100000:2.0:1715330297.897505:0:17200:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffae40 going to sleep for 11 seconds 00000100:00100000:2.0:1715330297.900895:0:17200:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba65500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:17200:1798653942484672:192.168.204.49@tcp:104: 00010000:00010000:2.0:1715330297.900922:0:17200:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88011db67180/0xd895711d66d9208 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330297.901387:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330297.901525:0:9404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938049984 00000100:00100000:2.0:1715330297.901532:0:9404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938049984 00002000:00100000:2.0:1715330297.901576:0:9404:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9c8:0x0] (0->1) req@ffff88007d634380 x1798653938049984/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:508/0 lens 496/0 e 0 to 0 dl 1715330308 ref 1 fl New:/200/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 00002000:00100000:2.0:1715330297.901585:0:9404:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88007d634380 with x1798653938049984 ext(0->1) 00010000:00010000:2.0:1715330297.901593:0:9404:0:(ldlm_extent.c:692:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009d7a3180/0xd895711d66d8e1f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb83e expref: 13 pid: 9633 timeout: 372 lvb_type: 0 00010000:00010000:2.0:1715330297.901604:0:9404:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009d7a3180/0xd895711d66d8e1f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb83e expref: 13 pid: 9633 timeout: 372 lvb_type: 0 00002000:00010000:2.0:1715330297.901610:0:9404:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88007d634380 00000100:00100000:2.0:1715330297.901644:0:9404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5 00000100:00100000:2.0:1715330297.901651:0:9404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:72de1896-1df4-4b3a-930a-9116d2c66168+13:2012:x1798653938049984:12345-192.168.204.49@tcp:4:bash.0 00000100:00100000:2.0:1715330297.903442:0:9404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:72de1896-1df4-4b3a-930a-9116d2c66168+15:2012:x1798653938049984:12345-192.168.204.49@tcp:4:bash.0 Request processed in 1784us (2049us total) trans 4294969884 rc 0/0 00000100:00100000:2.0:1715330297.903455:0:9404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5 00002000:00100000:2.0:1715330297.903464:0:9404:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9c8:0x0] (0->1) req@ffff88007d634380 x1798653938049984/t4294969884(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:508/0 lens 496/448 e 0 to 0 dl 1715330308 ref 1 fl Complete:H/200/0 rc 0/0 job:'bash.0' uid:0 gid:0 00002000:00100000:2.0:1715330297.903472:0:9404:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88007d634380 with x1798653938049984 ext(0->1) 00010000:00010000:2.0:1715330297.903479:0:9404:0:(ldlm_extent.c:692:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009d7a3180/0xd895711d66d8e1f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb83e expref: 15 pid: 9633 timeout: 372 lvb_type: 0 00010000:00010000:2.0:1715330297.903492:0:9404:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009d7a3180/0xd895711d66d8e1f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb83e expref: 15 pid: 9633 timeout: 372 lvb_type: 0 00002000:00010000:2.0:1715330297.903498:0:9404:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88007d634380 00000100:00100000:0.0:1715330297.906956:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330297.907471:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938050048 00000100:00100000:2.0:1715330297.907480:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938050048 00010000:00010000:2.0:1715330297.907517:0:9416:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7a3180/0xd895711d66d8e1f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb83e expref: 15 pid: 9633 timeout: 372 lvb_type: 0 00000100:00100000:2.0:1715330297.907548:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1550 00000100:00100000:2.0:1715330297.907555:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d634000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+15:2014:x1798653938050048:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1715330297.907573:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1715330297.907592:0:9416:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x9c8:0x0] updating lvb size from disk: 0 -> 2 00002000:00010000:2.0:1715330297.907595:0:9416:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x9c8:0x0] updating lvb mtime from disk: 0 -> 1715330297 00002000:00010000:2.0:1715330297.907597:0:9416:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000401:0x9c8:0x0] updating lvb ctime from disk: 0 -> 1715330297 00002000:00010000:2.0:1715330297.907599:0:9416:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000401:0x9c8:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1715330297.907605:0:9416:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d7a3180/0xd895711d66d8e1f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb83e expref: 15 pid: 9633 timeout: 372 lvb_type: 0 00010000:00010000:2.0:1715330297.907617:0:9416:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d7a3180/0xd895711d66d8e1f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb83e expref: 15 pid: 9633 timeout: 372 lvb_type: 0 00010000:00010000:2.0:1715330297.907645:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d7a3180/0xd895711d66d8e1f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb83e expref: 15 pid: 9633 timeout: 372 lvb_type: 0 00010000:00010000:2.0:1715330297.907679:0:9416:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330297.907681:0:9416:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330297.907685:0:9416:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011db67180/0xd895711d66d9208 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.907695:0:9416:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db67180/0xd895711d66d9208 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.907760:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330297.907806:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d634000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+14:2014:x1798653938050048:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 250us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330297.907813:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1550 00010000:00010000:3.0:1715330297.908149:0:17200:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88011db67180/0xd895711d66d9208 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.908159:0:17200:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011db67180/0xd895711d66d9208 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.908177:0:17200:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011db67180/0xd895711d66d9208 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.908191:0:17200:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88011db67180/0xd895711d66d9208 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.908198:0:17200:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88011db67180/0xd895711d66d9208 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.908204:0:17200:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db67180 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330297.908208:0:17200:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88011db67180/0xd895711d66d9208 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.908215:0:17200:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88011db67180/0xd895711d66d9208 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.908233:0:17200:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88011db67180/0xd895711d66d9208 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.908240:0:17200:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011db67180/0xd895711d66d9208 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330297.908295:0:17200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:72de1896-1df4-4b3a-930a-9116d2c66168+13:2011:x1798653938049920:12345-192.168.204.49@tcp:1:lfs.0 Request processed in 10978us (11097us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330297.908304:0:17200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5198 00000100:00100000:0.0:1715330297.911078:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330297.911180:0:7148:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938050176 00000100:00100000:2.0:1715330297.911189:0:7148:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938050176 00000100:00100000:2.0:1715330297.911247:0:7148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 6 00000100:00100000:2.0:1715330297.911254:0:7148:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:72de1896-1df4-4b3a-930a-9116d2c66168+29:17739:x1798653938050176:12345-192.168.204.49@tcp:36:lfs.0 00010000:00010000:2.0:1715330297.911307:0:7148:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330297.911351:0:7148:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d8e11 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x151d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb837 expref: 29 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.911369:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151d:0x0].0x0 (ffff88008d68ef00) 00010000:00010000:2.0:1715330297.911372:0:7148:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330297.911394:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d920f lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.911405:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d920f lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.911412:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d920f lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00000100:00100000:2.0:1715330297.911471:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba65500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942484736:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330297.911517:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330297.911542:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa780 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.911559:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942484736 00000100:00100000:1.0:1715330297.911564:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942484736 00000100:00100000:1.0:1715330297.911591:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2947 00000100:00100000:1.0:1715330297.911596:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:7148:x1798653942484736:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1715330297.911657:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:7148:x1798653942484736:12345-0@lo:1000:mdt_io00_002.0 Request processed in 60us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330297.911663:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2947 00000100:00100000:2.0:1715330297.911718:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba65500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942484736:0@lo:1000:mdt_io00_002.0 00000004:00080000:2.0:1715330297.911843:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x18c:0x0] 00000100:00100000:2.0:1715330297.911859:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba65500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942484800:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330297.911873:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330297.911889:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa780 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.911907:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942484800 00000100:00100000:1.0:1715330297.911911:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942484800 00000100:00100000:1.0:1715330297.911933:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2948 00000100:00100000:1.0:1715330297.911937:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:7148:x1798653942484800:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1715330297.911999:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:7148:x1798653942484800:12345-0@lo:1000:mdt_io00_002.0 Request processed in 60us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330297.912004:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2948 00000100:00100000:2.0:1715330297.912063:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba65500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942484800:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330297.912522:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba65500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942484864:0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1715330297.912550:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330297.912572:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffae40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.912632:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942484864 00000100:00100000:1.0:1715330297.912635:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942484864 00000100:00100000:1.0:1715330297.912681:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2949 00000100:00100000:1.0:1715330297.912685:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:7148:x1798653942484864:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:1.0:1715330297.914401:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:7148:x1798653942484864:12345-0@lo:403:mdt_io00_002.0 Request processed in 1709us (1845us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330297.914411:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2949 00000100:00100000:2.0:1715330297.914455:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba65500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942484864:0@lo:403:mdt_io00_002.0 00010000:00010000:2.0:1715330297.915111:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66f40/0xd895711d66d9216 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.915121:0:7148:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66f40/0xd895711d66d9216 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.915130:0:7148:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66f40/0xd895711d66d9216 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7148 initiator: MDT0 00000100:00100000:2.0:1715330297.915148:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba65500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942484928:0@lo:101:mdt_io00_002.0 00000100:00100000:2.0:1715330297.915180:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330297.915205:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffae40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.915225:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942484928 00000100:00100000:1.0:1715330297.915233:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942484928 00000100:00100000:1.0:1715330297.915268:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2950 00000100:00100000:1.0:1715330297.915275:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:7148:x1798653942484928:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1715330297.915291:0:24873:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330297.915309:0:24873:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d921d lrc: 2/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d9216 expref: -99 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.915346:0:24873:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d921d lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d9216 expref: 16 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.915360:0:24873:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d921d lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9216 expref: 16 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.915367:0:24873:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff880093b42700) 00010000:00010000:1.0:1715330297.915370:0:24873:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330297.915373:0:24873:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfc6c0, rc 0) 00000100:00100000:1.0:1715330297.915410:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:7148:x1798653942484928:12345-0@lo:101:mdt_io00_002.0 Request processed in 135us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330297.915416:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2950 00000100:00100000:2.0:1715330297.915488:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba65500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942484928:0@lo:101:mdt_io00_002.0 00010000:00010000:2.0:1715330297.915500:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66f40/0xd895711d66d9216 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d921d expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.915509:0:7148:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66f40/0xd895711d66d9216 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d921d expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715330297.915526:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00010000:00010000:2.0:1715330297.915543:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db646c0/0xd895711d66d9224 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.915549:0:7148:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db646c0/0xd895711d66d9224 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.915555:0:7148:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db646c0/0xd895711d66d9224 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7148 initiator: MDT0 00000100:00100000:2.0:1715330297.915564:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba65500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942484992:0@lo:101:mdt_io00_002.0 00000100:00100000:2.0:1715330297.915582:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330297.915604:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffae40 going to sleep for 11 seconds 00000100:00100000:0.0:1715330297.915626:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942484992 00000100:00100000:0.0:1715330297.915631:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942484992 00000100:00100000:0.0:1715330297.915660:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2951 00000100:00100000:0.0:1715330297.915664:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:7148:x1798653942484992:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:0.0:1715330297.915672:0:23404:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330297.915682:0:23404:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a0900/0xd895711d66d922b lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d9224 expref: -99 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.915696:0:23404:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a0900/0xd895711d66d922b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d9224 expref: 17 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.915704:0:23404:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a0900/0xd895711d66d922b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9224 expref: 17 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330297.915710:0:23404:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x30 (ffff88008b2f5f00) 00010000:00010000:0.0:1715330297.915712:0:23404:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330297.915715:0:23404:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a0900, rc 0) 00000100:00100000:0.0:1715330297.915772:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:7148:x1798653942484992:12345-0@lo:101:mdt_io00_002.0 Request processed in 106us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330297.915777:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2951 00000100:00100000:2.0:1715330297.916067:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba65500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942484992:0@lo:101:mdt_io00_002.0 00010000:00010000:2.0:1715330297.916076:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db646c0/0xd895711d66d9224 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d922b expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.916084:0:7148:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db646c0/0xd895711d66d9224 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d922b expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715330297.916093:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00010000:00010000:2.0:1715330297.916108:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9232 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.916115:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9232 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.916121:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9232 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.916129:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d9239 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.916134:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d9239 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.916138:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d9239 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.916170:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d9240 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x151d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.916180:0:7148:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d91fa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x151d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8e6 expref: 28 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.916187:0:7148:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d9240 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x151d:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.916206:0:7148:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d91fa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x151d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8e6 expref: 28 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.916223:0:7148:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d91fa lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x151d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8e6 expref: 28 pid: 7135 timeout: 372 lvb_type: 0 00000100:00100000:2.0:1715330297.916233:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba65500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:7148:1798653942485056:192.168.204.49@tcp:104: 00000100:00100000:2.0:1715330297.916292:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffae40 going to sleep for 11 seconds 00010000:00010000:2.0:1715330297.922439:0:7148:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.204.49@tcp) returned -22 from blocking AST (req@ffff88009ba65500 x1798653942485056) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d91fa lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x151d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8e6 expref: 28 pid: 7135 timeout: 372 lvb_type: 0 00010000:00010000:2.0:1715330297.922458:0:7148:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d91fa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x151d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8e6 expref: 28 pid: 7135 timeout: 372 lvb_type: 0 00010000:00010000:2.0:1715330297.922483:0:7148:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d91fa lrc: 0/0,0 mode: --/PW res: [0x200000402:0x151d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8e6 expref: 28 pid: 7135 timeout: 372 lvb_type: 0 00000100:00100000:2.0:1715330297.922849:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba65500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:7148:1798653942485056:192.168.204.49@tcp:104: 00010000:00010000:2.0:1715330297.922874:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151d:0x0].0x0 (ffff88008d68ef00) 00010000:00010000:2.0:1715330297.922879:0:7148:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d9240 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x151d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.922887:0:7148:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d9240 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x151d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.922893:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d9240 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x151d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.922910:0:7148:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d9240 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x151d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.922918:0:7148:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d9240 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x151d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330297.922923:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d9240 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x151d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00000100:00100000:2.0:1715330297.924158:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba65500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942485120:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330297.924215:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330297.924244:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa780 going to sleep for 11 seconds 00000100:00100000:0.0:1715330297.924308:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942485120 00000100:00100000:0.0:1715330297.924317:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942485120 00000100:00100000:0.0:1715330297.924369:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2952 00000100:00100000:0.0:1715330297.924376:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:7148:x1798653942485120:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1715330297.924993:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:7148:x1798653942485120:12345-0@lo:1000:mdt_io00_002.0 Request processed in 616us (777us total) trans 0 rc -2/-2 00000100:00100000:0.0:1715330297.925002:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2952 00000100:00100000:3.0:1715330297.925118:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba65500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942485120:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.925179:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c0700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942485184:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.925203:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.925216:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63900 going to sleep for 11 seconds 00000100:00100000:0.0:1715330297.925251:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942485184 00000100:00100000:0.0:1715330297.925255:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942485184 00000100:00100000:0.0:1715330297.925279:0:24873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2953 00000100:00100000:0.0:1715330297.925283:0:24873:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:7148:x1798653942485184:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1715330297.925329:0:24873:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:7148:x1798653942485184:12345-0@lo:1000:mdt_io00_002.0 Request processed in 45us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330297.925374:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c0700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942485184:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.925461:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c0700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942485248:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.925479:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.925491:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63900 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.925541:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942485248 00000100:00100000:1.0:1715330297.925545:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942485248 00000100:00100000:1.0:1715330297.925574:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2954 00000100:00100000:1.0:1715330297.925578:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+18:7148:x1798653942485248:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1715330297.925619:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+18:7148:x1798653942485248:12345-0@lo:1000:mdt_io00_002.0 Request processed in 40us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330297.925625:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2954 00000100:00100000:0.0:1715330297.925666:0:24873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2953 00000100:00100000:3.0:1715330297.925752:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c0700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942485248:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.925826:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d57b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942485312:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.925847:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.925867:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63780 going to sleep for 11 seconds 00000100:00100000:2.0:1715330297.925889:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942485312 00000100:00100000:2.0:1715330297.925893:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942485312 00000100:00100000:2.0:1715330297.925911:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2955 00000100:00100000:2.0:1715330297.925916:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7148:x1798653942485312:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330297.925966:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7148:x1798653942485312:12345-0@lo:1000:mdt_io00_002.0 Request processed in 50us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330297.925974:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2955 00000100:00100000:3.0:1715330297.926118:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d57b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942485312:0@lo:1000:mdt_io00_002.0 00000040:00080000:3.0:1715330297.927719:0:7148:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].378, 1264 off569584 00000040:00080000:3.0:1715330297.927796:0:7148:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].377, 1344 off613656 00000100:00100000:3.0:1715330297.927822:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d57b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942485376:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330297.927856:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330297.927868:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091cb5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1715330297.927943:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942485376 00000100:00100000:2.0:1715330297.927948:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942485376 00000100:00100000:2.0:1715330297.927987:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2956 00000100:00100000:2.0:1715330297.927992:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:7148:x1798653942485376:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330297.928081:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:7148:x1798653942485376:12345-0@lo:1000:mdt_io00_002.0 Request processed in 87us (223us total) trans 4294969885 rc 0/0 00000100:00100000:2.0:1715330297.928087:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2956 00000100:00100000:3.0:1715330297.928289:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d57b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942485376:0@lo:1000:mdt_io00_002.0 00000004:00080000:3.0:1715330297.928297:0:7148:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88011db630c0 with version 715 00000004:00080000:0.0:1715330297.928354:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 715 rpc_version 715 00000020:00100000:0.0:1715330297.928377:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1715330297.928383:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880091c3f480 x1798653942485504/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3088/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715330297.928395:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3f480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942485504:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330297.928426:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330297.928449:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009d7e3900 going to sleep for 11 seconds 00000100:00100000:1.0:1715330297.928483:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942485504 00000100:00100000:1.0:1715330297.928488:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942485504 00000100:00100000:1.0:1715330297.928520:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2957 00000100:00100000:1.0:1715330297.928525:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:8587:x1798653942485504:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330297.928807:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+18:8587:x1798653942485504:12345-0@lo:1000:osp_up1-0.0 Request processed in 280us (379us total) trans 4294968430 rc 0/0 00000100:00100000:1.0:1715330297.928814:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2957 00000100:00100000:0.0:1715330297.929282:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091c3f480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942485504:0@lo:1000:osp_up1-0.0 00000004:00010000:3.0:1715330297.929400:0:7148:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007d635880 reply state ffff88012fba5000 transno 4294983527 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d9240 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x151d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.929417:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d9240 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x151d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.929426:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151d:0x0].0x0 (ffff88008d68ef00) 00010000:00010000:3.0:1715330297.929429:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:3.0:1715330297.929433:0:7148:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330297.929440:0:7148:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9232 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.929447:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9232 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.929452:0:7148:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9232 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.929457:0:7148:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9232 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.929462:0:7148:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66ac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330297.929465:0:7148:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9232 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.929471:0:7148:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9232 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.929479:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff8801345c6200) 00010000:00010000:3.0:1715330297.929481:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330297.929484:0:7148:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9232 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.929489:0:7148:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9232 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00000004:00010000:3.0:1715330297.929507:0:7148:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007d635880 reply state ffff88012fba5000 transno 4294983527 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d9239 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.929513:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d9239 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.929517:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x30 (ffff8801345c6c00) 00010000:00010000:3.0:1715330297.929519:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330297.929520:0:7148:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00080000:3.0:1715330297.929524:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00010000:00010000:3.0:1715330297.929531:0:7148:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66f40/0xd895711d66d9216 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d921d expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.929537:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66f40/0xd895711d66d9216 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d921d expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.929542:0:7148:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66f40/0xd895711d66d9216 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d921d expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.929776:0:7148:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1715330297.929782:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xc9:0x0] 00010000:00010000:3.0:1715330297.929787:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db646c0/0xd895711d66d9224 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d922b expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330297.929794:0:7148:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db646c0/0xd895711d66d9224 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d922b expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.929861:0:7123:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715330297.929867:0:7123:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66f40/0xd895711d66d9216 lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d921d expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.929873:0:7123:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66f40 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330297.929877:0:7123:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66f40/0xd895711d66d9216 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d921d expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330297.929884:0:7123:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66f40/0xd895711d66d9216 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d921d expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.929909:0:7123:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66f40/0xd895711d66d9216 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d921d expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.929914:0:7123:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330297.929945:0:7123:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66f40/0xd895711d66d9216 lrc: 1/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d921d expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.929950:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66f40/0xd895711d66d9216 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d921d expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330297.929965:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942485568:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330297.929973:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330297.929974:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330297.929975:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330297.929996:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1715330297.930049:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x18c:0x0] 00010000:00010000:3.0:1715330297.930056:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d920f lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.930061:0:7148:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d920f lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.930066:0:7148:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d920f lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.930070:0:7148:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64fc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330297.930073:0:7148:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d920f lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.930077:0:7148:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d920f lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.930085:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff88008779d400) 00010000:00010000:3.0:1715330297.930088:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330297.930091:0:7148:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d920f lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330297.930096:0:7148:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d920f lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00000100:00100000:1.0:1715330297.930179:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942485568 00000100:00100000:1.0:1715330297.930183:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942485568 00000100:00100000:1.0:1715330297.930221:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1368 00000100:00100000:1.0:1715330297.930226:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ab78b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+18:3691:x1798653942485568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330297.930241:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1715330297.930268:0:7148:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:72de1896-1df4-4b3a-930a-9116d2c66168+29:17739:x1798653938050176:12345-192.168.204.49@tcp:36:lfs.0 Request processed in 19013us (19198us total) trans 4294983527 rc 0/0 00000100:00100000:3.0:1715330297.930275:0:7148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 6 00010000:00010000:1.0:1715330297.930317:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d921d lrc: 0/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d9216 expref: 18 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330297.930328:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff880093b42700) 00010000:00010000:1.0:1715330297.930343:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330297.930376:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ab78b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+17:3691:x1798653942485568:12345-0@lo:103:ldlm_bl.0 Request processed in 149us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330297.930381:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1368 00000100:00100000:2.0:1715330297.930394:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942485568:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330297.939042:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330297.939207:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938050304 00000100:00100000:1.0:1715330297.939216:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938050304 00000100:00100000:1.0:1715330297.939383:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5072 00000100:00100000:1.0:1715330297.939391:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+6:17739:x1798653938050304:12345-192.168.204.49@tcp:35:lfs.0 00000100:00100000:1.0:1715330297.939590:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+7:17739:x1798653938050304:12345-192.168.204.49@tcp:35:lfs.0 Request processed in 199us (560us total) trans 4294968431 rc 0/0 00000100:00100000:1.0:1715330297.939597:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5072 00000100:00100000:0.0:1715330297.952785:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330297.953016:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938050432 00000100:00100000:2.0:1715330297.953026:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938050432 00000100:00100000:2.0:1715330297.953082:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23491 00000100:00100000:2.0:1715330297.953090:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+29:17740:x1798653938050432:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:2.0:1715330297.953117:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330297.954209:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d9247 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb8ed expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.954294:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d924e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.954307:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d924e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.954317:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d924e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.954346:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d9255 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6088611d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.954353:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d9255 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.954358:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d9255 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.954419:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d925c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x18c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.954426:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d925c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.954431:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d925c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.954443:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d924e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.954448:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d924e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.954453:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d924e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.954458:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d924e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.954463:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66ac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330297.954467:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d924e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.954477:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d924e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.954486:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:2.0:1715330297.954488:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330297.954492:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d924e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.954497:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d924e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.954534:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d9255 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.954540:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d9255 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.954545:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d9255 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.954549:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66f40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330297.954551:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d9255 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.954555:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d9255 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.954560:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6088611d (ffff8801345c6900) 00010000:00010000:2.0:1715330297.954562:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330297.954564:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d9255 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.954568:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d9255 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330297.954595:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d9247 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8ed expref: 31 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.954607:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d925c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x18c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8ed expref: 30 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.954613:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18c:0x0].0x0 (ffff88009ef25d00) 00010000:00010000:2.0:1715330297.954615:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1715330297.954618:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db67a80, rc 0) 00000100:00100000:2.0:1715330297.954685:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+30:17740:x1798653938050432:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 1595us (1952us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330297.954693:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23491 00000100:00100000:0.0:1715330297.959656:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330297.959706:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330297.960065:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938050624 00000100:00100000:1.0:1715330297.960075:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938050624 00000100:00100000:1.0:1715330297.960143:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1369 00000100:00100000:1.0:1715330297.960151:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72de1896-1df4-4b3a-930a-9116d2c66168+30:2013:x1798653938050624:12345-192.168.204.49@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1715330297.960158:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938050560 00000100:00100000:2.0:1715330297.960163:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938050560 00010000:00010000:1.0:1715330297.960166:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330297.960191:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d925c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x18c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8ed expref: 30 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330297.960199:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23492 00000100:00100000:2.0:1715330297.960204:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+7:17740:x1798653938050560:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:1.0:1715330297.960214:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18c:0x0].0x0 (ffff88009ef25d00) 00010000:00010000:1.0:1715330297.960219:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330297.960223:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330297.960239:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65b00/0xd895711d66d9263 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x18c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb8f4 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330297.960265:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72de1896-1df4-4b3a-930a-9116d2c66168+29:2013:x1798653938050624:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 114us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330297.960272:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1369 00000004:00200000:2.0:1715330297.960423:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x18c:0x0]: returning size 4096 00010000:00010000:2.0:1715330297.960501:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65b00/0xd895711d66d9263 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x18c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8f4 expref: 9 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.960509:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65b00/0xd895711d66d9263 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x18c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8f4 expref: 9 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.960541:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db65b00, rc 0) 00000100:00100000:2.0:1715330297.960564:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+8:17740:x1798653938050560:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 360us (858us total) trans 4294968432 rc 301/301 00000100:00100000:2.0:1715330297.960573:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23492 00000100:00100000:0.0:1715330297.966459:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330297.966563:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938050688 00000100:00100000:1.0:1715330297.966574:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938050688 00000100:00100000:1.0:1715330297.966638:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5073 00000100:00100000:1.0:1715330297.966646:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+8:17740:x1798653938050688:12345-192.168.204.49@tcp:33:lfs.0 00000004:00200000:1.0:1715330297.966830:0:7137:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x18c:0x0]: returning size 4096 00000004:00200000:1.0:1715330297.966834:0:7137:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00000100:00100000:1.0:1715330297.966903:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+8:17740:x1798653938050688:12345-192.168.204.49@tcp:33:lfs.0 Request processed in 257us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330297.966910:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5073 00000100:00100000:0.0:1715330297.971924:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330297.971989:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938050816 00000100:00100000:3.0:1715330297.971999:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938050816 00000100:00100000:3.0:1715330297.972060:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5074 00000100:00100000:3.0:1715330297.972068:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+8:17740:x1798653938050816:12345-192.168.204.49@tcp:35:lfs.0 00000100:00100000:3.0:1715330297.973465:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+9:17740:x1798653938050816:12345-192.168.204.49@tcp:35:lfs.0 Request processed in 1391us (1544us total) trans 4294968433 rc 0/0 00000100:00100000:3.0:1715330297.973475:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5074 00000100:00100000:0.0:1715330297.977634:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330297.977696:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938050880 00000100:00100000:2.0:1715330297.977708:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938050880 00000100:00100000:2.0:1715330297.977796:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23493 00000100:00100000:2.0:1715330297.977805:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+9:17567:x1798653938050880:12345-192.168.204.49@tcp:101:bash.0 00010000:00010000:2.0:1715330297.977830:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330297.977857:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67a80/0xd895711d66d9271 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb8fb expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.977923:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67180/0xd895711d66d9278 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x18c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.977935:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67180/0xd895711d66d9278 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330297.977945:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67180/0xd895711d66d9278 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00000004:00200000:2.0:1715330297.978027:0:25569:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x18c:0x0]: returning size 4096 00000004:00200000:2.0:1715330297.978030:0:25569:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00000004:00010000:2.0:1715330297.978046:0:25569:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67180/0xd895711d66d9278 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330297.978061:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67a80/0xd895711d66d9271 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8fb expref: 11 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.978595:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67180/0xd895711d66d9278 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x18c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8fb expref: 10 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.978603:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18c:0x0].0x0 (ffff8801345c6d00) 00010000:00010000:2.0:1715330297.978607:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1715330297.978610:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db67180, rc 0) 00000100:00100000:2.0:1715330297.978717:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+10:17567:x1798653938050880:12345-192.168.204.49@tcp:101:bash.0 Request processed in 911us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330297.978726:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23493 00000100:00100000:0.0:1715330297.982438:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330297.982531:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938050944 00000100:00100000:2.0:1715330297.982541:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938050944 00000100:00100000:2.0:1715330297.982584:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23494 00000100:00100000:2.0:1715330297.982593:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+10:17567:x1798653938050944:12345-192.168.204.49@tcp:101:bash.0 00010000:00010000:2.0:1715330297.982618:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330297.982643:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65200/0xd895711d66d927f lrc: 2/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb902 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.982704:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67cc0/0xd895711d66d9286 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.982717:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67cc0/0xd895711d66d9286 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330297.982756:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67cc0/0xd895711d66d9286 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00000004:00200000:2.0:1715330297.982839:0:25569:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000400:0xc9:0x0]: returning size 4096 00000004:00200000:2.0:1715330297.982844:0:25569:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:2.0:1715330297.982878:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65200/0xd895711d66d927f lrc: 0/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb902 expref: 12 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.982896:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67cc0/0xd895711d66d9286 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb902 expref: 11 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.982904:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff8801345c6400) 00010000:00010000:2.0:1715330297.982907:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1715330297.982910:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db67cc0, rc 0) 00000100:00100000:2.0:1715330297.982954:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+11:17567:x1798653938050944:12345-192.168.204.49@tcp:101:bash.0 Request processed in 362us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330297.982960:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23494 00000100:00100000:0.0:1715330297.988285:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330297.988423:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938051008 00000100:00100000:2.0:1715330297.988434:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938051008 00000100:00100000:2.0:1715330297.988598:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23495 00000100:00100000:2.0:1715330297.988606:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+29:17567:x1798653938051008:12345-192.168.204.49@tcp:101:bash.0 00010000:00010000:2.0:1715330297.988622:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330297.988641:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d928d lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb909 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.988691:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d9294 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.988702:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d9294 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.988709:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d9294 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00000004:00200000:2.0:1715330297.988774:0:25569:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0xcc:0x0]: returning size 4096 00000004:00200000:2.0:1715330297.988779:0:25569:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:2.0:1715330297.988811:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d928d lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb909 expref: 31 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.988828:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d9294 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb909 expref: 30 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.988835:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff8801345c6700) 00010000:00010000:2.0:1715330297.988838:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1715330297.988841:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db64240, rc 0) 00000100:00100000:2.0:1715330297.989173:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+30:17567:x1798653938051008:12345-192.168.204.49@tcp:101:bash.0 Request processed in 567us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330297.989178:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23495 00000100:00100000:0.0:1715330297.995858:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330297.996017:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938051136 00000100:00100000:2.0:1715330297.996025:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938051136 00000100:00100000:2.0:1715330297.996061:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23496 00000100:00100000:2.0:1715330297.996067:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+11:17567:x1798653938051136:12345-192.168.204.49@tcp:101:bash.0 00010000:00010000:2.0:1715330297.996084:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330297.996101:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67a80/0xd895711d66d929b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb910 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.996262:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65200/0xd895711d66d92a2 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x18c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330297.996273:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65200/0xd895711d66d92a2 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x18c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330297.996281:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65200/0xd895711d66d92a2 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x18c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00000004:00200000:2.0:1715330297.996293:0:25569:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x18c:0x0]: returning size 4096 00010000:00010000:2.0:1715330297.996373:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67a80/0xd895711d66d929b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb910 expref: 14 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.996387:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65200/0xd895711d66d92a2 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x18c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb910 expref: 13 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330297.996393:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18c:0x0].0x0 (ffff8801345c6d00) 00010000:00010000:2.0:1715330297.996395:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1715330297.996398:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db65200, rc 0) 00000100:00100000:2.0:1715330297.996997:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+13:17567:x1798653938051136:12345-192.168.204.49@tcp:101:bash.0 Request processed in 928us (1145us total) trans 4294968434 rc 0/0 00000100:00100000:2.0:1715330297.997003:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23496 00000100:00100000:2.0:1715330298.003062:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942485632:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1715330298.003115:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330298.005406:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942485632 00000100:00100000:1.0:1715330298.005415:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942485632 00000100:00100000:1.0:1715330298.006087:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2958 00000100:00100000:1.0:1715330298.006094:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+16:3688:x1798653942485632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1715330298.006131:0:9407:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444052992 avail 1314590720 00000100:00100000:1.0:1715330298.006204:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+16:3688:x1798653942485632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (3088us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330298.006210:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2958 00000100:00100000:3.0:1715330298.006324:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942485632:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1715330298.006603:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330298.006698:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938051200 00000100:00100000:3.0:1715330298.006702:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938051200 00000100:00100000:3.0:1715330298.007261:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5075 00000100:00100000:3.0:1715330298.007267:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+13:17567:x1798653938051200:12345-192.168.204.49@tcp:37:bash.0 00000100:00100000:3.0:1715330298.013420:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+13:17567:x1798653938051200:12345-192.168.204.49@tcp:37:bash.0 Request processed in 6145us (6811us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330298.013433:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5075 00000100:00100000:0.0:1715330298.018559:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330298.018673:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938051264 00000100:00100000:3.0:1715330298.018682:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938051264 00000100:00100000:3.0:1715330298.018723:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5076 00000100:00100000:3.0:1715330298.018835:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ef0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+30:17567:x1798653938051264:12345-192.168.204.49@tcp:37:bash.0 00000100:00100000:3.0:1715330298.025215:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ef0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+30:17567:x1798653938051264:12345-192.168.204.49@tcp:37:bash.0 Request processed in 6475us (6655us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330298.025227:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5076 00000100:00100000:0.0:1715330298.035178:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330298.036394:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938051328 00000100:00100000:2.0:1715330298.036403:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938051328 00000100:00100000:2.0:1715330298.036442:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23497 00000100:00100000:2.0:1715330298.036449:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+30:17742:x1798653938051328:12345-192.168.204.49@tcp:101:cmp.0 00010000:00010000:2.0:1715330298.036465:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330298.036482:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d92b0 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb917 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330298.036534:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d92b7 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330298.036545:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d92b7 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330298.036555:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d92b7 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330298.036566:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d92be lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x736c74 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330298.036571:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d92be lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x736c74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330298.036575:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d92be lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x736c74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330298.036606:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d92b7 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330298.036611:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d92b7 lrc: 2/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330298.036616:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d92b7 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330298.036620:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db67840 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330298.036623:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d92b7 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330298.036628:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d92b7 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330298.036636:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff8801345c6700) 00010000:00010000:2.0:1715330298.036639:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330298.036641:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d92b7 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330298.036645:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d92b7 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330298.036675:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d92be lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x736c74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330298.036680:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d92be lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x736c74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330298.036684:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d92be lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x736c74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330298.036687:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db67600 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330298.036690:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d92be lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x736c74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330298.036694:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d92be lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x736c74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330298.036700:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x736c74 (ffff8801345c6900) 00010000:00010000:2.0:1715330298.036702:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330298.036704:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d92be lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x736c74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330298.036708:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d92be lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x736c74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330298.036756:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d92b0 lrc: 1/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb917 expref: 31 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330298.036763:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d92b0 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb917 expref: 31 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330298.036771:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db64000, rc 0) 00000100:00100000:2.0:1715330298.036822:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+30:17742:x1798653938051328:12345-192.168.204.49@tcp:101:cmp.0 Request processed in 373us (1651us total) trans 0 rc 301/301 00000100:00100000:2.0:1715330298.036829:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23497 00000100:00100000:0.0:1715330298.041779:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330298.042280:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938051392 00000100:00100000:1.0:1715330298.042288:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938051392 00000100:00100000:1.0:1715330298.042340:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23498 00000100:00100000:1.0:1715330298.042346:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+13:17742:x1798653938051392:12345-192.168.204.49@tcp:101:cmp.0 00010000:00010000:1.0:1715330298.042361:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330298.042377:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d92c5 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb91e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330298.042421:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d92cc lrc: 3/1,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330298.042430:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d92cc lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330298.042438:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d92cc lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330298.042447:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfef40/0xd895711d66d92d3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x736c74 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330298.042451:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfef40/0xd895711d66d92d3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x736c74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330298.042455:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfef40/0xd895711d66d92d3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x736c74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330298.042485:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d92cc lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330298.042489:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d92cc lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330298.042492:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d92cc lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330298.042497:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d92cc lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330298.042501:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfdb00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330298.042504:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d92cc lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330298.042509:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d92cc lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330298.042517:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff8801345c6400) 00010000:00010000:1.0:1715330298.042519:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330298.042521:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d92cc lrc: 3/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330298.042525:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d92cc lrc: 0/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330298.042545:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfef40/0xd895711d66d92d3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x736c74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330298.042549:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfef40/0xd895711d66d92d3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x736c74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330298.042553:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfef40/0xd895711d66d92d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x736c74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330298.042556:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfef40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330298.042558:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfef40/0xd895711d66d92d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x736c74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330298.042562:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfef40/0xd895711d66d92d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x736c74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330298.042566:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x736c74 (ffff880093b42700) 00010000:00010000:1.0:1715330298.042567:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330298.042569:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfef40/0xd895711d66d92d3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x736c74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330298.042573:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfef40/0xd895711d66d92d3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x736c74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330298.042593:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d92c5 lrc: 1/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb91e expref: 14 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330298.042599:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d92c5 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb91e expref: 14 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330298.042605:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bff3c0, rc 0) 00000100:00100000:1.0:1715330298.042646:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+13:17742:x1798653938051392:12345-192.168.204.49@tcp:101:cmp.0 Request processed in 300us (873us total) trans 0 rc 301/301 00000100:00100000:1.0:1715330298.042651:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23498 00000100:00100000:0.0:1715330298.046482:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330298.046631:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938051456 00000100:00100000:1.0:1715330298.046639:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938051456 00000100:00100000:1.0:1715330298.047216:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23499 00000100:00100000:1.0:1715330298.047223:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+30:17742:x1798653938051456:12345-192.168.204.49@tcp:101:cmp.0 00010000:00010000:1.0:1715330298.047238:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330298.047253:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d92da lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb925 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330298.047299:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d92e1 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330298.047308:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d92e1 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330298.047316:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d92e1 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330298.047325:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d92e8 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x5f366cae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330298.047347:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d92e8 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x5f366cae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330298.047352:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d92e8 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x5f366cae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330298.047385:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d92e1 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330298.047389:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d92e1 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330298.047394:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d92e1 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330298.047399:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d92e1 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330298.047403:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfdd40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330298.047406:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d92e1 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330298.047412:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d92e1 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330298.047420:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff8801345c6700) 00010000:00010000:1.0:1715330298.047422:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330298.047425:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d92e1 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330298.047429:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66d92e1 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330298.047439:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d92e8 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x5f366cae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330298.047444:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d92e8 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x5f366cae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330298.047448:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d92e8 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x5f366cae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330298.047452:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfcfc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330298.047454:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d92e8 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x5f366cae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330298.047458:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d92e8 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x5f366cae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330298.047463:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x5f366cae (ffff880093b42a00) 00010000:00010000:1.0:1715330298.047464:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330298.047466:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d92e8 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x5f366cae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330298.047470:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66d92e8 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x5f366cae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330298.047489:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d92da lrc: 1/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb925 expref: 31 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330298.047496:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66d92da lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb925 expref: 31 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330298.047501:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfc480, rc 0) 00000100:00100000:1.0:1715330298.047541:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+30:17742:x1798653938051456:12345-192.168.204.49@tcp:101:cmp.0 Request processed in 318us (1065us total) trans 0 rc 301/301 00000100:00100000:1.0:1715330298.047546:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23499 00000100:00100000:0.0:1715330298.050315:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330298.050728:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938051520 00000100:00100000:2.0:1715330298.050770:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938051520 00000100:00100000:2.0:1715330298.051113:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23500 00000100:00100000:2.0:1715330298.051120:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+13:17742:x1798653938051520:12345-192.168.204.49@tcp:101:cmp.0 00010000:00010000:2.0:1715330298.051137:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330298.051152:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64b40/0xd895711d66d92ef lrc: 2/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb92c expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330298.051197:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66400/0xd895711d66d92f6 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330298.051206:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66400/0xd895711d66d92f6 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330298.051214:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66400/0xd895711d66d92f6 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330298.051224:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db673c0/0xd895711d66d92fd lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x5f366cae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330298.051229:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db673c0/0xd895711d66d92fd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x5f366cae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330298.051234:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db673c0/0xd895711d66d92fd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x5f366cae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330298.051265:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66400/0xd895711d66d92f6 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330298.051269:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66400/0xd895711d66d92f6 lrc: 2/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330298.051274:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66400/0xd895711d66d92f6 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330298.051279:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66400 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330298.051281:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66400/0xd895711d66d92f6 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330298.051286:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66400/0xd895711d66d92f6 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330298.051292:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff8801345c6400) 00010000:00010000:2.0:1715330298.051294:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330298.051296:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66400/0xd895711d66d92f6 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330298.051300:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66400/0xd895711d66d92f6 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330298.051893:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db673c0/0xd895711d66d92fd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x5f366cae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330298.051899:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db673c0/0xd895711d66d92fd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x5f366cae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330298.051903:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011db673c0/0xd895711d66d92fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x5f366cae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330298.051907:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db673c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330298.051909:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db673c0/0xd895711d66d92fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x5f366cae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330298.051914:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db673c0/0xd895711d66d92fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x5f366cae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330298.051924:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x5f366cae (ffff8801345c6200) 00010000:00010000:2.0:1715330298.051926:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330298.051928:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011db673c0/0xd895711d66d92fd lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x5f366cae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330298.051932:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db673c0/0xd895711d66d92fd lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x5f366cae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330298.051963:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64b40/0xd895711d66d92ef lrc: 1/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb92c expref: 14 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330298.051970:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64b40/0xd895711d66d92ef lrc: 0/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb92c expref: 14 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330298.051978:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db64b40, rc 0) 00000100:00100000:2.0:1715330298.052047:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+13:17742:x1798653938051520:12345-192.168.204.49@tcp:101:cmp.0 Request processed in 926us (1736us total) trans 0 rc 301/301 00000100:00100000:2.0:1715330298.052054:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23500 00000100:00100000:0.0:1715330298.059843:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330298.060027:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938051648 00000100:00100000:2.0:1715330298.060036:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938051648 00000100:00100000:2.0:1715330298.060091:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23501 00000100:00100000:2.0:1715330298.060098:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+30:17742:x1798653938051648:12345-192.168.204.49@tcp:101:cmp.0 00010000:00010000:2.0:1715330298.060119:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330298.060140:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d9304 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb933 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330298.060215:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d930b lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330298.060231:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d930b lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330298.060240:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d930b lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330298.060249:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d9312 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x30 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330298.060254:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d9312 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330298.060259:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d9312 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330298.060285:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d930b lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330298.060290:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d930b lrc: 2/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330298.060295:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d930b lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330298.060301:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64b40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330298.060305:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d930b lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330298.060311:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d930b lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330298.060319:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff8801345c6700) 00010000:00010000:2.0:1715330298.060322:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330298.060325:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d930b lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330298.060341:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d930b lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330298.060364:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d9312 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330298.060370:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d9312 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330298.060375:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d9312 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330298.060378:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db673c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330298.060380:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d9312 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330298.060385:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d9312 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330298.060390:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x30 (ffff8801345c6c00) 00010000:00010000:2.0:1715330298.060391:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330298.060393:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d9312 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330298.060397:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d9312 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330298.060418:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d9304 lrc: 1/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb933 expref: 31 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330298.060425:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d9304 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb933 expref: 31 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330298.060437:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db64480, rc 0) 00000100:00100000:2.0:1715330298.060487:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+30:17742:x1798653938051648:12345-192.168.204.49@tcp:101:cmp.0 Request processed in 389us (655us total) trans 0 rc 301/301 00000100:00100000:2.0:1715330298.060494:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23501 00000100:00100000:0.0:1715330298.065860:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330298.066242:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938051776 00000100:00100000:1.0:1715330298.066250:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938051776 00000100:00100000:1.0:1715330298.066301:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23502 00000100:00100000:1.0:1715330298.066308:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+13:17742:x1798653938051776:12345-192.168.204.49@tcp:101:cmp.0 00010000:00010000:1.0:1715330298.066339:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330298.066377:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc480/0xd895711d66d9319 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb93a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330298.066448:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d9320 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330298.066460:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d9320 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330298.066470:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d9320 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330298.066479:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d9327 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x30 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330298.066487:0:7135:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a0900/0xd895711d66d922b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9224 expref: 16 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330298.066494:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d9327 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330298.066523:0:7135:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a0900/0xd895711d66d922b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd895711d66d9224 expref: 16 pid: 23404 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330298.066536:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7135:1798653942485696:0@lo:104: 00000100:00100000:1.0:1715330298.066579:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330298.067242:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4b2f000 going to sleep for 11 seconds 00000100:00100000:0.0:1715330298.067354:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942485696 00000100:00100000:0.0:1715330298.067359:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942485696 00000100:00100000:0.0:1715330298.067449:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1171 00000100:00100000:0.0:1715330298.067455:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7135:x1798653942485696:12345-0@lo:104: 00010000:00010000:0.0:1715330298.067466:0:7118:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db646c0/0xd895711d66d9224 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d922b expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330298.067804:0:7118:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1715330298.067810:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7135:x1798653942485696:12345-0@lo:104: Request processed in 354us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330298.067816:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1171 00000100:00100000:1.0:1715330298.067885:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7135:1798653942485696:0@lo:104: 00010000:00010000:1.0:1715330298.067903:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d9327 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330298.067958:0:9415:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1715330298.067966:0:9415:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db646c0/0xd895711d66d9224 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d922b expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330298.067974:0:9415:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db646c0 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:2.0:1715330298.067978:0:9415:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db646c0/0xd895711d66d9224 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x30 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd895711d66d922b expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1715330298.067986:0:9415:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db646c0/0xd895711d66d9224 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x30 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd895711d66d922b expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330298.068012:0:9415:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db646c0/0xd895711d66d9224 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x30 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d922b expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330298.068017:0:9415:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1715330298.068047:0:9415:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db646c0/0xd895711d66d9224 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x30 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d922b expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330298.068054:0:9415:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db646c0/0xd895711d66d9224 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x30 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d922b expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330298.068083:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330298.068084:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330298.068085:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330298.068123:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942485760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1715330298.068154:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330298.068375:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942485760 00000100:00100000:2.0:1715330298.068378:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942485760 00010000:00010000:2.0:1715330298.068395:0:9416:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a0900/0xd895711d66d922b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd895711d66d9224 expref: 17 pid: 23404 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330298.068469:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1551 00000100:00100000:2.0:1715330298.068474:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+17:3689:x1798653942485760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715330298.068482:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1715330298.069643:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968434 is committed 00000001:00080000:0.0:1715330298.069657:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968430 is committed 00000020:00080000:0.0:1715330298.069672:0:8267:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0001: 389 batchid updated 00010000:00010000:3.0:1715330298.070049:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a0900/0xd895711d66d922b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x30 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd895711d66d9224 expref: 11 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330298.070067:0:9416:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x30 (ffff88008b2f5f00) 00010000:00010000:3.0:1715330298.070072:0:9416:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d9327 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330298.070079:0:9416:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d9327 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330298.070086:0:9416:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d9327 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT1 00000020:00080000:2.0:1715330298.070264:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 389 00000004:00080000:2.0:1715330298.070313:0:8285:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff880091ffae40 with version 747 00000020:00080000:2.0:1715330298.070321:0:8285:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 389 cancel update log [0x200000401:0x3:0x0].390: rc = 0 00000020:00080000:2.0:1715330298.070386:0:8285:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 389 cancel update log [0x240000400:0x3:0x0].388: rc = 0 00000020:00080000:2.0:1715330298.070392:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 389 00000004:00080000:2.0:1715330298.070399:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 747 rpc_version 747 00000020:00100000:2.0:1715330298.070426:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1715330298.070431:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88009ba65880 x1798653942485888/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1715330298.070448:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba65880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942485888:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1715330298.070495:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330298.070510:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa240 going to sleep for 11 seconds 00000100:00100000:2.0:1715330298.070528:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942485888 00000100:00100000:2.0:1715330298.070532:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942485888 00010000:00010000:3.0:1715330298.070572:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715330298.070605:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+10:3689:x1798653942485760:12345-0@lo:103:ldlm_bl.0 Request processed in 2130us (2449us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330298.070613:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1551 00000100:00100000:3.0:1715330298.070652:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942485760:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330298.070705:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d9327 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330298.070713:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d9327 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330298.070803:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d932e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x192:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330298.070811:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d932e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x192:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330298.070817:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d932e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x192:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000004:00200000:1.0:1715330298.070826:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x192:0x0]: returning size 2 00010000:00010000:1.0:1715330298.070873:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d9320 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330298.070879:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d9320 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330298.070884:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d9320 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330298.070889:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d9320 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330298.070894:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfcfc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330298.070898:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d9320 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330298.070907:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d9320 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330298.070915:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff8801345c6400) 00010000:00010000:1.0:1715330298.070917:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330298.070919:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d9320 lrc: 3/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330298.070924:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d9320 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330298.070937:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d9327 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330298.070941:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d9327 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330298.070946:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d9327 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330298.070950:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfdd40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330298.070952:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d9327 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330298.070957:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d9327 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330298.070962:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x30 (ffff88008b2f5f00) 00010000:00010000:1.0:1715330298.070964:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330298.070966:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d9327 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330298.070970:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d9327 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330298.071018:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc480/0xd895711d66d9319 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb93a expref: 12 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330298.071029:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d932e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x192:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb93a expref: 11 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330298.071035:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x192:0x0].0x0 (ffff880093b42c00) 00010000:00010000:1.0:1715330298.071037:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715330298.071039:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bff3c0, rc 0) 00000100:00100000:1.0:1715330298.071090:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+11:17742:x1798653938051776:12345-192.168.204.49@tcp:101:cmp.0 Request processed in 4782us (5239us total) trans 4294968435 rc 0/0 00000100:00100000:1.0:1715330298.071096:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23502 00000100:00100000:2.0:1715330298.071589:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2959 00000100:00100000:2.0:1715330298.071595:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+16:8278:x1798653942485888:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1715330298.072142:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+17:8278:x1798653942485888:12345-0@lo:1000:osp_up0-1.0 Request processed in 546us (1645us total) trans 4294983528 rc 0/0 00000100:00100000:2.0:1715330298.072149:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2959 00000100:00100000:3.0:1715330298.072460:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba65880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942485888:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330298.074658:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330298.074783:0:17200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938051840 00000100:00100000:2.0:1715330298.074790:0:17200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938051840 00000100:00100000:2.0:1715330298.074827:0:17200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5199 00000100:00100000:2.0:1715330298.074833:0:17200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:72de1896-1df4-4b3a-930a-9116d2c66168+13:2013:x1798653938051840:12345-192.168.204.49@tcp:101:cmp.0 00010000:00010000:2.0:1715330298.074850:0:17200:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330298.074870:0:17200:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011db66400/0xd895711d66d933c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb941 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1715330298.074894:0:17200:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9c8:0x0] initial LVB size: 2, mtime: 0x663ddcf9, atime: 0x0, ctime: 0x663ddcf9, blocks: 0x8 00010000:00010000:2.0:1715330298.074912:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330298.074914:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330298.074923:0:17200:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db66400/0xd895711d66d933c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb941 expref: 14 pid: 17200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1715330298.074937:0:17200:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011db66400/0xd895711d66d933c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb941 expref: 14 pid: 17200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1715330298.074947:0:17200:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db66400, rc 0) 00000100:00100000:2.0:1715330298.075040:0:17200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:72de1896-1df4-4b3a-930a-9116d2c66168+14:2013:x1798653938051840:12345-192.168.204.49@tcp:101:cmp.0 Request processed in 207us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330298.075046:0:17200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5199 00000100:00100000:0.0:1715330298.095153:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330298.095217:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330298.095283:0:7130:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938051904 00000100:00100000:1.0:1715330298.095294:0:7130:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938051904 00000100:00100000:1.0:1715330298.095375:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 333 00000100:00100000:1.0:1715330298.095383:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2014:x1798653938051904:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:1.0:1715330298.095448:0:7130:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2014:x1798653938051904:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 65us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330298.095454:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 333 00000100:00100000:2.0:1715330298.095616:0:17200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938051968 00000100:00100000:2.0:1715330298.095621:0:17200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938051968 00000100:00100000:2.0:1715330298.095660:0:17200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 184 00000100:00100000:2.0:1715330298.095665:0:17200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:72de1896-1df4-4b3a-930a-9116d2c66168+14:2010:x1798653938051968:12345-192.168.204.49@tcp:8:kworker.0 00010000:02000400:2.0:1715330298.095694:0:17200:0:(ldlm_lib.c:898:target_handle_reconnect()) lustre-OST0000: Client 72de1896-1df4-4b3a-930a-9116d2c66168 (at 192.168.204.49@tcp) reconnecting 00000100:00080000:0.0:1715330298.095775:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330268 00010000:00080000:2.0:1715330298.099134:0:17200:0:(ldlm_lib.c:1360:target_handle_connect()) lustre-OST0000: connection from 72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp t4294969880 exp ffff88009d624800 cur 272 last 1715330297 00002000:00100000:2.0:1715330298.099154:0:17200:0:(ofd_obd.c:151:ofd_parse_connect_data()) lustre-OST0000: cli 72de1896-1df4-4b3a-930a-9116d2c66168/ffff88009d624800 ocd_connect_flags: 0xa0465af2e3640078 ocd_version: 20f3f03 ocd_grant: 8388608 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1715330298.099167:0:17200:0:(ofd_obd.c:250:ofd_parse_connect_data()) lustre-OST0000: cli 192.168.204.49@tcp supports cksum type f7, return f7 00000100:00080000:2.0:1715330298.099191:0:17200:0:(import.c:86:import_set_state_nolock()) ffff88009d627000 ÿÿÿÿ: changing import state from FULL to RECOVER 00000100:00080000:2.0:1715330298.099201:0:17200:0:(import.c:86:import_set_state_nolock()) ffff88009d627000 ÿÿÿÿ: changing import state from RECOVER to FULL 00000100:00100000:2.0:1715330298.099279:0:17200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:72de1896-1df4-4b3a-930a-9116d2c66168+14:2010:x1798653938051968:12345-192.168.204.49@tcp:8:kworker.0 Request processed in 3613us (4137us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330298.099291:0:17200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 184 00010000:00010000:2.0:1715330298.171239:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330299.101822:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330299.101902:0:17200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938051840 00000100:00100000:2.0:1715330299.101912:0:17200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938051840 00000100:00100000:2.0:1715330299.101986:0:17200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5200 00000100:00100000:2.0:1715330299.101993:0:17200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:72de1896-1df4-4b3a-930a-9116d2c66168+14:2013:x1798653938051840:12345-192.168.204.49@tcp:101:cmp.0 00010000:00010000:2.0:1715330299.102013:0:17200:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1715330299.102014:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330269 00010000:00010000:2.0:1715330299.102028:0:17200:0:(ldlm_lockd.c:1365:ldlm_handle_enqueue()) @@@ found existing lock cookie 0xd895711d66d933c req@ffff8801344c8a80 x1798653938051840/t0(0) o101->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:510/0 lens 328/0 e 0 to 0 dl 1715330310 ref 1 fl Interpret:/202/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00010000:00010000:2.0:1715330299.102059:0:17200:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011db66400/0xd895711d66d933c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb941 expref: 14 pid: 17200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1715330299.102079:0:17200:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db66400, rc 0) 00000100:00100000:2.0:1715330299.102139:0:17200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:72de1896-1df4-4b3a-930a-9116d2c66168+14:2013:x1798653938051840:12345-192.168.204.49@tcp:101:cmp.0 Request processed in 146us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330299.102146:0:17200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5200 00000100:00100000:0.0:1715330299.109342:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330299.109456:0:9404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938052160 00000100:00100000:2.0:1715330299.109466:0:9404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938052160 00002000:00100000:2.0:1715330299.109510:0:9404:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9c8:0x0] (0->4095) req@ffff8801344c9180 x1798653938052160/t0(0) o3->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:510/0 lens 488/0 e 0 to 0 dl 1715330310 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1715330299.109526:0:9404:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801344c9180 with x1798653938052160 ext(0->4095) 00002000:00010000:2.0:1715330299.109532:0:9404:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801344c9180 00000100:00100000:2.0:1715330299.109568:0:9404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 2 00000100:00100000:2.0:1715330299.109576:0:9404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:72de1896-1df4-4b3a-930a-9116d2c66168+14:2012:x1798653938052160:12345-192.168.204.49@tcp:3:cmp.0 00000100:00100000:2.0:1715330299.109782:0:9404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:72de1896-1df4-4b3a-930a-9116d2c66168+14:2012:x1798653938052160:12345-192.168.204.49@tcp:3:cmp.0 Request processed in 205us (450us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1715330299.109790:0:9404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 2 00002000:00100000:2.0:1715330299.109796:0:9404:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9c8:0x0] (0->4095) req@ffff8801344c9180 x1798653938052160/t0(0) o3->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:510/0 lens 488/4536 e 0 to 0 dl 1715330310 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1715330299.109802:0:9404:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801344c9180 with x1798653938052160 ext(0->4095) 00002000:00010000:2.0:1715330299.109805:0:9404:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801344c9180 00000100:00100000:0.0:1715330299.117969:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330299.119561:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938052288 00000100:00100000:3.0:1715330299.119574:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938052288 00000100:00100000:3.0:1715330299.119650:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5077 00000100:00100000:3.0:1715330299.119657:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+11:17742:x1798653938052288:12345-192.168.204.49@tcp:35:cmp.0 00000100:00080000:0.0:1715330299.119876:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330269 00000100:00100000:3.0:1715330299.120164:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+12:17742:x1798653938052288:12345-192.168.204.49@tcp:35:cmp.0 Request processed in 505us (2204us total) trans 4294968436 rc 0/0 00000100:00100000:3.0:1715330299.120172:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5077 00000100:00100000:0.0:1715330299.133212:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330299.134190:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938052416 00000100:00100000:1.0:1715330299.134202:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938052416 00000100:00080000:0.0:1715330299.134307:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330269 00000100:00100000:1.0:1715330299.134367:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23503 00000100:00100000:1.0:1715330299.134374:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+30:17745:x1798653938052416:12345-192.168.204.49@tcp:101:cmp.0 00010000:00010000:1.0:1715330299.134397:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330299.134553:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d9343 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb948 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.134747:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d934a lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330299.134760:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d934a lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330299.134771:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d934a lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330299.134779:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66d9351 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x31 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330299.134784:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66d9351 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330299.134788:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66d9351 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330299.134818:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d934a lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330299.134823:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d934a lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330299.134827:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d934a lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330299.134832:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d934a lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330299.134836:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfdb00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330299.134839:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d934a lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330299.134848:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d934a lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330299.134857:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff8801345c6700) 00010000:00010000:1.0:1715330299.134859:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330299.134863:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d934a lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330299.134868:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d934a lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330299.134986:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66d9351 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330299.134991:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66d9351 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330299.134995:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66d9351 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330299.134999:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfc6c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330299.135000:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66d9351 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330299.135004:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66d9351 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330299.135009:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x31 (ffff88008b233e00) 00010000:00010000:1.0:1715330299.135010:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330299.135012:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66d9351 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330299.135015:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66d9351 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330299.135037:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d9343 lrc: 1/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb948 expref: 31 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.135044:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66d9343 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb948 expref: 31 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.135051:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfef40, rc 0) 00000100:00100000:1.0:1715330299.135103:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+30:17745:x1798653938052416:12345-192.168.204.49@tcp:101:cmp.0 Request processed in 730us (2024us total) trans 0 rc 301/301 00000100:00100000:1.0:1715330299.135109:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23503 00000100:00100000:0.0:1715330299.137711:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330299.138442:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938052544 00000100:00100000:1.0:1715330299.138452:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938052544 00000100:00100000:1.0:1715330299.139766:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23504 00000100:00100000:1.0:1715330299.139775:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+12:17745:x1798653938052544:12345-192.168.204.49@tcp:101:cmp.0 00010000:00010000:1.0:1715330299.139804:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330299.139828:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d9358 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb94f expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.139903:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d935f lrc: 3/1,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330299.139915:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d935f lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330299.139927:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d935f lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330299.139936:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d9366 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x31 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330299.139947:0:7135:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c6c0/0xd895711d66d9159 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9152 expref: 9 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.139953:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d9366 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330299.139982:0:7135:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c6c0/0xd895711d66d9159 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd895711d66d9152 expref: 9 pid: 24873 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330299.139996:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7135:1798653942485952:0@lo:104: 00000100:00100000:1.0:1715330299.140052:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330299.140083:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4b2f000 going to sleep for 11 seconds 00000100:00100000:0.0:1715330299.140118:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942485952 00000100:00100000:0.0:1715330299.140125:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942485952 00000100:00100000:0.0:1715330299.140188:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1172 00000100:00100000:0.0:1715330299.140194:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7135:x1798653942485952:12345-0@lo:104: 00010000:00010000:0.0:1715330299.140207:0:7118:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f180/0xd895711d66d9152 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d9159 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00080000:1.0:1715330299.140251:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001-osp-MDT0000 older than 1715330269 00010000:00010000:0.0:1715330299.140264:0:7118:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1715330299.140270:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7135:x1798653942485952:12345-0@lo:104: Request processed in 76us (217us total) trans 0 rc 0/0 00010000:00010000:1.0:1715330299.140271:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715330299.140278:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f180/0xd895711d66d9152 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d9159 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330299.140278:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1172 00010000:00010000:1.0:1715330299.140286:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457f180 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330299.140291:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f180/0xd895711d66d9152 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x31 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd895711d66d9159 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330299.140299:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f180/0xd895711d66d9152 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x31 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd895711d66d9159 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330299.140357:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7135:1798653942485952:0@lo:104: 00010000:00010000:2.0:1715330299.140372:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d9366 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330299.140407:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f180/0xd895711d66d9152 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x31 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d9159 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.140413:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330299.140431:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f180/0xd895711d66d9152 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x31 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d9159 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.140441:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f180/0xd895711d66d9152 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x31 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d9159 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.140459:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330299.140460:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330299.140462:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330299.140502:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942486016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1715330299.140534:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330299.140995:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942486016 00000100:00100000:0.0:1715330299.140999:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942486016 00010000:00010000:0.0:1715330299.141017:0:9416:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c6c0/0xd895711d66d9159 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd895711d66d9152 expref: 10 pid: 24873 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330299.141051:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1552 00000100:00100000:0.0:1715330299.141056:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+10:3690:x1798653942486016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330299.141065:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1715330299.145961:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968436 is committed 00010000:00010000:2.0:1715330299.146090:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c6c0/0xd895711d66d9159 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x31 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd895711d66d9152 expref: 10 pid: 24873 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.146125:0:9416:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x31 (ffff88009b9a4600) 00010000:00010000:2.0:1715330299.146129:0:9416:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d9366 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330299.146138:0:9416:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d9366 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330299.146147:0:9416:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d9366 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330299.146170:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715330299.146183:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d9366 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330299.146192:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d9366 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000100:00100000:2.0:1715330299.146255:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+9:3690:x1798653942486016:12345-0@lo:103:ldlm_bl.0 Request processed in 5196us (5718us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330299.146265:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1552 00010000:00010000:0.0:1715330299.146285:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a0900/0xd895711d66d936d lrc: 3/1,0 mode: --/PR res: [0x240000402:0x190:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330299.146292:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a0900/0xd895711d66d936d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330299.146296:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a0900/0xd895711d66d936d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000004:00200000:0.0:1715330299.146303:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x190:0x0]: returning size 2 00000100:00100000:3.0:1715330299.146372:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942486016:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330299.146393:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d935f lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330299.146399:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d935f lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330299.146405:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d935f lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330299.146410:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d935f lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330299.146420:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bff600 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330299.146424:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d935f lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330299.146430:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d935f lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330299.146438:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff8801345c6400) 00010000:00010000:0.0:1715330299.146441:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330299.146444:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d935f lrc: 3/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330299.146449:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d935f lrc: 0/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330299.146471:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d9366 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330299.146476:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d9366 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330299.146480:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d9366 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330299.146484:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfc240 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330299.146487:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d9366 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330299.146491:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d9366 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330299.146496:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x31 (ffff88009b9a4600) 00010000:00010000:0.0:1715330299.146498:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330299.146501:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d9366 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330299.146505:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d9366 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330299.146552:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d9358 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb94f expref: 13 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.146564:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a0900/0xd895711d66d936d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb94f expref: 12 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.146570:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x190:0x0].0x0 (ffff88009bbf0c00) 00010000:00010000:0.0:1715330299.146572:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715330299.146574:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a0900, rc 0) 00000100:00100000:0.0:1715330299.146627:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+12:17745:x1798653938052544:12345-192.168.204.49@tcp:101:cmp.0 Request processed in 6853us (8926us total) trans 4294968437 rc 0/0 00000100:00100000:0.0:1715330299.146634:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23504 00000100:00100000:2.0:1715330299.152796:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330299.152872:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938052608 00000100:00100000:1.0:1715330299.152882:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938052608 00000100:00080000:2.0:1715330299.153145:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330269 00000100:00100000:1.0:1715330299.153470:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5201 00000100:00100000:1.0:1715330299.153477:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72de1896-1df4-4b3a-930a-9116d2c66168+12:2012:x1798653938052608:12345-192.168.204.49@tcp:101:cmp.0 00010000:00010000:1.0:1715330299.153496:0:9633:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330299.153523:0:9633:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093bfed00/0xd895711d66d937b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb956 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1715330299.153551:0:9633:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9c8:0x0] initial LVB size: 2, mtime: 0x663ddcf9, atime: 0x0, ctime: 0x663ddcf9, blocks: 0x8 00010000:00010000:1.0:1715330299.153577:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330299.153579:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330299.153589:0:9633:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093bfed00/0xd895711d66d937b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb956 expref: 13 pid: 9633 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1715330299.153607:0:9633:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093bfed00/0xd895711d66d937b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb956 expref: 13 pid: 9633 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1715330299.153619:0:9633:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfed00, rc 0) 00000100:00100000:1.0:1715330299.153681:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72de1896-1df4-4b3a-930a-9116d2c66168+13:2012:x1798653938052608:12345-192.168.204.49@tcp:101:cmp.0 Request processed in 203us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330299.153688:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5201 00000100:00100000:0.0:1715330299.161766:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330299.162100:0:9403:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938052736 00000100:00100000:1.0:1715330299.162110:0:9403:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938052736 00002000:00100000:1.0:1715330299.162153:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9c8:0x0] (0->4095) req@ffff88008d4e9f80 x1798653938052736/t0(0) o3->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:510/0 lens 488/0 e 0 to 0 dl 1715330310 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1715330299.162204:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d4e9f80 with x1798653938052736 ext(0->4095) 00002000:00010000:1.0:1715330299.162210:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d4e9f80 00000100:00100000:1.0:1715330299.162244:0:9403:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 3 00000100:00100000:1.0:1715330299.162251:0:9403:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+13:2011:x1798653938052736:12345-192.168.204.49@tcp:3:cmp.0 00000100:00100000:1.0:1715330299.165912:0:9403:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+13:2011:x1798653938052736:12345-192.168.204.49@tcp:3:cmp.0 Request processed in 3652us (4182us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1715330299.165924:0:9403:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 3 00002000:00100000:1.0:1715330299.165934:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9c8:0x0] (0->4095) req@ffff88008d4e9f80 x1798653938052736/t0(0) o3->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:510/0 lens 488/4536 e 0 to 0 dl 1715330310 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1715330299.165943:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d4e9f80 with x1798653938052736 ext(0->4095) 00002000:00010000:1.0:1715330299.165948:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d4e9f80 00000100:00100000:0.0:1715330299.173239:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00010000:00010000:1.0:1715330299.173339:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330299.173502:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938052864 00000100:00100000:3.0:1715330299.173511:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938052864 00000100:00100000:3.0:1715330299.173561:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5078 00000100:00100000:3.0:1715330299.173570:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+12:17745:x1798653938052864:12345-192.168.204.49@tcp:35:cmp.0 00000100:00100000:3.0:1715330299.174085:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+13:17745:x1798653938052864:12345-192.168.204.49@tcp:35:cmp.0 Request processed in 514us (855us total) trans 4294968438 rc 0/0 00000100:00100000:3.0:1715330299.174093:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5078 00000100:00100000:0.0:1715330299.191307:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330299.191440:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938052992 00000100:00100000:2.0:1715330299.191450:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938052992 00000100:00100000:2.0:1715330299.191500:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23505 00000100:00100000:2.0:1715330299.191509:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+30:17747:x1798653938052992:12345-192.168.204.49@tcp:101:cmp.0 00010000:00010000:2.0:1715330299.191530:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330299.191553:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d9382 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb95d expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.191634:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d9389 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.191647:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d9389 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.191657:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d9389 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.191722:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d9390 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x3031 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.191728:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d9390 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.191760:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d9390 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.191797:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d9389 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.191802:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d9389 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.191807:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d9389 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.191811:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d9389 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.191817:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db67600 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330299.191821:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d9389 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.191827:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d9389 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.191837:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff8801345c6700) 00010000:00010000:2.0:1715330299.191840:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330299.191844:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d9389 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.191849:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d9389 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.192200:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d9390 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.192207:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d9390 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.192212:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d9390 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.192216:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db67840 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330299.192223:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d9390 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.192229:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d9390 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.192237:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x3031 (ffff88009396df00) 00010000:00010000:2.0:1715330299.192239:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330299.192241:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d9390 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.192245:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d9390 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.192267:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d9382 lrc: 1/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb95d expref: 31 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.192273:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d9382 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb95d expref: 31 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.192281:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db64000, rc 0) 00000100:00100000:2.0:1715330299.192347:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+30:17747:x1798653938052992:12345-192.168.204.49@tcp:101:cmp.0 Request processed in 838us (1055us total) trans 0 rc 301/301 00000100:00100000:2.0:1715330299.192353:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23505 00000100:00100000:0.0:1715330299.199445:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330299.199514:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938053120 00000100:00100000:2.0:1715330299.199524:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938053120 00000100:00100000:2.0:1715330299.199589:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23506 00000100:00100000:2.0:1715330299.199597:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d645500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+13:17747:x1798653938053120:12345-192.168.204.49@tcp:101:cmp.0 00010000:00010000:2.0:1715330299.199627:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330299.199650:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67a80/0xd895711d66d9397 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb964 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.199723:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65b00/0xd895711d66d939e lrc: 3/1,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.199757:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65b00/0xd895711d66d939e lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330299.199766:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65b00/0xd895711d66d939e lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330299.199774:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64fc0/0xd895711d66d93a5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x3031 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.199779:0:7135:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c000/0xd895711d66d90f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x3031 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d90e9 expref: 8 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.199785:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64fc0/0xd895711d66d93a5 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x3031 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330299.199811:0:7135:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c000/0xd895711d66d90f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x3031 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd895711d66d90e9 expref: 8 pid: 23404 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330299.199825:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba65c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7135:1798653942486080:0@lo:104: 00000100:00100000:2.0:1715330299.199865:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330299.199888:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435a80 going to sleep for 11 seconds 00000100:00100000:0.0:1715330299.199906:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942486080 00000100:00100000:0.0:1715330299.199909:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942486080 00000100:00100000:0.0:1715330299.199940:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1173 00000100:00100000:0.0:1715330299.199945:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7135:x1798653942486080:12345-0@lo:104: 00010000:00010000:0.0:1715330299.199955:0:7118:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66d00/0xd895711d66d90e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d90f0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.200009:0:7118:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1715330299.200015:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7135:x1798653942486080:12345-0@lo:104: Request processed in 69us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330299.200021:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1173 00000100:00100000:2.0:1715330299.200029:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba65c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7135:1798653942486080:0@lo:104: 00010000:00010000:2.0:1715330299.200043:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64fc0/0xd895711d66d93a5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x3031 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.200069:0:9415:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1715330299.200075:0:9415:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66d00/0xd895711d66d90e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d90f0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.200082:0:9415:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66d00 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:3.0:1715330299.200086:0:9415:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66d00/0xd895711d66d90e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x3031 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd895711d66d90f0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1715330299.200094:0:9415:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66d00/0xd895711d66d90e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x3031 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd895711d66d90f0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.200146:0:9415:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66d00/0xd895711d66d90e9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x3031 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d90f0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.200151:0:9415:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1715330299.200180:0:9415:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66d00/0xd895711d66d90e9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x3031 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d90f0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.200186:0:9415:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db66d00/0xd895711d66d90e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x3031 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d90f0 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.200219:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715330299.200220:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715330299.200221:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330299.200259:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1715330299.200270:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942486144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330299.200295:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330299.200430:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942486144 00000100:00100000:3.0:1715330299.200433:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942486144 00010000:00010000:3.0:1715330299.200454:0:9416:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c000/0xd895711d66d90f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x3031 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd895711d66d90e9 expref: 9 pid: 23404 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330299.200469:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1553 00000100:00100000:3.0:1715330299.200472:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d645f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+9:3690:x1798653942486144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1715330299.200480:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:2.0:1715330299.209823:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968438 is committed 00010000:00010000:3.0:1715330299.209968:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c000/0xd895711d66d90f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x3031 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd895711d66d90e9 expref: 9 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.210001:0:9416:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x3031 (ffff88008779db00) 00010000:00010000:3.0:1715330299.210007:0:9416:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64fc0/0xd895711d66d93a5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x3031 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.210015:0:9416:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64fc0/0xd895711d66d93a5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x3031 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.210022:0:9416:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64fc0/0xd895711d66d93a5 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x3031 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.210194:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715330299.210270:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d645f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+8:3690:x1798653942486144:12345-0@lo:103:ldlm_bl.0 Request processed in 9794us (9971us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330299.210280:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1553 00000100:00100000:1.0:1715330299.210397:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942486144:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330299.210457:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64fc0/0xd895711d66d93a5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330299.210464:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64fc0/0xd895711d66d93a5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330299.210559:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a2d00/0xd895711d66d93ac lrc: 3/1,0 mode: --/PR res: [0x240000402:0x18f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330299.210567:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a2d00/0xd895711d66d93ac lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330299.210573:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a2d00/0xd895711d66d93ac lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000004:00200000:0.0:1715330299.210582:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x18f:0x0]: returning size 3 00010000:00010000:0.0:1715330299.210663:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65b00/0xd895711d66d939e lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330299.210669:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65b00/0xd895711d66d939e lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330299.210673:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65b00/0xd895711d66d939e lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330299.210678:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65b00/0xd895711d66d939e lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330299.210683:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db65b00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330299.210688:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65b00/0xd895711d66d939e lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330299.210693:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65b00/0xd895711d66d939e lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330299.210700:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff8801345c6400) 00010000:00010000:0.0:1715330299.210703:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330299.210706:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65b00/0xd895711d66d939e lrc: 3/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330299.210711:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65b00/0xd895711d66d939e lrc: 0/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330299.210725:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64fc0/0xd895711d66d93a5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330299.210728:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64fc0/0xd895711d66d93a5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330299.210753:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64fc0/0xd895711d66d93a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330299.210757:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64fc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330299.210759:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64fc0/0xd895711d66d93a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330299.210763:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64fc0/0xd895711d66d93a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330299.210770:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x3031 (ffff88008779db00) 00010000:00010000:0.0:1715330299.210771:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330299.210773:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64fc0/0xd895711d66d93a5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330299.210782:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64fc0/0xd895711d66d93a5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330299.210829:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67a80/0xd895711d66d9397 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb964 expref: 14 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.210842:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a2d00/0xd895711d66d93ac lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb964 expref: 13 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.210853:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18f:0x0].0x0 (ffff88009bbf0b00) 00010000:00010000:0.0:1715330299.210858:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715330299.210860:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a2d00, rc 0) 00000100:00100000:0.0:1715330299.210934:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d645500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+13:17747:x1798653938053120:12345-192.168.204.49@tcp:101:cmp.0 Request processed in 11336us (11502us total) trans 4294968439 rc 0/0 00000100:00100000:0.0:1715330299.210942:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23506 00000100:00100000:0.0:1715330299.214668:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330299.214782:0:17200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938053184 00000100:00100000:3.0:1715330299.214793:0:17200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938053184 00000100:00100000:3.0:1715330299.214902:0:17200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5202 00000100:00100000:3.0:1715330299.214910:0:17200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d644380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:72de1896-1df4-4b3a-930a-9116d2c66168+13:2011:x1798653938053184:12345-192.168.204.49@tcp:101:cmp.0 00010000:00010000:3.0:1715330299.214931:0:17200:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330299.214956:0:17200:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013457f180/0xd895711d66d93ba lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb96b expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1715330299.214983:0:17200:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9ca:0x0] initial LVB size: 3, mtime: 0x663ddcf9, atime: 0x0, ctime: 0x663ddcf9, blocks: 0x8 00010000:00010000:3.0:1715330299.215006:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330299.215009:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330299.215017:0:17200:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013457f180/0xd895711d66d93ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb96b expref: 14 pid: 17200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1715330299.215034:0:17200:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013457f180/0xd895711d66d93ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb96b expref: 14 pid: 17200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1715330299.215044:0:17200:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013457f180, rc 0) 00000100:00100000:3.0:1715330299.215843:0:17200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d644380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:72de1896-1df4-4b3a-930a-9116d2c66168+14:2011:x1798653938053184:12345-192.168.204.49@tcp:101:cmp.0 Request processed in 931us (1184us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330299.215853:0:17200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5202 00000100:00100000:0.0:1715330299.222886:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330299.223564:0:9403:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938053312 00000100:00100000:1.0:1715330299.223575:0:9403:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938053312 00002000:00100000:1.0:1715330299.223624:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9ca:0x0] (0->4095) req@ffff88009d647800 x1798653938053312/t0(0) o3->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:510/0 lens 488/0 e 0 to 0 dl 1715330310 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1715330299.223634:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d647800 with x1798653938053312 ext(0->4095) 00002000:00010000:1.0:1715330299.223639:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d647800 00000100:00100000:1.0:1715330299.223674:0:9403:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 4 00000100:00100000:1.0:1715330299.223681:0:9403:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d647800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+14:2011:x1798653938053312:12345-192.168.204.49@tcp:3:cmp.0 00000100:00100000:1.0:1715330299.223882:0:9403:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d647800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+14:2011:x1798653938053312:12345-192.168.204.49@tcp:3:cmp.0 Request processed in 201us (1007us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1715330299.223890:0:9403:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 4 00002000:00100000:1.0:1715330299.223896:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9ca:0x0] (0->4095) req@ffff88009d647800 x1798653938053312/t0(0) o3->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:510/0 lens 488/4536 e 0 to 0 dl 1715330310 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1715330299.223902:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d647800 with x1798653938053312 ext(0->4095) 00002000:00010000:1.0:1715330299.223905:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d647800 00000100:00100000:0.0:1715330299.228783:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330299.229257:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938053440 00000100:00100000:3.0:1715330299.229267:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938053440 00000100:00100000:3.0:1715330299.229335:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5079 00000100:00100000:3.0:1715330299.229343:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d644a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+13:17747:x1798653938053440:12345-192.168.204.49@tcp:35:cmp.0 00000100:00100000:3.0:1715330299.230369:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d644a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+14:17747:x1798653938053440:12345-192.168.204.49@tcp:35:cmp.0 Request processed in 1022us (1640us total) trans 4294968440 rc 0/0 00000100:00100000:3.0:1715330299.230379:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5079 00000100:00100000:0.0:1715330299.242248:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330299.242370:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938053568 00000100:00100000:2.0:1715330299.242380:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938053568 00000100:00100000:2.0:1715330299.242578:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23507 00000100:00100000:2.0:1715330299.242586:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+30:17749:x1798653938053568:12345-192.168.204.49@tcp:101:cmp.0 00010000:00010000:2.0:1715330299.242609:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330299.242632:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66d93c1 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb972 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.242714:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d93c8 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.242727:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d93c8 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.242777:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d93c8 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.242787:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d93cf lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x35 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.242793:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d93cf lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.242798:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d93cf lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.242830:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d93c8 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.242836:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d93c8 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.242844:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d93c8 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.242850:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d93c8 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.242856:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66f40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330299.242859:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d93c8 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.242866:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d93c8 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.242876:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff8801345c6700) 00010000:00010000:2.0:1715330299.242879:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330299.242883:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d93c8 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.242888:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d93c8 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.244121:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d93cf lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.244130:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d93cf lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.244135:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d93cf lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.244139:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66ac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330299.244142:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d93cf lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.244151:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d93cf lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.244159:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x35 (ffff88008b233000) 00010000:00010000:2.0:1715330299.244161:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330299.244164:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d93cf lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.244169:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d93cf lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.244201:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66d93c1 lrc: 1/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb972 expref: 31 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.244209:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66d93c1 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb972 expref: 31 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.244216:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db66d00, rc 0) 00000100:00100000:2.0:1715330299.245115:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+30:17749:x1798653938053568:12345-192.168.204.49@tcp:101:cmp.0 Request processed in 2526us (2875us total) trans 0 rc 301/301 00000100:00100000:2.0:1715330299.245124:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23507 00000100:00100000:0.0:1715330299.247349:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330299.247450:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938053696 00000100:00100000:2.0:1715330299.247458:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938053696 00000100:00100000:2.0:1715330299.247506:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23508 00000100:00100000:2.0:1715330299.247513:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d645180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+14:17749:x1798653938053696:12345-192.168.204.49@tcp:101:cmp.0 00010000:00010000:2.0:1715330299.247538:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330299.247559:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66d00/0xd895711d66d93d6 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb979 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.247633:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66ac0/0xd895711d66d93dd lrc: 3/1,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.247645:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66ac0/0xd895711d66d93dd lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330299.247654:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66ac0/0xd895711d66d93dd lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330299.247663:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66f40/0xd895711d66d93e4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x35 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.247672:0:7135:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d91c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d91bb expref: 7 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.247678:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66f40/0xd895711d66d93e4 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330299.247709:0:7135:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d91c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd895711d66d91bb expref: 7 pid: 23404 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330299.247725:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba65c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7135:1798653942486208:0@lo:104: 00000100:00100000:2.0:1715330299.247786:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330299.247811:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435a80 going to sleep for 11 seconds 00000100:00100000:1.0:1715330299.247886:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942486208 00000100:00100000:1.0:1715330299.247889:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942486208 00000100:00100000:1.0:1715330299.247957:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1174 00000100:00100000:1.0:1715330299.247963:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7135:x1798653942486208:12345-0@lo:104: 00010000:00010000:1.0:1715330299.247974:0:7118:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457cd80/0xd895711d66d91bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d91c2 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.248015:0:7118:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1715330299.248020:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7135:x1798653942486208:12345-0@lo:104: Request processed in 58us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330299.248026:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1174 00010000:00010000:1.0:1715330299.248056:0:7124:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715330299.248062:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457cd80/0xd895711d66d91bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d91c2 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.248070:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457cd80 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330299.248075:0:7124:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457cd80/0xd895711d66d91bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x35 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd895711d66d91c2 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330299.248083:0:7124:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457cd80/0xd895711d66d91bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x35 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd895711d66d91c2 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.248107:0:7124:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457cd80/0xd895711d66d91bb lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x35 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d91c2 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.248113:0:7124:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1715330299.248418:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba65c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7135:1798653942486208:0@lo:104: 00010000:00010000:2.0:1715330299.248433:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66f40/0xd895711d66d93e4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330299.248618:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457cd80/0xd895711d66d91bb lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x35 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d91c2 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.248625:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457cd80/0xd895711d66d91bb lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x35 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d91c2 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.248646:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330299.248647:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330299.248649:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330299.248724:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1715330299.248756:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942486272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1715330299.248786:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330299.248846:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942486272 00000100:00100000:2.0:1715330299.248850:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942486272 00010000:00010000:2.0:1715330299.248868:0:9416:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d91c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd895711d66d91bb expref: 8 pid: 23404 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330299.248886:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1554 00000100:00100000:2.0:1715330299.248890:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+8:3689:x1798653942486272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715330299.248899:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:3.0:1715330299.250492:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968440 is committed 00010000:00010000:2.0:1715330299.250689:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d91c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x35 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd895711d66d91bb expref: 8 pid: 23404 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.250777:0:9416:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x35 (ffff88009396d800) 00010000:00010000:2.0:1715330299.250782:0:9416:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66f40/0xd895711d66d93e4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330299.250792:0:9416:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66f40/0xd895711d66d93e4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330299.250800:0:9416:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66f40/0xd895711d66d93e4 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330299.250942:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330299.251222:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66f40/0xd895711d66d93e4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.251228:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66f40/0xd895711d66d93e4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.251333:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457dd40/0xd895711d66d93eb lrc: 3/1,0 mode: --/PR res: [0x240000402:0x191:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330299.251342:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457dd40/0xd895711d66d93eb lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.251349:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013457dd40/0xd895711d66d93eb lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000004:00200000:3.0:1715330299.251358:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x191:0x0]: returning size 2 00010000:00010000:3.0:1715330299.251438:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66ac0/0xd895711d66d93dd lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.251445:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66ac0/0xd895711d66d93dd lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.251451:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66ac0/0xd895711d66d93dd lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.251457:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66ac0/0xd895711d66d93dd lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.251463:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66ac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330299.251467:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66ac0/0xd895711d66d93dd lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.251474:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66ac0/0xd895711d66d93dd lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.251481:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff8801345c6400) 00010000:00010000:3.0:1715330299.251484:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330299.251486:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66ac0/0xd895711d66d93dd lrc: 3/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.251490:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66ac0/0xd895711d66d93dd lrc: 0/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.251505:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66f40/0xd895711d66d93e4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.251509:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66f40/0xd895711d66d93e4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.251514:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66f40/0xd895711d66d93e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.251518:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66f40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330299.251521:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66f40/0xd895711d66d93e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.251525:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66f40/0xd895711d66d93e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.251531:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x35 (ffff88009396d800) 00010000:00010000:3.0:1715330299.251532:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330299.251534:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66f40/0xd895711d66d93e4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.251539:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66f40/0xd895711d66d93e4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.251587:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66d00/0xd895711d66d93d6 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb979 expref: 15 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.251599:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457dd40/0xd895711d66d93eb lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb979 expref: 14 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.251605:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x191:0x0].0x0 (ffff88009ef25e00) 00010000:00010000:3.0:1715330299.251606:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330299.251609:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013457dd40, rc 0) 00000100:00100000:3.0:1715330299.251669:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d645180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+14:17749:x1798653938053696:12345-192.168.204.49@tcp:101:cmp.0 Request processed in 4155us (4327us total) trans 4294968441 rc 0/0 00000100:00100000:3.0:1715330299.251678:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23508 00000100:00100000:2.0:1715330299.251765:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+7:3689:x1798653942486272:12345-0@lo:103:ldlm_bl.0 Request processed in 2873us (2978us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330299.251773:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1554 00000100:00100000:0.0:1715330299.252177:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942486272:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330299.256233:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330299.256303:0:17200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938053760 00000100:00100000:3.0:1715330299.256325:0:17200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938053760 00000100:00100000:3.0:1715330299.256391:0:17200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5203 00000100:00100000:3.0:1715330299.256399:0:17200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:72de1896-1df4-4b3a-930a-9116d2c66168+14:2013:x1798653938053760:12345-192.168.204.49@tcp:101:cmp.0 00010000:00010000:3.0:1715330299.256424:0:17200:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330299.256450:0:17200:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013457e640/0xd895711d66d93f9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb980 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1715330299.256473:0:17200:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9c9:0x0] initial LVB size: 2, mtime: 0x663ddcf9, atime: 0x0, ctime: 0x663ddcf9, blocks: 0x8 00010000:00010000:3.0:1715330299.256492:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330299.256494:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330299.256503:0:17200:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013457e640/0xd895711d66d93f9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb980 expref: 15 pid: 17200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1715330299.256524:0:17200:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013457e640/0xd895711d66d93f9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb980 expref: 15 pid: 17200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1715330299.256534:0:17200:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013457e640, rc 0) 00000100:00100000:3.0:1715330299.256590:0:17200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:72de1896-1df4-4b3a-930a-9116d2c66168+15:2013:x1798653938053760:12345-192.168.204.49@tcp:101:cmp.0 Request processed in 191us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330299.256596:0:17200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5203 00000100:00100000:0.0:1715330299.260192:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330299.260282:0:9403:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938053888 00000100:00100000:1.0:1715330299.260293:0:9403:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938053888 00002000:00100000:1.0:1715330299.260352:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9c9:0x0] (0->4095) req@ffff88012cc79180 x1798653938053888/t0(0) o3->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:510/0 lens 488/0 e 0 to 0 dl 1715330310 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1715330299.260362:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cc79180 with x1798653938053888 ext(0->4095) 00002000:00010000:1.0:1715330299.260368:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cc79180 00000100:00100000:1.0:1715330299.260404:0:9403:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5 00000100:00100000:1.0:1715330299.260411:0:9403:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+15:2011:x1798653938053888:12345-192.168.204.49@tcp:3:cmp.0 00000100:00100000:1.0:1715330299.260589:0:9403:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+15:2011:x1798653938053888:12345-192.168.204.49@tcp:3:cmp.0 Request processed in 177us (408us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1715330299.260596:0:9403:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5 00002000:00100000:1.0:1715330299.260601:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9c9:0x0] (0->4095) req@ffff88012cc79180 x1798653938053888/t0(0) o3->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:510/0 lens 488/4536 e 0 to 0 dl 1715330310 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1715330299.260613:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cc79180 with x1798653938053888 ext(0->4095) 00002000:00010000:1.0:1715330299.260616:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cc79180 00000100:00100000:0.0:1715330299.265120:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330299.265406:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938054016 00000100:00100000:3.0:1715330299.265417:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938054016 00000100:00100000:3.0:1715330299.265476:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5080 00000100:00100000:3.0:1715330299.265484:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+14:17749:x1798653938054016:12345-192.168.204.49@tcp:35:cmp.0 00000100:00100000:3.0:1715330299.265916:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+15:17749:x1798653938054016:12345-192.168.204.49@tcp:35:cmp.0 Request processed in 430us (805us total) trans 4294968442 rc 0/0 00000100:00100000:3.0:1715330299.265923:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5080 00000100:00100000:0.0:1715330299.277813:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330299.277890:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938054144 00000100:00100000:3.0:1715330299.277900:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938054144 00000100:00100000:3.0:1715330299.278318:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23509 00000100:00100000:3.0:1715330299.278326:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+30:17751:x1798653938054144:12345-192.168.204.49@tcp:101:cmp.0 00010000:00010000:3.0:1715330299.278348:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330299.278369:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d9400 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb987 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.278446:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d9407 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330299.278458:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d9407 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330299.278469:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d9407 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330299.278477:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d940e lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x36 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330299.278482:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d940e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330299.278486:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d940e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330299.278518:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d9407 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330299.278524:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d9407 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330299.278529:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d9407 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330299.278534:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d9407 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330299.278540:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457e880 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330299.278544:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d9407 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330299.278550:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d9407 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330299.278561:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff8801345c6700) 00010000:00010000:3.0:1715330299.278563:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330299.278567:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d9407 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330299.278572:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d9407 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330299.278604:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d940e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330299.278609:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d940e lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330299.278614:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d940e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330299.278618:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457c480 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330299.278620:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d940e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330299.278624:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d940e lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330299.278630:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x36 (ffff880129edf600) 00010000:00010000:3.0:1715330299.278632:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330299.278635:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d940e lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330299.278640:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d940e lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330299.278661:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d9400 lrc: 1/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb987 expref: 31 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.278668:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d9400 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb987 expref: 31 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.278675:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013457c240, rc 0) 00000100:00100000:3.0:1715330299.278758:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+30:17751:x1798653938054144:12345-192.168.204.49@tcp:101:cmp.0 Request processed in 431us (955us total) trans 0 rc 301/301 00000100:00100000:3.0:1715330299.278764:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23509 00000100:00100000:0.0:1715330299.281035:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330299.281215:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938054272 00000100:00100000:1.0:1715330299.281225:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938054272 00000100:00100000:1.0:1715330299.281284:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23510 00000100:00100000:1.0:1715330299.281292:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+15:17751:x1798653938054272:12345-192.168.204.49@tcp:101:cmp.0 00010000:00010000:1.0:1715330299.281328:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330299.281350:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d9415 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb98e expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.281428:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d941c lrc: 3/1,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330299.281442:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d941c lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.281452:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d941c lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.281461:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d9423 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x36 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330299.281468:0:25569:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfeac0/0xd895711d66d9087 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9080 expref: 6 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.281475:0:25569:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d9423 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.281506:0:25569:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfeac0/0xd895711d66d9087 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd895711d66d9080 expref: 6 pid: 9408 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330299.281527:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48f480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:25569:1798653942486336:0@lo:104: 00000100:00100000:1.0:1715330299.281576:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330299.281604:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4b2fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1715330299.281630:0:9413:0:(service.c:168:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1715330299.281643:0:9413:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942486336 00000100:00100000:2.0:1715330299.281647:0:9413:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942486336 00000100:00100000:2.0:1715330299.281681:0:9413:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1175 00000100:00100000:2.0:1715330299.281686:0:9413:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7e8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:25569:x1798653942486336:12345-0@lo:104: 00010000:00010000:2.0:1715330299.281755:0:9413:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457ed00/0xd895711d66d9080 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d9087 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.281812:0:9413:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1715330299.281812:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48f480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:25569:1798653942486336:0@lo:104: 00000100:00100000:2.0:1715330299.281817:0:9413:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7e8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:25569:x1798653942486336:12345-0@lo:104: Request processed in 132us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330299.281824:0:9413:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1175 00010000:00010000:1.0:1715330299.281826:0:25569:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d9423 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:0.0:1715330299.281833:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715330299.281840:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457ed00/0xd895711d66d9080 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d9087 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.281846:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457ed00 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330299.281851:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457ed00/0xd895711d66d9080 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x36 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd895711d66d9087 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330299.281858:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457ed00/0xd895711d66d9080 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x36 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd895711d66d9087 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.281888:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457ed00/0xd895711d66d9080 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x36 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d9087 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.281893:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330299.281921:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457ed00/0xd895711d66d9080 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x36 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d9087 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.281926:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457ed00/0xd895711d66d9080 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x36 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d9087 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330299.281939:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942486400:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330299.281950:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330299.281951:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330299.281953:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330299.281965:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330299.281991:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942486400 00000100:00100000:2.0:1715330299.281994:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942486400 00010000:00010000:2.0:1715330299.282007:0:9416:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfeac0/0xd895711d66d9087 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd895711d66d9080 expref: 7 pid: 9408 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330299.282024:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1555 00000100:00100000:2.0:1715330299.282028:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+7:3689:x1798653942486400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715330299.282035:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:3.0:1715330299.285045:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968442 is committed 00010000:00010000:2.0:1715330299.285180:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfeac0/0xd895711d66d9087 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x36 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd895711d66d9080 expref: 7 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.285833:0:9416:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x36 (ffff880093b42800) 00010000:00010000:2.0:1715330299.285840:0:9416:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d9423 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330299.285850:0:9416:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d9423 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330299.285856:0:9416:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d9423 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330299.285893:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330299.286140:0:25569:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d9423 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.286148:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d9423 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.286254:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd200/0xd895711d66d942a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x18e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330299.286263:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd200/0xd895711d66d942a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.286270:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd200/0xd895711d66d942a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00000004:00200000:1.0:1715330299.286279:0:25569:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x18e:0x0]: returning size 2 00010000:00010000:1.0:1715330299.286371:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d941c lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00000100:00100000:2.0:1715330299.286575:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+6:3689:x1798653942486400:12345-0@lo:103:ldlm_bl.0 Request processed in 4542us (4606us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330299.286586:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1555 00000100:00100000:3.0:1715330299.286675:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942486400:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330299.286790:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d941c lrc: 2/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.286796:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d941c lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.286805:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfe640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330299.286808:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d941c lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.286815:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d941c lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.286825:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff8801345c6400) 00010000:00010000:1.0:1715330299.286828:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330299.286831:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d941c lrc: 2/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.286835:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d941c lrc: 0/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.286857:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d9423 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.286862:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d9423 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.286866:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d9423 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.286871:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfcd80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330299.286873:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d9423 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.286877:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d9423 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.286883:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x36 (ffff880093b42800) 00010000:00010000:1.0:1715330299.286885:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330299.286888:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d9423 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.286892:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d9423 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.286933:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bffa80/0xd895711d66d9415 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb98e expref: 16 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.286948:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd200/0xd895711d66d942a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb98e expref: 15 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.286954:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18e:0x0].0x0 (ffff880093b42b00) 00010000:00010000:1.0:1715330299.286956:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715330299.286958:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfd200, rc 0) 00000100:00100000:1.0:1715330299.288826:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+15:17751:x1798653938054272:12345-192.168.204.49@tcp:101:cmp.0 Request processed in 7524us (7791us total) trans 4294968443 rc 0/0 00000100:00100000:1.0:1715330299.288837:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23510 00000100:00100000:1.0:1715330299.294492:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330299.294847:0:17200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938054336 00000100:00100000:3.0:1715330299.294857:0:17200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938054336 00000100:00100000:3.0:1715330299.294931:0:17200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5204 00000100:00100000:3.0:1715330299.294940:0:17200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:72de1896-1df4-4b3a-930a-9116d2c66168+14:2013:x1798653938054336:12345-192.168.204.49@tcp:101:cmp.0 00010000:00010000:3.0:1715330299.294959:0:17200:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330299.294982:0:17200:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013457ed00/0xd895711d66d9438 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb995 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1715330299.295005:0:17200:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9c9:0x0] initial LVB size: 2, mtime: 0x663ddcf9, atime: 0x0, ctime: 0x663ddcf9, blocks: 0x8 00010000:00010000:3.0:1715330299.295025:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330299.295026:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330299.295035:0:17200:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013457ed00/0xd895711d66d9438 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb995 expref: 15 pid: 17200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1715330299.295050:0:17200:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013457ed00/0xd895711d66d9438 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb995 expref: 15 pid: 17200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1715330299.295061:0:17200:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013457ed00, rc 0) 00000100:00100000:3.0:1715330299.295560:0:17200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:72de1896-1df4-4b3a-930a-9116d2c66168+15:2013:x1798653938054336:12345-192.168.204.49@tcp:101:cmp.0 Request processed in 619us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330299.295567:0:17200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5204 00000100:00100000:0.0:1715330299.300862:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330299.301203:0:9403:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938054464 00000100:00100000:1.0:1715330299.301215:0:9403:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938054464 00002000:00100000:1.0:1715330299.301259:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9c9:0x0] (0->4095) req@ffff88012cc7b800 x1798653938054464/t0(0) o3->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:510/0 lens 488/0 e 0 to 0 dl 1715330310 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1715330299.301270:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cc7b800 with x1798653938054464 ext(0->4095) 00002000:00010000:1.0:1715330299.301275:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cc7b800 00000100:00100000:1.0:1715330299.301325:0:9403:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 6 00000100:00100000:1.0:1715330299.301332:0:9403:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+15:2012:x1798653938054464:12345-192.168.204.49@tcp:3:cmp.0 00000100:00100000:1.0:1715330299.301503:0:9403:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+15:2012:x1798653938054464:12345-192.168.204.49@tcp:3:cmp.0 Request processed in 168us (650us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1715330299.301510:0:9403:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 6 00002000:00100000:1.0:1715330299.301516:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9c9:0x0] (0->4095) req@ffff88012cc7b800 x1798653938054464/t0(0) o3->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:510/0 lens 488/4536 e 0 to 0 dl 1715330310 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1715330299.301522:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cc7b800 with x1798653938054464 ext(0->4095) 00002000:00010000:1.0:1715330299.301525:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cc7b800 00000100:00100000:0.0:1715330299.306668:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330299.306829:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938054592 00000100:00100000:3.0:1715330299.306839:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938054592 00000100:00100000:3.0:1715330299.306892:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5081 00000100:00100000:3.0:1715330299.306899:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+15:17751:x1798653938054592:12345-192.168.204.49@tcp:35:cmp.0 00000100:00100000:3.0:1715330299.307139:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+16:17751:x1798653938054592:12345-192.168.204.49@tcp:35:cmp.0 Request processed in 240us (482us total) trans 4294968444 rc 0/0 00000100:00100000:3.0:1715330299.307146:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5081 00000100:00100000:0.0:1715330299.316454:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330299.316618:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938054720 00000100:00100000:1.0:1715330299.316627:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938054720 00000100:00100000:1.0:1715330299.316682:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23511 00000100:00100000:1.0:1715330299.316689:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+30:17753:x1798653938054720:12345-192.168.204.49@tcp:101:cmp.0 00010000:00010000:1.0:1715330299.316710:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330299.316767:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66d943f lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb99c expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.316844:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66d9446 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330299.316855:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66d9446 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330299.316865:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66d9446 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330299.316873:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d944d lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x39 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330299.316878:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d944d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330299.316883:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d944d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330299.316911:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66d9446 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330299.316917:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66d9446 lrc: 2/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330299.316922:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66d9446 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330299.316928:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfd680 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330299.316931:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66d9446 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330299.316936:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66d9446 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330299.316945:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff8801345c6700) 00010000:00010000:1.0:1715330299.316948:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330299.316951:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66d9446 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330299.316956:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66d9446 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330299.316971:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d944d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330299.316975:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d944d lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330299.316980:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d944d lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330299.316984:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfd440 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330299.316987:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d944d lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330299.316992:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d944d lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330299.316997:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x39 (ffff88009ef25f00) 00010000:00010000:1.0:1715330299.316999:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330299.317001:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d944d lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330299.317004:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d944d lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330299.317024:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66d943f lrc: 1/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb99c expref: 31 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.317030:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66d943f lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb99c expref: 31 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.317037:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfeac0, rc 0) 00000100:00100000:1.0:1715330299.317080:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+30:17753:x1798653938054720:12345-192.168.204.49@tcp:101:cmp.0 Request processed in 391us (637us total) trans 0 rc 301/301 00000100:00100000:1.0:1715330299.317085:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23511 00000100:00100000:0.0:1715330299.319405:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330299.319602:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938054848 00000100:00100000:3.0:1715330299.319611:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938054848 00000100:00100000:3.0:1715330299.319659:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23512 00000100:00100000:3.0:1715330299.319667:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+16:17753:x1798653938054848:12345-192.168.204.49@tcp:101:cmp.0 00010000:00010000:3.0:1715330299.319692:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330299.319712:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013457eac0/0xd895711d66d9454 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb9a3 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.319803:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c240/0xd895711d66d945b lrc: 3/1,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330299.319821:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c240/0xd895711d66d945b lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.319831:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c240/0xd895711d66d945b lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.319840:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c480/0xd895711d66d9462 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x39 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330299.319848:0:7135:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd8c0/0xd895711d66d901e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9017 expref: 5 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.320026:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c480/0xd895711d66d9462 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.320059:0:7135:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd8c0/0xd895711d66d901e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd895711d66d9017 expref: 5 pid: 9408 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330299.320074:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d55880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7135:1798653942486464:0@lo:104: 00000100:00100000:3.0:1715330299.320115:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330299.320968:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091cb5480 going to sleep for 11 seconds 00000100:00100000:2.0:1715330299.321013:0:9413:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942486464 00000100:00100000:2.0:1715330299.321019:0:9413:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942486464 00000100:00100000:2.0:1715330299.321054:0:9413:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1176 00000100:00100000:2.0:1715330299.321060:0:9413:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:7135:x1798653942486464:12345-0@lo:104: 00010000:00010000:2.0:1715330299.321071:0:9413:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db661c0/0xd895711d66d9017 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d901e expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.321127:0:9413:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1715330299.321132:0:9413:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:7135:x1798653942486464:12345-0@lo:104: Request processed in 72us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330299.321138:0:9413:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1176 00010000:00010000:0.0:1715330299.321184:0:7123:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715330299.321191:0:7123:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db661c0/0xd895711d66d9017 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d901e expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.321203:0:7123:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db661c0 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330299.321207:0:7123:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db661c0/0xd895711d66d9017 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x39 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd895711d66d901e expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330299.321215:0:7123:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db661c0/0xd895711d66d9017 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x39 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd895711d66d901e expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.321238:0:7123:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db661c0/0xd895711d66d9017 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x39 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d901e expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.321243:0:7123:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330299.321259:0:7123:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db661c0/0xd895711d66d9017 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x39 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d901e expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.321265:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88011db661c0/0xd895711d66d9017 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x39 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d901e expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.321286:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330299.321287:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330299.321288:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330299.321351:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942486528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330299.321380:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330299.321415:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942486528 00000100:00100000:1.0:1715330299.321418:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942486528 00010000:00010000:1.0:1715330299.321432:0:9416:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd8c0/0xd895711d66d901e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd895711d66d9017 expref: 6 pid: 9408 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330299.321621:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d55880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7135:1798653942486464:0@lo:104: 00010000:00010000:3.0:1715330299.321638:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c480/0xd895711d66d9462 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000100:00100000:1.0:1715330299.321714:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1556 00000100:00100000:1.0:1715330299.321719:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ab78b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+6:3690:x1798653942486528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330299.321728:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:3.0:1715330299.323791:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968444 is committed 00010000:00010000:1.0:1715330299.323889:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd8c0/0xd895711d66d901e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x39 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd895711d66d9017 expref: 6 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.323907:0:9416:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x39 (ffff880093b42500) 00010000:00010000:1.0:1715330299.323911:0:9416:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c480/0xd895711d66d9462 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330299.323919:0:9416:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c480/0xd895711d66d9462 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330299.323926:0:9416:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c480/0xd895711d66d9462 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330299.324211:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330299.324274:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ab78b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942486528:12345-0@lo:103:ldlm_bl.0 Request processed in 2553us (2892us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330299.324283:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1556 00000100:00100000:0.0:1715330299.324323:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942486528:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1715330299.324543:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c480/0xd895711d66d9462 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.324550:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c480/0xd895711d66d9462 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.324651:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e880/0xd895711d66d9469 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x18d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330299.324661:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e880/0xd895711d66d9469 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.324668:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e880/0xd895711d66d9469 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000004:00200000:3.0:1715330299.324676:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x18d:0x0]: returning size 2 00010000:00010000:3.0:1715330299.326203:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c240/0xd895711d66d945b lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.326213:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c240/0xd895711d66d945b lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.326220:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c240/0xd895711d66d945b lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.326225:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c240/0xd895711d66d945b lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.326230:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457c240 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330299.326233:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c240/0xd895711d66d945b lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.326240:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c240/0xd895711d66d945b lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.326251:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff8801345c6400) 00010000:00010000:3.0:1715330299.326253:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330299.326256:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c240/0xd895711d66d945b lrc: 3/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.326265:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c240/0xd895711d66d945b lrc: 0/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.326293:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c480/0xd895711d66d9462 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.326297:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c480/0xd895711d66d9462 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.326302:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c480/0xd895711d66d9462 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.326306:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457c480 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330299.326315:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c480/0xd895711d66d9462 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.326319:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c480/0xd895711d66d9462 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc9:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.326325:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x39 (ffff880093b42500) 00010000:00010000:3.0:1715330299.326326:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330299.326329:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c480/0xd895711d66d9462 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.326333:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c480/0xd895711d66d9462 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.326381:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457eac0/0xd895711d66d9454 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xc9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9a3 expref: 17 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.326392:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e880/0xd895711d66d9469 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9a3 expref: 16 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.326403:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18d:0x0].0x0 (ffff880091ea7500) 00010000:00010000:3.0:1715330299.326405:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330299.326407:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013457e880, rc 0) 00000100:00100000:3.0:1715330299.326476:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+16:17753:x1798653938054848:12345-192.168.204.49@tcp:101:cmp.0 Request processed in 6808us (7080us total) trans 4294968445 rc 0/0 00000100:00100000:3.0:1715330299.326485:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23512 00000100:00100000:0.0:1715330299.330610:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330299.330943:0:17200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938054912 00000100:00100000:3.0:1715330299.330953:0:17200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938054912 00000100:00100000:3.0:1715330299.331457:0:17200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5205 00000100:00100000:3.0:1715330299.331465:0:17200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:72de1896-1df4-4b3a-930a-9116d2c66168+15:2013:x1798653938054912:12345-192.168.204.49@tcp:101:cmp.0 00010000:00010000:3.0:1715330299.331796:0:17200:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330299.331821:0:17200:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013457cd80/0xd895711d66d9477 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb9aa expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1715330299.331846:0:17200:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9ca:0x0] initial LVB size: 2, mtime: 0x663ddcf9, atime: 0x0, ctime: 0x663ddcf9, blocks: 0x8 00010000:00010000:3.0:1715330299.331866:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330299.331868:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330299.331876:0:17200:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013457cd80/0xd895711d66d9477 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9aa expref: 16 pid: 17200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1715330299.331892:0:17200:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013457cd80/0xd895711d66d9477 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9aa expref: 16 pid: 17200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1715330299.331903:0:17200:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013457cd80, rc 0) 00000100:00100000:3.0:1715330299.332007:0:17200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:72de1896-1df4-4b3a-930a-9116d2c66168+16:2013:x1798653938054912:12345-192.168.204.49@tcp:101:cmp.0 Request processed in 542us (1513us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330299.332015:0:17200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5205 00000100:00100000:0.0:1715330299.341328:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330299.341424:0:9404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938055040 00000100:00100000:2.0:1715330299.341434:0:9404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938055040 00002000:00100000:2.0:1715330299.341479:0:9404:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9ca:0x0] (0->4095) req@ffff88012cc78380 x1798653938055040/t0(0) o3->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:510/0 lens 488/0 e 0 to 0 dl 1715330310 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1715330299.341488:0:9404:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cc78380 with x1798653938055040 ext(0->4095) 00002000:00010000:2.0:1715330299.341494:0:9404:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cc78380 00000100:00100000:2.0:1715330299.341583:0:9404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 7 00000100:00100000:2.0:1715330299.341589:0:9404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:72de1896-1df4-4b3a-930a-9116d2c66168+16:2011:x1798653938055040:12345-192.168.204.49@tcp:3:cmp.0 00000100:00100000:2.0:1715330299.341764:0:9404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:72de1896-1df4-4b3a-930a-9116d2c66168+16:2011:x1798653938055040:12345-192.168.204.49@tcp:3:cmp.0 Request processed in 174us (455us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1715330299.341772:0:9404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 7 00002000:00100000:2.0:1715330299.341778:0:9404:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9ca:0x0] (0->4095) req@ffff88012cc78380 x1798653938055040/t0(0) o3->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:510/0 lens 488/4536 e 0 to 0 dl 1715330310 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1715330299.341785:0:9404:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cc78380 with x1798653938055040 ext(0->4095) 00002000:00010000:2.0:1715330299.341787:0:9404:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cc78380 00000100:00100000:0.0:1715330299.346560:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330299.346643:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938055168 00000100:00100000:1.0:1715330299.346653:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938055168 00000100:00100000:1.0:1715330299.346703:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5082 00000100:00100000:1.0:1715330299.346711:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ef0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+16:17753:x1798653938055168:12345-192.168.204.49@tcp:35:cmp.0 00000100:00100000:1.0:1715330299.346979:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ef0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+17:17753:x1798653938055168:12345-192.168.204.49@tcp:35:cmp.0 Request processed in 268us (429us total) trans 4294968446 rc 0/0 00000100:00100000:1.0:1715330299.346986:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5082 00000100:00100000:0.0:1715330299.371861:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330299.372047:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938055296 00000100:00100000:3.0:1715330299.372057:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938055296 00000100:00100000:3.0:1715330299.372109:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23513 00000100:00100000:3.0:1715330299.372116:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:17754:x1798653938055296:12345-192.168.204.49@tcp:36:rm.0 00010000:00010000:3.0:1715330299.372176:0:7135:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330299.372237:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457dd40/0xd895711d66d93eb lrc: 0/0,0 mode: --/PR res: [0x240000402:0x191:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb979 expref: 17 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.372862:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x191:0x0].0x0 (ffff88009ef25e00) 00010000:00010000:3.0:1715330299.372876:0:7135:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330299.372925:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c000/0xd895711d66d947e lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330299.372933:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c000/0xd895711d66d947e lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.372942:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c000/0xd895711d66d947e lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT1 00000100:00100000:3.0:1715330299.372961:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d55880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942486592:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1715330299.373129:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330299.373302:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091cb5480 going to sleep for 11 seconds 00000100:00100000:1.0:1715330299.373359:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942486592 00000100:00100000:1.0:1715330299.373364:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942486592 00000100:00100000:1.0:1715330299.373518:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2960 00000100:00100000:1.0:1715330299.373524:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+17:7135:x1798653942486592:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330299.373537:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330299.373553:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd8c0/0xd895711d66d9485 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d947e expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.373572:0:9407:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d9294 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb909 expref: 29 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.373581:0:9407:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd8c0/0xd895711d66d9485 lrc: 4/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d947e expref: 18 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.373600:0:9407:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d9294 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb909 expref: 29 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.373610:0:9407:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d9294 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb909 expref: 29 pid: 25569 timeout: 373 lvb_type: 0 00000100:00100000:1.0:1715330299.373619:0:9407:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:9407:1798653942486656:192.168.204.49@tcp:104: 00000100:00100000:1.0:1715330299.374675:0:9407:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4b2f300 going to sleep for 11 seconds 00000100:00100000:0.0:1715330299.379578:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330299.380918:0:9407:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:9407:1798653942486656:192.168.204.49@tcp:104: 00010000:00010000:1.0:1715330299.380957:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd8c0/0xd895711d66d9485 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d947e expref: 18 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.380972:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff8801345c6700) 00010000:00010000:1.0:1715330299.380975:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330299.380979:0:9407:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd8c0/0xd895711d66d9485 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d947e expref: 18 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.380989:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfd8c0, rc 0) 00000100:00100000:1.0:1715330299.381057:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+18:7135:x1798653942486592:12345-0@lo:101:mdt00_002.0 Request processed in 7532us (7927us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330299.381070:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2960 00000100:00100000:2.0:1715330299.381177:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938055360 00000100:00100000:2.0:1715330299.381185:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938055360 00010000:00010000:2.0:1715330299.381211:0:9416:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d9294 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb909 expref: 30 pid: 25569 timeout: 373 lvb_type: 0 00000100:00100000:2.0:1715330299.381239:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1557 00000100:00100000:2.0:1715330299.381250:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+30:2011:x1798653938055360:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1715330299.381266:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330299.381271:0:9416:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d9294 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb909 expref: 30 pid: 25569 timeout: 373 lvb_type: 0 00010000:00010000:2.0:1715330299.381281:0:9416:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d9294 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb909 expref: 30 pid: 25569 timeout: 373 lvb_type: 0 00000100:00100000:3.0:1715330299.381295:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d55880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942486592:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1715330299.381304:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d9294 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb909 expref: 30 pid: 25569 timeout: 373 lvb_type: 0 00010000:00010000:3.0:1715330299.381327:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c000/0xd895711d66d947e lrc: 4/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9485 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.381332:0:9416:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff8801345c6700) 00010000:00010000:2.0:1715330299.381335:0:9416:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd8c0/0xd895711d66d9485 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d947e expref: 17 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.381338:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c000/0xd895711d66d947e lrc: 4/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9485 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.381344:0:9416:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd8c0/0xd895711d66d9485 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d947e expref: 17 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.381352:0:9416:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd8c0/0xd895711d66d9485 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d947e expref: 17 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.381384:0:9416:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd8c0/0xd895711d66d9485 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d947e expref: 17 pid: 9407 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330299.381404:0:9416:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba66d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:9416:1798653942486720:0@lo:105: 00000100:00100000:2.0:1715330299.381441:0:9416:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330299.381532:0:9416:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa000 going to sleep for 11 seconds 00000100:00100000:0.0:1715330299.381581:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942486720 00000100:00100000:0.0:1715330299.381585:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942486720 00000100:00100000:0.0:1715330299.381704:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1177 00000100:00100000:0.0:1715330299.381709:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:9416:x1798653942486720:12345-0@lo:105: 00010000:00010000:0.0:1715330299.381718:0:7118:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c000/0xd895711d66d947e lrc: 5/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9485 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.381726:0:7118:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c000/0xd895711d66d947e lrc: 5/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9485 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.381751:0:7118:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c000/0xd895711d66d947e lrc: 5/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9485 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.381757:0:7118:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c000/0xd895711d66d947e lrc: 5/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d9485 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.381763:0:7118:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c000/0xd895711d66d947e lrc: 6/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d9485 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.381770:0:7118:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c000/0xd895711d66d947e lrc: 6/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d9485 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1715330299.381860:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000-osp-MDT0001 older than 1715330269 00010000:00010000:0.0:1715330299.381908:0:7118:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88013457c000) 00000100:00100000:0.0:1715330299.381934:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:9416:x1798653942486720:12345-0@lo:105: Request processed in 224us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330299.381940:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1177 00010000:00010000:3.0:1715330299.382011:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c000/0xd895711d66d947e lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9485 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.382018:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c000/0xd895711d66d947e lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9485 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330299.382041:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00010000:00010000:3.0:1715330299.382070:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c6c0/0xd895711d66d948c lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330299.382076:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c6c0/0xd895711d66d948c lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.382084:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c6c0/0xd895711d66d948c lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT1 00000100:00100000:3.0:1715330299.382097:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d55880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942486784:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1715330299.382120:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330299.382139:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091cb5480 going to sleep for 11 seconds 00000100:00100000:1.0:1715330299.382176:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942486784 00000100:00100000:1.0:1715330299.382180:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942486784 00000100:00100000:1.0:1715330299.382195:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2961 00000100:00100000:1.0:1715330299.382199:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+18:7135:x1798653942486784:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330299.382214:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330299.382227:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d9493 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x35 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d948c expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.382242:0:9407:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d91d0 lrc: 2/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:1.0:1715330299.382248:0:9407:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d9493 lrc: 4/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d948c expref: 19 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.382259:0:9407:0:(ldlm_request.c:381:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d91d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 7148 initiator: MDT0 00080000:00080000:1.0:1715330299.382285:0:9407:0:(osd_handler.c:2696:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:1.0:1715330299.382330:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d9493 lrc: 3/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d948c expref: 19 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.382337:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x35 (ffff88008b233000) 00010000:00010000:1.0:1715330299.382339:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330299.382343:0:9407:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d9493 lrc: 3/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d948c expref: 19 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.382353:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bffcc0, rc 0) 00000100:00100000:1.0:1715330299.382374:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+19:7135:x1798653942486784:12345-0@lo:101:mdt00_002.0 Request processed in 174us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330299.382379:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2961 00000100:00100000:2.0:1715330299.383433:0:9416:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba66d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:9416:1798653942486720:0@lo:105: 00010000:00010000:2.0:1715330299.383447:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330299.383491:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+29:2011:x1798653938055360:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 2239us (3924us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330299.383500:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1557 00000100:00100000:3.0:1715330299.383960:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d55880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942486784:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1715330299.383975:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c6c0/0xd895711d66d948c lrc: 4/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9493 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.383982:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c6c0/0xd895711d66d948c lrc: 4/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9493 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1715330299.386162:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983528 is committed 00000001:00080000:1.0:1715330299.386195:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983527 is committed 00000020:00080000:1.0:1715330299.386239:0:7116:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 387 batchid updated 00010000:00010000:2.0:1715330299.386317:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f600/0xd895711d66d902c lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386328:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f600/0xd895711d66d902c lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386335:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f600/0xd895711d66d902c lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386340:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457f600 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330299.386344:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f600/0xd895711d66d902c lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386350:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f600/0xd895711d66d902c lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386365:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x39 (ffff88009ef25f00) 00010000:00010000:2.0:1715330299.386367:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330299.386371:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f600/0xd895711d66d902c lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386379:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f600/0xd895711d66d902c lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386399:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f3c0/0xd895711d66d9033 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1521:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386403:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f3c0/0xd895711d66d9033 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1521:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386407:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f3c0/0xd895711d66d9033 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1521:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386410:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457f3c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330299.386412:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f3c0/0xd895711d66d9033 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1521:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386415:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f3c0/0xd895711d66d9033 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1521:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386419:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1521:0x0].0x0 (ffff88008d68e400) 00010000:00010000:2.0:1715330299.386420:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:2.0:1715330299.386422:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f3c0/0xd895711d66d9033 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1521:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386425:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f3c0/0xd895711d66d9033 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1521:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386439:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457df80/0xd895711d66d9095 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386443:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457df80/0xd895711d66d9095 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386448:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457df80/0xd895711d66d9095 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386452:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457df80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330299.386454:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457df80/0xd895711d66d9095 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386458:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457df80/0xd895711d66d9095 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386464:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x36 (ffff880129edf600) 00010000:00010000:2.0:1715330299.386465:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330299.386467:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457df80/0xd895711d66d9095 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386471:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457df80/0xd895711d66d9095 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386480:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d909c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1520:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386484:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d909c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1520:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386488:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d909c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1520:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386492:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457d680 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330299.386494:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d909c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1520:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386498:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d909c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1520:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386503:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1520:0x0].0x0 (ffff88008d68e500) 00010000:00010000:2.0:1715330299.386504:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:2.0:1715330299.386507:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d909c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1520:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386511:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d909c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1520:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386522:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d90fe lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386526:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d90fe lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386530:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d90fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386534:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64900 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330299.386536:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d90fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386540:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d90fe lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386546:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x3031 (ffff88009396df00) 00010000:00010000:2.0:1715330299.386547:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330299.386549:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d90fe lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386553:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d90fe lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386578:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d9105 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1522:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386583:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d9105 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1522:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386595:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d9105 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1522:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386598:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db65d40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330299.386600:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d9105 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1522:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386604:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d9105 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1522:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386609:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1522:0x0].0x0 (ffff88009ef25b00) 00010000:00010000:2.0:1715330299.386611:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:2.0:1715330299.386613:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d9105 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1522:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386616:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d9105 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1522:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386632:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457db00/0xd895711d66d9167 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386638:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457db00/0xd895711d66d9167 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386642:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457db00/0xd895711d66d9167 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386646:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457db00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330299.386647:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457db00/0xd895711d66d9167 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386652:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457db00/0xd895711d66d9167 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386660:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x31 (ffff88008b233e00) 00010000:00010000:2.0:1715330299.386662:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330299.386665:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457db00/0xd895711d66d9167 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386669:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457db00/0xd895711d66d9167 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386682:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d916e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x151e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386687:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d916e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x151e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386691:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d916e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x151e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386695:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457e400 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330299.386697:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d916e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x151e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386701:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d916e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x151e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386706:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151e:0x0].0x0 (ffff8800ad981600) 00010000:00010000:2.0:1715330299.386708:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:2.0:1715330299.386710:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d916e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x151e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386713:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d916e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x151e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386726:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d91d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386764:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d91d0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386768:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d91d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386772:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457ef40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330299.386774:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d91d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386778:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d91d0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330299.386784:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x35 (ffff88008b233000) 00010000:00010000:2.0:1715330299.386785:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330299.386791:0:3674:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d9493 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d948c expref: 13 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.386801:0:3674:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d9493 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d948c expref: 13 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.386812:0:3674:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d9493 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d948c expref: 13 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.386853:0:3674:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d9493 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d948c expref: 13 pid: 9407 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330299.386866:0:3674:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3674:1798653942486848:0@lo:105: 00000100:00100000:2.0:1715330299.386923:0:3674:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330299.386944:0:3674:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa000 going to sleep for 11 seconds 00000020:00080000:3.0:1715330299.387000:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 387 00000004:00080000:3.0:1715330299.387062:0:7163:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880091cb5480 with version 716 00000020:00080000:3.0:1715330299.387070:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 387 cancel update log [0x240000401:0x3:0x0].371: rc = 0 00000020:00080000:3.0:1715330299.387138:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 387 cancel update log [0x200000400:0x3:0x0].372: rc = 0 00000020:00080000:3.0:1715330299.387144:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 387 00000004:00080000:3.0:1715330299.387162:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 716 rpc_version 716 00000020:00100000:3.0:1715330299.387184:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1715330299.387192:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880091d54700 x1798653942486976/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1715330299.387206:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d54700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942486976:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1715330299.387367:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330299.387381:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091cb5900 going to sleep for 11 seconds 00000100:00100000:3.0:1715330299.387405:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942486976 00000100:00100000:3.0:1715330299.387411:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942486976 00000100:00100000:3.0:1715330299.387445:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2962 00000100:00100000:3.0:1715330299.387452:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:8587:x1798653942486976:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1715330299.387562:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:8587:x1798653942486976:12345-0@lo:1000:osp_up1-0.0 Request processed in 111us (195us total) trans 4294968447 rc 0/0 00000100:00100000:3.0:1715330299.387569:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2962 00000100:00100000:1.0:1715330299.387778:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942486848 00000100:00100000:1.0:1715330299.387782:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942486848 00000100:00100000:1.0:1715330299.387802:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1178 00000100:00100000:1.0:1715330299.387806:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:3674:x1798653942486848:12345-0@lo:105: 00010000:00010000:1.0:1715330299.387815:0:7118:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c6c0/0xd895711d66d948c lrc: 5/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9493 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.387823:0:7118:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c6c0/0xd895711d66d948c lrc: 5/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9493 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.387829:0:7118:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c6c0/0xd895711d66d948c lrc: 5/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9493 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.387834:0:7118:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c6c0/0xd895711d66d948c lrc: 5/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d9493 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.387839:0:7118:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c6c0/0xd895711d66d948c lrc: 6/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d9493 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.387846:0:7118:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c6c0/0xd895711d66d948c lrc: 6/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d9493 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.387859:0:7118:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88013457c6c0) 00000100:00100000:1.0:1715330299.387886:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:3674:x1798653942486848:12345-0@lo:105: Request processed in 79us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330299.387891:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1178 00010000:00010000:3.0:1715330299.387969:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c6c0/0xd895711d66d948c lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9493 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.387977:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c6c0/0xd895711d66d948c lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9493 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330299.388002:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00000100:00100000:3.0:1715330299.388029:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d55880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942487040:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1715330299.388053:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330299.388063:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63780 going to sleep for 11 seconds 00000100:00100000:3.0:1715330299.388070:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942487040 00000100:00100000:3.0:1715330299.388072:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942487040 00000100:00100000:3.0:1715330299.388086:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2963 00000100:00100000:3.0:1715330299.388090:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:7135:x1798653942487040:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1715330299.388128:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:7135:x1798653942487040:12345-0@lo:1000:mdt00_002.0 Request processed in 37us (75us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330299.388133:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2963 00000100:00100000:3.0:1715330299.388153:0:7135:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983528 gen 2 00000004:00080000:3.0:1715330299.388158:0:7135:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983513 committed transno 4294983528 00000004:00080000:3.0:1715330299.388173:0:7135:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983514 committed transno 4294983528 00000004:00080000:3.0:1715330299.388184:0:7135:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983515 committed transno 4294983528 00000004:00080000:3.0:1715330299.388198:0:7135:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983516 committed transno 4294983528 00000004:00080000:3.0:1715330299.388211:0:7135:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983528 committed transno 4294983528 00000100:00100000:3.0:1715330299.388228:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d55880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942487040:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1715330299.388261:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d55880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942487104:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1715330299.388275:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330299.388282:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496f540 going to sleep for 11 seconds 00000100:00100000:3.0:1715330299.388288:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942487104 00000100:00100000:3.0:1715330299.388290:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942487104 00000100:00100000:3.0:1715330299.388300:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2964 00000100:00100000:3.0:1715330299.388303:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:7135:x1798653942487104:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1715330299.388351:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:7135:x1798653942487104:12345-0@lo:1000:mdt00_002.0 Request processed in 46us (75us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330299.388355:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2964 00000100:00100000:3.0:1715330299.388370:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d55880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942487104:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1715330299.388394:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d55880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942487168:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1715330299.388408:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330299.388415:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496f540 going to sleep for 11 seconds 00000100:00100000:3.0:1715330299.388420:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942487168 00000100:00100000:3.0:1715330299.388423:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942487168 00000100:00100000:3.0:1715330299.388433:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2965 00000100:00100000:3.0:1715330299.388436:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:7135:x1798653942487168:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1715330299.388472:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:7135:x1798653942487168:12345-0@lo:1000:mdt00_002.0 Request processed in 35us (64us total) trans 0 rc -2/-2 00000100:00100000:3.0:1715330299.388476:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2965 00000100:00100000:3.0:1715330299.389857:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d55880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942487168:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1715330299.389860:0:8587:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968430 gen 2 00000004:00080000:2.0:1715330299.389866:0:8587:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968425 committed transno 4294968430 00000020:00080000:2.0:1715330299.389871:0:8587:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88008d667600 refcount 2 committed 0 result 0 batchid 388 00000020:00080000:2.0:1715330299.389875:0:8587:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009ef25600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88008d6670c0 00000020:00080000:2.0:1715330299.389878:0:8587:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009ef25900 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88008d667a80 00000004:00080000:3.0:1715330299.389882:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00000020:00080000:2.0:1715330299.389885:0:8587:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].372 00000020:00080000:2.0:1715330299.389887:0:8587:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009ef25400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88009b953600 00010000:00010000:3.0:1715330299.389889:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c000/0xd895711d66d947e lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9485 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000020:00080000:2.0:1715330299.389889:0:8587:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].373 00010000:00010000:3.0:1715330299.389899:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c000/0xd895711d66d947e lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9485 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.389906:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c000/0xd895711d66d947e lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9485 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000020:00080000:3.0:1715330299.389919:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 388 committed batchid 387 00000004:00080000:2.0:1715330299.389919:0:8587:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968426 committed transno 4294968430 00000020:00080000:2.0:1715330299.389922:0:8587:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88008d667e40 refcount 2 committed 0 result 0 batchid 389 00000020:00080000:2.0:1715330299.389925:0:8587:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008b2f5900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88009d7e3a80 00000020:00080000:2.0:1715330299.389928:0:8587:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008779d700 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88008d667f00 00000020:00080000:2.0:1715330299.389931:0:8587:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].373 00000020:00080000:2.0:1715330299.389932:0:8587:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880129edfd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88009b953200 00000020:00080000:2.0:1715330299.389935:0:8587:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].374 00000004:00080000:2.0:1715330299.389955:0:8587:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968427 committed transno 4294968430 00000020:00080000:2.0:1715330299.389959:0:8587:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff880134435000 refcount 2 committed 0 result 0 batchid 390 00000020:00080000:2.0:1715330299.389961:0:8587:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009396dc00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff880091ffa300 00000020:00080000:3.0:1715330299.389962:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 389 committed batchid 387 00000020:00080000:2.0:1715330299.389964:0:8587:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009396d300 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8801344356c0 00000020:00080000:2.0:1715330299.389966:0:8587:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].374 00000020:00080000:2.0:1715330299.389967:0:8587:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009396d200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff880091f46000 00000020:00080000:2.0:1715330299.389969:0:8587:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].375 00000020:00080000:3.0:1715330299.389970:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 387 00010000:00010000:3.0:1715330299.389994:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1715330299.389998:0:8587:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968428 committed transno 4294968430 00000004:00080000:3.0:1715330299.389999:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00000020:00080000:2.0:1715330299.390001:0:8587:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88011db63f00 refcount 2 committed 0 result 0 batchid 391 00000020:00080000:3.0:1715330299.390003:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 390 committed batchid 387 00000020:00080000:2.0:1715330299.390003:0:8587:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008b233500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88011db63540 00000020:00080000:2.0:1715330299.390006:0:8587:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008b233f00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88011db636c0 00000020:00080000:2.0:1715330299.390009:0:8587:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].375 00000020:00080000:2.0:1715330299.390011:0:8587:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008b233800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88011dad0600 00000020:00080000:3.0:1715330299.390013:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 387 00000020:00080000:2.0:1715330299.390013:0:8587:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].376 00010000:00010000:3.0:1715330299.390019:0:9415:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1715330299.390025:0:9415:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c000/0xd895711d66d947e lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d9485 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715330299.390033:0:8587:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968429 committed transno 4294968430 00000020:00080000:2.0:1715330299.390035:0:8587:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff880091ffab40 refcount 2 committed 0 result 0 batchid 392 00010000:00010000:3.0:1715330299.390036:0:9415:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457c000 already unused, calling callback (ffffffffa0ee9520) 00000020:00080000:2.0:1715330299.390037:0:8587:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009396da00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff880134435f00 00000020:00080000:2.0:1715330299.390039:0:8587:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009396d700 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff880091ffacc0 00010000:00010000:3.0:1715330299.390041:0:9415:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c000/0xd895711d66d947e lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d9485 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000020:00080000:2.0:1715330299.390042:0:8587:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].376 00000020:00080000:2.0:1715330299.390044:0:8587:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009396d400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff880091f46800 00000020:00080000:2.0:1715330299.390046:0:8587:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].377 00000004:00010000:3.0:1715330299.390049:0:9415:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c000/0xd895711d66d947e lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d9485 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330299.390057:0:3674:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3674:1798653942486848:0@lo:105: 00000004:00080000:2.0:1715330299.390065:0:8587:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968430 committed transno 4294968430 00000020:00080000:2.0:1715330299.390068:0:8587:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88011db63b40 refcount 2 committed 0 result 0 batchid 393 00000020:00080000:2.0:1715330299.390070:0:8587:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008b233200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff880091cb5180 00000020:00080000:2.0:1715330299.390072:0:8587:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008b233100 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88011db630c0 00010000:00010000:1.0:1715330299.390072:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d91d0 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 7148 initiator: MDT0 00000020:00080000:2.0:1715330299.390074:0:8587:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].377 00010000:00010000:3.0:1715330299.390075:0:9415:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c000/0xd895711d66d947e lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9485 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000020:00080000:2.0:1715330299.390075:0:8587:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008b233c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88011dad0800 00000020:00080000:2.0:1715330299.390077:0:8587:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].378 00010000:00010000:1.0:1715330299.390080:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d91d0 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330299.390081:0:9415:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1715330299.390095:0:8587:0:(client.c:3000:ptlrpc_free_committed()) @@@ stopping search req@ffff880091d54700 x1798653942486976/t4294968447(4294968447) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1715330315 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up1-0.0' uid:0 gid:0 00000100:00100000:2.0:1715330299.390110:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d54700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942486976:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1715330299.390130:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942487232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1715330299.390165:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1715330299.390188:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 393 committed batchid 387 00000020:00080000:2.0:1715330299.390207:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 387 00000100:00100000:2.0:1715330299.390218:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942487232 00000100:00100000:2.0:1715330299.390223:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942487232 00010000:00010000:1.0:1715330299.390617:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d91d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x151f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:1.0:1715330299.390623:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d91d7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x151f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:1.0:1715330299.390628:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d91d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x151f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:1.0:1715330299.390632:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457f840 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330299.390635:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d91d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x151f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:1.0:1715330299.390640:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d91d7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x151f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7148 initiator: MDT0 00010000:00010000:1.0:1715330299.390650:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151f:0x0].0x0 (ffff88008d68e000) 00010000:00010000:1.0:1715330299.390652:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:1.0:1715330299.390655:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d91d7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x151f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:1.0:1715330299.390661:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d91d7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x151f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:1.0:1715330299.390681:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d9239 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:1.0:1715330299.390686:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d9239 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:1.0:1715330299.390691:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d9239 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:1.0:1715330299.390695:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330299.390697:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d9239 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:1.0:1715330299.390701:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d9239 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7148 initiator: MDT0 00010000:00010000:1.0:1715330299.390706:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x30 (ffff8801345c6c00) 00010000:00010000:1.0:1715330299.390708:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330299.390710:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d9239 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:1.0:1715330299.390714:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d9239 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:1.0:1715330299.390724:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d9240 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x151d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:1.0:1715330299.390728:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d9240 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x151d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:1.0:1715330299.390747:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d9240 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x151d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:1.0:1715330299.390752:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db65440 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330299.390755:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d9240 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x151d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:1.0:1715330299.390759:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d9240 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x151d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7148 initiator: MDT0 00010000:00010000:1.0:1715330299.390768:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x151d:0x0].0x0 (ffff88008d68ef00) 00010000:00010000:1.0:1715330299.390769:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:1.0:1715330299.390771:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d9240 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x151d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:1.0:1715330299.390776:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d9240 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x151d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330299.390836:0:9415:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c000/0xd895711d66d947e lrc: 1/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9485 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.390843:0:9415:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c000/0xd895711d66d947e lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9485 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.390862:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715330299.390864:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715330299.390865:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330299.390870:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1370 00010000:00010000:3.0:1715330299.390877:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c6c0/0xd895711d66d948c lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9493 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330299.390879:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+14:3691:x1798653942487232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1715330299.390883:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c6c0/0xd895711d66d948c lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9493 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.390890:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c6c0/0xd895711d66d948c lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9493 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.390893:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330299.390900:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1715330299.390912:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd8c0/0xd895711d66d9485 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d947e expref: 14 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.390924:0:9416:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff8801345c6700) 00010000:00010000:2.0:1715330299.390931:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330299.390938:0:7124:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715330299.390944:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c6c0/0xd895711d66d948c lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d9493 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.390965:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457c6c0 already unused, calling callback (ffffffffa0ee9520) 00000100:00100000:2.0:1715330299.390969:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+13:3691:x1798653942487232:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (803us total) trans 0 rc 0/0 00010000:00010000:1.0:1715330299.390970:0:7124:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c6c0/0xd895711d66d948c lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d9493 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330299.390977:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1370 00000004:00010000:1.0:1715330299.390978:0:7124:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c6c0/0xd895711d66d948c lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d9493 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330299.390982:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+16:17754:x1798653938055296:12345-192.168.204.49@tcp:36:rm.0 Request processed in 18862us (19129us total) trans 0 rc -2/-2 00000100:00100000:3.0:1715330299.390989:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23513 00010000:00010000:1.0:1715330299.390997:0:7124:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c6c0/0xd895711d66d948c lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9493 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.391002:0:7124:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1715330299.391004:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942487232:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330299.391018:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c6c0/0xd895711d66d948c lrc: 1/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9493 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330299.391021:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942487296:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330299.391025:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c6c0/0xd895711d66d948c lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9493 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.391037:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330299.391038:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330299.391039:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330299.391043:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330299.391055:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942487296 00000100:00100000:2.0:1715330299.391058:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942487296 00000100:00100000:2.0:1715330299.391072:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1371 00000100:00100000:2.0:1715330299.391075:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+13:3688:x1798653942487296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715330299.391081:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330299.391090:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d9493 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d948c expref: 13 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.391100:0:9416:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x35 (ffff88008b233000) 00010000:00010000:2.0:1715330299.391106:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330299.391135:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942487296:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (91us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330299.391140:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1371 00000100:00100000:3.0:1715330299.391182:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942487296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330299.392940:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330299.393031:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938055488 00000100:00100000:3.0:1715330299.393038:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938055488 00000100:00100000:3.0:1715330299.393120:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23514 00000100:00100000:3.0:1715330299.393126:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+16:17754:x1798653938055488:12345-192.168.204.49@tcp:36:rm.0 00010000:00010000:3.0:1715330299.393170:0:7135:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330299.393189:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67cc0/0xd895711d66d9286 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb902 expref: 16 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.393203:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff8801345c6400) 00010000:00010000:3.0:1715330299.393210:0:7135:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330299.393235:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e1c0/0xd895711d66d949a lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330299.393247:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e1c0/0xd895711d66d949a lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.393255:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e1c0/0xd895711d66d949a lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.393264:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457cfc0/0xd895711d66d94a1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330299.393269:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457cfc0/0xd895711d66d94a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.393275:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013457cfc0/0xd895711d66d94a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.393335:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c900/0xd895711d66d94a8 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x191:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330299.393341:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c900/0xd895711d66d94a8 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x191:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.393347:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c900/0xd895711d66d94a8 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x191:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000040:00080000:3.0:1715330299.394084:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1715330299.394089:0:7135:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 273870357703ns, next at 274870356240ns, rc = 0 00010000:00010000:3.0:1715330299.394132:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e400/0xd895711d66d94af lrc: 3/0,1 mode: --/PW res: [0x240000402:0x191:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330299.394139:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e400/0xd895711d66d94af lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x191:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.394145:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e400/0xd895711d66d94af lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x191:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.394151:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e400/0xd895711d66d94af lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x191:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.394155:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e400/0xd895711d66d94af lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x191:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.394159:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e400/0xd895711d66d94af lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x191:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.394164:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e400/0xd895711d66d94af lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x191:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.394172:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457e400 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330299.394176:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e400/0xd895711d66d94af lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x191:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.394182:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e400/0xd895711d66d94af lrc: 5/0,0 mode: PW/PW res: [0x240000402:0x191:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.394187:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x191:0x0].0x0 (ffff880091ea7e00) 00010000:00010000:3.0:1715330299.394189:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330299.394192:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e400/0xd895711d66d94af lrc: 3/0,0 mode: --/PW res: [0x240000402:0x191:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.394196:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e400/0xd895711d66d94af lrc: 0/0,0 mode: --/PW res: [0x240000402:0x191:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.394219:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c900/0xd895711d66d94a8 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x191:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.394222:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c900/0xd895711d66d94a8 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x191:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.394225:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c900/0xd895711d66d94a8 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x191:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.394228:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457c900 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330299.394231:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c900/0xd895711d66d94a8 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x191:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.394235:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c900/0xd895711d66d94a8 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x191:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.394241:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x191:0x0].0x0 (ffff880091ea7e00) 00010000:00010000:3.0:1715330299.394243:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330299.394246:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c900/0xd895711d66d94a8 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x191:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.394251:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c900/0xd895711d66d94a8 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x191:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.394365:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e1c0/0xd895711d66d949a lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.394371:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e1c0/0xd895711d66d949a lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.394375:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e1c0/0xd895711d66d949a lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.394380:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e1c0/0xd895711d66d949a lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.394384:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457e1c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330299.394386:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e1c0/0xd895711d66d949a lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.394391:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e1c0/0xd895711d66d949a lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.394398:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff880091ea7a00) 00010000:00010000:3.0:1715330299.394400:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330299.394402:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e1c0/0xd895711d66d949a lrc: 3/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.394406:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e1c0/0xd895711d66d949a lrc: 0/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00000004:00010000:3.0:1715330299.394417:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012cc7a300 reply state ffff88009d514000 transno 4294968448 ns: mdt-lustre-MDT0001_UUID lock: ffff88013457cfc0/0xd895711d66d94a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.394429:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457cfc0/0xd895711d66d94a1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.394434:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x35 (ffff880091ea7900) 00010000:00010000:3.0:1715330299.394437:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330299.394439:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330299.394521:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:17754:x1798653938055488:12345-192.168.204.49@tcp:36:rm.0 Request processed in 1392us (1583us total) trans 4294968448 rc 0/0 00000100:00100000:3.0:1715330299.394530:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23514 00000100:00100000:2.0:1715330299.398613:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330299.398714:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938055616 00000100:00100000:3.0:1715330299.398724:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938055616 00000100:00100000:3.0:1715330299.398802:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23515 00000100:00100000:3.0:1715330299.398811:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:17754:x1798653938055616:12345-192.168.204.49@tcp:36:rm.0 00010000:00010000:3.0:1715330299.398871:0:7135:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330299.398899:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a0900/0xd895711d66d936d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb94f expref: 17 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.398918:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x190:0x0].0x0 (ffff88009bbf0c00) 00010000:00010000:3.0:1715330299.398928:0:7135:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330299.398974:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c000/0xd895711d66d94b6 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330299.398982:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c000/0xd895711d66d94b6 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.398991:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c000/0xd895711d66d94b6 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT1 00000100:00100000:3.0:1715330299.399011:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d57480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942487360:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1715330299.399062:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330299.399096:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496f540 going to sleep for 11 seconds 00000100:00100000:0.0:1715330299.399115:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942487360 00000100:00100000:0.0:1715330299.399120:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942487360 00000100:00100000:0.0:1715330299.399154:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2966 00000100:00100000:0.0:1715330299.399159:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:7135:x1798653942487360:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330299.399173:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330299.399187:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3cc0/0xd895711d66d94bd lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d94b6 expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.399209:0:9408:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3cc0/0xd895711d66d94bd lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d94b6 expref: 13 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.399221:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3cc0/0xd895711d66d94bd lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d94b6 expref: 13 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.399226:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff88009bbf0800) 00010000:00010000:0.0:1715330299.399228:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330299.399231:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a3cc0, rc 0) 00000100:00100000:0.0:1715330299.399275:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+13:7135:x1798653942487360:12345-0@lo:101:mdt00_002.0 Request processed in 115us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330299.399280:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2966 00000100:00100000:3.0:1715330299.399571:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d57480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942487360:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1715330299.399585:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c000/0xd895711d66d94b6 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d94bd expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.399594:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c000/0xd895711d66d94b6 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d94bd expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330299.399611:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00010000:00010000:3.0:1715330299.399626:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457db00/0xd895711d66d94c4 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330299.399630:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457db00/0xd895711d66d94c4 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330299.399636:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457db00/0xd895711d66d94c4 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT1 00000100:00100000:3.0:1715330299.399644:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d57480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942487424:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1715330299.399662:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330299.399671:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496f540 going to sleep for 11 seconds 00000100:00100000:0.0:1715330299.399719:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942487424 00000100:00100000:0.0:1715330299.399722:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942487424 00000100:00100000:0.0:1715330299.399766:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2967 00000100:00100000:0.0:1715330299.399770:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+13:7135:x1798653942487424:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330299.399777:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330299.399786:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66d94cb lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d94c4 expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.399798:0:9408:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66d94cb lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d94c4 expref: 14 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.399805:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66d94cb lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d94c4 expref: 14 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.399814:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x31 (ffff88009bbf0500) 00010000:00010000:0.0:1715330299.399817:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330299.399818:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a2880, rc 0) 00000100:00100000:0.0:1715330299.399848:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:7135:x1798653942487424:12345-0@lo:101:mdt00_002.0 Request processed in 77us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330299.399854:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2967 00000100:00100000:2.0:1715330299.399873:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d57480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942487424:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1715330299.399880:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457db00/0xd895711d66d94c4 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d94cb expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.399886:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457db00/0xd895711d66d94c4 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d94cb expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715330299.399893:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00000100:00100000:2.0:1715330299.399923:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba67480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942487488:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1715330299.399947:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330299.399956:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa600 going to sleep for 11 seconds 00000100:00100000:3.0:1715330299.400890:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942487488 00000100:00100000:3.0:1715330299.400896:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942487488 00000100:00100000:3.0:1715330299.400918:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2968 00000100:00100000:3.0:1715330299.400923:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:7135:x1798653942487488:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1715330299.401001:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:7135:x1798653942487488:12345-0@lo:1000:mdt00_002.0 Request processed in 77us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330299.401006:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2968 00000100:00100000:2.0:1715330299.401157:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba67480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942487488:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1715330299.401201:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba67480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942487552:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1715330299.401220:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330299.401228:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa600 going to sleep for 11 seconds 00000100:00100000:0.0:1715330299.401285:0:24873:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942487552 00000100:00100000:0.0:1715330299.401290:0:24873:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942487552 00000100:00100000:3.0:1715330299.401413:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2969 00000100:00100000:3.0:1715330299.401418:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:7135:x1798653942487552:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1715330299.401485:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:7135:x1798653942487552:12345-0@lo:1000:mdt00_002.0 Request processed in 66us (264us total) trans 0 rc -2/-2 00000100:00100000:3.0:1715330299.401493:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2969 00000100:00100000:2.0:1715330299.401570:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba67480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942487552:0@lo:1000:mdt00_002.0 00000004:00080000:2.0:1715330299.401586:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00010000:00010000:2.0:1715330299.401592:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c000/0xd895711d66d94b6 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d94bd expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.401600:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c000/0xd895711d66d94b6 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d94bd expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.401606:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c000/0xd895711d66d94b6 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d94bd expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.401632:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1715330299.401638:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00010000:00010000:2.0:1715330299.401641:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457db00/0xd895711d66d94c4 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d94cb expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.401647:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457db00/0xd895711d66d94c4 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d94cb expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.401652:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457db00/0xd895711d66d94c4 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d94cb expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.401669:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1715330299.401695:0:7123:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1715330299.401704:0:7123:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c000/0xd895711d66d94b6 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d94bd expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.401712:0:7123:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457c000 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330299.401717:0:7123:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c000/0xd895711d66d94b6 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d94bd expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330299.401722:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+16:17754:x1798653938055616:12345-192.168.204.49@tcp:36:rm.0 Request processed in 2910us (3121us total) trans 0 rc -2/-2 00000004:00010000:1.0:1715330299.401726:0:7123:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c000/0xd895711d66d94b6 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d94bd expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330299.401728:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23515 00010000:00010000:1.0:1715330299.401768:0:7123:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c000/0xd895711d66d94b6 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d94bd expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.401773:0:7123:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330299.401809:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715330299.401814:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457db00/0xd895711d66d94c4 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d94cb expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.401819:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457db00 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330299.401822:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457db00/0xd895711d66d94c4 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d94cb expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330299.401828:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457db00/0xd895711d66d94c4 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d94cb expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330299.401856:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942487616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1715330299.401879:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1715330299.401925:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457db00/0xd895711d66d94c4 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d94cb expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.401930:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330299.401941:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457db00/0xd895711d66d94c4 lrc: 1/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d94cb expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.401946:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457db00/0xd895711d66d94c4 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d94cb expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330299.402220:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1715330299.402229:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cc78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942487680:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1715330299.402248:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330299.402268:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942487616 00000100:00100000:2.0:1715330299.402271:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942487616 00000100:00100000:2.0:1715330299.402298:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942487680 00000100:00100000:2.0:1715330299.402300:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942487680 00000100:00100000:2.0:1715330299.402322:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1372 00000100:00100000:2.0:1715330299.402327:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+15:3689:x1798653942487616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715330299.402417:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330299.402431:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3cc0/0xd895711d66d94bd lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d94b6 expref: 15 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.402453:0:9416:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff88009bbf0800) 00010000:00010000:2.0:1715330299.402462:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330299.402479:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+14:3689:x1798653942487616:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330299.402484:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1372 00000100:00100000:2.0:1715330299.402495:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1373 00000100:00100000:2.0:1715330299.402499:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+13:3691:x1798653942487680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715330299.402504:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330299.402512:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66d94cb lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d94c4 expref: 13 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.402520:0:9416:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x31 (ffff88009bbf0500) 00010000:00010000:2.0:1715330299.402524:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330299.402537:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+12:3691:x1798653942487680:12345-0@lo:103:ldlm_bl.0 Request processed in 38us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330299.402542:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1373 00000100:00100000:3.0:1715330299.402550:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942487616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1715330299.402561:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cc78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942487680:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330299.402590:0:7123:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c000/0xd895711d66d94b6 lrc: 1/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d94bd expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.402594:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330299.402596:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330299.402597:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c000/0xd895711d66d94b6 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d94bd expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.402597:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330299.402610:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330299.402612:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330299.402614:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330299.404367:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330299.404412:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938055744 00000100:00100000:2.0:1715330299.404419:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938055744 00000100:00100000:2.0:1715330299.404461:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23516 00000100:00100000:2.0:1715330299.404467:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+16:17754:x1798653938055744:12345-192.168.204.49@tcp:36:rm.0 00010000:00010000:2.0:1715330299.404536:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67cc0/0xd895711d66d94d2 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.404550:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67cc0/0xd895711d66d94d2 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330299.404564:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67cc0/0xd895711d66d94d2 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330299.404574:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d94d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.404579:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d94d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330299.404584:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d94d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330299.404622:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66640/0xd895711d66d94e0 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x190:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.404628:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66640/0xd895711d66d94e0 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x190:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330299.404633:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66640/0xd895711d66d94e0 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x190:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000040:00080000:2.0:1715330299.404868:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1715330299.404874:0:7135:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 273881141970ns, next at 274881140455ns, rc = 0 00010000:00010000:2.0:1715330299.404909:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d94e7 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x190:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.404916:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d94e7 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x190:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330299.404922:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d94e7 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x190:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330299.404929:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d94e7 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x190:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330299.404938:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d94e7 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x190:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330299.404943:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d94e7 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x190:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330299.404949:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d94e7 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x190:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330299.404953:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db65d40 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330299.404957:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d94e7 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x190:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330299.404962:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d94e7 lrc: 5/0,0 mode: PW/PW res: [0x240000402:0x190:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330299.404970:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x190:0x0].0x0 (ffff88008d5ee400) 00010000:00010000:2.0:1715330299.404973:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1715330299.404975:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d94e7 lrc: 3/0,0 mode: --/PW res: [0x240000402:0x190:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330299.404980:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d94e7 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x190:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330299.405003:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66640/0xd895711d66d94e0 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x190:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330299.405008:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66640/0xd895711d66d94e0 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x190:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330299.405013:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66640/0xd895711d66d94e0 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x190:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330299.405017:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330299.405020:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66640/0xd895711d66d94e0 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x190:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330299.405025:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66640/0xd895711d66d94e0 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x190:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330299.405030:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x190:0x0].0x0 (ffff88008d5ee400) 00010000:00010000:2.0:1715330299.405031:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330299.405033:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66640/0xd895711d66d94e0 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x190:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330299.405038:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66640/0xd895711d66d94e0 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x190:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330299.405120:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67cc0/0xd895711d66d94d2 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330299.405125:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67cc0/0xd895711d66d94d2 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330299.405130:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67cc0/0xd895711d66d94d2 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330299.405134:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67cc0/0xd895711d66d94d2 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330299.405138:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db67cc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330299.405140:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67cc0/0xd895711d66d94d2 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330299.405144:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67cc0/0xd895711d66d94d2 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330299.405149:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff88008d5ee300) 00010000:00010000:2.0:1715330299.405150:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330299.405153:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67cc0/0xd895711d66d94d2 lrc: 3/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330299.405158:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67cc0/0xd895711d66d94d2 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00000004:00010000:2.0:1715330299.405166:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012cc79880 reply state ffff88009d7c4000 transno 4294968449 ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d94d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330299.405173:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d94d9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330299.405178:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x31 (ffff88008d5ee200) 00010000:00010000:2.0:1715330299.405180:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330299.405182:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1715330299.405245:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+18:17754:x1798653938055744:12345-192.168.204.49@tcp:36:rm.0 Request processed in 777us (882us total) trans 4294968449 rc 0/0 00000100:00100000:2.0:1715330299.405252:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23516 00000100:00100000:0.0:1715330299.409585:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330299.409687:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938055872 00000100:00100000:1.0:1715330299.409696:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938055872 00000100:00100000:1.0:1715330299.409776:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23517 00000100:00100000:1.0:1715330299.409784:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+18:17754:x1798653938055872:12345-192.168.204.49@tcp:36:rm.0 00010000:00010000:1.0:1715330299.409840:0:25569:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330299.409866:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd200/0xd895711d66d942a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x18e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb98e expref: 18 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.409885:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18e:0x0].0x0 (ffff880093b42b00) 00010000:00010000:1.0:1715330299.409894:0:25569:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330299.409938:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bffcc0/0xd895711d66d94ee lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330299.409946:0:25569:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bffcc0/0xd895711d66d94ee lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.409954:0:25569:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bffcc0/0xd895711d66d94ee lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 25569 initiator: MDT1 00000100:00100000:1.0:1715330299.409973:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48d180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942487744:0@lo:101:mdt00_005.0 00000100:00100000:1.0:1715330299.410017:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330299.410057:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4b2f300 going to sleep for 11 seconds 00000100:00100000:3.0:1715330299.410875:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942487744 00000100:00100000:3.0:1715330299.410881:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942487744 00000100:00100000:3.0:1715330299.410913:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2970 00000100:00100000:3.0:1715330299.410918:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:25569:x1798653942487744:12345-0@lo:101:mdt00_005.0 00010000:00010000:3.0:1715330299.410932:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330299.410949:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457db00/0xd895711d66d94f5 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d94ee expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.410971:0:9407:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457db00/0xd895711d66d94f5 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d94ee expref: 13 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.410983:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457db00/0xd895711d66d94f5 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d94ee expref: 13 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.410990:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff880091ea7f00) 00010000:00010000:3.0:1715330299.410992:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330299.410994:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013457db00, rc 0) 00000100:00100000:3.0:1715330299.411030:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+13:25569:x1798653942487744:12345-0@lo:101:mdt00_005.0 Request processed in 112us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330299.411036:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2970 00000100:00100000:1.0:1715330299.411097:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48d180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942487744:0@lo:101:mdt00_005.0 00010000:00010000:1.0:1715330299.411112:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bffcc0/0xd895711d66d94ee lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d94f5 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.411121:0:25569:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bffcc0/0xd895711d66d94ee lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d94f5 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330299.411144:0:25569:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00010000:00010000:1.0:1715330299.411163:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd8c0/0xd895711d66d94fc lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330299.411168:0:25569:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd8c0/0xd895711d66d94fc lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.411175:0:25569:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd8c0/0xd895711d66d94fc lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 25569 initiator: MDT1 00000100:00100000:1.0:1715330299.411185:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48d180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942487808:0@lo:101:mdt00_005.0 00000100:00100000:1.0:1715330299.411206:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330299.411234:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4b2f300 going to sleep for 11 seconds 00000100:00100000:2.0:1715330299.411286:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942487808 00000100:00100000:2.0:1715330299.411291:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942487808 00000100:00100000:2.0:1715330299.411325:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2971 00000100:00100000:2.0:1715330299.411329:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+13:25569:x1798653942487808:12345-0@lo:101:mdt00_005.0 00010000:00010000:2.0:1715330299.411336:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330299.411347:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9503 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d94fc expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.411361:0:9408:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9503 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d94fc expref: 14 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.411369:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9503 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d94fc expref: 14 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.411379:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x36 (ffff88008d5ee700) 00010000:00010000:2.0:1715330299.411381:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330299.411383:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db64900, rc 0) 00000100:00100000:2.0:1715330299.411407:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942487808:12345-0@lo:101:mdt00_005.0 Request processed in 77us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330299.411413:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2971 00000100:00100000:1.0:1715330299.411464:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48d180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942487808:0@lo:101:mdt00_005.0 00010000:00010000:1.0:1715330299.411472:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd8c0/0xd895711d66d94fc lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9503 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.411478:0:25569:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd8c0/0xd895711d66d94fc lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9503 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330299.411488:0:25569:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00000100:00100000:1.0:1715330299.411516:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48d180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942487872:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1715330299.411538:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330299.411547:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4b2f780 going to sleep for 11 seconds 00000100:00100000:2.0:1715330299.412283:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942487872 00000100:00100000:2.0:1715330299.412288:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942487872 00000100:00100000:2.0:1715330299.412726:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2972 00000100:00100000:2.0:1715330299.412761:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942487872:12345-0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1715330299.413042:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942487872:12345-0@lo:1000:mdt00_005.0 Request processed in 280us (1503us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330299.413050:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2972 00000100:00100000:1.0:1715330299.413379:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48d180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942487872:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1715330299.413437:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48d180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942487936:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1715330299.413462:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330299.413546:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4b2f780 going to sleep for 11 seconds 00000100:00100000:3.0:1715330299.413585:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942487936 00000100:00100000:3.0:1715330299.413591:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942487936 00000100:00100000:3.0:1715330299.413619:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2973 00000100:00100000:3.0:1715330299.413625:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942487936:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1715330299.413703:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942487936:12345-0@lo:1000:mdt00_005.0 Request processed in 77us (239us total) trans 0 rc -2/-2 00000100:00100000:3.0:1715330299.413708:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2973 00000100:00100000:1.0:1715330299.413791:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48d180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942487936:0@lo:1000:mdt00_005.0 00000004:00080000:1.0:1715330299.413810:0:25569:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00010000:00010000:1.0:1715330299.413817:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bffcc0/0xd895711d66d94ee lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d94f5 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.413826:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bffcc0/0xd895711d66d94ee lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d94f5 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.413833:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bffcc0/0xd895711d66d94ee lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d94f5 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.413846:0:25569:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1715330299.413851:0:25569:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00010000:00010000:1.0:1715330299.413853:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd8c0/0xd895711d66d94fc lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9503 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.413858:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd8c0/0xd895711d66d94fc lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9503 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.413864:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd8c0/0xd895711d66d94fc lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9503 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.413879:0:25569:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1715330299.413935:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+17:17754:x1798653938055872:12345-192.168.204.49@tcp:36:rm.0 Request processed in 4150us (4359us total) trans 0 rc -2/-2 00000100:00100000:1.0:1715330299.413942:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23517 00010000:00010000:3.0:1715330299.414009:0:9415:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1715330299.414015:0:9415:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bffcc0/0xd895711d66d94ee lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d94f5 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.414022:0:9415:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bffcc0 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:3.0:1715330299.414027:0:9415:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bffcc0/0xd895711d66d94ee lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d94f5 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1715330299.414034:0:9415:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bffcc0/0xd895711d66d94ee lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d94f5 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.414057:0:9415:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bffcc0/0xd895711d66d94ee lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d94f5 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.414061:0:9415:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1715330299.414197:0:9415:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bffcc0/0xd895711d66d94ee lrc: 1/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d94f5 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.414203:0:9415:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bffcc0/0xd895711d66d94ee lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d94f5 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.414219:0:9415:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1715330299.414222:0:9415:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd8c0/0xd895711d66d94fc lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d9503 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.414226:0:9415:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfd8c0 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:3.0:1715330299.414229:0:9415:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd8c0/0xd895711d66d94fc lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d9503 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1715330299.414234:0:9415:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd8c0/0xd895711d66d94fc lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d9503 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.414246:0:9415:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd8c0/0xd895711d66d94fc lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9503 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.414251:0:9415:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1715330299.414262:0:9415:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd8c0/0xd895711d66d94fc lrc: 1/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9503 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.414267:0:9415:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd8c0/0xd895711d66d94fc lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9503 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.414278:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715330299.414279:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715330299.414280:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330299.414287:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1715330299.414295:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942488064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1715330299.414335:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330299.414385:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1715330299.414393:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942488000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330299.414417:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330299.414437:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942488064 00000100:00100000:1.0:1715330299.414440:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942488064 00010000:00010000:0.0:1715330299.414625:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330299.414639:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942488000 00000100:00100000:1.0:1715330299.414642:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942488000 00000100:00100000:1.0:1715330299.414658:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1374 00000100:00100000:1.0:1715330299.414662:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+15:3689:x1798653942488064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330299.414671:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330299.414687:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9503 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d94fc expref: 15 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.414699:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x36 (ffff88008d5ee700) 00010000:00010000:1.0:1715330299.414708:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330299.414782:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1375 00000100:00100000:2.0:1715330299.414786:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ab78ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+14:3690:x1798653942488000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715330299.414794:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330299.414803:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457db00/0xd895711d66d94f5 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d94ee expref: 14 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.414811:0:9416:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff880091ea7f00) 00010000:00010000:2.0:1715330299.414817:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330299.415141:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ab78ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+13:3690:x1798653942488000:12345-0@lo:103:ldlm_bl.0 Request processed in 354us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330299.415148:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1375 00000100:00100000:1.0:1715330299.415187:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+12:3689:x1798653942488064:12345-0@lo:103:ldlm_bl.0 Request processed in 524us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330299.415192:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1374 00000100:00100000:1.0:1715330299.415238:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942488000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1715330299.415322:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942488064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330299.418605:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330299.418834:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938056000 00000100:00100000:1.0:1715330299.418844:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938056000 00000100:00100000:1.0:1715330299.418887:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23518 00000100:00100000:1.0:1715330299.418894:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+17:17754:x1798653938056000:12345-192.168.204.49@tcp:36:rm.0 00010000:00010000:1.0:1715330299.419137:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d950a lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330299.419154:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d950a lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.419166:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d950a lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.419179:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdf80/0xd895711d66d9511 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330299.419184:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdf80/0xd895711d66d9511 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.419189:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdf80/0xd895711d66d9511 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.419230:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfeac0/0xd895711d66d9518 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x18e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330299.419233:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfeac0/0xd895711d66d9518 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.419236:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfeac0/0xd895711d66d9518 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00000040:00080000:1.0:1715330299.419445:0:25569:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00010000:00010000:1.0:1715330299.419479:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd440/0xd895711d66d951f lrc: 3/0,1 mode: --/PW res: [0x240000402:0x18e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330299.419484:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd440/0xd895711d66d951f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x18e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.419488:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd440/0xd895711d66d951f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x18e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.419492:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd440/0xd895711d66d951f lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x18e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.419496:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd440/0xd895711d66d951f lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x18e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.419500:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd440/0xd895711d66d951f lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x18e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.419504:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd440/0xd895711d66d951f lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x18e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.419509:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfd440 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:1.0:1715330299.419511:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd440/0xd895711d66d951f lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x18e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.419515:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd440/0xd895711d66d951f lrc: 5/0,0 mode: PW/PW res: [0x240000402:0x18e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.419522:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18e:0x0].0x0 (ffff88008b0d2c00) 00010000:00010000:1.0:1715330299.419524:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1715330299.419526:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd440/0xd895711d66d951f lrc: 3/0,0 mode: --/PW res: [0x240000402:0x18e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.419529:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd440/0xd895711d66d951f lrc: 0/0,0 mode: --/PW res: [0x240000402:0x18e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.419550:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfeac0/0xd895711d66d9518 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.419553:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfeac0/0xd895711d66d9518 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x18e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.419555:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfeac0/0xd895711d66d9518 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.419558:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfeac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330299.419560:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfeac0/0xd895711d66d9518 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.419563:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfeac0/0xd895711d66d9518 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x18e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.419568:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18e:0x0].0x0 (ffff88008b0d2c00) 00010000:00010000:1.0:1715330299.419570:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330299.419571:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfeac0/0xd895711d66d9518 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x18e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.419573:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfeac0/0xd895711d66d9518 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x18e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.419649:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d950a lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.419652:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d950a lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.419654:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d950a lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.419656:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d950a lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.419658:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfe1c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330299.419659:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d950a lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.419662:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d950a lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.419665:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff88008b0d2b00) 00010000:00010000:1.0:1715330299.419666:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330299.419667:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d950a lrc: 3/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.419669:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d950a lrc: 0/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00000004:00010000:1.0:1715330299.419676:0:25569:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012cc7bb80 reply state ffff88012fbb8000 transno 4294968450 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdf80/0xd895711d66d9511 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.419681:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdf80/0xd895711d66d9511 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.419684:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x36 (ffff88008b0d2000) 00010000:00010000:1.0:1715330299.419685:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330299.419687:0:25569:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1715330299.419765:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+19:17754:x1798653938056000:12345-192.168.204.49@tcp:36:rm.0 Request processed in 869us (1168us total) trans 4294968450 rc 0/0 00000100:00100000:1.0:1715330299.419772:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23518 00000100:00100000:0.0:1715330299.425205:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330299.425588:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938056128 00000100:00100000:1.0:1715330299.425599:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938056128 00000100:00100000:1.0:1715330299.425831:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23519 00000100:00100000:1.0:1715330299.425839:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+19:17754:x1798653938056128:12345-192.168.204.49@tcp:36:rm.0 00010000:00010000:1.0:1715330299.425899:0:25569:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330299.425928:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d932e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x192:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb93a expref: 19 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.425947:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x192:0x0].0x0 (ffff880093b42c00) 00010000:00010000:1.0:1715330299.425957:0:25569:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330299.426008:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd680/0xd895711d66d9526 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330299.426015:0:25569:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd680/0xd895711d66d9526 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.426024:0:25569:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd680/0xd895711d66d9526 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 25569 initiator: MDT1 00000100:00100000:1.0:1715330299.426047:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48d180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942488128:0@lo:101:mdt00_005.0 00000100:00100000:1.0:1715330299.426118:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330299.426144:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4b2f480 going to sleep for 11 seconds 00000100:00100000:2.0:1715330299.426234:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942488128 00000100:00100000:2.0:1715330299.426238:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942488128 00000100:00100000:2.0:1715330299.426346:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2974 00000100:00100000:2.0:1715330299.426352:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:25569:x1798653942488128:12345-0@lo:101:mdt00_005.0 00010000:00010000:2.0:1715330299.426363:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330299.426383:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d952d lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d9526 expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.426405:0:9408:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d952d lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d9526 expref: 13 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.426417:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d952d lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9526 expref: 13 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.426423:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff88008d5ee800) 00010000:00010000:2.0:1715330299.426426:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330299.426428:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db64240, rc 0) 00000100:00100000:2.0:1715330299.426468:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+13:25569:x1798653942488128:12345-0@lo:101:mdt00_005.0 Request processed in 116us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330299.426474:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2974 00000100:00100000:1.0:1715330299.426543:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48d180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942488128:0@lo:101:mdt00_005.0 00010000:00010000:1.0:1715330299.426555:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd680/0xd895711d66d9526 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d952d expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.426562:0:25569:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd680/0xd895711d66d9526 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d952d expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330299.426578:0:25569:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00010000:00010000:1.0:1715330299.426615:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bffa80/0xd895711d66d9534 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330299.426620:0:25569:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bffa80/0xd895711d66d9534 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.426626:0:25569:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bffa80/0xd895711d66d9534 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 25569 initiator: MDT1 00000100:00100000:1.0:1715330299.426633:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48d180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942488192:0@lo:101:mdt00_005.0 00000100:00100000:1.0:1715330299.426649:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330299.426656:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4b2f480 going to sleep for 11 seconds 00000100:00100000:3.0:1715330299.427905:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942488192 00000100:00100000:3.0:1715330299.427913:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942488192 00000100:00100000:3.0:1715330299.427941:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2975 00000100:00100000:3.0:1715330299.427946:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+13:25569:x1798653942488192:12345-0@lo:101:mdt00_005.0 00010000:00010000:3.0:1715330299.427994:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330299.428010:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d953b lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d9534 expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.428034:0:9407:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d953b lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d9534 expref: 14 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.428044:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d953b lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9534 expref: 14 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.428051:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x30 (ffff880091ea7a00) 00010000:00010000:3.0:1715330299.428053:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330299.428055:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013457e1c0, rc 0) 00000100:00100000:3.0:1715330299.428113:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942488192:12345-0@lo:101:mdt00_005.0 Request processed in 165us (1461us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330299.428119:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2975 00000100:00100000:1.0:1715330299.428204:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48d180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942488192:0@lo:101:mdt00_005.0 00010000:00010000:1.0:1715330299.428217:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bffa80/0xd895711d66d9534 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d953b expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.428225:0:25569:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bffa80/0xd895711d66d9534 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d953b expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330299.428243:0:25569:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00000100:00100000:1.0:1715330299.428279:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48d180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942488256:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1715330299.428317:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330299.428327:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4b2f780 going to sleep for 11 seconds 00000100:00100000:3.0:1715330299.428371:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942488256 00000100:00100000:3.0:1715330299.428375:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942488256 00000100:00100000:3.0:1715330299.428403:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2976 00000100:00100000:3.0:1715330299.428408:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942488256:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1715330299.428481:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942488256:12345-0@lo:1000:mdt00_005.0 Request processed in 72us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330299.428487:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2976 00000100:00100000:1.0:1715330299.428612:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48d180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942488256:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1715330299.428646:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48d180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942488320:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1715330299.428665:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330299.428685:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4b2f780 going to sleep for 11 seconds 00000100:00100000:2.0:1715330299.428727:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942488320 00000100:00100000:2.0:1715330299.428751:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942488320 00000100:00100000:2.0:1715330299.429268:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2977 00000100:00100000:2.0:1715330299.429274:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942488320:12345-0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1715330299.429373:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942488320:12345-0@lo:1000:mdt00_005.0 Request processed in 99us (707us total) trans 0 rc -2/-2 00000100:00100000:2.0:1715330299.429380:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2977 00000100:00100000:1.0:1715330299.429447:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48d180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942488320:0@lo:1000:mdt00_005.0 00000004:00080000:1.0:1715330299.429466:0:25569:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00010000:00010000:1.0:1715330299.429472:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd680/0xd895711d66d9526 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d952d expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.429479:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd680/0xd895711d66d9526 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d952d expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.429485:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd680/0xd895711d66d9526 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d952d expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.429514:0:25569:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1715330299.429519:0:25569:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00010000:00010000:1.0:1715330299.429522:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bffa80/0xd895711d66d9534 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d953b expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.429527:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bffa80/0xd895711d66d9534 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d953b expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.429536:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bffa80/0xd895711d66d9534 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d953b expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.429547:0:25569:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1715330299.429575:0:7123:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1715330299.429581:0:7123:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd680/0xd895711d66d9526 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d952d expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.429587:0:7123:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfd680 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330299.429592:0:7123:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd680/0xd895711d66d9526 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d952d expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330299.429600:0:7123:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd680/0xd895711d66d9526 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d952d expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.429609:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715330299.429616:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bffa80/0xd895711d66d9534 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d953b expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.429623:0:7123:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd680/0xd895711d66d9526 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d952d expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.429623:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bffa80 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330299.429626:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bffa80/0xd895711d66d9534 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d953b expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.429629:0:7123:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000004:00010000:0.0:1715330299.429633:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bffa80/0xd895711d66d9534 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d953b expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.429652:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bffa80/0xd895711d66d9534 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d953b expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.429656:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330299.429671:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bffa80/0xd895711d66d9534 lrc: 1/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d953b expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330299.429676:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1715330299.429677:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bffa80/0xd895711d66d9534 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d953b expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330299.429685:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b160e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942488448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1715330299.429709:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330299.429824:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942488384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1715330299.429843:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1715330299.430349:0:7123:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd680/0xd895711d66d9526 lrc: 1/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d952d expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.430356:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfd680/0xd895711d66d9526 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d952d expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.430357:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330299.430359:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330299.430361:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330299.430369:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330299.430370:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330299.430372:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330299.430382:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942488448 00000100:00100000:1.0:1715330299.430387:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942488448 00000100:00100000:1.0:1715330299.430476:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1376 00000100:00100000:1.0:1715330299.430482:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+14:3691:x1798653942488448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330299.430495:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330299.430512:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d953b lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d9534 expref: 14 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.430523:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x30 (ffff880091ea7a00) 00010000:00010000:1.0:1715330299.430532:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330299.430595:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942488384 00000100:00100000:0.0:1715330299.430598:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942488384 00000100:00100000:0.0:1715330299.430623:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1377 00000100:00100000:0.0:1715330299.430628:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+14:3689:x1798653942488384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330299.430635:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330299.430645:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d952d lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d9526 expref: 14 pid: 9408 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330299.430758:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+13:3691:x1798653942488448:12345-0@lo:103:ldlm_bl.0 Request processed in 275us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330299.430764:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1376 00000100:00100000:1.0:1715330299.430818:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+18:17754:x1798653938056128:12345-192.168.204.49@tcp:36:rm.0 Request processed in 4977us (5622us total) trans 0 rc -2/-2 00000100:00100000:1.0:1715330299.430826:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23519 00010000:00010000:0.0:1715330299.430994:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff88008d5ee800) 00010000:00010000:0.0:1715330299.431002:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330299.431041:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+12:3689:x1798653942488384:12345-0@lo:103:ldlm_bl.0 Request processed in 412us (1196us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330299.431046:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1377 00000100:00100000:3.0:1715330299.431261:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942488384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1715330299.431356:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b160e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942488448:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330299.434699:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330299.434813:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938056256 00000100:00100000:1.0:1715330299.434822:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938056256 00000100:00100000:1.0:1715330299.434972:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23520 00000100:00100000:1.0:1715330299.434980:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+18:17754:x1798653938056256:12345-192.168.204.49@tcp:36:rm.0 00010000:00010000:1.0:1715330299.435063:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d9542 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330299.435080:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d9542 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.435092:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d9542 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.435101:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d9549 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330299.435107:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d9549 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.435112:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d9549 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.435157:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d9550 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x192:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330299.435163:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d9550 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x192:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.435169:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d9550 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x192:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00000040:00080000:1.0:1715330299.435401:0:25569:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00010000:00010000:1.0:1715330299.435443:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d9557 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x192:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330299.435451:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d9557 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x192:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.435457:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d9557 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x192:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.435463:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d9557 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x192:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.435468:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d9557 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x192:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.435474:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d9557 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x192:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.435480:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d9557 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x192:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.435492:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfc240 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:1.0:1715330299.435496:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d9557 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x192:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.435502:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d9557 lrc: 5/0,0 mode: PW/PW res: [0x240000402:0x192:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.435512:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x192:0x0].0x0 (ffff88008b0d2f00) 00010000:00010000:1.0:1715330299.435515:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1715330299.435519:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d9557 lrc: 3/0,0 mode: --/PW res: [0x240000402:0x192:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.435524:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d9557 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x192:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.435548:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d9550 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x192:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.435552:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d9550 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x192:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.435556:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d9550 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x192:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.435560:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bff180 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330299.435562:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d9550 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x192:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.435565:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d9550 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x192:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.435569:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x192:0x0].0x0 (ffff88008b0d2f00) 00010000:00010000:1.0:1715330299.435571:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330299.435573:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d9550 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x192:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.435578:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d9550 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x192:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.435669:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d9542 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.435675:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d9542 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.435680:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d9542 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.435686:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d9542 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.435691:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfcd80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330299.435693:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d9542 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.435698:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d9542 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.435705:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff88008b0d2700) 00010000:00010000:1.0:1715330299.435707:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330299.435709:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d9542 lrc: 3/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.435714:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcd80/0xd895711d66d9542 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00000004:00010000:1.0:1715330299.435724:0:25569:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008b160e00 reply state ffff88012fbbb000 transno 4294968451 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d9549 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.435761:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d9549 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.435766:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x30 (ffff88008b0d2a00) 00010000:00010000:1.0:1715330299.435768:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330299.435770:0:25569:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1715330299.435878:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+20:17754:x1798653938056256:12345-192.168.204.49@tcp:36:rm.0 Request processed in 899us (1189us total) trans 4294968451 rc 0/0 00000100:00100000:1.0:1715330299.435887:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23520 00000100:00100000:0.0:1715330299.438395:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330299.438502:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938056384 00000100:00100000:1.0:1715330299.438510:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938056384 00000100:00100000:1.0:1715330299.438566:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23521 00000100:00100000:1.0:1715330299.438574:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+20:17754:x1798653938056384:12345-192.168.204.49@tcp:36:rm.0 00010000:00010000:1.0:1715330299.438629:0:25569:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330299.438655:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a2d00/0xd895711d66d93ac lrc: 0/0,0 mode: --/PR res: [0x240000402:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb964 expref: 20 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.438672:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18f:0x0].0x0 (ffff88009bbf0b00) 00010000:00010000:1.0:1715330299.438680:0:25569:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330299.438726:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff600/0xd895711d66d955e lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330299.438759:0:25569:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff600/0xd895711d66d955e lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.438769:0:25569:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff600/0xd895711d66d955e lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 25569 initiator: MDT1 00000100:00100000:1.0:1715330299.438801:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48f800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942488512:0@lo:101:mdt00_005.0 00000100:00100000:1.0:1715330299.438850:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330299.438878:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4b2f000 going to sleep for 11 seconds 00000100:00100000:3.0:1715330299.438910:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942488512 00000100:00100000:3.0:1715330299.438914:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942488512 00000100:00100000:3.0:1715330299.438949:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2978 00000100:00100000:3.0:1715330299.438954:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:25569:x1798653942488512:12345-0@lo:101:mdt00_005.0 00010000:00010000:3.0:1715330299.438963:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330299.438984:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c900/0xd895711d66d9565 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d955e expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.439005:0:9407:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c900/0xd895711d66d9565 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d955e expref: 13 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.439017:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c900/0xd895711d66d9565 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d955e expref: 13 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.439023:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff880091ea7e00) 00010000:00010000:3.0:1715330299.439025:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330299.439027:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013457c900, rc 0) 00000100:00100000:3.0:1715330299.439070:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+13:25569:x1798653942488512:12345-0@lo:101:mdt00_005.0 Request processed in 115us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330299.439076:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2978 00000100:00100000:1.0:1715330299.439112:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48f800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942488512:0@lo:101:mdt00_005.0 00010000:00010000:1.0:1715330299.439123:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff600/0xd895711d66d955e lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9565 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.439132:0:25569:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff600/0xd895711d66d955e lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9565 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330299.439146:0:25569:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00010000:00010000:1.0:1715330299.439159:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfef40/0xd895711d66d956c lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330299.439164:0:25569:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfef40/0xd895711d66d956c lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.439169:0:25569:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfef40/0xd895711d66d956c lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 25569 initiator: MDT1 00000100:00100000:1.0:1715330299.439177:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48f800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942488576:0@lo:101:mdt00_005.0 00000100:00100000:1.0:1715330299.439193:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330299.439213:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4b2f000 going to sleep for 11 seconds 00000100:00100000:3.0:1715330299.439300:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942488576 00000100:00100000:3.0:1715330299.439303:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942488576 00000100:00100000:3.0:1715330299.439336:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2979 00000100:00100000:3.0:1715330299.439340:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+13:25569:x1798653942488576:12345-0@lo:101:mdt00_005.0 00010000:00010000:3.0:1715330299.439347:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330299.439356:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d9573 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d956c expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.439367:0:9407:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d9573 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d956c expref: 14 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.439374:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d9573 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d956c expref: 14 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.439379:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x3031 (ffff880091ea7d00) 00010000:00010000:3.0:1715330299.439381:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330299.439383:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013457e400, rc 0) 00000100:00100000:3.0:1715330299.439406:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942488576:12345-0@lo:101:mdt00_005.0 Request processed in 66us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330299.439411:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2979 00000100:00100000:1.0:1715330299.439426:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48f800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942488576:0@lo:101:mdt00_005.0 00010000:00010000:1.0:1715330299.439434:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfef40/0xd895711d66d956c lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9573 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.439440:0:25569:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfef40/0xd895711d66d956c lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9573 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330299.439448:0:25569:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00000100:00100000:1.0:1715330299.439478:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48f800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942488640:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1715330299.439500:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330299.439508:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4b2f480 going to sleep for 11 seconds 00000100:00100000:3.0:1715330299.439536:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942488640 00000100:00100000:3.0:1715330299.439539:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942488640 00000100:00100000:3.0:1715330299.439558:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2980 00000100:00100000:3.0:1715330299.439561:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942488640:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1715330299.439614:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942488640:12345-0@lo:1000:mdt00_005.0 Request processed in 52us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330299.439620:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2980 00000100:00100000:1.0:1715330299.439640:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48f800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942488640:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1715330299.439754:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48f800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942488704:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1715330299.439776:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330299.439793:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4b2f480 going to sleep for 11 seconds 00000100:00100000:2.0:1715330299.439809:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942488704 00000100:00100000:2.0:1715330299.439813:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942488704 00000100:00100000:2.0:1715330299.439830:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2981 00000100:00100000:2.0:1715330299.439834:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942488704:12345-0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1715330299.439998:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942488704:12345-0@lo:1000:mdt00_005.0 Request processed in 163us (220us total) trans 0 rc -2/-2 00000100:00100000:2.0:1715330299.440005:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2981 00000100:00100000:1.0:1715330299.440055:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48f800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942488704:0@lo:1000:mdt00_005.0 00000004:00080000:1.0:1715330299.440072:0:25569:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00010000:00010000:1.0:1715330299.440076:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff600/0xd895711d66d955e lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9565 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.440083:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff600/0xd895711d66d955e lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9565 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.440089:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff600/0xd895711d66d955e lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9565 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.440108:0:25569:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1715330299.440112:0:25569:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00010000:00010000:1.0:1715330299.440115:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfef40/0xd895711d66d956c lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9573 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.440119:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfef40/0xd895711d66d956c lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9573 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.440124:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfef40/0xd895711d66d956c lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9573 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.440144:0:25569:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1715330299.440188:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+19:17754:x1798653938056384:12345-192.168.204.49@tcp:36:rm.0 Request processed in 1613us (1802us total) trans 0 rc -2/-2 00000100:00100000:1.0:1715330299.440194:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23521 00010000:00010000:3.0:1715330299.440241:0:9415:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1715330299.440264:0:7124:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715330299.440270:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfef40/0xd895711d66d956c lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d9573 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.440279:0:9415:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff600/0xd895711d66d955e lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d9565 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.440285:0:9415:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bff600 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:3.0:1715330299.440290:0:9415:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff600/0xd895711d66d955e lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d9565 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1715330299.440296:0:9415:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff600/0xd895711d66d955e lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d9565 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.440322:0:9415:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff600/0xd895711d66d955e lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9565 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.440334:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfef40 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330299.440337:0:7124:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfef40/0xd895711d66d956c lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d9573 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330299.440342:0:7124:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfef40/0xd895711d66d956c lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d9573 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.440355:0:7124:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfef40/0xd895711d66d956c lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9573 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.440359:0:7124:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330299.440381:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfef40/0xd895711d66d956c lrc: 1/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9573 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.440387:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfef40/0xd895711d66d956c lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9573 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330299.440389:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1715330299.440398:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942488832:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330299.440403:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330299.440405:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330299.440406:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330299.440420:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330299.440448:0:10673:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942488832 00000100:00100000:0.0:1715330299.440450:0:10673:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942488832 00000100:00100000:0.0:1715330299.440472:0:10673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1378 00000100:00100000:0.0:1715330299.440476:0:10673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+14:3690:x1798653942488832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330299.440484:0:10673:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330299.440493:0:10673:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e400/0xd895711d66d9573 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x3031 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d956c expref: 14 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.440501:0:10673:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x3031 (ffff880091ea7d00) 00010000:00010000:0.0:1715330299.440506:0:10673:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330299.440524:0:10673:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+13:3690:x1798653942488832:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330299.440529:0:10673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1378 00000100:00100000:1.0:1715330299.440533:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942488832:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1715330299.440611:0:9415:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1715330299.440625:0:9415:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff600/0xd895711d66d955e lrc: 1/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9565 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.440635:0:9415:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bff600/0xd895711d66d955e lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9565 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.440649:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715330299.440650:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715330299.440651:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330299.440657:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1715330299.440664:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942488768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1715330299.441188:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330299.441289:0:10673:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942488768 00000100:00100000:0.0:1715330299.441293:0:10673:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942488768 00000100:00100000:0.0:1715330299.441324:0:10673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1379 00000100:00100000:0.0:1715330299.441328:0:10673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+13:3689:x1798653942488768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330299.441336:0:10673:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330299.441346:0:10673:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c900/0xd895711d66d9565 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d955e expref: 13 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.441355:0:10673:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff880091ea7e00) 00010000:00010000:0.0:1715330299.441360:0:10673:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330299.441386:0:10673:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+12:3689:x1798653942488768:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330299.441391:0:10673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1379 00000100:00100000:3.0:1715330299.441436:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942488768:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330299.442667:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330299.442759:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938056512 00000100:00100000:1.0:1715330299.442765:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938056512 00000100:00100000:1.0:1715330299.443001:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23522 00000100:00100000:1.0:1715330299.443007:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+19:17754:x1798653938056512:12345-192.168.204.49@tcp:36:rm.0 00010000:00010000:1.0:1715330299.443079:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d957a lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330299.443093:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d957a lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.443104:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d957a lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.443114:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d9581 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330299.443119:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d9581 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.443124:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d9581 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.443170:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc480/0xd895711d66d9588 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x18f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330299.443176:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc480/0xd895711d66d9588 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.443181:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc480/0xd895711d66d9588 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00000040:00080000:1.0:1715330299.443420:0:25569:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00010000:00010000:1.0:1715330299.443461:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d958f lrc: 3/0,1 mode: --/PW res: [0x240000402:0x18f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330299.443468:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d958f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x18f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.443475:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d958f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x18f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.443481:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d958f lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x18f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.443486:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d958f lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x18f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.443492:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d958f lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x18f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.443497:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d958f lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x18f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.443502:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfdd40 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:1.0:1715330299.443506:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d958f lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x18f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.443516:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d958f lrc: 5/0,0 mode: PW/PW res: [0x240000402:0x18f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.443525:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18f:0x0].0x0 (ffff88008b0d2b00) 00010000:00010000:1.0:1715330299.443527:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1715330299.443531:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d958f lrc: 3/0,0 mode: --/PW res: [0x240000402:0x18f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.443535:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdd40/0xd895711d66d958f lrc: 0/0,0 mode: --/PW res: [0x240000402:0x18f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.443569:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc480/0xd895711d66d9588 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.443574:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc480/0xd895711d66d9588 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x18f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.443579:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc480/0xd895711d66d9588 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.443583:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfc480 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330299.443585:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc480/0xd895711d66d9588 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.443590:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc480/0xd895711d66d9588 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x18f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.443597:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18f:0x0].0x0 (ffff88008b0d2b00) 00010000:00010000:1.0:1715330299.443599:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330299.443601:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc480/0xd895711d66d9588 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x18f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.443605:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc480/0xd895711d66d9588 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x18f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.443695:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d957a lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.443700:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d957a lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.443704:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d957a lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.443708:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d957a lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.443712:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfc6c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330299.443714:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d957a lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.443718:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d957a lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.443723:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff88008b0d2e00) 00010000:00010000:1.0:1715330299.443725:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330299.443726:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d957a lrc: 3/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.443749:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc6c0/0xd895711d66d957a lrc: 0/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00000004:00010000:1.0:1715330299.443759:0:25569:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007d634a80 reply state ffff88008b18c000 transno 4294968452 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d9581 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.443767:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d9581 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.443771:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x3031 (ffff88008b0d2400) 00010000:00010000:1.0:1715330299.443774:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330299.443777:0:25569:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1715330299.443841:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+21:17754:x1798653938056512:12345-192.168.204.49@tcp:36:rm.0 Request processed in 833us (1178us total) trans 4294968452 rc 0/0 00000100:00100000:1.0:1715330299.443848:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23522 00000100:00100000:0.0:1715330299.446659:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330299.446771:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938056640 00000100:00100000:1.0:1715330299.446780:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938056640 00000100:00100000:1.0:1715330299.446851:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23523 00000100:00100000:1.0:1715330299.446859:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+21:17754:x1798653938056640:12345-192.168.204.49@tcp:36:rm.0 00010000:00010000:1.0:1715330299.446909:0:25569:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330299.446937:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e880/0xd895711d66d9469 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9a3 expref: 21 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.446953:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18d:0x0].0x0 (ffff880091ea7500) 00010000:00010000:1.0:1715330299.446962:0:25569:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330299.447005:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcfc0/0xd895711d66d9596 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330299.447013:0:25569:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcfc0/0xd895711d66d9596 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.447021:0:25569:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcfc0/0xd895711d66d9596 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 25569 initiator: MDT1 00000100:00100000:1.0:1715330299.447041:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942488896:0@lo:101:mdt00_005.0 00000100:00100000:1.0:1715330299.447085:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330299.447112:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4b2f300 going to sleep for 11 seconds 00000100:00100000:3.0:1715330299.447258:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942488896 00000100:00100000:3.0:1715330299.447263:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942488896 00000100:00100000:3.0:1715330299.447451:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2982 00000100:00100000:3.0:1715330299.447457:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:25569:x1798653942488896:12345-0@lo:101:mdt00_005.0 00010000:00010000:3.0:1715330299.447466:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330299.447482:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d959d lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d9596 expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.447503:0:9407:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d959d lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d9596 expref: 13 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.447514:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d959d lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9596 expref: 13 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.447519:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff880091ea7c00) 00010000:00010000:3.0:1715330299.447521:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330299.447523:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013457d680, rc 0) 00000100:00100000:3.0:1715330299.447568:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+13:25569:x1798653942488896:12345-0@lo:101:mdt00_005.0 Request processed in 111us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330299.447574:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2982 00000100:00100000:1.0:1715330299.447635:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942488896:0@lo:101:mdt00_005.0 00010000:00010000:1.0:1715330299.447646:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcfc0/0xd895711d66d9596 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d959d expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.447654:0:25569:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcfc0/0xd895711d66d9596 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d959d expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330299.447668:0:25569:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00010000:00010000:1.0:1715330299.447681:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcd80/0xd895711d66d95a4 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330299.447685:0:25569:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcd80/0xd895711d66d95a4 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.447690:0:25569:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcd80/0xd895711d66d95a4 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 25569 initiator: MDT1 00000100:00100000:1.0:1715330299.447701:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942488960:0@lo:101:mdt00_005.0 00000100:00100000:1.0:1715330299.447716:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330299.447723:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4b2f300 going to sleep for 11 seconds 00000100:00100000:3.0:1715330299.447801:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942488960 00000100:00100000:3.0:1715330299.447804:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942488960 00000100:00100000:3.0:1715330299.447824:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2983 00000100:00100000:3.0:1715330299.447828:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+13:25569:x1798653942488960:12345-0@lo:101:mdt00_005.0 00010000:00010000:3.0:1715330299.447835:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330299.447843:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457df80/0xd895711d66d95ab lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d95a4 expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.447854:0:9407:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457df80/0xd895711d66d95ab lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d95a4 expref: 14 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.447862:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457df80/0xd895711d66d95ab lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d95a4 expref: 14 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.447867:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x39 (ffff880091ea7700) 00010000:00010000:3.0:1715330299.447869:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330299.447871:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013457df80, rc 0) 00000100:00100000:3.0:1715330299.447903:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942488960:12345-0@lo:101:mdt00_005.0 Request processed in 73us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330299.447908:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2983 00000100:00100000:1.0:1715330299.447992:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942488960:0@lo:101:mdt00_005.0 00010000:00010000:1.0:1715330299.448000:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcd80/0xd895711d66d95a4 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d95ab expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.448007:0:25569:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcd80/0xd895711d66d95a4 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d95ab expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330299.448019:0:25569:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00000100:00100000:1.0:1715330299.448049:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942489024:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1715330299.448069:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330299.448086:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4b2fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330299.448122:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942489024 00000100:00100000:0.0:1715330299.448125:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942489024 00000100:00100000:0.0:1715330299.448183:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2984 00000100:00100000:0.0:1715330299.448188:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942489024:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1715330299.448275:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942489024:12345-0@lo:1000:mdt00_005.0 Request processed in 86us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330299.448280:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2984 00000100:00100000:1.0:1715330299.448338:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942489024:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1715330299.448368:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942489088:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1715330299.448384:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330299.448397:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4b2fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330299.448408:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942489088 00000100:00100000:0.0:1715330299.448411:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942489088 00000100:00100000:0.0:1715330299.448458:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2985 00000100:00100000:0.0:1715330299.448462:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942489088:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1715330299.448612:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942489088:12345-0@lo:1000:mdt00_005.0 Request processed in 149us (226us total) trans 0 rc -2/-2 00000100:00100000:0.0:1715330299.448617:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2985 00000100:00100000:1.0:1715330299.448622:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942489088:0@lo:1000:mdt00_005.0 00000004:00080000:1.0:1715330299.448634:0:25569:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00010000:00010000:1.0:1715330299.448638:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcfc0/0xd895711d66d9596 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d959d expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.448652:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcfc0/0xd895711d66d9596 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d959d expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.448657:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcfc0/0xd895711d66d9596 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d959d expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.448671:0:25569:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1715330299.448674:0:25569:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00010000:00010000:1.0:1715330299.448676:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcd80/0xd895711d66d95a4 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d95ab expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.448681:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcd80/0xd895711d66d95a4 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d95ab expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.448686:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcd80/0xd895711d66d95a4 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d95ab expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.448703:0:25569:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1715330299.448725:0:7123:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1715330299.448748:0:7123:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcfc0/0xd895711d66d9596 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d959d expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.448755:0:7123:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfcfc0 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:2.0:1715330299.448760:0:7123:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcfc0/0xd895711d66d9596 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d959d expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330299.448762:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+20:17754:x1798653938056640:12345-192.168.204.49@tcp:36:rm.0 Request processed in 1902us (2114us total) trans 0 rc -2/-2 00000100:00100000:1.0:1715330299.448766:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23523 00000004:00010000:2.0:1715330299.448767:0:7123:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcfc0/0xd895711d66d9596 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d959d expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.448786:0:7123:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcfc0/0xd895711d66d9596 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d959d expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.448792:0:7123:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1715330299.448806:0:7123:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcfc0/0xd895711d66d9596 lrc: 1/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d959d expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.448811:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcfc0/0xd895711d66d9596 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d959d expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.448828:0:7123:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1715330299.448830:0:7123:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcd80/0xd895711d66d95a4 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d95ab expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.448835:0:7123:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfcd80 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:2.0:1715330299.448837:0:7123:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcd80/0xd895711d66d95a4 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d95ab expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1715330299.448843:0:7123:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcd80/0xd895711d66d95a4 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d95ab expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.448852:0:7123:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcd80/0xd895711d66d95a4 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d95ab expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.448855:0:7123:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1715330299.448863:0:7123:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcd80/0xd895711d66d95a4 lrc: 1/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d95ab expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.448868:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff880093bfcd80/0xd895711d66d95a4 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d95ab expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330299.448868:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942489216:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715330299.448876:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330299.448877:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330299.448879:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330299.448884:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1715330299.448892:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942489152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330299.448892:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330299.448911:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330299.448916:0:10673:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942489216 00000100:00100000:1.0:1715330299.448918:0:10673:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942489216 00000100:00100000:1.0:1715330299.448933:0:10673:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942489152 00000100:00100000:1.0:1715330299.448935:0:10673:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942489152 00000100:00100000:1.0:1715330299.448947:0:10673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1380 00000100:00100000:1.0:1715330299.448950:0:10673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+15:3690:x1798653942489216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330299.448958:0:10673:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330299.448966:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330299.448968:0:10673:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457df80/0xd895711d66d95ab lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcc:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d95a4 expref: 15 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.448976:0:10673:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x39 (ffff880091ea7700) 00010000:00010000:1.0:1715330299.448981:0:10673:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330299.448999:0:10673:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+14:3690:x1798653942489216:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330299.449003:0:10673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1380 00000100:00100000:1.0:1715330299.449011:0:10673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1381 00000100:00100000:1.0:1715330299.449014:0:10673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+13:3688:x1798653942489152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330299.449019:0:10673:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330299.449025:0:10673:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d959d lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d9596 expref: 13 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.449031:0:10673:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff880091ea7c00) 00010000:00010000:1.0:1715330299.449035:0:10673:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330299.449050:0:10673:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942489152:12345-0@lo:103:ldlm_bl.0 Request processed in 35us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330299.449054:0:10673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1381 00000100:00100000:1.0:1715330299.449076:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942489216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1715330299.449142:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942489152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330299.451288:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330299.451365:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938056768 00000100:00100000:1.0:1715330299.451373:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938056768 00000100:00100000:1.0:1715330299.451426:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23524 00000100:00100000:1.0:1715330299.451432:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+20:17754:x1798653938056768:12345-192.168.204.49@tcp:36:rm.0 00010000:00010000:1.0:1715330299.451505:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d95b2 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330299.451517:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d95b2 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.451526:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d95b2 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.451534:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d95b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc9:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330299.451538:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d95b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.451543:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d95b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.451596:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d95c0 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x18d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330299.451601:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d95c0 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.451606:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d95c0 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00000040:00080000:1.0:1715330299.451853:0:25569:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00010000:00010000:1.0:1715330299.451895:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd680/0xd895711d66d95c7 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x18d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330299.451902:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd680/0xd895711d66d95c7 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x18d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.451907:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd680/0xd895711d66d95c7 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x18d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.451913:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd680/0xd895711d66d95c7 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x18d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.451917:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd680/0xd895711d66d95c7 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x18d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.451922:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd680/0xd895711d66d95c7 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x18d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.451927:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd680/0xd895711d66d95c7 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x18d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.451932:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfd680 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:1.0:1715330299.451935:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd680/0xd895711d66d95c7 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x18d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.451941:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd680/0xd895711d66d95c7 lrc: 5/0,0 mode: PW/PW res: [0x240000402:0x18d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.451950:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18d:0x0].0x0 (ffff88008b0d2900) 00010000:00010000:1.0:1715330299.451953:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1715330299.451955:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd680/0xd895711d66d95c7 lrc: 3/0,0 mode: --/PW res: [0x240000402:0x18d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.451960:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd680/0xd895711d66d95c7 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x18d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.451988:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d95c0 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.451993:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d95c0 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x18d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.451997:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d95c0 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.452001:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfc240 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330299.452004:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d95c0 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.452008:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d95c0 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x18d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.452013:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18d:0x0].0x0 (ffff88008b0d2900) 00010000:00010000:1.0:1715330299.452014:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330299.452016:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d95c0 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x18d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.452020:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfc240/0xd895711d66d95c0 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x18d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.452107:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d95b2 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.452113:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d95b2 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.452117:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d95b2 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.452121:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d95b2 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.452125:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bff600 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330299.452128:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d95b2 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.452132:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d95b2 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.452137:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff88008b0d2300) 00010000:00010000:1.0:1715330299.452139:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330299.452141:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d95b2 lrc: 3/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.452146:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff600/0xd895711d66d95b2 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00000004:00010000:1.0:1715330299.452155:0:25569:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007d635f80 reply state ffff88011db75000 transno 4294968453 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d95b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc9:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.452161:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d95b9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330299.452165:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x39 (ffff88008b0d2600) 00010000:00010000:1.0:1715330299.452167:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330299.452169:0:25569:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1715330299.452229:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+22:17754:x1798653938056768:12345-192.168.204.49@tcp:36:rm.0 Request processed in 796us (949us total) trans 4294968453 rc 0/0 00000100:00100000:1.0:1715330299.452235:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23524 00000100:00100000:2.0:1715330299.455446:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330299.455534:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938056832 00000100:00100000:3.0:1715330299.455544:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938056832 00000100:00100000:3.0:1715330299.455683:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1382 00000100:00100000:3.0:1715330299.455690:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ab78a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+11:2012:x1798653938056832:12345-192.168.204.49@tcp:103:rm.0 00000100:00100000:0.0:1715330299.455990:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330299.456051:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938056960 00000100:00100000:2.0:1715330299.456055:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938056960 00000100:00100000:2.0:1715330299.456091:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5083 00000100:00100000:2.0:1715330299.456096:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+22:17754:x1798653938056960:12345-192.168.204.49@tcp:35:rm.0 00010000:00010000:3.0:1715330299.456143:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330299.456171:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d200/0xd895711d66d8f92 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x18c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8a0 expref: 11 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.456191:0:9416:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18c:0x0].0x0 (ffff88009ef25d00) 00010000:00010000:3.0:1715330299.456201:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715330299.456242:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ab78a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+10:2012:x1798653938056832:12345-192.168.204.49@tcp:103:rm.0 Request processed in 552us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330299.456248:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1382 00000100:00100000:2.0:1715330299.456262:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+23:17754:x1798653938056960:12345-192.168.204.49@tcp:35:rm.0 Request processed in 167us (273us total) trans 4294968454 rc 0/0 00000100:00100000:2.0:1715330299.456268:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5083 00000100:00100000:1.0:1715330299.458898:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1715330299.458925:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942489280:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1715330299.458992:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330299.459057:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942489280 00000100:00100000:2.0:1715330299.459065:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942489280 00000100:00100000:2.0:1715330299.459163:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2986 00000100:00100000:2.0:1715330299.459170:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3690:x1798653942489280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1715330299.459205:0:9408:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445085184 avail 1315622912 00000100:00100000:3.0:1715330299.459246:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330299.459253:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3690:x1798653942489280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330299.459259:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2986 00000100:00100000:0.0:1715330299.459324:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938057088 00000100:00100000:1.0:1715330299.459327:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942489280:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1715330299.459328:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938057088 00000100:00100000:0.0:1715330299.459353:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23525 00000100:00100000:0.0:1715330299.459357:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+23:17754:x1798653938057088:12345-192.168.204.49@tcp:36:rm.0 00010000:00010000:0.0:1715330299.459395:0:25569:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1715330299.459421:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65200/0xd895711d66d92a2 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x18c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb910 expref: 23 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.459441:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67180/0xd895711d66d9278 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x18c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb8fb expref: 22 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.459450:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18c:0x0].0x0 (ffff8801345c6d00) 00010000:00010000:0.0:1715330299.459459:0:25569:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715330299.459495:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a0b40/0xd895711d66d95ce lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330299.459503:0:25569:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a0b40/0xd895711d66d95ce lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 25569 initiator: MDT1 00010000:00010000:0.0:1715330299.459511:0:25569:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a0b40/0xd895711d66d95ce lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 25569 initiator: MDT1 00000100:00100000:0.0:1715330299.459525:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d635180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942489344:0@lo:101:mdt00_005.0 00000100:00100000:0.0:1715330299.459549:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330299.459556:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009d7e33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715330299.459614:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942489344 00000100:00100000:2.0:1715330299.459617:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942489344 00000100:00100000:2.0:1715330299.459631:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2987 00000100:00100000:2.0:1715330299.459635:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:25569:x1798653942489344:12345-0@lo:101:mdt00_005.0 00010000:00010000:2.0:1715330299.459643:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330299.459657:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db661c0/0xd895711d66d95d5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d95ce expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.459676:0:9408:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457fa80/0xd895711d66d8f76 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb899 expref: 9 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.459688:0:9408:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db661c0/0xd895711d66d95d5 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d95ce expref: 13 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.459708:0:9408:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013457fa80/0xd895711d66d8f76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb899 expref: 9 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.459719:0:9408:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457fa80/0xd895711d66d8f76 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb899 expref: 9 pid: 25569 timeout: 373 lvb_type: 0 00000100:00100000:2.0:1715330299.459728:0:9408:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba64700 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:9408:1798653942489408:192.168.204.49@tcp:104: 00000100:00100000:2.0:1715330299.459790:0:9408:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa780 going to sleep for 11 seconds 00000100:00100000:2.0:1715330299.464957:0:9408:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba64700 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:9408:1798653942489408:192.168.204.49@tcp:104: 00010000:00010000:2.0:1715330299.464990:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db661c0/0xd895711d66d95d5 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d95ce expref: 13 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.465810:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:2.0:1715330299.465928:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330299.465933:0:9408:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db661c0/0xd895711d66d95d5 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d95ce expref: 13 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.465943:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db661c0, rc 0) 00000100:00100000:2.0:1715330299.466004:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+13:25569:x1798653942489344:12345-0@lo:101:mdt00_005.0 Request processed in 6366us (6452us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330299.466014:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2987 00000100:00100000:2.0:1715330299.466080:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330299.466120:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d635180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942489344:0@lo:101:mdt00_005.0 00010000:00010000:1.0:1715330299.466507:0:25569:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a0b40/0xd895711d66d95ce lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d95d5 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330299.466517:0:25569:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a0b40/0xd895711d66d95ce lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d95d5 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330299.466693:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938057152 00000100:00100000:3.0:1715330299.466701:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938057152 00010000:00010000:3.0:1715330299.466756:0:9416:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457fa80/0xd895711d66d8f76 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb899 expref: 10 pid: 25569 timeout: 373 lvb_type: 0 00000100:00100000:3.0:1715330299.466789:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1558 00000100:00100000:3.0:1715330299.466884:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+10:2014:x1798653938057152:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1715330299.466900:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330299.466906:0:9416:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013457fa80/0xd895711d66d8f76 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb899 expref: 10 pid: 25569 timeout: 373 lvb_type: 0 00010000:00010000:3.0:1715330299.466917:0:9416:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013457fa80/0xd895711d66d8f76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb899 expref: 10 pid: 25569 timeout: 373 lvb_type: 0 00010000:00010000:3.0:1715330299.467110:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457fa80/0xd895711d66d8f76 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb899 expref: 10 pid: 25569 timeout: 373 lvb_type: 0 00010000:00010000:3.0:1715330299.467137:0:9416:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:3.0:1715330299.467142:0:9416:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db661c0/0xd895711d66d95d5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d95ce expref: 12 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.467152:0:9416:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db661c0/0xd895711d66d95d5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d95ce expref: 12 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.467160:0:9416:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db661c0/0xd895711d66d95d5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d95ce expref: 12 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.467192:0:9416:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011db661c0/0xd895711d66d95d5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d95ce expref: 12 pid: 9408 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330299.467208:0:9416:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:9416:1798653942489472:0@lo:105: 00000100:00100000:3.0:1715330299.467244:0:9416:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330299.467271:0:9416:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1715330299.467283:0:9413:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942489472 00000100:00100000:0.0:1715330299.467288:0:9413:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942489472 00000100:00100000:0.0:1715330299.467927:0:9413:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1179 00000100:00100000:0.0:1715330299.467932:0:9413:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:9416:x1798653942489472:12345-0@lo:105: 00010000:00010000:0.0:1715330299.467941:0:9413:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a0b40/0xd895711d66d95ce lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d95d5 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.467948:0:9413:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a0b40/0xd895711d66d95ce lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d95d5 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.467955:0:9413:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a0b40/0xd895711d66d95ce lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d95d5 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.467960:0:9413:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a0b40/0xd895711d66d95ce lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d95d5 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.467964:0:9413:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a0b40/0xd895711d66d95ce lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d95d5 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.467971:0:9413:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a0b40/0xd895711d66d95ce lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d95d5 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.467999:0:9413:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88009d7a0b40) 00010000:00010000:2.0:1715330299.468023:0:25569:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a0b40/0xd895711d66d95ce lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d95d5 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.468032:0:25569:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a0b40/0xd895711d66d95ce lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d95d5 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715330299.468058:0:25569:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1715330299.468062:0:9413:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:9416:x1798653942489472:12345-0@lo:105: Request processed in 130us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330299.468068:0:9413:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1179 00010000:00010000:2.0:1715330299.468093:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d95dc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330299.468099:0:25569:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d95dc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330299.468107:0:25569:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d95dc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 25569 initiator: MDT1 00000100:00100000:2.0:1715330299.468122:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba64a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942489536:0@lo:101:mdt00_005.0 00000100:00100000:3.0:1715330299.468128:0:9416:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:9416:1798653942489472:0@lo:105: 00010000:00010000:3.0:1715330299.468139:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330299.468147:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330299.468159:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa780 going to sleep for 11 seconds 00000100:00100000:2.0:1715330299.468170:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942489536 00000100:00100000:2.0:1715330299.468172:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942489536 00000100:00100000:3.0:1715330299.468175:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+9:2014:x1798653938057152:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 1294us (2096us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330299.468182:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1558 00000100:00100000:2.0:1715330299.468192:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2988 00000100:00100000:2.0:1715330299.468196:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+13:25569:x1798653942489536:12345-0@lo:101:mdt00_005.0 00010000:00010000:2.0:1715330299.468213:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330299.468227:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d95e3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d95dc expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.468244:0:9408:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d95e3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d95dc expref: 14 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.468253:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d95e3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d95dc expref: 14 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.468263:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6088611d (ffff88008d5ee100) 00010000:00010000:2.0:1715330299.468266:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330299.468268:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db66f40, rc 0) 00000100:00100000:2.0:1715330299.468285:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942489536:12345-0@lo:101:mdt00_005.0 Request processed in 88us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330299.468290:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2988 00000100:00100000:2.0:1715330299.468324:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba64a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942489536:0@lo:101:mdt00_005.0 00010000:00010000:2.0:1715330299.468332:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d95dc lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d95e3 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.468339:0:25569:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d95dc lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d95e3 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715330299.468347:0:25569:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:2.0:1715330299.468377:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba64a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942489600:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1715330299.468398:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330299.468405:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa900 going to sleep for 11 seconds 00000100:00100000:0.0:1715330299.468416:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942489600 00000100:00100000:0.0:1715330299.468419:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942489600 00000100:00100000:0.0:1715330299.468443:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2989 00000100:00100000:0.0:1715330299.468446:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942489600:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1715330299.468499:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942489600:12345-0@lo:1000:mdt00_005.0 Request processed in 52us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330299.468507:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2989 00000100:00100000:3.0:1715330299.468612:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba64a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942489600:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1715330299.468649:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c1880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942489664:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1715330299.468669:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330299.468772:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330299.468815:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942489664 00000100:00100000:0.0:1715330299.468819:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942489664 00000100:00100000:0.0:1715330299.468838:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2990 00000100:00100000:0.0:1715330299.468842:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942489664:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1715330299.469146:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942489664:12345-0@lo:1000:mdt00_005.0 Request processed in 303us (475us total) trans 0 rc 1/1 00000100:00100000:0.0:1715330299.469152:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2990 00000100:00100000:3.0:1715330299.469204:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c1880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942489664:0@lo:1000:mdt00_005.0 00010000:00010000:3.0:1715330299.469236:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457d680/0xd895711d66d95ea lrc: 3/0,1 mode: --/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330299.469242:0:25569:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457d680/0xd895711d66d95ea lrc: 3/0,1 mode: --/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330299.469248:0:25569:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457d680/0xd895711d66d95ea lrc: 3/0,1 mode: --/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 25569 initiator: MDT1 00000100:00100000:3.0:1715330299.469256:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c1880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942489728:0@lo:101:mdt00_005.0 00000100:00100000:3.0:1715330299.469274:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330299.469282:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1715330299.469400:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942489728 00000100:00100000:0.0:1715330299.469403:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942489728 00000100:00100000:0.0:1715330299.469428:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2991 00000100:00100000:0.0:1715330299.469432:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942489728:12345-0@lo:101:mdt00_005.0 00010000:00010000:0.0:1715330299.469439:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330299.469451:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66d95f1 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d95ea expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.469464:0:9407:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66d95f1 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d95ea expref: 15 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.469474:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66d95f1 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d95ea expref: 15 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.469480:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18c:0x0].0x0 (ffff88009bbf0700) 00010000:00010000:0.0:1715330299.469482:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1715330299.469484:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a2f40, rc 0) 00000100:00100000:0.0:1715330299.469502:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+15:25569:x1798653942489728:12345-0@lo:101:mdt00_005.0 Request processed in 69us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330299.469510:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2991 00000100:00100000:3.0:1715330299.469561:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c1880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942489728:0@lo:101:mdt00_005.0 00010000:00010000:3.0:1715330299.469568:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457d680/0xd895711d66d95ea lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d95f1 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.469576:0:25569:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457d680/0xd895711d66d95ea lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d95f1 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.469593:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457df80/0xd895711d66d95f8 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330299.469599:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457df80/0xd895711d66d95f8 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330299.469606:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013457df80/0xd895711d66d95f8 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330299.469618:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e880/0xd895711d66d95ff lrc: 3/0,1 mode: --/EX res: [0x240000400:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330299.469623:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e880/0xd895711d66d95ff lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xc9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330299.469628:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e880/0xd895711d66d95ff lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xc9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330299.469640:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c900/0xd895711d66d9606 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330299.469645:0:25569:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c900/0xd895711d66d9606 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330299.469650:0:25569:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c900/0xd895711d66d9606 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 25569 initiator: MDT1 00000100:00100000:3.0:1715330299.469657:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c1880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942489792:0@lo:101:mdt00_005.0 00000100:00100000:3.0:1715330299.469670:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330299.469677:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1715330299.469718:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942489792 00000100:00100000:2.0:1715330299.469721:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942489792 00000100:00100000:2.0:1715330299.469760:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2992 00000100:00100000:2.0:1715330299.469764:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+15:25569:x1798653942489792:12345-0@lo:101:mdt00_005.0 00010000:00010000:2.0:1715330299.469770:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330299.469779:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d960d lrc: 2/0,0 mode: --/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d9606 expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.469790:0:9408:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d960d lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d9606 expref: 16 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.469797:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d960d lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9606 expref: 16 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.469802:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff88008d5eed00) 00010000:00010000:2.0:1715330299.469804:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330299.469806:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db66ac0, rc 0) 00000100:00100000:2.0:1715330299.469823:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+16:25569:x1798653942489792:12345-0@lo:101:mdt00_005.0 Request processed in 59us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330299.469827:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2992 00000100:00100000:3.0:1715330299.470013:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c1880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942489792:0@lo:101:mdt00_005.0 00010000:00010000:3.0:1715330299.470021:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c900/0xd895711d66d9606 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d960d expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.470028:0:25569:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c900/0xd895711d66d9606 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d960d expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330299.470583:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c1880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942489856:0@lo:403:mdt00_005.0 00000100:00100000:3.0:1715330299.470609:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330299.470631:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1715330299.470678:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942489856 00000100:00100000:0.0:1715330299.470681:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942489856 00000100:00100000:0.0:1715330299.470749:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2993 00000100:00100000:0.0:1715330299.470755:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+16:25569:x1798653942489856:12345-0@lo:403:mdt00_005.0 00000100:00100000:0.0:1715330299.472555:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+16:25569:x1798653942489856:12345-0@lo:403:mdt00_005.0 Request processed in 1793us (1938us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330299.472567:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2993 00000100:00100000:3.0:1715330299.472761:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c1880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942489856:0@lo:403:mdt00_005.0 00000040:00080000:3.0:1715330299.473629:0:25569:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].389, 960 off586728 00000040:00080000:3.0:1715330299.473806:0:25569:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].391, 1040 off642168 00000004:00080000:3.0:1715330299.473811:0:25569:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8800b496fd80 with version 748 00000004:00080000:0.0:1715330299.473881:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 748 rpc_version 748 00000020:00100000:0.0:1715330299.473912:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1715330299.473919:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012f579180 x1798653942489984/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2368/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715330299.473940:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f579180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942489984:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330299.474021:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330299.474044:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009d7e3600 going to sleep for 11 seconds 00000100:00100000:2.0:1715330299.474102:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942489984 00000100:00100000:2.0:1715330299.474110:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942489984 00000100:00100000:2.0:1715330299.474388:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2994 00000100:00100000:2.0:1715330299.474394:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f578700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+16:8278:x1798653942489984:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1715330299.475601:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f578700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+17:8278:x1798653942489984:12345-0@lo:1000:osp_up0-1.0 Request processed in 1204us (1577us total) trans 4294983529 rc 0/0 00000100:00100000:2.0:1715330299.475611:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2994 00000100:00100000:1.0:1715330299.475871:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f579180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942489984:0@lo:1000:osp_up0-1.0 00000004:00200000:3.0:1715330299.476595:0:25569:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x18c:0x0]: returning size 4096 00010000:00010000:3.0:1715330299.476623:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e880/0xd895711d66d95ff lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xc9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330299.476634:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e880/0xd895711d66d95ff lrc: 2/0,0 mode: EX/EX res: [0x240000400:0xc9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330299.476642:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e880/0xd895711d66d95ff lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xc9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330299.476648:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457e880 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330299.476652:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e880/0xd895711d66d95ff lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xc9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330299.476660:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e880/0xd895711d66d95ff lrc: 4/0,0 mode: EX/EX res: [0x240000400:0xc9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330299.476676:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x0 (ffff880091ea7500) 00010000:00010000:3.0:1715330299.476679:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330299.476684:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e880/0xd895711d66d95ff lrc: 2/0,0 mode: --/EX res: [0x240000400:0xc9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330299.476689:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e880/0xd895711d66d95ff lrc: 0/0,0 mode: --/EX res: [0x240000400:0xc9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330299.476710:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c900/0xd895711d66d9606 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d960d expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.476717:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c900/0xd895711d66d9606 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d960d expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.476723:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c900/0xd895711d66d9606 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d960d expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.476946:0:25569:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1715330299.476956:0:25569:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcc:0x0] 00010000:00010000:3.0:1715330299.476963:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457df80/0xd895711d66d95f8 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330299.476971:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013457df80/0xd895711d66d95f8 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330299.476975:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013457df80/0xd895711d66d95f8 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330299.476979:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457df80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330299.476980:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457df80/0xd895711d66d95f8 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330299.476984:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457df80/0xd895711d66d95f8 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330299.476991:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18c:0x0].0x0 (ffff880091ea7700) 00010000:00010000:3.0:1715330299.476993:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330299.476995:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013457df80/0xd895711d66d95f8 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330299.476999:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457df80/0xd895711d66d95f8 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330299.477010:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457d680/0xd895711d66d95ea lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d95f1 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.477015:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457d680/0xd895711d66d95ea lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d95f1 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.477019:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457d680/0xd895711d66d95ea lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d95f1 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.477030:0:25569:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1715330299.477049:0:9415:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1715330299.477056:0:9415:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c900/0xd895711d66d9606 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d960d expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.477061:0:9415:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457c900 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:3.0:1715330299.477065:0:9415:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c900/0xd895711d66d9606 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d960d expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1715330299.477070:0:9415:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c900/0xd895711d66d9606 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d960d expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.477100:0:9415:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c900/0xd895711d66d9606 lrc: 2/0,0 mode: --/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d960d expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.477105:0:9415:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1715330299.477133:0:9415:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c900/0xd895711d66d9606 lrc: 1/0,0 mode: --/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d960d expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.477138:0:9415:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457c900/0xd895711d66d9606 lrc: 0/0,0 mode: --/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d960d expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.477150:0:9415:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1715330299.477154:0:9415:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457d680/0xd895711d66d95ea lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d95f1 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.477158:0:9415:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457d680 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:3.0:1715330299.477161:0:9415:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457d680/0xd895711d66d95ea lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d95f1 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1715330299.477165:0:9415:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457d680/0xd895711d66d95ea lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d95f1 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.477182:0:9415:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457d680/0xd895711d66d95ea lrc: 2/0,0 mode: --/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d95f1 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.477186:0:9415:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1715330299.477190:0:9415:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457d680/0xd895711d66d95ea lrc: 1/0,0 mode: --/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d95f1 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.477195:0:9415:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457d680/0xd895711d66d95ea lrc: 0/0,0 mode: --/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d95f1 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.477204:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715330299.477206:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715330299.477207:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330299.477219:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942490112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1715330299.477268:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330299.477295:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1715330299.477300:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942490048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1715330299.477334:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330299.477367:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942490112 00000100:00100000:3.0:1715330299.477372:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942490112 00010000:00010000:1.0:1715330299.477813:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330299.478467:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942490048 00000100:00100000:3.0:1715330299.478472:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942490048 00000100:00100000:0.0:1715330299.478524:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1383 00000100:00100000:0.0:1715330299.478532:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+18:3689:x1798653942490112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330299.478545:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330299.478565:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66d95f1 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d95ea expref: 18 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.478589:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18c:0x0].0x0 (ffff88009bbf0700) 00010000:00010000:0.0:1715330299.478598:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330299.478636:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+17:3689:x1798653942490112:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (1368us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330299.478643:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1383 00000100:00100000:0.0:1715330299.478666:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1384 00000100:00100000:0.0:1715330299.478669:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+16:3689:x1798653942490048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330299.478676:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330299.478685:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d960d lrc: 0/0,0 mode: --/EX res: [0x200000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d9606 expref: 16 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.478696:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcc:0x0].0x0 (ffff88008d5eed00) 00010000:00010000:0.0:1715330299.478701:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330299.478717:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+15:3689:x1798653942490048:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (1383us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330299.478722:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1384 00000100:00100000:0.0:1715330299.478766:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942490048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330299.478774:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942490112:0@lo:103:ldlm_bl.0 00000004:00080000:3.0:1715330299.479148:0:25569:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1715330299.479153:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a0b40/0xd895711d66d95ce lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d95d5 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.479161:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a0b40/0xd895711d66d95ce lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d95d5 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.479171:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a0b40/0xd895711d66d95ce lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d95d5 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.479427:0:25569:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1715330299.479433:0:25569:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1715330299.479438:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d95dc lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d95e3 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.479445:0:25569:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d95dc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d95e3 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330299.479508:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+22:17754:x1798653938057088:12345-192.168.204.49@tcp:36:rm.0 Request processed in 20147us (20261us total) trans 4294968455 rc 0/0 00000100:00100000:3.0:1715330299.479515:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23525 00010000:00010000:2.0:1715330299.479962:0:7123:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1715330299.479968:0:7123:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a0b40/0xd895711d66d95ce lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d95d5 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.479975:0:7123:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a0b40 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:2.0:1715330299.479979:0:7123:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a0b40/0xd895711d66d95ce lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d95d5 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1715330299.479986:0:7123:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a0b40/0xd895711d66d95ce lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d95d5 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.480015:0:7123:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a0b40/0xd895711d66d95ce lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d95d5 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.480020:0:7123:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1715330299.480210:0:7123:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a0b40/0xd895711d66d95ce lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d95d5 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.480216:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009d7a0b40/0xd895711d66d95ce lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d95d5 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.480228:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330299.480230:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330299.480231:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330299.480265:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1715330299.480277:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942490176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330299.480319:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330299.480455:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942490176 00000100:00100000:2.0:1715330299.480460:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942490176 00000100:00100000:2.0:1715330299.480494:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1385 00000100:00100000:2.0:1715330299.480499:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+15:3691:x1798653942490176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715330299.480510:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330299.480524:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db661c0/0xd895711d66d95d5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d95ce expref: 15 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.480534:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:2.0:1715330299.480537:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330299.480559:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+14:3691:x1798653942490176:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330299.480564:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1385 00000100:00100000:0.0:1715330299.480820:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942490176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1715330299.941097:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330299.941207:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938057216 00000100:00100000:3.0:1715330299.941216:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938057216 00000100:00100000:3.0:1715330299.941277:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23526 00000100:00100000:3.0:1715330299.941285:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+9:17764:x1798653938057216:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:3.0:1715330299.941320:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330299.941370:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d9614 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb9b1 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.941435:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c900/0xd895711d66d961b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330299.941449:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c900/0xd895711d66d961b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330299.941462:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c900/0xd895711d66d961b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00000004:00200000:3.0:1715330299.941506:0:25569:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 270336 00000004:00200000:3.0:1715330299.941510:0:25569:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1715330299.941528:0:25569:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c900/0xd895711d66d961b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330299.941548:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d9614 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9b1 expref: 11 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.941562:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c900/0xd895711d66d961b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9b1 expref: 10 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330299.941570:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:3.0:1715330299.941572:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1715330299.941575:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013457c900, rc 0) 00000100:00100000:3.0:1715330299.941627:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+10:17764:x1798653938057216:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 342us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330299.941634:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23526 00000100:00100000:0.0:1715330299.946902:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330299.947040:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938057280 00000100:00100000:2.0:1715330299.947050:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938057280 00000100:00100000:2.0:1715330299.947103:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23527 00000100:00100000:2.0:1715330299.947110:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+10:17764:x1798653938057280:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:2.0:1715330299.947131:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330299.947153:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db661c0/0xd895711d66d9622 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb9b8 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.947217:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9629 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.947231:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9629 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.947243:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9629 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.947255:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d9630 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6088621d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.947260:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d9630 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.947264:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d9630 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.947326:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9629 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.947331:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9629 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.947336:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9629 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.947345:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9629 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.947351:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66ac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330299.947355:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9629 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.947361:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9629 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.947371:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:2.0:1715330299.947374:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330299.947378:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9629 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.947383:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9629 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.947392:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d9630 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.947396:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d9630 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.947400:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d9630 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.947404:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64d80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330299.947406:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d9630 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.947410:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d9630 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.947418:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6088621d (ffff88008d5eee00) 00010000:00010000:2.0:1715330299.947420:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330299.947422:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d9630 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.947425:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d9630 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330299.947448:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db661c0/0xd895711d66d9622 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9b8 expref: 11 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.947454:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db661c0/0xd895711d66d9622 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9b8 expref: 11 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.947460:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db661c0, rc 0) 00000100:00100000:2.0:1715330299.947504:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+10:17764:x1798653938057280:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 394us (612us total) trans 0 rc 301/301 00000100:00100000:2.0:1715330299.947511:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23527 00000100:00100000:0.0:1715330299.953443:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330299.953516:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938057408 00000100:00100000:2.0:1715330299.953527:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938057408 00000100:00100000:2.0:1715330299.953578:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23528 00000100:00100000:2.0:1715330299.953586:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7ec2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+10:17764:x1798653938057408:12345-192.168.204.49@tcp:36:lfs.0 00010000:00010000:2.0:1715330299.953639:0:25569:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330299.953665:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c900/0xd895711d66d961b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9b1 expref: 10 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.953681:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:2.0:1715330299.953685:0:25569:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330299.953758:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d9637 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330299.953770:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d9637 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330299.953778:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d9637 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330299.953790:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d963e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330299.953795:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d963e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330299.953800:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d963e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00000004:02000000:2.0:1715330299.953895:0:25569:0:(lod_object.c:2139:lod_mdt_alloc_specific()) *** cfs_fail_loc=189, val=0*** 00010000:00010000:2.0:1715330299.956793:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d9645 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1523:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330299.956808:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d9645 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1523:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330299.956819:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d9645 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1523:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330299.956835:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d964c lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330299.956840:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d964c lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330299.956845:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d964c lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00000004:00010000:2.0:1715330299.956855:0:25569:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800a7ec2a00 reply state ffff88009d7c2000 transno 4294983530 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d964c lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330299.956863:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d964c lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330299.956868:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff88008d5eef00) 00010000:00010000:2.0:1715330299.956871:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330299.956874:0:25569:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000004:00010000:2.0:1715330299.956879:0:25569:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800a7ec2a00 reply state ffff88009d7c2000 transno 4294983530 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d9645 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1523:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330299.956884:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d9645 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1523:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330299.956889:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1523:0x0].0x0 (ffff88008d5ee700) 00010000:00010000:2.0:1715330299.956890:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330299.956891:0:25569:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00200000:2.0:1715330299.956895:0:25569:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1523:0x0]: returning size 4096 00010000:00010000:2.0:1715330299.956902:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d9637 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330299.956907:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d9637 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330299.956912:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d9637 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330299.956918:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d9637 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330299.956923:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db67a80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330299.956927:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d9637 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330299.956934:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d9637 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330299.956941:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:2.0:1715330299.956943:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330299.956946:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d9637 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330299.956950:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d9637 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00000004:00010000:2.0:1715330299.956962:0:25569:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800a7ec2a00 reply state ffff88009d7c2000 transno 4294983530 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d963e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330299.956968:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d963e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330299.956972:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6088621d (ffff88008d5ee800) 00010000:00010000:2.0:1715330299.956974:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330299.956975:0:25569:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00000100:00100000:2.0:1715330299.957064:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7ec2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+11:17764:x1798653938057408:12345-192.168.204.49@tcp:36:lfs.0 Request processed in 3474us (3626us total) trans 4294983530 rc 0/0 00000100:00100000:2.0:1715330299.957072:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23528 00000100:00100000:0.0:1715330299.963397:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330299.963461:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938057472 00000100:00100000:2.0:1715330299.963471:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938057472 00000100:00100000:2.0:1715330299.963528:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23529 00000100:00100000:2.0:1715330299.963536:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7ec2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+11:17567:x1798653938057472:12345-192.168.204.49@tcp:101:bash.0 00010000:00010000:2.0:1715330299.963560:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330299.963582:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d9653 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb9bf expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.963647:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d965a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330299.963660:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d965a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330299.963671:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d965a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00000004:00200000:2.0:1715330299.963707:0:25569:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 270336 00000004:00200000:2.0:1715330299.963711:0:25569:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1715330299.963727:0:25569:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d965a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330299.963772:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d9653 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9bf expref: 13 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.963787:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d965a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9bf expref: 12 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.963794:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:2.0:1715330299.963797:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1715330299.963800:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db67600, rc 0) 00000100:00100000:2.0:1715330299.963848:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7ec2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+12:17567:x1798653938057472:12345-192.168.204.49@tcp:101:bash.0 Request processed in 312us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330299.963854:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23529 00000100:00100000:1.0:1715330299.970188:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330299.970273:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938057536 00000100:00100000:0.0:1715330299.970283:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938057536 00000100:00100000:0.0:1715330299.970341:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23530 00000100:00100000:0.0:1715330299.970349:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+12:17567:x1798653938057536:12345-192.168.204.49@tcp:101:bash.0 00010000:00010000:0.0:1715330299.970371:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330299.970392:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0000/0xd895711d66d9661 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb9c6 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.970454:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3840/0xd895711d66d9668 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330299.970467:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3840/0xd895711d66d9668 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330299.970480:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3840/0xd895711d66d9668 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330299.970488:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66d966f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6088621d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330299.970493:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66d966f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330299.970498:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66d966f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330299.970561:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66d9676 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1523:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330299.970568:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66d9676 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1523:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330299.970574:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66d9676 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1523:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00200000:0.0:1715330299.970646:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1523:0x0]: returning size 4096 00000004:00200000:0.0:1715330299.970650:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1715330299.970670:0:7135:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66d9676 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1523:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330299.970681:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3840/0xd895711d66d9668 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330299.970687:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3840/0xd895711d66d9668 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330299.970692:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3840/0xd895711d66d9668 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330299.970697:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3840/0xd895711d66d9668 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330299.970702:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a3840 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330299.970705:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3840/0xd895711d66d9668 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330299.970712:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3840/0xd895711d66d9668 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330299.970721:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:0.0:1715330299.970724:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330299.970728:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3840/0xd895711d66d9668 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330299.970753:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3840/0xd895711d66d9668 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330299.970764:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66d966f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330299.970769:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66d966f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330299.970773:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66d966f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330299.970776:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a1d40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330299.970779:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66d966f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330299.970784:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66d966f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330299.970789:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6088621d (ffff88008d5ee800) 00010000:00010000:0.0:1715330299.970791:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330299.970793:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66d966f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330299.970797:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66d966f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330299.970814:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0000/0xd895711d66d9661 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9c6 expref: 14 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.970835:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66d9676 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1523:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9c6 expref: 13 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.970841:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1523:0x0].0x0 (ffff88008d5ee700) 00010000:00010000:0.0:1715330299.970843:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1715330299.970845:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a1200, rc 0) 00000100:00100000:0.0:1715330299.972112:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+13:17567:x1798653938057536:12345-192.168.204.49@tcp:101:bash.0 Request processed in 1759us (1930us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330299.972121:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23530 00000100:00100000:1.0:1715330299.978052:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330299.978100:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938057600 00000100:00100000:0.0:1715330299.978110:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938057600 00000100:00100000:0.0:1715330299.978160:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23531 00000100:00100000:0.0:1715330299.978323:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+13:17567:x1798653938057600:12345-192.168.204.49@tcp:101:bash.0 00010000:00010000:0.0:1715330299.978346:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330299.978366:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3a80/0xd895711d66d967d lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb9cd expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.978415:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0fc0/0xd895711d66d9684 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330299.978427:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0fc0/0xd895711d66d9684 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330299.978437:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0fc0/0xd895711d66d9684 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00200000:0.0:1715330299.978473:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0xcd:0x0]: returning size 4096 00000004:00200000:0.0:1715330299.978477:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1715330299.978506:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3a80/0xd895711d66d967d lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9cd expref: 15 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.978519:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0fc0/0xd895711d66d9684 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9cd expref: 14 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.978527:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff88008d5eef00) 00010000:00010000:0.0:1715330299.978530:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1715330299.978532:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a0fc0, rc 0) 00000100:00100000:0.0:1715330299.978586:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+14:17567:x1798653938057600:12345-192.168.204.49@tcp:101:bash.0 Request processed in 419us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330299.978773:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23531 00000100:00100000:1.0:1715330299.981322:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330299.981396:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938057728 00000100:00100000:0.0:1715330299.981405:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938057728 00000100:00100000:0.0:1715330299.981454:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23532 00000100:00100000:0.0:1715330299.981462:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+14:17567:x1798653938057728:12345-192.168.204.49@tcp:101:bash.0 00010000:00010000:0.0:1715330299.981480:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330299.981484:0:7135:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1715330299.981530:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0fc0/0xd895711d66d9684 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9cd expref: 14 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.981545:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff88008d5eef00) 00010000:00010000:0.0:1715330299.981549:0:7135:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715330299.981562:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a21c0/0xd895711d66d968b lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb9d4 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.981673:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2ac0/0xd895711d66d9692 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330299.981684:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2ac0/0xd895711d66d9692 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330299.981693:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2ac0/0xd895711d66d9692 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330299.981705:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66d9699 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330299.981710:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66d9699 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330299.981715:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66d9699 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00080000:0.0:1715330299.982049:0:7135:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9cb:0x0], index 0: 0 00010000:00010000:0.0:1715330299.982153:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0b40/0xd895711d66d96a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1524:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330299.982164:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0b40/0xd895711d66d96a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1524:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330299.982170:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0b40/0xd895711d66d96a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1524:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330299.982197:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2ac0/0xd895711d66d9692 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330299.982202:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2ac0/0xd895711d66d9692 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330299.982206:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2ac0/0xd895711d66d9692 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330299.982211:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2ac0/0xd895711d66d9692 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330299.982216:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a2ac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330299.982220:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2ac0/0xd895711d66d9692 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330299.982226:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2ac0/0xd895711d66d9692 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330299.982232:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff88008d5eef00) 00010000:00010000:0.0:1715330299.982235:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330299.982238:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2ac0/0xd895711d66d9692 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330299.982243:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2ac0/0xd895711d66d9692 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00000004:00010000:0.0:1715330299.982251:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012b55df80 reply state ffff880091c40000 transno 4294983531 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66d9699 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330299.982260:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66d9699 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330299.982264:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x30 (ffff88009bbf0f00) 00010000:00010000:0.0:1715330299.982266:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330299.982269:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1715330299.982287:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a21c0/0xd895711d66d968b lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9d4 expref: 16 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.982307:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0b40/0xd895711d66d96a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1524:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9d4 expref: 15 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330299.982314:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1524:0x0].0x0 (ffff88009bbf0d00) 00010000:00010000:0.0:1715330299.982315:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715330299.982317:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a0b40, rc 0) 00000100:00100000:0.0:1715330299.982465:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+16:17567:x1798653938057728:12345-192.168.204.49@tcp:101:bash.0 Request processed in 1002us (1151us total) trans 4294983531 rc 0/0 00000100:00100000:0.0:1715330299.982471:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23532 00000100:00100000:0.0:1715330299.986852:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330299.987235:0:17200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938057792 00000100:00100000:2.0:1715330299.987244:0:17200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938057792 00000100:00100000:2.0:1715330299.987284:0:17200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5206 00000100:00100000:2.0:1715330299.987290:0:17200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7ec0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:72de1896-1df4-4b3a-930a-9116d2c66168+16:17567:x1798653938057792:12345-192.168.204.49@tcp:101:bash.0 00010000:00010000:2.0:1715330299.987322:0:17200:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330299.987346:0:17200:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011db646c0/0xd895711d66d96ae lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb9db expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1715330299.987370:0:17200:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1715330299.987390:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330299.987392:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330299.987401:0:17200:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db646c0/0xd895711d66d96ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9db expref: 17 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.987417:0:17200:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011db646c0/0xd895711d66d96ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9db expref: 17 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330299.988110:0:17200:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db646c0, rc 0) 00000100:00100000:2.0:1715330299.988483:0:17200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7ec0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:72de1896-1df4-4b3a-930a-9116d2c66168+17:17567:x1798653938057792:12345-192.168.204.49@tcp:101:bash.0 Request processed in 1190us (1640us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330299.988491:0:17200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5206 00000100:00100000:1.0:1715330299.994326:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330299.994422:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938057920 00000100:00100000:1.0:1715330299.994431:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938057920 00000100:00100000:1.0:1715330299.994483:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5084 00000100:00100000:1.0:1715330299.994491:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+16:17567:x1798653938057920:12345-192.168.204.49@tcp:35:bash.0 00000100:00100000:1.0:1715330299.995360:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+17:17567:x1798653938057920:12345-192.168.204.49@tcp:35:bash.0 Request processed in 867us (1041us total) trans 4294983532 rc 0/0 00000100:00100000:1.0:1715330299.995368:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5084 00000100:00100000:0.0:1715330300.000579:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330300.000616:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938058048 00000100:00100000:0.0:1715330300.000624:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938058048 00000100:00100000:0.0:1715330300.000666:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23533 00000100:00100000:0.0:1715330300.000673:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7ec3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:17567:x1798653938058048:12345-192.168.204.49@tcp:101:bash.0 00010000:00010000:0.0:1715330300.000695:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330300.000715:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2d00/0xd895711d66d96b5 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb9e2 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.000833:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66d96bc lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.000852:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66d96bc lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.000863:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66d96bc lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.000874:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66d96c3 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.000880:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66d96c3 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.000885:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66d96c3 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00080000:0.0:1715330300.001152:0:7135:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9cb:0x0], index 1: 0 00010000:00010000:0.0:1715330300.001265:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3cc0/0xd895711d66d96ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1525:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.001272:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3cc0/0xd895711d66d96ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1525:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.001279:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3cc0/0xd895711d66d96ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1525:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.001320:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66d96bc lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.001326:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66d96bc lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.001336:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66d96bc lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.001341:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66d96bc lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.001347:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a0900 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330300.001350:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66d96bc lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.001358:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66d96bc lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.001369:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff88008d5eef00) 00010000:00010000:0.0:1715330300.001372:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330300.001376:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66d96bc lrc: 3/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.001381:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66d96bc lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00000004:00010000:0.0:1715330300.001391:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800a7ec3480 reply state ffff880091c46000 transno 4294983533 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66d96c3 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.001398:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66d96c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.001402:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x31 (ffff88009bbf0b00) 00010000:00010000:0.0:1715330300.001404:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330300.001406:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1715330300.001424:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2d00/0xd895711d66d96b5 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9e2 expref: 20 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.001440:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3cc0/0xd895711d66d96ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1525:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9e2 expref: 19 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.001445:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1525:0x0].0x0 (ffff88009bbf0800) 00010000:00010000:0.0:1715330300.001447:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715330300.001449:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a3cc0, rc 0) 00000100:00100000:0.0:1715330300.001497:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7ec3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+20:17567:x1798653938058048:12345-192.168.204.49@tcp:101:bash.0 Request processed in 824us (925us total) trans 4294983533 rc 0/0 00000100:00100000:0.0:1715330300.001505:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23533 00000100:00100000:0.0:1715330300.004752:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.006459:0:17200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938058112 00000100:00100000:2.0:1715330300.006469:0:17200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938058112 00000100:00100000:2.0:1715330300.008045:0:17200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5207 00000100:00100000:2.0:1715330300.008056:0:17200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7ec1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:72de1896-1df4-4b3a-930a-9116d2c66168+15:17567:x1798653938058112:12345-192.168.204.49@tcp:101:bash.0 00010000:00010000:2.0:1715330300.008077:0:17200:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330300.008105:0:17200:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011db64480/0xd895711d66d96d8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb9e9 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1715330300.008126:0:17200:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1715330300.008150:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330300.008153:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330300.008163:0:17200:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db64480/0xd895711d66d96d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9e9 expref: 16 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.008180:0:17200:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011db64480/0xd895711d66d96d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9e9 expref: 16 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.008190:0:17200:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db64480, rc 0) 00000100:00100000:2.0:1715330300.008253:0:17200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7ec1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:72de1896-1df4-4b3a-930a-9116d2c66168+16:17567:x1798653938058112:12345-192.168.204.49@tcp:101:bash.0 Request processed in 199us (3525us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.008259:0:17200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5207 00000100:00100000:1.0:1715330300.013525:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330300.013564:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938058240 00000100:00100000:1.0:1715330300.013573:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938058240 00000100:00100000:1.0:1715330300.013878:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5085 00000100:00100000:1.0:1715330300.013886:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+20:17567:x1798653938058240:12345-192.168.204.49@tcp:35:bash.0 00000100:00100000:1.0:1715330300.014322:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+21:17567:x1798653938058240:12345-192.168.204.49@tcp:35:bash.0 Request processed in 435us (811us total) trans 4294983534 rc 0/0 00000100:00100000:1.0:1715330300.014330:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5085 00000100:00100000:0.0:1715330300.019210:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.019262:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938058368 00000100:00100000:2.0:1715330300.019273:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938058368 00000100:00100000:2.0:1715330300.019337:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23534 00000100:00100000:2.0:1715330300.019345:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7ec0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+21:17567:x1798653938058368:12345-192.168.204.49@tcp:101:bash.0 00010000:00010000:2.0:1715330300.019374:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330300.019396:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d96df lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb9f0 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.019490:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d96e6 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.019502:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d96e6 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.019512:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d96e6 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.019526:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d96ed lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.019535:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d96ed lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.019539:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d96ed lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00000004:00080000:2.0:1715330300.019843:0:25569:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9cc:0x0], index 0: 0 00010000:00010000:2.0:1715330300.019956:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d96f4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1526:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.019963:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d96f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1526:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.019970:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d96f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1526:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.019997:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d96e6 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.020003:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d96e6 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.020008:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d96e6 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.020013:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d96e6 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.020019:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64b40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.020022:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d96e6 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.020029:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d96e6 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.020039:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff88008d5eef00) 00010000:00010000:2.0:1715330300.020042:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.020046:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d96e6 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.020051:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d96e6 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00000004:00010000:2.0:1715330300.020086:0:25569:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800a7ec0000 reply state ffff88011db74000 transno 4294983535 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d96ed lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.020094:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d96ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.020099:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x35 (ffff88008d5ee300) 00010000:00010000:2.0:1715330300.020100:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330300.020103:0:25569:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1715330300.020121:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d96df lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9f0 expref: 24 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.020133:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d96f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1526:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9f0 expref: 23 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.020138:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1526:0x0].0x0 (ffff88008d5eee00) 00010000:00010000:2.0:1715330300.020140:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330300.020142:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db67a80, rc 0) 00000100:00100000:2.0:1715330300.020199:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7ec0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+24:17567:x1798653938058368:12345-192.168.204.49@tcp:101:bash.0 Request processed in 854us (1000us total) trans 4294983535 rc 0/0 00000100:00100000:2.0:1715330300.020206:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23534 00000100:00100000:0.0:1715330300.023015:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.023110:0:17200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938058432 00000100:00100000:2.0:1715330300.023120:0:17200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938058432 00000100:00100000:2.0:1715330300.023159:0:17200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5208 00000100:00100000:2.0:1715330300.023166:0:17200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:72de1896-1df4-4b3a-930a-9116d2c66168+17:17567:x1798653938058432:12345-192.168.204.49@tcp:101:bash.0 00010000:00010000:2.0:1715330300.023183:0:17200:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330300.023206:0:17200:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011db661c0/0xd895711d66d9702 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb9f7 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1715330300.023229:0:17200:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1715330300.023249:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330300.023251:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330300.023261:0:17200:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db661c0/0xd895711d66d9702 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9f7 expref: 18 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.023275:0:17200:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011db661c0/0xd895711d66d9702 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9f7 expref: 18 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.023284:0:17200:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db661c0, rc 0) 00000100:00100000:2.0:1715330300.023346:0:17200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:72de1896-1df4-4b3a-930a-9116d2c66168+18:17567:x1798653938058432:12345-192.168.204.49@tcp:101:bash.0 Request processed in 179us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.023353:0:17200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5208 00000100:00100000:0.0:1715330300.026939:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330300.027143:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938058560 00000100:00100000:1.0:1715330300.027154:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938058560 00000100:00100000:1.0:1715330300.027218:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5086 00000100:00100000:1.0:1715330300.027226:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7ec1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+24:17567:x1798653938058560:12345-192.168.204.49@tcp:35:bash.0 00000100:00100000:1.0:1715330300.027544:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7ec1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+25:17567:x1798653938058560:12345-192.168.204.49@tcp:35:bash.0 Request processed in 317us (616us total) trans 4294983536 rc 0/0 00000100:00100000:1.0:1715330300.027551:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5086 00000100:00100000:0.0:1715330300.037056:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.037154:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938058688 00000100:00100000:2.0:1715330300.037164:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938058688 00000100:00100000:2.0:1715330300.037206:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23535 00000100:00100000:2.0:1715330300.037213:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7ec2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+25:17567:x1798653938058688:12345-192.168.204.49@tcp:101:bash.0 00010000:00010000:2.0:1715330300.037237:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330300.037258:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d9709 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfb9fe expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.037370:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9710 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.037383:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9710 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.037394:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9710 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.037406:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d9717 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.037411:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d9717 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.037416:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d9717 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00000004:00080000:2.0:1715330300.037672:0:25569:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9cc:0x0], index 1: 0 00010000:00010000:2.0:1715330300.037797:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d971e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1527:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.037804:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d971e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1527:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.037809:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d971e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1527:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.037832:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9710 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.037837:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9710 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.037846:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9710 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.037851:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9710 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.037856:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66ac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.037859:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9710 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.037865:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9710 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.037873:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff88008d5eef00) 00010000:00010000:2.0:1715330300.037875:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.037878:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9710 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.037882:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9710 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00000004:00010000:2.0:1715330300.037909:0:25569:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800a7ec2d80 reply state ffff88009d47c000 transno 4294983537 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d9717 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.037915:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d9717 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.037919:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x36 (ffff88008d5ee900) 00010000:00010000:2.0:1715330300.037921:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330300.037923:0:25569:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1715330300.037940:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d9709 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9fe expref: 28 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.037955:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d971e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1527:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9fe expref: 27 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.037961:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1527:0x0].0x0 (ffff88008d5eeb00) 00010000:00010000:2.0:1715330300.037962:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330300.037964:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db65200, rc 0) 00000100:00100000:2.0:1715330300.038022:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7ec2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+28:17567:x1798653938058688:12345-192.168.204.49@tcp:101:bash.0 Request processed in 809us (978us total) trans 4294983537 rc 0/0 00000100:00100000:2.0:1715330300.038027:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23535 00000100:00100000:0.0:1715330300.042105:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.042206:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938058752 00000100:00100000:2.0:1715330300.042216:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938058752 00000100:00100000:2.0:1715330300.042260:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5209 00000100:00100000:2.0:1715330300.042267:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72de1896-1df4-4b3a-930a-9116d2c66168+16:17567:x1798653938058752:12345-192.168.204.49@tcp:101:bash.0 00010000:00010000:2.0:1715330300.042288:0:9633:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330300.042323:0:9633:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011db64240/0xd895711d66d972c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfba05 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1715330300.042350:0:9633:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1715330300.042372:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330300.042375:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330300.042386:0:9633:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db64240/0xd895711d66d972c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba05 expref: 17 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.042401:0:9633:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011db64240/0xd895711d66d972c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba05 expref: 17 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.042417:0:9633:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db64240, rc 0) 00000100:00100000:2.0:1715330300.042706:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72de1896-1df4-4b3a-930a-9116d2c66168+17:17567:x1798653938058752:12345-192.168.204.49@tcp:101:bash.0 Request processed in 436us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.042713:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5209 00000100:00100000:0.0:1715330300.046617:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330300.046681:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938058880 00000100:00100000:1.0:1715330300.046691:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938058880 00000100:00100000:1.0:1715330300.046845:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5087 00000100:00100000:1.0:1715330300.046853:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+28:17567:x1798653938058880:12345-192.168.204.49@tcp:35:bash.0 00000100:00100000:1.0:1715330300.047165:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+29:17567:x1798653938058880:12345-192.168.204.49@tcp:35:bash.0 Request processed in 311us (561us total) trans 4294983538 rc 0/0 00000100:00100000:1.0:1715330300.047176:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5087 00000100:00100000:0.0:1715330300.052859:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.053017:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938059008 00000100:00100000:2.0:1715330300.053028:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938059008 00000100:00100000:2.0:1715330300.053078:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23536 00000100:00100000:2.0:1715330300.053085:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+29:17567:x1798653938059008:12345-192.168.204.49@tcp:101:bash.0 00010000:00010000:2.0:1715330300.053112:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330300.053134:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d9733 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfba0c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.053253:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d973a lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.053268:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d973a lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.053279:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d973a lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.053293:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d9741 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.053311:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d9741 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.053317:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d9741 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00080000:2.0:1715330300.053588:0:7135:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9cd:0x0], index 0: 0 00010000:00010000:2.0:1715330300.053708:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d9748 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.053716:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d9748 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.053722:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d9748 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.053776:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d973a lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.053782:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d973a lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.053787:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d973a lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.053792:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d973a lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.053798:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64900 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.053801:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d973a lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.053807:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d973a lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.053818:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff88008d5eef00) 00010000:00010000:2.0:1715330300.053821:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.053825:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d973a lrc: 3/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.053834:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d973a lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00000004:00010000:2.0:1715330300.053862:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009b5ed500 reply state ffff88009c618000 transno 4294983539 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d9741 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.053870:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d9741 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.053875:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x39 (ffff8800b5206500) 00010000:00010000:2.0:1715330300.053877:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330300.053879:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1715330300.053901:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d9733 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba0c expref: 32 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.053914:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d9748 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba0c expref: 31 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.053921:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1528:0x0].0x0 (ffff8800b5206900) 00010000:00010000:2.0:1715330300.053923:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330300.053925:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db65d40, rc 0) 00000100:00100000:2.0:1715330300.053984:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+32:17567:x1798653938059008:12345-192.168.204.49@tcp:101:bash.0 Request processed in 898us (1135us total) trans 4294983539 rc 0/0 00000100:00100000:2.0:1715330300.053991:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23536 00000100:00100000:0.0:1715330300.058682:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.058923:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938059072 00000100:00100000:2.0:1715330300.059461:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938059072 00000100:00100000:2.0:1715330300.059520:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5210 00000100:00100000:2.0:1715330300.059529:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72de1896-1df4-4b3a-930a-9116d2c66168+18:17567:x1798653938059072:12345-192.168.204.49@tcp:101:bash.0 00010000:00010000:2.0:1715330300.059552:0:9633:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330300.059586:0:9633:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011db67cc0/0xd895711d66d9756 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfba13 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1715330300.059609:0:9633:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1715330300.059631:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330300.059633:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330300.059646:0:9633:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db67cc0/0xd895711d66d9756 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba13 expref: 19 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.059660:0:9633:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011db67cc0/0xd895711d66d9756 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba13 expref: 19 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.059670:0:9633:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db67cc0, rc 0) 00000100:00100000:2.0:1715330300.059745:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72de1896-1df4-4b3a-930a-9116d2c66168+19:17567:x1798653938059072:12345-192.168.204.49@tcp:101:bash.0 Request processed in 201us (1561us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.059752:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5210 00000100:00100000:0.0:1715330300.069676:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330300.069811:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938059200 00000100:00100000:1.0:1715330300.069821:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938059200 00000100:00100000:1.0:1715330300.069880:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5088 00000100:00100000:1.0:1715330300.069889:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fbefc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+32:17567:x1798653938059200:12345-192.168.204.49@tcp:35:bash.0 00000100:00100000:1.0:1715330300.070141:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fbefc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+33:17567:x1798653938059200:12345-192.168.204.49@tcp:35:bash.0 Request processed in 252us (476us total) trans 4294983540 rc 0/0 00000100:00100000:1.0:1715330300.070146:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5088 00000100:00100000:0.0:1715330300.073841:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.074217:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938059328 00000100:00100000:2.0:1715330300.074228:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938059328 00000100:00100000:2.0:1715330300.074283:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23537 00000100:00100000:2.0:1715330300.074291:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+33:17567:x1798653938059328:12345-192.168.204.49@tcp:101:bash.0 00010000:00010000:2.0:1715330300.074342:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330300.074363:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d975d lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfba1a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.074464:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d9764 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.074477:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d9764 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.074491:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d9764 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.074502:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d976b lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.074507:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d976b lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.074511:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d976b lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00080000:2.0:1715330300.074816:0:7135:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9cd:0x0], index 1: 0 00010000:00010000:2.0:1715330300.074930:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d9772 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1529:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.074936:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d9772 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1529:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.074942:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d9772 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1529:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.074971:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d9764 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.074976:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d9764 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.074982:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d9764 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.074988:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d9764 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.074997:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64d80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.075001:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d9764 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.075007:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d9764 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.075018:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff88008d5eef00) 00010000:00010000:2.0:1715330300.075021:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.075025:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d9764 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.075030:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d9764 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00000004:00010000:2.0:1715330300.075064:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009b5edf80 reply state ffff88009c619000 transno 4294983541 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d976b lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.075072:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d976b lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.075077:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x3031 (ffff8800b5206d00) 00010000:00010000:2.0:1715330300.075079:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330300.075081:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1715330300.075101:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d975d lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba1a expref: 36 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.075111:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d9772 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1529:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba1a expref: 35 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.075117:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1529:0x0].0x0 (ffff8800b5206f00) 00010000:00010000:2.0:1715330300.075119:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330300.075121:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db673c0, rc 0) 00000100:00100000:2.0:1715330300.075172:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+36:17567:x1798653938059328:12345-192.168.204.49@tcp:101:bash.0 Request processed in 881us (1341us total) trans 4294983541 rc 0/0 00000100:00100000:2.0:1715330300.075178:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23537 00000100:00100000:0.0:1715330300.078614:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.078705:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938059392 00000100:00100000:2.0:1715330300.078715:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938059392 00000100:00100000:2.0:1715330300.078779:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5211 00000100:00100000:2.0:1715330300.078787:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72de1896-1df4-4b3a-930a-9116d2c66168+17:17567:x1798653938059392:12345-192.168.204.49@tcp:101:bash.0 00010000:00010000:2.0:1715330300.078805:0:9633:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330300.078833:0:9633:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011db64b40/0xd895711d66d9780 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfba21 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1715330300.078856:0:9633:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1715330300.078878:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330300.078880:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330300.078891:0:9633:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db64b40/0xd895711d66d9780 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba21 expref: 18 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.078903:0:9633:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011db64b40/0xd895711d66d9780 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba21 expref: 18 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.078913:0:9633:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db64b40, rc 0) 00000100:00100000:2.0:1715330300.079172:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72de1896-1df4-4b3a-930a-9116d2c66168+18:17567:x1798653938059392:12345-192.168.204.49@tcp:101:bash.0 Request processed in 383us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.079179:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5211 00000100:00100000:0.0:1715330300.081883:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330300.083431:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938059520 00000100:00100000:3.0:1715330300.083443:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938059520 00000100:00100000:3.0:1715330300.083499:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5089 00000100:00100000:3.0:1715330300.083506:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+36:17567:x1798653938059520:12345-192.168.204.49@tcp:35:bash.0 00000100:00100000:3.0:1715330300.084804:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+37:17567:x1798653938059520:12345-192.168.204.49@tcp:35:bash.0 Request processed in 1293us (2925us total) trans 4294983542 rc 0/0 00000100:00100000:3.0:1715330300.084814:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5089 00000100:00100000:0.0:1715330300.098246:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.098349:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938059648 00000100:00100000:2.0:1715330300.098359:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938059648 00000100:00100000:2.0:1715330300.098404:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23538 00000100:00100000:2.0:1715330300.098412:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+37:17765:x1798653938059648:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:2.0:1715330300.098439:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330300.098461:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9787 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfba28 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715330300.098647:0:25569:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1523:0x0]: returning size 4096 00010000:00010000:2.0:1715330300.098756:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9787 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba28 expref: 39 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.098765:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9787 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba28 expref: 39 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.098775:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db64900, rc 0) 00000100:00100000:2.0:1715330300.098819:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+38:17765:x1798653938059648:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 408us (583us total) trans 4294983543 rc 301/301 00000100:00100000:2.0:1715330300.098824:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23538 00000100:00100000:0.0:1715330300.101931:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330300.102039:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938059712 00000100:00100000:3.0:1715330300.102049:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938059712 00000100:00100000:3.0:1715330300.102430:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5090 00000100:00100000:3.0:1715330300.102437:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+38:17765:x1798653938059712:12345-192.168.204.49@tcp:33:lfs.0 00000004:00200000:3.0:1715330300.102585:0:15159:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1523:0x0]: returning size 4096 00000004:00200000:3.0:1715330300.102589:0:15159:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:3.0:1715330300.103094:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+38:17765:x1798653938059712:12345-192.168.204.49@tcp:33:lfs.0 Request processed in 654us (1175us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.103102:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5090 00000100:00100000:0.0:1715330300.106931:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330300.107021:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938059840 00000100:00100000:3.0:1715330300.107030:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938059840 00000100:00100000:3.0:1715330300.107082:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5091 00000100:00100000:3.0:1715330300.107089:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+38:17765:x1798653938059840:12345-192.168.204.49@tcp:35:lfs.0 00000100:00100000:3.0:1715330300.107283:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+39:17765:x1798653938059840:12345-192.168.204.49@tcp:35:lfs.0 Request processed in 194us (361us total) trans 4294983544 rc 0/0 00000100:00100000:3.0:1715330300.107290:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5091 00000100:00100000:0.0:1715330300.116369:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.116471:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938059968 00000100:00100000:2.0:1715330300.116480:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938059968 00000100:00100000:2.0:1715330300.116532:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23539 00000100:00100000:2.0:1715330300.116540:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+39:17766:x1798653938059968:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:2.0:1715330300.116566:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330300.116587:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d9795 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfba2f expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.116804:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d979c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1523:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.116819:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d979c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1523:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.116829:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d979c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1523:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00200000:2.0:1715330300.116838:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1523:0x0]: returning size 4096 00010000:00010000:2.0:1715330300.116919:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d9795 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba2f expref: 42 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.116932:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d979c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1523:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba2f expref: 41 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.116940:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1523:0x0].0x0 (ffff88008d5ee700) 00010000:00010000:2.0:1715330300.116942:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1715330300.116945:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db64900, rc 0) 00000100:00100000:2.0:1715330300.116989:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+41:17766:x1798653938059968:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 450us (631us total) trans 4294983545 rc 0/0 00000100:00100000:2.0:1715330300.116994:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23539 00000100:00100000:0.0:1715330300.120410:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330300.120488:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330300.120660:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938060032 00000100:00100000:3.0:1715330300.120669:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938060032 00000100:00100000:1.0:1715330300.120799:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938060160 00000100:00100000:1.0:1715330300.120802:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938060160 00000100:00100000:1.0:1715330300.120830:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5092 00000100:00100000:1.0:1715330300.120837:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+42:17766:x1798653938060160:12345-192.168.204.49@tcp:35:lfs.0 00000100:00100000:1.0:1715330300.121025:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+43:17766:x1798653938060160:12345-192.168.204.49@tcp:35:lfs.0 Request processed in 188us (535us total) trans 4294983546 rc 0/0 00000100:00100000:1.0:1715330300.121031:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5092 00000100:00100000:3.0:1715330300.122171:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1386 00000100:00100000:3.0:1715330300.122178:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+42:2011:x1798653938060032:12345-192.168.204.49@tcp:103:lfs.0 00010000:00010000:3.0:1715330300.122191:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330300.122214:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d965a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9bf expref: 42 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.122407:0:9416:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:3.0:1715330300.122412:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715330300.123007:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+41:2011:x1798653938060032:12345-192.168.204.49@tcp:103:lfs.0 Request processed in 828us (2607us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.123014:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1386 00000100:00100000:0.0:1715330300.127884:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330300.128289:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938060224 00000100:00100000:3.0:1715330300.128305:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938060224 00000100:00100000:3.0:1715330300.128363:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1387 00000100:00100000:3.0:1715330300.128369:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+41:2012:x1798653938060224:12345-192.168.204.49@tcp:103:lfs.0 00010000:00010000:3.0:1715330300.128386:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1715330300.128410:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d979c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1523:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba2f expref: 41 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.128429:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66d9676 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1523:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9c6 expref: 40 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.128440:0:9416:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1523:0x0].0x0 (ffff88008d5ee700) 00010000:00010000:3.0:1715330300.128444:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715330300.128494:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+39:2012:x1798653938060224:12345-192.168.204.49@tcp:103:lfs.0 Request processed in 125us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.128500:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1387 00000100:00100000:1.0:1715330300.128944:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330300.129382:0:7148:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938060352 00000100:00100000:3.0:1715330300.129387:0:7148:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938060352 00000100:00100000:3.0:1715330300.129423:0:7148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 7 00000100:00100000:3.0:1715330300.129428:0:7148:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:72de1896-1df4-4b3a-930a-9116d2c66168+22:17766:x1798653938060352:12345-192.168.204.49@tcp:36:lfs.0 00010000:00010000:3.0:1715330300.129516:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457df80/0xd895711d66d97aa lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.129525:0:7148:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457df80/0xd895711d66d97aa lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7148 initiator: MDT1 00010000:00010000:3.0:1715330300.129534:0:7148:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457df80/0xd895711d66d97aa lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7148 initiator: MDT1 00000100:00100000:3.0:1715330300.129553:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4ed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942490240:0@lo:101:mdt_io00_002.0 00000100:00100000:3.0:1715330300.129592:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.129613:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496f840 going to sleep for 11 seconds 00000100:00100000:2.0:1715330300.129751:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942490240 00000100:00100000:2.0:1715330300.129755:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942490240 00000100:00100000:2.0:1715330300.129803:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2995 00000100:00100000:2.0:1715330300.129807:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+14:7148:x1798653942490240:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:2.0:1715330300.129819:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330300.129834:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d97b1 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d97aa expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.129854:0:9407:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d97b1 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d97aa expref: 15 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.129866:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d97b1 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d97aa expref: 15 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.129872:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff8800b4207800) 00010000:00010000:2.0:1715330300.129875:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.129877:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db64d80, rc 0) 00000100:00100000:2.0:1715330300.129912:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+15:7148:x1798653942490240:12345-0@lo:101:mdt_io00_002.0 Request processed in 104us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.129916:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2995 00000100:00100000:3.0:1715330300.130510:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4ed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942490240:0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1715330300.130523:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457df80/0xd895711d66d97aa lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d97b1 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.130532:0:7148:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457df80/0xd895711d66d97aa lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d97b1 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330300.130549:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1715330300.130581:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4ed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942490304:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.130603:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.130930:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1715330300.131067:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942490304 00000100:00100000:0.0:1715330300.131072:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942490304 00000100:00100000:0.0:1715330300.131273:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2996 00000100:00100000:0.0:1715330300.131279:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+15:7148:x1798653942490304:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1715330300.131354:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+15:7148:x1798653942490304:12345-0@lo:1000:mdt_io00_002.0 Request processed in 74us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330300.131359:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2996 00000100:00100000:3.0:1715330300.131446:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4ed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942490304:0@lo:1000:mdt_io00_002.0 00000004:00080000:3.0:1715330300.131465:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1715330300.131483:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4ed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942490368:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.131498:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.131627:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1715330300.131652:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942490368 00000100:00100000:2.0:1715330300.131656:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942490368 00000100:00100000:2.0:1715330300.131783:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2997 00000100:00100000:2.0:1715330300.131787:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+15:7148:x1798653942490368:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330300.131844:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+15:7148:x1798653942490368:12345-0@lo:1000:mdt_io00_002.0 Request processed in 56us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.131849:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2997 00000100:00100000:3.0:1715330300.131895:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4ed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942490368:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.131942:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4ed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942490432:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.131963:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.131970:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1715330300.132022:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942490432 00000100:00100000:0.0:1715330300.132025:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942490432 00000100:00100000:0.0:1715330300.132048:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2998 00000100:00100000:0.0:1715330300.132052:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+15:7148:x1798653942490432:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1715330300.132084:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+15:7148:x1798653942490432:12345-0@lo:1000:mdt_io00_002.0 Request processed in 32us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330300.132089:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2998 00000100:00100000:3.0:1715330300.132355:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4ed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942490432:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.132380:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091cc8380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942490496:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.132395:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.132501:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1715330300.132525:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942490496 00000100:00100000:2.0:1715330300.132527:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942490496 00000100:00100000:2.0:1715330300.132579:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2999 00000100:00100000:2.0:1715330300.132583:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+15:7148:x1798653942490496:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330300.132649:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+15:7148:x1798653942490496:12345-0@lo:1000:mdt_io00_002.0 Request processed in 66us (253us total) trans 0 rc 1/1 00000100:00100000:2.0:1715330300.132654:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2999 00000100:00100000:3.0:1715330300.132697:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091cc8380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942490496:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.132950:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091cc8380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942490560:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.132966:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.132980:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330300.133014:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942490560 00000100:00100000:1.0:1715330300.133017:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942490560 00000100:00100000:1.0:1715330300.133073:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3000 00000100:00100000:1.0:1715330300.133077:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+15:7148:x1798653942490560:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1715330300.133213:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+15:7148:x1798653942490560:12345-0@lo:1000:mdt_io00_002.0 Request processed in 135us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330300.133218:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3000 00000100:00100000:3.0:1715330300.133258:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091cc8380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942490560:0@lo:1000:mdt_io00_002.0 00010000:00010000:3.0:1715330300.133306:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e880/0xd895711d66d97b8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.133314:0:7148:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e880/0xd895711d66d97b8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 7148 initiator: MDT1 00010000:00010000:3.0:1715330300.133323:0:7148:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e880/0xd895711d66d97b8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 7148 initiator: MDT1 00000100:00100000:3.0:1715330300.133331:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091cc8380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942490624:0@lo:101:mdt_io00_002.0 00000100:00100000:3.0:1715330300.133347:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.133353:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496f840 going to sleep for 11 seconds 00000100:00100000:1.0:1715330300.133399:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942490624 00000100:00100000:1.0:1715330300.133402:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942490624 00000100:00100000:1.0:1715330300.133412:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3001 00000100:00100000:1.0:1715330300.133415:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+15:7148:x1798653942490624:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1715330300.133423:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330300.133437:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d97bf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d97b8 expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.133456:0:9408:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d97bf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d97b8 expref: 16 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.133468:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d97bf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d97b8 expref: 16 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.133474:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:1.0:1715330300.133478:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330300.133481:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfcd80, rc 0) 00000100:00100000:1.0:1715330300.133497:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+16:7148:x1798653942490624:12345-0@lo:101:mdt_io00_002.0 Request processed in 81us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330300.133501:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3001 00000100:00100000:3.0:1715330300.133782:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091cc8380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942490624:0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1715330300.133791:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e880/0xd895711d66d97b8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d97bf expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.133800:0:7148:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e880/0xd895711d66d97b8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d97bf expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330300.133811:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1715330300.133828:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e400/0xd895711d66d97c6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.133833:0:7148:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e400/0xd895711d66d97c6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7148 initiator: MDT1 00010000:00010000:3.0:1715330300.133839:0:7148:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e400/0xd895711d66d97c6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7148 initiator: MDT1 00000100:00100000:3.0:1715330300.133847:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091cc8380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942490688:0@lo:101:mdt_io00_002.0 00000100:00100000:3.0:1715330300.133861:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.133878:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496f840 going to sleep for 11 seconds 00000100:00100000:2.0:1715330300.133946:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942490688 00000100:00100000:2.0:1715330300.133949:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942490688 00000100:00100000:2.0:1715330300.134084:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3002 00000100:00100000:2.0:1715330300.134088:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+16:7148:x1798653942490688:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:2.0:1715330300.134094:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330300.134106:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d97cd lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d97c6 expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.134117:0:9407:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d963e lrc: 2/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.134124:0:9407:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d97cd lrc: 4/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d97c6 expref: 17 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.134136:0:9407:0:(ldlm_request.c:381:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d963e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 25569 initiator: MDT0 00080000:00080000:2.0:1715330300.134162:0:9407:0:(osd_handler.c:2696:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:2.0:1715330300.134203:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d97cd lrc: 3/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d97c6 expref: 17 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.134209:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6088621d (ffff88008d5ee800) 00010000:00010000:2.0:1715330300.134211:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.134214:0:9407:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d97cd lrc: 3/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d97c6 expref: 17 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.134218:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db67600, rc 0) 00000100:00100000:2.0:1715330300.134236:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+17:7148:x1798653942490688:12345-0@lo:101:mdt_io00_002.0 Request processed in 148us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.134240:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3002 00000100:00100000:3.0:1715330300.134459:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091cc8380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942490688:0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1715330300.134467:0:7148:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e400/0xd895711d66d97c6 lrc: 4/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d97cd expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.134473:0:7148:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e400/0xd895711d66d97c6 lrc: 4/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d97cd expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1715330300.137122:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983546 is committed 00000001:00080000:0.0:1715330300.137162:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983529 is committed 00000020:00080000:0.0:1715330300.137167:0:7116:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 393 batchid updated 00000020:00080000:0.0:1715330300.137170:0:7116:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 390 batchid updated 00000020:00080000:0.0:1715330300.137173:0:7116:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 389 batchid updated 00000020:00080000:0.0:1715330300.137175:0:7116:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 388 batchid updated 00010000:00010000:2.0:1715330300.137502:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d963e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.137514:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d963e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.137520:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d963e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.137526:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64fc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.137530:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d963e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.137536:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d963e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.137551:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6088621d (ffff88008d5ee800) 00010000:00010000:2.0:1715330300.137553:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.137558:0:3675:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d97cd lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d97c6 expref: 15 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.137567:0:3675:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d97cd lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d97c6 expref: 15 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.137574:0:3675:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d97cd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d97c6 expref: 15 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.137611:0:3675:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d97cd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d97c6 expref: 15 pid: 9407 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330300.137623:0:3675:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba67480 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3675:1798653942490752:0@lo:105: 00000100:00100000:2.0:1715330300.137685:0:3675:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330300.137748:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942490752 00000100:00100000:1.0:1715330300.137755:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942490752 00000020:00080000:3.0:1715330300.137809:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 393 00000004:00080000:3.0:1715330300.137868:0:7163:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8800b496f840 with version 717 00000020:00080000:3.0:1715330300.137876:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 388 cancel update log [0x240000401:0x3:0x0].372: rc = 0 00000020:00080000:3.0:1715330300.137936:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 388 cancel update log [0x200000400:0x3:0x0].373: rc = 0 00000004:00080000:3.0:1715330300.137954:0:7163:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8800b496f6c0 with version 718 00000020:00080000:3.0:1715330300.137957:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 389 cancel update log [0x240000401:0x3:0x0].373: rc = 0 00000020:00080000:3.0:1715330300.137972:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 389 cancel update log [0x200000400:0x3:0x0].374: rc = 0 00000004:00080000:3.0:1715330300.137991:0:7163:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8800b496f780 with version 719 00000020:00080000:3.0:1715330300.137992:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 390 cancel update log [0x240000401:0x3:0x0].374: rc = 0 00000020:00080000:3.0:1715330300.138004:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 390 cancel update log [0x200000400:0x3:0x0].375: rc = 0 00000004:00080000:3.0:1715330300.138017:0:7163:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8800b496f000 with version 720 00000020:00080000:3.0:1715330300.138019:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 391 cancel update log [0x240000401:0x3:0x0].375: rc = 0 00000020:00080000:3.0:1715330300.138028:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 391 cancel update log [0x200000400:0x3:0x0].376: rc = 0 00000004:00080000:3.0:1715330300.138044:0:7163:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8800b496f540 with version 721 00000020:00080000:3.0:1715330300.138046:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 392 cancel update log [0x240000401:0x3:0x0].376: rc = 0 00000020:00080000:3.0:1715330300.138059:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 392 cancel update log [0x200000400:0x3:0x0].377: rc = 0 00000004:00080000:3.0:1715330300.138072:0:7163:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8800b496f300 with version 722 00000020:00080000:3.0:1715330300.138074:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 393 cancel update log [0x240000401:0x3:0x0].377: rc = 0 00000020:00080000:3.0:1715330300.138083:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 393 cancel update log [0x200000400:0x3:0x0].378: rc = 0 00000020:00080000:3.0:1715330300.138087:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 393 00000004:00080000:3.0:1715330300.138101:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 717 rpc_version 717 00000020:00100000:3.0:1715330300.138119:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1715330300.138124:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880091cc9500 x1798653942490880/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1715330300.138139:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091cc9500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942490880:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330300.138224:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1180 00000100:00100000:1.0:1715330300.138231:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:3675:x1798653942490752:12345-0@lo:105: 00010000:00010000:1.0:1715330300.138241:0:7118:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e400/0xd895711d66d97c6 lrc: 5/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d97cd expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.138249:0:7118:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e400/0xd895711d66d97c6 lrc: 5/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d97cd expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.138255:0:7118:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e400/0xd895711d66d97c6 lrc: 5/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d97cd expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.138261:0:7118:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e400/0xd895711d66d97c6 lrc: 5/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d97cd expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.138265:0:7118:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e400/0xd895711d66d97c6 lrc: 6/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d97cd expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.138271:0:7118:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e400/0xd895711d66d97c6 lrc: 6/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d97cd expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.138288:0:7118:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88013457e400) 00000100:00100000:3.0:1715330300.138611:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.138635:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496f180 going to sleep for 11 seconds 00000100:00100000:0.0:1715330300.138648:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942490880 00010000:00010000:3.0:1715330300.138653:0:7148:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e400/0xd895711d66d97c6 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d97cd expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330300.138653:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942490880 00010000:00010000:3.0:1715330300.138660:0:7148:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e400/0xd895711d66d97c6 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d97cd expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330300.138675:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3003 00000100:00100000:0.0:1715330300.138680:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:8587:x1798653942490880:12345-0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1715330300.138681:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1715330300.138717:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f3c0/0xd895711d66d97d4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1523:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.138723:0:7148:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f3c0/0xd895711d66d97d4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1523:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7148 initiator: MDT1 00010000:00010000:3.0:1715330300.138751:0:7148:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f3c0/0xd895711d66d97d4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1523:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7148 initiator: MDT1 00000100:00100000:3.0:1715330300.138761:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091cc8380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942490944:0@lo:101:mdt_io00_002.0 00000100:00100000:3.0:1715330300.138780:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.138790:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa000 going to sleep for 11 seconds 00000100:00100000:0.0:1715330300.138797:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:8587:x1798653942490880:12345-0@lo:1000:osp_up1-0.0 Request processed in 117us (186us total) trans 4294968456 rc 0/0 00000100:00100000:0.0:1715330300.138804:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3003 00000100:00100000:0.0:1715330300.138817:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942490944 00000100:00100000:3.0:1715330300.138819:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091cc9500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942490880:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330300.138819:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942490944 00000004:00080000:3.0:1715330300.138827:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 718 rpc_version 718 00000100:00100000:0.0:1715330300.138831:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3004 00000020:00100000:3.0:1715330300.138835:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1715330300.138835:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+16:7148:x1798653942490944:12345-0@lo:101:mdt_io00_002.0 00000100:00100000:3.0:1715330300.138838:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880091cc9f80 x1798653942491072/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:0.0:1715330300.138843:0:9408:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1715330300.138847:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091cc9f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942491072:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1715330300.138856:0:9408:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66d97db lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1523:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d97d4 expref: -99 pid: 9408 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330300.138867:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1715330300.138869:0:9408:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66d97db lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1523:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d97d4 expref: 17 pid: 9408 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330300.138871:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffab40 going to sleep for 11 seconds 00010000:00010000:0.0:1715330300.138879:0:9408:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66d97db lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1523:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d97d4 expref: 17 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.138884:0:9408:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1523:0x0].0x0 (ffff88008d5ee700) 00000100:00100000:3.0:1715330300.138886:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942491072 00010000:00010000:0.0:1715330300.138887:0:9408:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:3.0:1715330300.138889:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942491072 00010000:00010000:0.0:1715330300.138889:0:9408:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a1200, rc 0) 00000100:00100000:3.0:1715330300.138902:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3005 00000100:00100000:3.0:1715330300.138906:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:8587:x1798653942491072:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330300.138907:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+17:7148:x1798653942490944:12345-0@lo:101:mdt_io00_002.0 Request processed in 73us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330300.138912:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3004 00000100:00100000:3.0:1715330300.138962:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:8587:x1798653942491072:12345-0@lo:1000:osp_up1-0.0 Request processed in 54us (94us total) trans 4294968457 rc 0/0 00000100:00100000:3.0:1715330300.138967:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3005 00000100:00100000:3.0:1715330300.138988:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091cc9f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942491072:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1715330300.138994:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 719 rpc_version 719 00000020:00100000:3.0:1715330300.139002:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1715330300.139005:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880091cca680 x1798653942491200/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1715330300.139018:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091cca680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942491200:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1715330300.139036:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.139042:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63a80 going to sleep for 11 seconds 00000100:00100000:3.0:1715330300.139049:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942491200 00000100:00100000:3.0:1715330300.139051:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942491200 00000100:00100000:3.0:1715330300.139071:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3006 00000100:00100000:3.0:1715330300.139074:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:8587:x1798653942491200:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1715330300.139116:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:8587:x1798653942491200:12345-0@lo:1000:osp_up1-0.0 Request processed in 41us (79us total) trans 4294968458 rc 0/0 00000100:00100000:3.0:1715330300.139120:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3006 00000100:00100000:3.0:1715330300.139137:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091cca680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942491200:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1715330300.139141:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 720 rpc_version 720 00000020:00100000:3.0:1715330300.139148:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1715330300.139151:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880091ccad80 x1798653942491328/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1715330300.139159:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091ccad80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942491328:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1715330300.139174:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.139179:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63a80 going to sleep for 11 seconds 00000100:00100000:3.0:1715330300.139185:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942491328 00000100:00100000:3.0:1715330300.139187:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942491328 00000100:00100000:3.0:1715330300.139196:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3007 00000100:00100000:3.0:1715330300.139200:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091ccb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:8587:x1798653942491328:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1715330300.139239:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091ccb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:8587:x1798653942491328:12345-0@lo:1000:osp_up1-0.0 Request processed in 38us (64us total) trans 4294968459 rc 0/0 00000100:00100000:3.0:1715330300.139243:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3007 00000100:00100000:3.0:1715330300.139259:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091ccad80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942491328:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1715330300.139263:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 721 rpc_version 721 00000020:00100000:3.0:1715330300.139270:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1715330300.139273:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880091ccb480 x1798653942491456/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1715330300.139282:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091ccb480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942491456:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1715330300.139308:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.139314:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63a80 going to sleep for 11 seconds 00000100:00100000:3.0:1715330300.139320:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942491456 00000100:00100000:3.0:1715330300.139322:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942491456 00000100:00100000:3.0:1715330300.139332:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3008 00000100:00100000:3.0:1715330300.139335:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091ccb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:8587:x1798653942491456:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1715330300.139373:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091ccb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:8587:x1798653942491456:12345-0@lo:1000:osp_up1-0.0 Request processed in 37us (65us total) trans 4294968460 rc 0/0 00000100:00100000:3.0:1715330300.139378:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3008 00000100:00100000:3.0:1715330300.139394:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091ccb480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942491456:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1715330300.139399:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 722 rpc_version 722 00000020:00100000:3.0:1715330300.139406:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1715330300.139409:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880091ccbb80 x1798653942491584/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1715330300.139418:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091ccbb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942491584:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1715330300.139507:0:3675:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330300.139552:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:3675:x1798653942490752:12345-0@lo:105: Request processed in 1320us (1866us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330300.139559:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1180 00000100:00100000:2.0:1715330300.139621:0:3675:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba67480 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3675:1798653942490752:0@lo:105: 00010000:00010000:2.0:1715330300.139634:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d963e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.139640:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d963e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.139657:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d9645 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1523:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.139662:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d9645 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1523:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.139666:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d9645 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1523:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.139671:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db65b00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.139674:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d9645 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1523:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.139678:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d9645 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1523:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.139686:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1523:0x0].0x0 (ffff88008d5ee700) 00010000:00010000:2.0:1715330300.139689:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.139691:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d9645 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1523:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.139695:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d9645 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1523:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.139703:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d964c lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.139707:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d964c lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.139711:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d964c lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.139714:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64000 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.139716:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d964c lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.139720:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d964c lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.139726:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff88008d5eef00) 00010000:00010000:2.0:1715330300.139728:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.139752:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d964c lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.139758:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d964c lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.139780:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66d9699 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.139784:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66d9699 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.139788:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66d9699 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.139792:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a2f40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.139794:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66d9699 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.139798:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66d9699 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.139805:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x30 (ffff88009bbf0f00) 00010000:00010000:2.0:1715330300.139807:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.139809:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66d9699 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.139817:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66d9699 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.139831:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66d96c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.139835:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66d96c3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.139840:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66d96c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.139844:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a2880 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.139846:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66d96c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.139850:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66d96c3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.139855:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x31 (ffff88009bbf0b00) 00010000:00010000:2.0:1715330300.139857:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.139858:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66d96c3 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.139862:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66d96c3 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.139872:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d96ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.139877:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d96ed lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.139880:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d96ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.139885:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db67840 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.139887:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d96ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.139891:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d96ed lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.139896:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x35 (ffff88008d5ee300) 00010000:00010000:2.0:1715330300.139898:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.139899:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d96ed lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.139903:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d96ed lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.139913:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d9717 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.139918:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d9717 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.139923:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d9717 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.139927:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db67180 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.139930:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d9717 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.139935:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d9717 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.139940:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x36 (ffff88008d5ee900) 00010000:00010000:2.0:1715330300.139942:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.139945:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d9717 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.139949:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d9717 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.139959:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d9741 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.139963:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d9741 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.139967:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d9741 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.139970:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.139972:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d9741 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.139975:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d9741 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.139980:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x39 (ffff8800b5206500) 00010000:00010000:2.0:1715330300.139981:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.139983:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d9741 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.139986:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d9741 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.139996:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d976b lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.140000:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d976b lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.140007:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d976b lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.140011:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66ac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.140012:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d976b lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.140016:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d976b lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.140020:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x3031 (ffff8800b5206d00) 00010000:00010000:2.0:1715330300.140021:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.140023:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d976b lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.140026:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d976b lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00000100:00100000:3.0:1715330300.140172:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330300.142021:0:7148:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983529 gen 2 00000004:00080000:2.0:1715330300.142031:0:7148:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983529 committed transno 4294983529 00000100:00100000:2.0:1715330300.142065:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091cc8380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942490944:0@lo:101:mdt_io00_002.0 00010000:00010000:2.0:1715330300.142087:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f3c0/0xd895711d66d97d4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1523:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d97db expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.142098:0:7148:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f3c0/0xd895711d66d97d4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1523:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d97db expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715330300.142117:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x1523:0x0] 00000100:00100000:2.0:1715330300.142172:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba67480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942491648:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1715330300.142335:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942491584 00000100:00100000:0.0:1715330300.142343:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942491584 00000100:00100000:0.0:1715330300.142389:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3009 00000100:00100000:0.0:1715330300.142395:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:8587:x1798653942491584:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330300.142528:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:8587:x1798653942491584:12345-0@lo:1000:osp_up1-0.0 Request processed in 133us (3088us total) trans 4294968461 rc 0/0 00000100:00100000:0.0:1715330300.142537:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3009 00000100:00100000:3.0:1715330300.143147:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63a80 going to sleep for 11 seconds 00000100:00100000:3.0:1715330300.143168:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091ccbb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942491584:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1715330300.143241:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330300.144060:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1715330300.144106:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942491648 00000100:00100000:1.0:1715330300.144111:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942491648 00000100:00100000:1.0:1715330300.144701:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3010 00000100:00100000:1.0:1715330300.144706:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+17:7148:x1798653942491648:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1715330300.144826:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+17:7148:x1798653942491648:12345-0@lo:1000:mdt_io00_002.0 Request processed in 119us (1584us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330300.144831:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3010 00000100:00100000:2.0:1715330300.144886:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba67480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942491648:0@lo:1000:mdt_io00_002.0 00000004:00080000:2.0:1715330300.144917:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x1523:0x0] 00000100:00100000:2.0:1715330300.144950:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba67480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942491712:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330300.144973:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330300.144980:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1715330300.145012:0:9408:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942491712 00000100:00100000:1.0:1715330300.145015:0:9408:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942491712 00000100:00100000:1.0:1715330300.145030:0:9408:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3011 00000100:00100000:1.0:1715330300.145033:0:9408:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+17:7148:x1798653942491712:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1715330300.145087:0:9408:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+17:7148:x1798653942491712:12345-0@lo:1000:mdt_io00_002.0 Request processed in 52us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330300.145091:0:9408:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3011 00000100:00100000:3.0:1715330300.145141:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba67480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942491712:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.145578:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d774000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942491776:0@lo:403:mdt_io00_002.0 00000100:00100000:3.0:1715330300.145608:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.145616:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63a80 going to sleep for 11 seconds 00000100:00100000:0.0:1715330300.145672:0:23404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942491776 00000100:00100000:0.0:1715330300.145676:0:23404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942491776 00000100:00100000:0.0:1715330300.145692:0:23404:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3012 00000100:00100000:0.0:1715330300.145695:0:23404:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d774380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+17:7148:x1798653942491776:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:0.0:1715330300.147223:0:23404:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d774380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+17:7148:x1798653942491776:12345-0@lo:403:mdt_io00_002.0 Request processed in 1520us (1607us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330300.147232:0:23404:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3012 00000100:00100000:3.0:1715330300.147344:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d774000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942491776:0@lo:403:mdt_io00_002.0 00000100:00100000:3.0:1715330300.148001:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d774000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942491840:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.148031:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.148044:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63f00 going to sleep for 11 seconds 00000100:00100000:3.0:1715330300.148057:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942491840 00000100:00100000:3.0:1715330300.148061:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942491840 00000100:00100000:3.0:1715330300.148082:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3013 00000100:00100000:3.0:1715330300.148087:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d774700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+17:7148:x1798653942491840:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.148133:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d774700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+17:7148:x1798653942491840:12345-0@lo:1000:mdt_io00_002.0 Request processed in 46us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.148137:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3013 00000100:00100000:3.0:1715330300.148151:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d774000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942491840:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.148173:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d774000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942491904:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.148185:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.148191:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63f00 going to sleep for 11 seconds 00000100:00100000:3.0:1715330300.148195:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942491904 00000100:00100000:3.0:1715330300.148197:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942491904 00000100:00100000:3.0:1715330300.148204:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3014 00000100:00100000:3.0:1715330300.148207:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d774a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+17:7148:x1798653942491904:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.148231:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d774a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+17:7148:x1798653942491904:12345-0@lo:1000:mdt_io00_002.0 Request processed in 23us (45us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.148235:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3014 00000100:00100000:3.0:1715330300.148246:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d774000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942491904:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.148579:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d774000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942491968:0@lo:403:mdt_io00_002.0 00000100:00100000:3.0:1715330300.148601:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.148608:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63a80 going to sleep for 11 seconds 00000100:00100000:3.0:1715330300.148614:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942491968 00000100:00100000:3.0:1715330300.148616:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942491968 00000100:00100000:3.0:1715330300.148624:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3015 00000100:00100000:3.0:1715330300.148627:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d774e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+17:7148:x1798653942491968:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:3.0:1715330300.150107:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d774e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+17:7148:x1798653942491968:12345-0@lo:403:mdt_io00_002.0 Request processed in 1473us (1500us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.150116:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3015 00000100:00100000:3.0:1715330300.150146:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d774000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942491968:0@lo:403:mdt_io00_002.0 00000100:00100000:3.0:1715330300.150629:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d774000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942492032:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.150653:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.150666:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63f00 going to sleep for 11 seconds 00000100:00100000:3.0:1715330300.150679:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942492032 00000100:00100000:3.0:1715330300.150683:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942492032 00000100:00100000:3.0:1715330300.150699:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3016 00000100:00100000:3.0:1715330300.150703:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d775180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+17:7148:x1798653942492032:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.150775:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d775180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+17:7148:x1798653942492032:12345-0@lo:1000:mdt_io00_002.0 Request processed in 72us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.150781:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3016 00000100:00100000:3.0:1715330300.150795:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d774000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942492032:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.150820:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d774000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942492096:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.150833:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.150840:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63f00 going to sleep for 11 seconds 00000100:00100000:3.0:1715330300.150846:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942492096 00000100:00100000:3.0:1715330300.150848:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942492096 00000100:00100000:3.0:1715330300.150855:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3017 00000100:00100000:3.0:1715330300.150858:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d775500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+17:7148:x1798653942492096:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.150903:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d775500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+17:7148:x1798653942492096:12345-0@lo:1000:mdt_io00_002.0 Request processed in 43us (68us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.150907:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3017 00000100:00100000:3.0:1715330300.150920:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d774000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942492096:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.150938:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d774000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942492160:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.150952:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.150958:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63f00 going to sleep for 11 seconds 00000100:00100000:3.0:1715330300.150963:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942492160 00000100:00100000:3.0:1715330300.150965:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942492160 00000100:00100000:3.0:1715330300.150972:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3018 00000100:00100000:3.0:1715330300.150975:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d775880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+17:7148:x1798653942492160:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.151000:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d775880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+17:7148:x1798653942492160:12345-0@lo:1000:mdt_io00_002.0 Request processed in 24us (47us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.151004:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3018 00000100:00100000:3.0:1715330300.151015:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d774000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942492160:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.151031:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d774000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942492224:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.151045:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.151051:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63f00 going to sleep for 11 seconds 00000100:00100000:3.0:1715330300.151057:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942492224 00000100:00100000:3.0:1715330300.151059:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942492224 00000100:00100000:3.0:1715330300.151066:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3019 00000100:00100000:3.0:1715330300.151070:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d775c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+17:7148:x1798653942492224:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.151095:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d775c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+17:7148:x1798653942492224:12345-0@lo:1000:mdt_io00_002.0 Request processed in 25us (49us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.151099:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3019 00000100:00100000:3.0:1715330300.151111:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d774000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942492224:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.151126:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d774000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942492288:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.151138:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.151143:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63f00 going to sleep for 11 seconds 00000100:00100000:3.0:1715330300.151148:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942492288 00000100:00100000:3.0:1715330300.151150:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942492288 00000100:00100000:3.0:1715330300.151157:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3020 00000100:00100000:3.0:1715330300.151160:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d775f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+17:7148:x1798653942492288:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.151182:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d775f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+17:7148:x1798653942492288:12345-0@lo:1000:mdt_io00_002.0 Request processed in 21us (43us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.151186:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3020 00000100:00100000:3.0:1715330300.151197:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d774000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942492288:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.151555:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d774000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942492352:0@lo:403:mdt_io00_002.0 00000100:00100000:3.0:1715330300.151578:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.151585:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63a80 going to sleep for 11 seconds 00000100:00100000:3.0:1715330300.151592:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942492352 00000100:00100000:3.0:1715330300.151594:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942492352 00000100:00100000:3.0:1715330300.151604:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3021 00000100:00100000:3.0:1715330300.151607:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134007050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+17:7148:x1798653942492352:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:3.0:1715330300.153028:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134007050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+17:7148:x1798653942492352:12345-0@lo:403:mdt_io00_002.0 Request processed in 1414us (1443us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.153041:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3021 00000100:00100000:3.0:1715330300.153280:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d774000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942492352:0@lo:403:mdt_io00_002.0 00000100:00100000:3.0:1715330300.154560:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d774000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942492416:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.155553:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.155600:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63f00 going to sleep for 11 seconds 00000100:00100000:2.0:1715330300.155632:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942492416 00000100:00100000:2.0:1715330300.155641:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942492416 00000100:00100000:2.0:1715330300.155691:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2919 00000100:00100000:2.0:1715330300.155697:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d774380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+17:7148:x1798653942492416:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330300.155802:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d774380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+17:7148:x1798653942492416:12345-0@lo:1000:mdt_io00_002.0 Request processed in 105us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.155808:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2919 00000100:00100000:3.0:1715330300.155986:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d774000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942492416:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.156084:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d774000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942492480:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.156120:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.156140:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63d80 going to sleep for 11 seconds 00000100:00100000:2.0:1715330300.156154:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942492480 00000100:00100000:2.0:1715330300.156157:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942492480 00000100:00100000:2.0:1715330300.156175:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2920 00000100:00100000:2.0:1715330300.156178:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d774700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+17:7148:x1798653942492480:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330300.156223:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d774700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+17:7148:x1798653942492480:12345-0@lo:1000:mdt_io00_002.0 Request processed in 43us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.156227:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2920 00000100:00100000:3.0:1715330300.156257:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d774000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942492480:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.156284:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d774000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942492544:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.156316:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.156334:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63900 going to sleep for 11 seconds 00000100:00100000:2.0:1715330300.156348:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942492544 00000100:00100000:2.0:1715330300.156351:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942492544 00000100:00100000:2.0:1715330300.156367:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2921 00000100:00100000:2.0:1715330300.156370:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d774a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+17:7148:x1798653942492544:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330300.156405:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d774a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+17:7148:x1798653942492544:12345-0@lo:1000:mdt_io00_002.0 Request processed in 34us (88us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.156409:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2921 00000100:00100000:3.0:1715330300.156420:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d774000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942492544:0@lo:1000:mdt_io00_002.0 00000040:00080000:3.0:1715330300.157290:0:7148:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].390, 2464 off589192 00000040:00080000:3.0:1715330300.157353:0:7148:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].392, 2544 off644712 00000004:00080000:3.0:1715330300.157358:0:7148:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88011db63a80 with version 749 00000004:00080000:1.0:1715330300.157435:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 749 rpc_version 749 00000020:00100000:1.0:1715330300.157471:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1715330300.157478:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880091c3ca80 x1798653942492672/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1715330300.157495:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3ca80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942492672:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1715330300.157531:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330300.157553:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4b2f480 going to sleep for 11 seconds 00000100:00100000:0.0:1715330300.157598:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942492672 00000100:00100000:0.0:1715330300.157604:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942492672 00000100:00100000:0.0:1715330300.157633:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2922 00000100:00100000:0.0:1715330300.157637:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7ec1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+17:8278:x1798653942492672:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330300.158202:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7ec1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+18:8278:x1798653942492672:12345-0@lo:1000:osp_up0-1.0 Request processed in 563us (669us total) trans 4294983547 rc 0/0 00000100:00100000:0.0:1715330300.158208:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2922 00000100:00100000:1.0:1715330300.158327:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091c3ca80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942492672:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1715330300.158920:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f600/0xd895711d66d97e2 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x193:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.158934:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f600/0xd895711d66d97e2 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x193:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT1 00010000:00010000:3.0:1715330300.158946:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f600/0xd895711d66d97e2 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x193:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT1 00010000:00010000:3.0:1715330300.158964:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457dd40/0xd895711d66d97e9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.158969:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457dd40/0xd895711d66d97e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT1 00010000:00010000:3.0:1715330300.158973:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013457dd40/0xd895711d66d97e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT1 00010000:00010000:3.0:1715330300.159002:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457eac0/0xd895711d66d97f0 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.159007:0:7148:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457eac0/0xd895711d66d97f0 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7148 initiator: MDT1 00010000:00010000:3.0:1715330300.159016:0:7148:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457eac0/0xd895711d66d97f0 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7148 initiator: MDT1 00000100:00100000:3.0:1715330300.159036:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d774000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942492736:0@lo:101:mdt_io00_002.0 00000100:00100000:3.0:1715330300.159082:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.162222:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db630c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715330300.162508:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942492736 00000100:00100000:2.0:1715330300.162517:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942492736 00000100:00100000:2.0:1715330300.165582:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2923 00000100:00100000:2.0:1715330300.165595:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d774e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+18:7148:x1798653942492736:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:2.0:1715330300.165619:0:7138:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330300.165641:0:7138:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d97f7 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d97f0 expref: -99 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.165666:0:7138:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d97f7 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d97f0 expref: 19 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.165677:0:7138:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d97f7 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d97f0 expref: 19 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.165684:0:7138:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff8800b4207a00) 00010000:00010000:2.0:1715330300.165686:0:7138:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.165688:0:7138:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db66ac0, rc 0) 00000100:00100000:2.0:1715330300.166118:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d774e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+19:7148:x1798653942492736:12345-0@lo:101:mdt_io00_002.0 Request processed in 527us (7035us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.166125:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2923 00000100:00100000:3.0:1715330300.166227:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d774000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:7148:1798653942492736:0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1715330300.166244:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457eac0/0xd895711d66d97f0 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d97f7 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.166252:0:7148:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457eac0/0xd895711d66d97f0 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d97f7 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1715330300.166271:0:7148:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880091c3f480 reply state ffff8801345aa000 transno 4294968462 ns: mdt-lustre-MDT0001_UUID lock: ffff88013457dd40/0xd895711d66d97e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT1 00010000:00010000:3.0:1715330300.166285:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457dd40/0xd895711d66d97e9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT1 00010000:00010000:3.0:1715330300.166290:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff880091ea7700) 00010000:00010000:3.0:1715330300.166305:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330300.166308:0:7148:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330300.166313:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457eac0/0xd895711d66d97f0 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d97f7 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.166319:0:7148:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457eac0/0xd895711d66d97f0 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d97f7 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330300.166329:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00000004:00010000:3.0:1715330300.166337:0:7148:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880091c3f480 reply state ffff8801345aa000 transno 4294968462 ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f600/0xd895711d66d97e2 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x193:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT1 00010000:00010000:3.0:1715330300.166343:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f600/0xd895711d66d97e2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x193:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT1 00010000:00010000:3.0:1715330300.166348:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x193:0x0].0x0 (ffff880091ea7500) 00010000:00010000:3.0:1715330300.166350:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330300.166351:0:7148:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00080000:3.0:1715330300.166358:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000402:0x1523:0x0] 00010000:00010000:3.0:1715330300.166363:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f3c0/0xd895711d66d97d4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1523:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d97db expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.166368:0:7148:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f3c0/0xd895711d66d97d4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1523:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d97db expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330300.166375:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1715330300.166379:0:7148:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e880/0xd895711d66d97b8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d97bf expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.166385:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e880/0xd895711d66d97b8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d97bf expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.166390:0:7148:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e880/0xd895711d66d97b8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d97bf expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.166416:0:7148:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1715330300.166419:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1715330300.166422:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e400/0xd895711d66d97c6 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d97cd expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.166428:0:7148:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e400/0xd895711d66d97c6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d97cd expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330300.166457:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1715330300.166461:0:7148:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457df80/0xd895711d66d97aa lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d97b1 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.166466:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457df80/0xd895711d66d97aa lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d97b1 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.166471:0:7148:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457df80/0xd895711d66d97aa lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d97b1 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.166600:0:7148:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1715330300.166659:0:7148:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:72de1896-1df4-4b3a-930a-9116d2c66168+24:17766:x1798653938060352:12345-192.168.204.49@tcp:36:lfs.0 Request processed in 37227us (37714us total) trans 4294968462 rc 0/0 00000100:00100000:3.0:1715330300.166665:0:7148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 7 00010000:00010000:0.0:1715330300.166715:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1715330300.166721:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e880/0xd895711d66d97b8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d97bf expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.166728:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457e880 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330300.166753:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e880/0xd895711d66d97b8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d97bf expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330300.166760:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e880/0xd895711d66d97b8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d97bf expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.166784:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e880/0xd895711d66d97b8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d97bf expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.166790:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330300.166814:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e880/0xd895711d66d97b8 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d97bf expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.166820:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e880/0xd895711d66d97b8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d97bf expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330300.166824:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1715330300.166830:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715330300.166832:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457df80/0xd895711d66d97aa lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d97b1 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.166837:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457df80 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330300.166840:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457df80/0xd895711d66d97aa lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d97b1 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330300.166845:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457df80/0xd895711d66d97aa lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d97b1 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330300.166847:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942492800:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330300.166859:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457df80/0xd895711d66d97aa lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d97b1 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.166863:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330300.166875:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457df80/0xd895711d66d97aa lrc: 1/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d97b1 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.166880:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457df80/0xd895711d66d97aa lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d97b1 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.166891:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330300.166892:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330300.166894:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330300.166902:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330300.166904:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1715330300.166916:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942492864:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715330300.166952:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330300.167048:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942492800 00000100:00100000:2.0:1715330300.167059:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942492800 00000100:00100000:2.0:1715330300.167091:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1388 00000100:00100000:2.0:1715330300.167096:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ab78a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+19:3690:x1798653942492800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715330300.167105:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330300.167117:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66d97bf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d97b8 expref: 19 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.167135:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:2.0:1715330300.167138:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330300.167164:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ab78a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+18:3690:x1798653942492800:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.167169:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1388 00000100:00100000:1.0:1715330300.167239:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942492800:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330300.167314:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.167486:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942492864 00000100:00100000:3.0:1715330300.167489:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942492864 00000100:00100000:3.0:1715330300.167542:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1389 00000100:00100000:3.0:1715330300.167547:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+18:3689:x1798653942492864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1715330300.167553:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330300.167562:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d97b1 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d97aa expref: 18 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.167572:0:9416:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff8800b4207800) 00010000:00010000:3.0:1715330300.167578:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715330300.167612:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+17:3689:x1798653942492864:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.167617:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1389 00000100:00100000:0.0:1715330300.167671:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942492864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330300.174270:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330300.174459:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938060416 00000100:00100000:0.0:1715330300.174469:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938060416 00000100:00100000:0.0:1715330300.174525:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23540 00000100:00100000:0.0:1715330300.174532:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d644a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+15:17766:x1798653938060416:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:0.0:1715330300.174558:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330300.174580:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3180/0xd895711d66d97fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfba36 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.174638:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1680/0xd895711d66d9805 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.174651:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1680/0xd895711d66d9805 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.174662:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1680/0xd895711d66d9805 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00000004:00200000:0.0:1715330300.174699:0:25569:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 270336 00000004:00200000:0.0:1715330300.174703:0:25569:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1715330300.174718:0:25569:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1680/0xd895711d66d9805 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.174772:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3180/0xd895711d66d97fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba36 expref: 17 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.174796:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1680/0xd895711d66d9805 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba36 expref: 16 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.174805:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:0.0:1715330300.174808:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1715330300.174811:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a1680, rc 0) 00000100:00100000:0.0:1715330300.175290:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d644a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+16:17766:x1798653938060416:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 755us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330300.175306:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23540 00010000:00010000:1.0:1715330300.175362:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330300.179155:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.180114:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938060544 00000100:00100000:2.0:1715330300.180124:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938060544 00000100:00100000:2.0:1715330300.180336:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23541 00000100:00100000:2.0:1715330300.180478:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+16:17766:x1798653938060544:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:2.0:1715330300.180544:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330300.180563:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d980c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfba3d expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.180627:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d9813 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.180638:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d9813 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.180647:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d9813 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.180656:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d981a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6088621d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.180663:0:25569:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d97cd lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d97c6 expref: 16 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.180669:0:25569:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d981a lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.180694:0:25569:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d97cd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd895711d66d97c6 expref: 16 pid: 9407 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330300.180708:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba64700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:25569:1798653942492928:0@lo:104: 00000100:00100000:2.0:1715330300.180774:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330300.182403:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942492928 00000100:00100000:1.0:1715330300.182411:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942492928 00000100:00100000:2.0:1715330300.182421:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47e780 going to sleep for 11 seconds 00000100:00100000:1.0:1715330300.182451:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1181 00000100:00100000:1.0:1715330300.182456:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:25569:x1798653942492928:12345-0@lo:104: 00010000:00010000:1.0:1715330300.182466:0:7118:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e400/0xd895711d66d97c6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d97cd expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.182516:0:7118:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1715330300.182520:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:25569:x1798653942492928:12345-0@lo:104: Request processed in 64us (1746us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330300.182526:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1181 00000100:00100000:2.0:1715330300.182556:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba64700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:25569:1798653942492928:0@lo:104: 00010000:00010000:2.0:1715330300.182572:0:25569:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d981a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.182592:0:7123:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1715330300.182599:0:7123:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e400/0xd895711d66d97c6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d97cd expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.182606:0:7123:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457e400 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:3.0:1715330300.182610:0:7123:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e400/0xd895711d66d97c6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd895711d66d97cd expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1715330300.182618:0:7123:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e400/0xd895711d66d97c6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd895711d66d97cd expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.182640:0:7123:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e400/0xd895711d66d97c6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d97cd expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.182645:0:7123:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1715330300.183357:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d774000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942492992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330300.183393:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1715330300.183467:0:7123:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e400/0xd895711d66d97c6 lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d97cd expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.183478:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457e400/0xd895711d66d97c6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d97cd expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330300.183524:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942492992 00000100:00100000:2.0:1715330300.183528:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942492992 00010000:00010000:2.0:1715330300.183545:0:10674:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d97cd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd895711d66d97c6 expref: 17 pid: 9407 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330300.183563:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1559 00000100:00100000:2.0:1715330300.183567:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+17:3689:x1798653942492992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715330300.183576:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330300.183689:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715330300.183692:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715330300.183693:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1715330300.185999:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983547 is committed 00010000:00010000:3.0:1715330300.186765:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d97cd lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd895711d66d97c6 expref: 16 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.186781:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6088621d (ffff88008d5ee800) 00010000:00010000:3.0:1715330300.186785:0:10674:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d981a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.186792:0:10674:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d981a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.186797:0:10674:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d981a lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.186829:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715330300.186881:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+15:3689:x1798653942492992:12345-0@lo:103:ldlm_bl.0 Request processed in 3312us (3487us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.186889:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1559 00000100:00100000:0.0:1715330300.186973:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d774000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942492992:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715330300.187033:0:25569:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d981a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.187040:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d981a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00000100:00100000:2.0:1715330300.187149:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba64700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:25569:1798653942493056:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1715330300.187187:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330300.187212:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1715330300.187534:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942493056 00000100:00100000:0.0:1715330300.187540:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942493056 00000100:00100000:0.0:1715330300.187570:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2924 00000100:00100000:0.0:1715330300.187576:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:25569:x1798653942493056:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1715330300.187653:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:25569:x1798653942493056:12345-0@lo:1000:mdt00_005.0 Request processed in 76us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330300.187658:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2924 00000100:00100000:3.0:1715330300.187726:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba64700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:25569:1798653942493056:0@lo:1000:mdt00_005.0 00010000:00010000:3.0:1715330300.187790:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d9821 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x193:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.187800:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d9821 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.187810:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d9821 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.187822:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d9813 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.187827:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d9813 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.187832:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d9813 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.187837:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d9813 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.187843:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db67180 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330300.187848:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d9813 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.187854:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d9813 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.187863:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:3.0:1715330300.187865:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330300.187868:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d9813 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.187872:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d9813 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.187882:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d981a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.187886:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d981a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.187892:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d981a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.187896:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db67840 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330300.187898:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d981a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.187902:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d981a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.187908:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6088621d (ffff88008d5ee800) 00010000:00010000:3.0:1715330300.187910:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330300.187912:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d981a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.187917:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d981a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.187951:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d980c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba3d expref: 18 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.187963:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d9821 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba3d expref: 17 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.187969:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x193:0x0].0x0 (ffff880091ea7f00) 00010000:00010000:3.0:1715330300.187970:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1715330300.187972:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013457c480, rc 0) 00000100:00100000:3.0:1715330300.188018:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+17:17766:x1798653938060544:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 7542us (8871us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.188024:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23541 00000100:00100000:3.0:1715330300.190998:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330300.191354:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938060672 00000100:00100000:0.0:1715330300.191364:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938060672 00000100:00100000:0.0:1715330300.191405:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23542 00000100:00100000:0.0:1715330300.191413:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d775180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+24:17766:x1798653938060672:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:0.0:1715330300.191435:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330300.191455:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a33c0/0xd895711d66d9828 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x193:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfba44 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715330300.193150:0:25569:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x193:0x0]: returning size 4096 00010000:00010000:0.0:1715330300.193239:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a33c0/0xd895711d66d9828 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba44 expref: 26 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.193249:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a33c0/0xd895711d66d9828 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba44 expref: 26 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.193259:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a33c0, rc 0) 00000100:00100000:0.0:1715330300.193326:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d775180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+25:17766:x1798653938060672:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 1912us (2333us total) trans 4294968463 rc 301/301 00000100:00100000:0.0:1715330300.193337:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23542 00000100:00100000:1.0:1715330300.198010:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330300.198164:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938060736 00000100:00100000:0.0:1715330300.198175:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938060736 00000100:00100000:0.0:1715330300.198237:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23543 00000100:00100000:0.0:1715330300.198245:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d645f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+25:17766:x1798653938060736:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:0.0:1715330300.198275:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330300.198305:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a0480/0xd895711d66d9836 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfba4b expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.198370:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a1b00/0xd895711d66d983d lrc: 3/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.198435:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a1b00/0xd895711d66d983d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:0.0:1715330300.198449:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a1b00/0xd895711d66d983d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00000004:00200000:0.0:1715330300.198494:0:25569:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000400:0xca:0x0]: returning size 4096 00000004:00200000:0.0:1715330300.198498:0:25569:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:0.0:1715330300.198530:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a0480/0xd895711d66d9836 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba4b expref: 27 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.198546:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a1b00/0xd895711d66d983d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba4b expref: 26 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.198553:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff880091ea7700) 00010000:00010000:0.0:1715330300.198556:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1715330300.198558:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a1b00, rc 0) 00000100:00100000:0.0:1715330300.198615:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d645f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+26:17766:x1798653938060736:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 371us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330300.198620:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23543 00000100:00100000:0.0:1715330300.200831:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.201003:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938060800 00000100:00100000:2.0:1715330300.201011:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938060800 00000100:00100000:2.0:1715330300.201085:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23544 00000100:00100000:2.0:1715330300.201093:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+17:17766:x1798653938060800:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:2.0:1715330300.201111:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330300.201127:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d9844 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfba52 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.201289:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d984b lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.201308:0:25569:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d97f7 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d97f0 expref: 14 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.201315:0:25569:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d984b lrc: 4/1,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.201339:0:25569:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d97f7 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd895711d66d97f0 expref: 14 pid: 7138 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330300.201351:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba64000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:25569:1798653942493120:0@lo:104: 00000100:00100000:2.0:1715330300.201387:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330300.201670:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47e900 going to sleep for 11 seconds 00000100:00100000:1.0:1715330300.201764:0:7118:0:(service.c:168:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1715330300.201775:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942493120 00000100:00100000:1.0:1715330300.201778:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942493120 00000100:00100000:1.0:1715330300.201832:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1182 00000100:00100000:1.0:1715330300.201837:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7edc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:25569:x1798653942493120:12345-0@lo:104: 00010000:00010000:1.0:1715330300.201847:0:7118:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457eac0/0xd895711d66d97f0 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d97f7 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.202047:0:7118:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1715330300.202053:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7edc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:25569:x1798653942493120:12345-0@lo:104: Request processed in 215us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330300.202061:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1182 00010000:00010000:0.0:1715330300.202175:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715330300.202180:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457eac0/0xd895711d66d97f0 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d97f7 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.202186:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457eac0 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330300.202190:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457eac0/0xd895711d66d97f0 lrc: 4/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd895711d66d97f7 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330300.202198:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457eac0/0xd895711d66d97f0 lrc: 4/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd895711d66d97f7 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.202219:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457eac0/0xd895711d66d97f0 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d97f7 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.202228:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330300.202248:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457eac0/0xd895711d66d97f0 lrc: 1/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d97f7 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.202253:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457eac0/0xd895711d66d97f0 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d97f7 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330300.202264:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba64000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:25569:1798653942493120:0@lo:104: 00010000:00010000:0.0:1715330300.202266:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330300.202268:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330300.202269:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330300.202275:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1715330300.202277:0:25569:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d984b lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00000100:00100000:0.0:1715330300.202420:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942493184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330300.202459:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.202517:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942493184 00000100:00100000:3.0:1715330300.202522:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942493184 00010000:00010000:3.0:1715330300.202539:0:10674:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d97f7 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd895711d66d97f0 expref: 15 pid: 7138 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330300.202569:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1560 00000100:00100000:3.0:1715330300.202573:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134564000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+15:3691:x1798653942493184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1715330300.202582:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330300.203328:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d97f7 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd895711d66d97f0 expref: 15 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.203344:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff8800b4207a00) 00010000:00010000:3.0:1715330300.203348:0:10674:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d984b lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.203355:0:10674:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d984b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.203360:0:10674:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d984b lrc: 4/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.203375:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715330300.203414:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134564000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+14:3691:x1798653942493184:12345-0@lo:103:ldlm_bl.0 Request processed in 840us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.203421:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1560 00010000:00010000:3.0:1715330300.203443:0:25569:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d984b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.203449:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d984b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00000004:00200000:3.0:1715330300.203493:0:25569:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0xcd:0x0]: returning size 4096 00000004:00200000:3.0:1715330300.203496:0:25569:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:3.0:1715330300.203524:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d9844 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba52 expref: 19 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.203536:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d984b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba52 expref: 18 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.203541:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff8800b4207a00) 00010000:00010000:3.0:1715330300.203543:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1715330300.203543:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942493184:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1715330300.203545:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db65b00, rc 0) 00000100:00100000:3.0:1715330300.203592:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+18:17766:x1798653938060800:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 2499us (2766us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.203598:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23544 00000100:00100000:3.0:1715330300.207815:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330300.207889:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938060864 00000100:00100000:0.0:1715330300.207897:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938060864 00000100:00100000:0.0:1715330300.208462:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23545 00000100:00100000:0.0:1715330300.208468:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d775500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+26:17766:x1798653938060864:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:0.0:1715330300.208485:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330300.208504:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a0480/0xd895711d66d9852 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfba59 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.208555:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a33c0/0xd895711d66d9859 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x193:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.208565:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a33c0/0xd895711d66d9859 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x193:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:0.0:1715330300.208573:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a33c0/0xd895711d66d9859 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x193:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00000004:00200000:0.0:1715330300.208691:0:25569:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x193:0x0]: returning size 4096 00000004:00200000:0.0:1715330300.208695:0:25569:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00000004:00010000:0.0:1715330300.208711:0:25569:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a33c0/0xd895711d66d9859 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x193:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:0.0:1715330300.208727:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a0480/0xd895711d66d9852 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba59 expref: 28 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.212624:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a33c0/0xd895711d66d9859 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x193:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba59 expref: 27 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.212634:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x193:0x0].0x0 (ffff880091ea7500) 00010000:00010000:0.0:1715330300.212636:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1715330300.212639:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a33c0, rc 0) 00000100:00100000:0.0:1715330300.212714:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d775500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+27:17766:x1798653938060864:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 4244us (4906us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330300.212721:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23545 00000100:00100000:0.0:1715330300.221465:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330300.221526:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938060928 00000100:00100000:1.0:1715330300.221534:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938060928 00000100:00100000:1.0:1715330300.221580:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5093 00000100:00100000:1.0:1715330300.221587:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fbef850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+27:17766:x1798653938060928:12345-192.168.204.49@tcp:37:lfs.0 00000100:00100000:1.0:1715330300.225169:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fbef850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+27:17766:x1798653938060928:12345-192.168.204.49@tcp:37:lfs.0 Request processed in 3574us (3703us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330300.225182:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5093 00000100:00100000:3.0:1715330300.229667:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330300.229767:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938060992 00000100:00100000:1.0:1715330300.229775:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938060992 00000100:00100000:1.0:1715330300.229872:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5094 00000100:00100000:1.0:1715330300.229879:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d775880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+18:17766:x1798653938060992:12345-192.168.204.49@tcp:37:lfs.0 00000100:00100000:1.0:1715330300.236334:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d775880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+18:17766:x1798653938060992:12345-192.168.204.49@tcp:37:lfs.0 Request processed in 6447us (6665us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330300.236346:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5094 00000100:00100000:0.0:1715330300.239669:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.239774:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938061056 00000100:00100000:2.0:1715330300.239782:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938061056 00000100:00100000:2.0:1715330300.239819:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23546 00000100:00100000:2.0:1715330300.239826:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134564380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+18:17766:x1798653938061056:12345-192.168.204.49@tcp:34:lfs.0 00010000:00010000:2.0:1715330300.239883:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d9860 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.239895:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d9860 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.239904:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d9860 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.239914:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9867 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.239919:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9867 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.239923:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9867 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.239962:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d986e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.239968:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d986e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.239973:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d986e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00000004:00010000:2.0:1715330300.240007:0:25569:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d986e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.240016:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d9860 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.240020:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d9860 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.240027:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d9860 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.240032:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d9860 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.240036:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64fc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.240040:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d9860 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.240045:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d9860 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.240053:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff8800b4207a00) 00010000:00010000:2.0:1715330300.240055:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.240057:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d9860 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.240061:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d9860 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.241017:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9867 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.241024:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9867 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.241029:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9867 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.241033:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64900 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.241036:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9867 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.241044:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9867 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.241050:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x39 (ffff8800b4207700) 00010000:00010000:2.0:1715330300.241052:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.241055:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9867 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.241058:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9867 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.241070:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d986e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.241074:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d986e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.241078:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d986e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.241082:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64000 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.241084:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d986e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.241088:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d986e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.241093:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1528:0x0].0x0 (ffff8800b5206900) 00010000:00010000:2.0:1715330300.241095:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.241096:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d986e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.241100:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d986e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00000100:00100000:2.0:1715330300.241151:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134564380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+18:17766:x1798653938061056:12345-192.168.204.49@tcp:34:lfs.0 Request processed in 1324us (1489us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.241158:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23546 00000100:00100000:3.0:1715330300.244607:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.244688:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938061184 00000100:00100000:2.0:1715330300.244697:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938061184 00000100:00100000:2.0:1715330300.244764:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23547 00000100:00100000:2.0:1715330300.244770:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d775c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+18:17766:x1798653938061184:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:2.0:1715330300.244789:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330300.244805:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9875 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1528:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfba60 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.244888:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d987c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1528:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.244898:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d987c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1528:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.244907:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d987c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1528:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00000004:00200000:2.0:1715330300.244916:0:25569:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1528:0x0]: returning size 2 00010000:00010000:2.0:1715330300.244999:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9875 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1528:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba60 expref: 21 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.245014:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d987c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1528:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba60 expref: 20 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.245020:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1528:0x0].0x0 (ffff8800b5206900) 00010000:00010000:2.0:1715330300.245022:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1715330300.245024:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db66640, rc 0) 00000100:00100000:2.0:1715330300.245072:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d775c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+20:17766:x1798653938061184:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 301us (471us total) trans 4294983548 rc 0/0 00000100:00100000:2.0:1715330300.245079:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23547 00000100:00100000:0.0:1715330300.247833:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.247915:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938061248 00000100:00100000:2.0:1715330300.247923:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938061248 00000100:00100000:2.0:1715330300.247962:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5212 00000100:00100000:2.0:1715330300.247969:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134564700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72de1896-1df4-4b3a-930a-9116d2c66168+19:2011:x1798653938061248:12345-192.168.204.49@tcp:1:lfs.0 00010000:00010000:2.0:1715330300.248006:0:9633:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011db67840/0xd895711d66d988a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.248019:0:9633:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011db67cc0/0xd895711d66d9756 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba13 expref: 19 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.248026:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1715330300.248027:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1715330300.248030:0:9633:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db67840/0xd895711d66d988a lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.248055:0:9633:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011db67cc0/0xd895711d66d9756 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba13 expref: 19 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.248066:0:9633:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011db67cc0/0xd895711d66d9756 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba13 expref: 19 pid: 9633 timeout: 374 lvb_type: 0 00000100:00100000:2.0:1715330300.248077:0:9633:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba64000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9633:1798653942493248:192.168.204.49@tcp:104: 00000100:00100000:2.0:1715330300.248133:0:9633:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1715330300.250516:0:9633:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba64000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9633:1798653942493248:192.168.204.49@tcp:104: 00010000:00010000:2.0:1715330300.250534:0:9633:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88011db67840/0xd895711d66d988a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330300.252025:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330300.252554:0:9403:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938061312 00000100:00100000:1.0:1715330300.252562:0:9403:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938061312 00002000:00100000:1.0:1715330300.252597:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9cd:0x0] (0->1) req@ffff880134564a80 x1798653938061312/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:511/0 lens 496/0 e 0 to 0 dl 1715330311 ref 1 fl New:/200/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 00002000:00100000:1.0:1715330300.252606:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880134564a80 with x1798653938061312 ext(0->1) 00010000:00010000:1.0:1715330300.252612:0:9403:0:(ldlm_extent.c:692:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011db67cc0/0xd895711d66d9756 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba13 expref: 20 pid: 9633 timeout: 374 lvb_type: 0 00010000:00010000:1.0:1715330300.252622:0:9403:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011db67cc0/0xd895711d66d9756 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba13 expref: 20 pid: 9633 timeout: 374 lvb_type: 0 00002000:00010000:1.0:1715330300.252628:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134564a80 00000100:00100000:1.0:1715330300.252678:0:9403:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 6 00000100:00100000:1.0:1715330300.252685:0:9403:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134564a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+20:2012:x1798653938061312:12345-192.168.204.49@tcp:4:bash.0 00000100:00100000:1.0:1715330300.253472:0:9403:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134564a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+22:2012:x1798653938061312:12345-192.168.204.49@tcp:4:bash.0 Request processed in 785us (1449us total) trans 4294969886 rc 0/0 00000100:00100000:1.0:1715330300.253480:0:9403:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 6 00002000:00100000:1.0:1715330300.253486:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9cd:0x0] (0->1) req@ffff880134564a80 x1798653938061312/t4294969886(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:511/0 lens 496/448 e 0 to 0 dl 1715330311 ref 1 fl Complete:H/200/0 rc 0/0 job:'bash.0' uid:0 gid:0 00002000:00100000:1.0:1715330300.253493:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880134564a80 with x1798653938061312 ext(0->1) 00010000:00010000:1.0:1715330300.253498:0:9403:0:(ldlm_extent.c:692:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011db67cc0/0xd895711d66d9756 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba13 expref: 22 pid: 9633 timeout: 374 lvb_type: 0 00010000:00010000:1.0:1715330300.253507:0:9403:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011db67cc0/0xd895711d66d9756 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba13 expref: 22 pid: 9633 timeout: 374 lvb_type: 0 00002000:00010000:1.0:1715330300.253512:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134564a80 00000100:00100000:0.0:1715330300.256458:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330300.256558:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938061376 00000100:00100000:3.0:1715330300.256566:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938061376 00010000:00010000:3.0:1715330300.256595:0:10674:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011db67cc0/0xd895711d66d9756 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba13 expref: 22 pid: 9633 timeout: 374 lvb_type: 0 00000100:00100000:3.0:1715330300.257063:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1561 00000100:00100000:3.0:1715330300.257070:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134564e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:72de1896-1df4-4b3a-930a-9116d2c66168+22:2013:x1798653938061376:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1715330300.257081:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1715330300.257095:0:10674:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x9cd:0x0] updating lvb size from disk: 0 -> 2 00002000:00010000:3.0:1715330300.257098:0:10674:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x9cd:0x0] updating lvb mtime from disk: 0 -> 1715330300 00002000:00010000:3.0:1715330300.257100:0:10674:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000401:0x9cd:0x0] updating lvb ctime from disk: 0 -> 1715330300 00002000:00010000:3.0:1715330300.257101:0:10674:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000401:0x9cd:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1715330300.257106:0:10674:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011db67cc0/0xd895711d66d9756 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba13 expref: 22 pid: 9633 timeout: 374 lvb_type: 0 00010000:00010000:3.0:1715330300.257116:0:10674:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011db67cc0/0xd895711d66d9756 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba13 expref: 22 pid: 9633 timeout: 374 lvb_type: 0 00010000:00010000:3.0:1715330300.257137:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011db67cc0/0xd895711d66d9756 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba13 expref: 22 pid: 9633 timeout: 374 lvb_type: 0 00010000:00010000:3.0:1715330300.257157:0:10674:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330300.257159:0:10674:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330300.257162:0:10674:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011db67840/0xd895711d66d988a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.257170:0:10674:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db67840/0xd895711d66d988a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.257260:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330300.257453:0:9633:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88011db67840/0xd895711d66d988a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.257461:0:9633:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011db67840/0xd895711d66d988a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.257475:0:9633:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011db67840/0xd895711d66d988a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.257480:0:9633:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88011db67840/0xd895711d66d988a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.257485:0:9633:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88011db67840/0xd895711d66d988a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.257490:0:9633:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db67840 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330300.257493:0:9633:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88011db67840/0xd895711d66d988a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.257498:0:9633:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88011db67840/0xd895711d66d988a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.257508:0:9633:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88011db67840/0xd895711d66d988a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.257517:0:9633:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011db67840/0xd895711d66d988a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330300.257573:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134564e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:72de1896-1df4-4b3a-930a-9116d2c66168+21:2013:x1798653938061376:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 502us (1121us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.257579:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1561 00000100:00100000:2.0:1715330300.258048:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134564700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72de1896-1df4-4b3a-930a-9116d2c66168+20:2011:x1798653938061248:12345-192.168.204.49@tcp:1:lfs.0 Request processed in 10078us (10219us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.258055:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5212 00000100:00100000:3.0:1715330300.263149:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330300.263187:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330300.263304:0:7148:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938061696 00000100:00100000:0.0:1715330300.263313:0:7148:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938061696 00000100:00100000:0.0:1715330300.263355:0:7148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 8 00000100:00100000:0.0:1715330300.263362:0:7148:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d775f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:72de1896-1df4-4b3a-930a-9116d2c66168+20:17766:x1798653938061696:12345-192.168.204.49@tcp:36:lfs.0 00010000:00010000:0.0:1715330300.263421:0:7148:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330300.263443:0:7148:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d9748 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1528:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba0c expref: 20 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.263461:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1528:0x0].0x0 (ffff8800b5206900) 00010000:00010000:0.0:1715330300.263464:0:7148:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715330300.263482:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66d9891 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:0.0:1715330300.263491:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66d9891 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:0.0:1715330300.263499:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66d9891 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00000004:00080000:0.0:1715330300.263516:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x193:0x0] 00000100:00100000:0.0:1715330300.263555:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134565180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942493312:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1715330300.263593:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.263705:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330300.265142:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942493312 00000100:00100000:1.0:1715330300.265151:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942493312 00000100:00100000:1.0:1715330300.265189:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2925 00000100:00100000:1.0:1715330300.265195:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134565500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+12:7148:x1798653942493312:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1715330300.265276:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134565500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+12:7148:x1798653942493312:12345-0@lo:1000:mdt_io00_002.0 Request processed in 80us (1681us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330300.265281:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2925 00000100:00100000:0.0:1715330300.265350:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009d7e3000 going to sleep for 11 seconds 00000100:00100000:0.0:1715330300.265375:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880134565180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942493312:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1715330300.265854:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134565180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942493376:0@lo:403:mdt_io00_002.0 00000100:00100000:0.0:1715330300.265885:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.266493:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.266660:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938061504 00000100:00100000:2.0:1715330300.266667:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938061504 00000100:00100000:3.0:1715330300.266702:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938061440 00000100:00100000:3.0:1715330300.266705:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938061440 00000100:00100000:0.0:1715330300.268138:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009d7e30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715330300.268339:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938061568 00000100:00100000:2.0:1715330300.268348:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938061568 00000100:00100000:3.0:1715330300.268476:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1390 00000100:00100000:3.0:1715330300.268485:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d776300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+20:2011:x1798653938061504:12345-192.168.204.49@tcp:103:lfs.0 00010000:00010000:3.0:1715330300.268503:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330300.268530:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d984b lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba52 expref: 20 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.268557:0:9416:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff8800b4207a00) 00010000:00010000:3.0:1715330300.268570:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715330300.268627:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d776300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+19:2011:x1798653938061504:12345-192.168.204.49@tcp:103:lfs.0 Request processed in 142us (5438us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.268634:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1390 00000100:00100000:3.0:1715330300.268650:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1391 00000100:00100000:3.0:1715330300.268655:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d776680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+28:2011:x1798653938061440:12345-192.168.204.49@tcp:103:lfs.0 00010000:00010000:3.0:1715330300.268663:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330300.268675:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a33c0/0xd895711d66d9859 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x193:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba59 expref: 28 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.268686:0:9416:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x193:0x0].0x0 (ffff880091ea7500) 00010000:00010000:3.0:1715330300.268689:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715330300.268704:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d776680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+27:2011:x1798653938061440:12345-192.168.204.49@tcp:103:lfs.0 Request processed in 49us (5000us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.268709:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1391 00000100:00100000:3.0:1715330300.268721:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1392 00000100:00100000:3.0:1715330300.268725:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ab78a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+26:2011:x1798653938061568:12345-192.168.204.49@tcp:103:lfs.0 00010000:00010000:3.0:1715330300.268746:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330300.268756:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a1b00/0xd895711d66d983d lrc: 0/0,0 mode: --/PR res: [0x240000400:0xca:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba4b expref: 26 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.268765:0:9416:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff880091ea7700) 00010000:00010000:3.0:1715330300.268767:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715330300.268781:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ab78a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+25:2011:x1798653938061568:12345-192.168.204.49@tcp:103:lfs.0 Request processed in 55us (2290us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.268786:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1392 00000100:00100000:1.0:1715330300.269068:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942493376 00000100:00100000:1.0:1715330300.269074:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942493376 00000100:00100000:1.0:1715330300.269107:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2926 00000100:00100000:1.0:1715330300.269111:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134565880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:7148:x1798653942493376:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:0.0:1715330300.273353:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134565880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:7148:x1798653942493376:12345-0@lo:403:mdt_io00_002.0 Request processed in 4234us (7460us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330300.273365:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2926 00000100:00100000:2.0:1715330300.273461:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880134565180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942493376:0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1715330300.274135:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba64000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942493440:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330300.274164:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330300.274189:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47e600 going to sleep for 11 seconds 00000100:00100000:1.0:1715330300.274243:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942493440 00000100:00100000:1.0:1715330300.274248:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942493440 00000100:00100000:1.0:1715330300.274269:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2927 00000100:00100000:1.0:1715330300.274274:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:7148:x1798653942493440:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1715330300.274363:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:7148:x1798653942493440:12345-0@lo:1000:mdt_io00_002.0 Request processed in 87us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330300.274368:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2927 00000100:00100000:3.0:1715330300.274478:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba64000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942493440:0@lo:1000:mdt_io00_002.0 00010000:00010000:3.0:1715330300.274522:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c240/0xd895711d66d9898 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.274529:0:7148:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c240/0xd895711d66d9898 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.274537:0:7148:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c240/0xd895711d66d9898 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7148 initiator: MDT0 00000100:00100000:3.0:1715330300.274546:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d776300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942493504:0@lo:101:mdt_io00_002.0 00000100:00100000:3.0:1715330300.274567:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.274578:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63d80 going to sleep for 11 seconds 00000100:00100000:0.0:1715330300.274626:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942493504 00000100:00100000:0.0:1715330300.274631:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942493504 00000100:00100000:0.0:1715330300.274659:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2928 00000100:00100000:0.0:1715330300.274663:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d776680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:7148:x1798653942493504:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:0.0:1715330300.274674:0:7138:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330300.274686:0:7138:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a1f80/0xd895711d66d989f lrc: 2/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d9898 expref: -99 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.274703:0:7138:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457dd40/0xd895711d66d97e9 lrc: 2/0,1 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT1 00010000:00010000:0.0:1715330300.274710:0:7138:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a1f80/0xd895711d66d989f lrc: 4/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d9898 expref: 13 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.274721:0:7138:0:(ldlm_request.c:381:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff88013457dd40/0xd895711d66d97e9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 7148 initiator: MDT1 00080000:00080000:0.0:1715330300.274755:0:7138:0:(osd_handler.c:2696:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00010000:0.0:1715330300.274780:0:7138:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a1f80/0xd895711d66d989f lrc: 3/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9898 expref: 13 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.274787:0:7138:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff880091ea7700) 00010000:00010000:0.0:1715330300.274790:0:7138:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330300.274792:0:7138:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a1f80/0xd895711d66d989f lrc: 3/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9898 expref: 13 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.274797:0:7138:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a1f80, rc 0) 00000100:00100000:0.0:1715330300.274816:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d776680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+13:7148:x1798653942493504:12345-0@lo:101:mdt_io00_002.0 Request processed in 153us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330300.274820:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2928 00000100:00100000:3.0:1715330300.275402:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d776300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942493504:0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1715330300.275413:0:7148:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c240/0xd895711d66d9898 lrc: 4/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d989f expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.275420:0:7148:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c240/0xd895711d66d9898 lrc: 4/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d989f expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.276308:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457cfc0/0xd895711d66d94a1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330300.276316:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013457cfc0/0xd895711d66d94a1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330300.276321:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013457cfc0/0xd895711d66d94a1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330300.276325:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457cfc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330300.276327:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457cfc0/0xd895711d66d94a1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330300.276332:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457cfc0/0xd895711d66d94a1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330300.276341:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x35 (ffff880091ea7900) 00010000:00010000:1.0:1715330300.276343:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330300.276346:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013457cfc0/0xd895711d66d94a1 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xc9:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330300.276350:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457cfc0/0xd895711d66d94a1 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xc9:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330300.276365:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d94d9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330300.276369:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d94d9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330300.276373:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d94d9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330300.276376:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db65440 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330300.276378:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d94d9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330300.276381:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d94d9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330300.276386:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x31 (ffff88008d5ee200) 00010000:00010000:1.0:1715330300.276387:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330300.276389:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d94d9 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xc9:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330300.276392:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d94d9 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xc9:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330300.276401:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdf80/0xd895711d66d9511 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330300.276405:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdf80/0xd895711d66d9511 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330300.276408:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdf80/0xd895711d66d9511 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330300.276411:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfdf80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330300.276414:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdf80/0xd895711d66d9511 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330300.276418:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdf80/0xd895711d66d9511 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330300.276423:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x36 (ffff88008b0d2000) 00010000:00010000:1.0:1715330300.276424:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330300.276425:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdf80/0xd895711d66d9511 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xc9:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330300.276429:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdf80/0xd895711d66d9511 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xc9:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330300.276437:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d9549 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330300.276440:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d9549 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330300.276444:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d9549 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330300.276447:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfe640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330300.276448:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d9549 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330300.276452:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d9549 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330300.276456:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x30 (ffff88008b0d2a00) 00010000:00010000:1.0:1715330300.276457:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330300.276459:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d9549 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xc9:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330300.276466:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe640/0xd895711d66d9549 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xc9:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330300.276474:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d9581 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330300.276478:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d9581 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330300.276481:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d9581 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330300.276484:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfdb00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330300.276486:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d9581 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330300.276490:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d9581 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330300.276494:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x3031 (ffff88008b0d2400) 00010000:00010000:1.0:1715330300.276495:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330300.276497:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d9581 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xc9:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330300.276500:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfdb00/0xd895711d66d9581 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xc9:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330300.276507:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d95b9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330300.276510:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d95b9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330300.276513:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d95b9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330300.276517:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bff180 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330300.276519:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d95b9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330300.276523:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d95b9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xc9:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330300.276528:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xc9:0x0].0x39 (ffff88008b0d2600) 00010000:00010000:1.0:1715330300.276529:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330300.276531:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d95b9 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xc9:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330300.276535:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff180/0xd895711d66d95b9 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xc9:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.276567:0:8267:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f3c0/0xd895711d66d97d4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1523:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d97db expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1715330300.276575:0:8267:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f3c0/0xd895711d66d97d4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1523:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d97db expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.276597:0:8267:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f3c0/0xd895711d66d97d4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1523:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d97db expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.276601:0:8267:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1715330300.276623:0:8267:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88013457f3c0/0xd895711d66d97d4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1523:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d97db expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.276634:0:8267:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d95dc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d95e3 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1715330300.276640:0:8267:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d95dc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d95e3 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.276651:0:8267:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d95dc lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d95e3 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.276655:0:8267:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1715330300.276665:0:8267:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d95dc lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d95e3 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1715330300.276674:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968463 is committed 00000001:00080000:3.0:1715330300.276685:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968461 is committed 00000020:00080000:3.0:1715330300.276701:0:8267:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8800b496f3c0 refcount 2 committed 0 result 0 batchid 390 00000020:00080000:3.0:1715330300.276704:0:8267:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880091ea7400 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8800b496fd80 00000020:00080000:3.0:1715330300.276707:0:8267:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].391 00000020:00080000:3.0:1715330300.276708:0:8267:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880091ea7800 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88009d6a5600 00000020:00080000:3.0:1715330300.276711:0:8267:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].389 00010000:00010000:2.0:1715330300.276755:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f600/0xd895711d66d97e2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x193:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT1 00010000:00010000:2.0:1715330300.276761:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f600/0xd895711d66d97e2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x193:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT1 00010000:00010000:2.0:1715330300.276765:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f600/0xd895711d66d97e2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x193:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT1 00010000:00010000:2.0:1715330300.276769:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457f600 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.276771:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f600/0xd895711d66d97e2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x193:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT1 00010000:00010000:2.0:1715330300.276774:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f600/0xd895711d66d97e2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x193:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7148 initiator: MDT1 00010000:00010000:2.0:1715330300.276781:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x193:0x0].0x0 (ffff880091ea7500) 00010000:00010000:2.0:1715330300.276783:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.276785:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f600/0xd895711d66d97e2 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x193:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT1 00010000:00010000:2.0:1715330300.276789:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f600/0xd895711d66d97e2 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x193:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT1 00010000:00010000:2.0:1715330300.276802:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457dd40/0xd895711d66d97e9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 7148 initiator: MDT1 00010000:00010000:2.0:1715330300.276806:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013457dd40/0xd895711d66d97e9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 7148 initiator: MDT1 00010000:00010000:2.0:1715330300.276810:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88013457dd40/0xd895711d66d97e9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 7148 initiator: MDT1 00010000:00010000:2.0:1715330300.276813:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457dd40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.276815:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457dd40/0xd895711d66d97e9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 7148 initiator: MDT1 00010000:00010000:2.0:1715330300.276818:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88013457dd40/0xd895711d66d97e9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 7148 initiator: MDT1 00010000:00010000:2.0:1715330300.276822:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff880091ea7700) 00010000:00010000:2.0:1715330300.276824:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.276827:0:3675:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a1f80/0xd895711d66d989f lrc: 2/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9898 expref: 6 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.276834:0:3675:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a1f80/0xd895711d66d989f lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d9898 expref: 6 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.276843:0:3675:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a1f80/0xd895711d66d989f lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d9898 expref: 6 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.276861:0:3675:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a1f80/0xd895711d66d989f lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9898 expref: 6 pid: 7138 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330300.276870:0:3675:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba67800 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0001_UUID:3675:1798653942493696:0@lo:105: 00000100:00100000:2.0:1715330300.276900:0:3675:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330300.276912:0:3675:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47e000 going to sleep for 11 seconds 00000100:00100000:0.0:1715330300.276962:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1715330300.276970:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d776a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942493568:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1715330300.276991:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330300.277004:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1715330300.277008:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d776d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942493632:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1715330300.277019:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1715330300.277070:0:8267:0:(osp_sync.c:1604:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 4 committed 00000004:00080000:3.0:1715330300.277077:0:8267:0:(osp_sync.c:1604:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 4 committed 00000100:00100000:3.0:1715330300.277141:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1715330300.277148:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d777100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942493760:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1715330300.277170:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.277190:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942493760 00000100:00100000:3.0:1715330300.277195:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942493760 00000100:00100000:3.0:1715330300.277225:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5213 00000100:00100000:3.0:1715330300.277231:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d777800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942493760:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1715330300.277252:0:9633:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2504 count 1 00010000:00010000:3.0:1715330300.277269:0:9633:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013457eac0/0xd895711d66d98a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.277282:0:9633:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093bfed00/0xd895711d66d937b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb956 expref: 17 pid: 9633 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1715330300.277288:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330300.277290:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330300.277304:0:9633:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013457eac0/0xd895711d66d98a6 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.277322:0:9633:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093bfed00/0xd895711d66d937b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb956 expref: 17 pid: 9633 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1715330300.277332:0:9633:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093bfed00/0xd895711d66d937b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb956 expref: 17 pid: 9633 timeout: 374 lvb_type: 1 00000100:00100000:3.0:1715330300.277346:0:9633:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d777b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9633:1798653942493888:192.168.204.49@tcp:104: 00000100:00100000:3.0:1715330300.277381:0:9633:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63d80 going to sleep for 11 seconds 00000100:00080000:3.0:1715330300.277390:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330270 00000020:00080000:3.0:1715330300.277409:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 390 committed batchid 389 00000100:00100000:1.0:1715330300.277420:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1715330300.277429:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d777480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942493824:0@lo:6:osp-syn-0-1.0 00000020:00080000:3.0:1715330300.277444:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 389 00000100:00100000:3.0:1715330300.277453:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942493568 00000100:00100000:1.0:1715330300.277454:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.277456:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942493568 00000100:00100000:1.0:1715330300.277475:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942493696 00000100:00100000:1.0:1715330300.277478:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942493696 00000100:00100000:3.0:1715330300.277482:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942493632 00000100:00100000:3.0:1715330300.277484:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942493632 00000100:00100000:1.0:1715330300.277497:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1183 00000100:00100000:3.0:1715330300.277498:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1393 00000100:00100000:1.0:1715330300.277501:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:3675:x1798653942493696:12345-0@lo:105: 00000100:00100000:3.0:1715330300.277502:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134565c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+15:3690:x1798653942493568:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1715330300.277509:0:7118:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c240/0xd895711d66d9898 lrc: 5/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d989f expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.277510:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330300.277517:0:7118:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c240/0xd895711d66d9898 lrc: 5/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d989f expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.277523:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66d97db lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1523:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d97d4 expref: 15 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.277524:0:7118:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c240/0xd895711d66d9898 lrc: 5/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d989f expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.277533:0:7118:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c240/0xd895711d66d9898 lrc: 5/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d989f expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.277534:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1523:0x0].0x0 (ffff88008d5ee700) 00010000:00010000:1.0:1715330300.277538:0:7118:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c240/0xd895711d66d9898 lrc: 6/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d989f expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.277540:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330300.277543:0:7118:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c240/0xd895711d66d9898 lrc: 6/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d989f expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.277556:0:7118:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88013457c240) 00000100:00100000:3.0:1715330300.277561:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134565c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+14:3690:x1798653942493568:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 59us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.277566:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1393 00000100:00100000:1.0:1715330300.277577:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:3675:x1798653942493696:12345-0@lo:105: Request processed in 75us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.277578:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1394 00000100:00100000:3.0:1715330300.277581:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134565f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+13:3689:x1798653942493632:12345-0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1715330300.277582:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1183 00010000:00010000:3.0:1715330300.277586:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330300.277594:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d95e3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6088611d bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d95dc expref: 13 pid: 9408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.277606:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6088611d (ffff88008d5ee100) 00010000:00010000:3.0:1715330300.277610:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715330300.277624:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134565f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+12:3689:x1798653942493632:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 43us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.277629:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1394 00010000:00010000:3.0:1715330300.277646:0:7148:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c240/0xd895711d66d9898 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d989f expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.277652:0:7148:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c240/0xd895711d66d9898 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d989f expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330300.277669:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00000100:00100000:0.0:1715330300.277719:0:17206:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942493824 00000100:00100000:0.0:1715330300.277722:0:17206:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942493824 00000100:00100000:0.0:1715330300.277769:0:17206:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5214 00000100:00100000:0.0:1715330300.277773:0:17206:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942493824:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1715330300.277785:0:17206:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2505 count 1 00010000:00010000:0.0:1715330300.277799:0:17206:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d7a18c0/0xd895711d66d98b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.277807:0:17206:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013457e640/0xd895711d66d93f9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb980 expref: 19 pid: 17200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1715330300.277812:0:17206:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330300.277813:0:17206:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330300.277815:0:17206:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7a18c0/0xd895711d66d98b4 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.277829:0:17206:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013457e640/0xd895711d66d93f9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb980 expref: 19 pid: 17200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1715330300.277836:0:17206:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013457e640/0xd895711d66d93f9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb980 expref: 19 pid: 17200 timeout: 374 lvb_type: 1 00000100:00100000:0.0:1715330300.277844:0:17206:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134566300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:17206:1798653942494016:192.168.204.49@tcp:104: 00000100:00100000:0.0:1715330300.277864:0:17206:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009d7e3000 going to sleep for 11 seconds 00000100:00100000:0.0:1715330300.277883:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d776d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942493632:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1715330300.277900:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d776a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942493568:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1715330300.278001:0:3675:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba67800 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0001_UUID:3675:1798653942493696:0@lo:105: 00010000:00010000:2.0:1715330300.278012:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88013457dd40/0xd895711d66d97e9 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 7148 initiator: MDT1 00010000:00010000:2.0:1715330300.278017:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457dd40/0xd895711d66d97e9 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 7148 initiator: MDT1 00010000:00010000:3.0:1715330300.278626:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e400/0xd895711d66d98ad lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.278632:0:7148:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e400/0xd895711d66d98ad lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.278640:0:7148:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e400/0xd895711d66d98ad lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7148 initiator: MDT0 00000100:00080000:3.0:1715330300.278648:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330270 00000100:00100000:3.0:1715330300.278658:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d776300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942493952:0@lo:101:mdt_io00_002.0 00000100:00100000:3.0:1715330300.278680:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.278689:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63780 going to sleep for 11 seconds 00000100:00100000:3.0:1715330300.278698:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942493952 00000100:00100000:3.0:1715330300.278701:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942493952 00000100:00100000:3.0:1715330300.278908:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2929 00000100:00100000:3.0:1715330300.278913:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d776a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7148:x1798653942493952:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1715330300.278923:0:8592:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330300.278933:0:8592:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013457df80/0xd895711d66d98bb lrc: 2/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d98ad expref: -99 pid: 8592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.278948:0:8592:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457df80/0xd895711d66d98bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d98ad expref: 7 pid: 8592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.278956:0:8592:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457df80/0xd895711d66d98bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d98ad expref: 7 pid: 8592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.278961:0:8592:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x39 (ffff8800aa391300) 00010000:00010000:3.0:1715330300.278963:0:8592:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330300.278965:0:8592:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013457df80, rc 0) 00000100:00100000:3.0:1715330300.278984:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d776a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:7148:x1798653942493952:12345-0@lo:101:mdt_io00_002.0 Request processed in 71us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.278988:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2929 00000100:00100000:3.0:1715330300.279016:0:7148:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968461 gen 2 00000004:00080000:3.0:1715330300.279019:0:7148:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968447 committed transno 4294968461 00000004:00080000:3.0:1715330300.279041:0:7148:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968456 committed transno 4294968461 00000004:00080000:3.0:1715330300.279051:0:7148:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968457 committed transno 4294968461 00000004:00080000:3.0:1715330300.279061:0:7148:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968458 committed transno 4294968461 00000004:00080000:3.0:1715330300.279071:0:7148:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968459 committed transno 4294968461 00000004:00080000:3.0:1715330300.279080:0:7148:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968460 committed transno 4294968461 00000004:00080000:3.0:1715330300.279089:0:7148:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968461 committed transno 4294968461 00000100:00100000:3.0:1715330300.279099:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d776300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942493952:0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1715330300.279108:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e400/0xd895711d66d98ad lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d98bb expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.279115:0:7148:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e400/0xd895711d66d98ad lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d98bb expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330300.279123:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00010000:00010000:3.0:1715330300.279136:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d98c2 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.279141:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d98c2 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.279147:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d98c2 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.279154:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c900/0xd895711d66d98c9 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.279159:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c900/0xd895711d66d98c9 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.279163:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c900/0xd895711d66d98c9 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.279194:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d98d0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1528:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.279200:0:7148:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d987c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1528:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba60 expref: 18 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.279206:0:7148:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d98d0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1528:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.279221:0:7148:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d987c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1528:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba60 expref: 18 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.279229:0:7148:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d987c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1528:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba60 expref: 18 pid: 25569 timeout: 374 lvb_type: 0 00000100:00100000:3.0:1715330300.279240:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d776300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:7148:1798653942494080:192.168.204.49@tcp:104: 00000100:00100000:3.0:1715330300.279258:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63780 going to sleep for 11 seconds 00000100:00100000:0.0:1715330300.282957:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330300.282989:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330300.283107:0:9633:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d777b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9633:1798653942493888:192.168.204.49@tcp:104: 00000100:00100000:1.0:1715330300.283112:0:17206:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880134566300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:17206:1798653942494016:192.168.204.49@tcp:104: 00010000:00010000:3.0:1715330300.283135:0:9633:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88013457eac0/0xd895711d66d98a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.283135:0:17206:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009d7a18c0/0xd895711d66d98b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330300.283163:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938061824 00000100:00100000:3.0:1715330300.283169:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938061824 00010000:00010000:3.0:1715330300.283199:0:10674:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013457e640/0xd895711d66d93f9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb980 expref: 20 pid: 17200 timeout: 374 lvb_type: 1 00000100:00100000:2.0:1715330300.283204:0:10673:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938061760 00000100:00100000:2.0:1715330300.283208:0:10673:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938061760 00010000:00010000:2.0:1715330300.283222:0:10673:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093bfed00/0xd895711d66d937b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb956 expref: 18 pid: 9633 timeout: 374 lvb_type: 1 00000100:00100000:3.0:1715330300.283225:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1562 00000100:00100000:3.0:1715330300.283232:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134566680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:72de1896-1df4-4b3a-930a-9116d2c66168+20:2012:x1798653938061824:12345-192.168.204.49@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1715330300.283248:0:10673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1563 00000100:00100000:2.0:1715330300.283252:0:10673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134566a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:72de1896-1df4-4b3a-930a-9116d2c66168+18:2012:x1798653938061760:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1715330300.283258:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330300.283261:0:10673:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330300.283263:0:10674:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013457e640/0xd895711d66d93f9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb980 expref: 20 pid: 17200 timeout: 374 lvb_type: 1 00010000:00010000:2.0:1715330300.283264:0:10673:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093bfed00/0xd895711d66d937b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb956 expref: 18 pid: 9633 timeout: 374 lvb_type: 1 00010000:00010000:3.0:1715330300.283272:0:10674:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013457e640/0xd895711d66d93f9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb980 expref: 20 pid: 17200 timeout: 374 lvb_type: 1 00010000:00010000:2.0:1715330300.283278:0:10673:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093bfed00/0xd895711d66d937b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb956 expref: 18 pid: 9633 timeout: 374 lvb_type: 1 00010000:00010000:2.0:1715330300.283308:0:10673:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093bfed00/0xd895711d66d937b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb956 expref: 18 pid: 9633 timeout: 374 lvb_type: 1 00010000:00010000:3.0:1715330300.283309:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013457e640/0xd895711d66d93f9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb980 expref: 20 pid: 17200 timeout: 374 lvb_type: 1 00010000:00010000:3.0:1715330300.283322:0:10674:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330300.283322:0:10673:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330300.283325:0:10674:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330300.283325:0:10673:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330300.283328:0:10674:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d7a18c0/0xd895711d66d98b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.283328:0:10673:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013457eac0/0xd895711d66d98a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.283336:0:10674:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7a18c0/0xd895711d66d98b4 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.283336:0:10673:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013457eac0/0xd895711d66d98a6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.283355:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330300.283362:0:10673:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330300.283372:0:9633:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88013457eac0/0xd895711d66d98a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.283379:0:9633:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013457eac0/0xd895711d66d98a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.283388:0:9633:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013457eac0/0xd895711d66d98a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.283396:0:9633:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88013457eac0/0xd895711d66d98a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330300.283399:0:10673:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134566a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:72de1896-1df4-4b3a-930a-9116d2c66168+17:2012:x1798653938061760:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 146us (409us total) trans 0 rc 0/0 00010000:00010000:3.0:1715330300.283402:0:9633:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013457eac0/0xd895711d66d98a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330300.283406:0:10673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1563 00010000:00010000:3.0:1715330300.283409:0:9633:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457eac0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330300.283413:0:9633:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013457eac0/0xd895711d66d98a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.283420:0:9633:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013457eac0/0xd895711d66d98a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.283435:0:9633:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013457eac0/0xd895711d66d98a6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.283441:0:9633:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013457eac0/0xd895711d66d98a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.283441:0:7148:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.204.49@tcp) returned -22 from blocking AST (req@ffff88008d776300 x1798653942494080) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d987c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1528:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba60 expref: 18 pid: 25569 timeout: 374 lvb_type: 0 00010000:00010000:2.0:1715330300.283452:0:7148:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d987c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1528:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba60 expref: 18 pid: 25569 timeout: 374 lvb_type: 0 00010000:00010000:2.0:1715330300.283465:0:7148:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d987c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1528:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba60 expref: 18 pid: 25569 timeout: 374 lvb_type: 0 00000100:00100000:2.0:1715330300.283481:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d776300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:7148:1798653942494080:192.168.204.49@tcp:104: 00010000:00010000:2.0:1715330300.283495:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1528:0x0].0x0 (ffff8800b5206900) 00010000:00010000:2.0:1715330300.283500:0:7148:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d98d0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1528:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.283507:0:7148:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d98d0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1528:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.283514:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d98d0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1528:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.283525:0:7148:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d98d0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1528:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.283531:0:7148:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d98d0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1528:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.283535:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d98d0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1528:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00000100:00100000:2.0:1715330300.283659:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba67800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942494144:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330300.283698:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330300.283713:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1715330300.283725:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942494144 00000100:00100000:2.0:1715330300.283728:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942494144 00000100:00100000:3.0:1715330300.283758:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d777800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3688:x1798653942493760:12345-0@lo:6:osp-syn-1-1.0 Request processed in 6526us (6586us total) trans 4294969887 rc 0/0 00000100:00100000:3.0:1715330300.283767:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5213 00000100:00100000:2.0:1715330300.283779:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2930 00000100:00100000:2.0:1715330300.283783:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:7148:x1798653942494144:12345-0@lo:1000:mdt_io00_002.0 00000004:00080000:3.0:1715330300.283801:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d777100/2, rc 0, transno 2591 00000100:00100000:3.0:1715330300.283810:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d777100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942493760:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1715330300.283836:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134566680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:72de1896-1df4-4b3a-930a-9116d2c66168+19:2012:x1798653938061824:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 605us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.283842:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1562 00000100:00100000:2.0:1715330300.283884:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:7148:x1798653942494144:12345-0@lo:1000:mdt_io00_002.0 Request processed in 99us (184us total) trans 0 rc -2/-2 00000100:00100000:2.0:1715330300.283894:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2930 00000100:00100000:2.0:1715330300.283915:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba67800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942494144:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330300.283946:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba67800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942494208:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330300.283967:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330300.283991:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1715330300.284067:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942494208 00000100:00100000:3.0:1715330300.284071:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942494208 00010000:00010000:1.0:1715330300.284079:0:17206:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009d7a18c0/0xd895711d66d98b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.284086:0:17206:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d7a18c0/0xd895711d66d98b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330300.284087:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2931 00000100:00100000:3.0:1715330300.284091:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:7148:x1798653942494208:12345-0@lo:1000:mdt_io00_002.0 00010000:00010000:1.0:1715330300.284093:0:17206:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d7a18c0/0xd895711d66d98b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.284098:0:17206:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7a18c0/0xd895711d66d98b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.284104:0:17206:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d7a18c0/0xd895711d66d98b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.284109:0:17206:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a18c0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:1.0:1715330300.284112:0:17206:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d7a18c0/0xd895711d66d98b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.284118:0:17206:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d7a18c0/0xd895711d66d98b4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.284130:0:17206:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d7a18c0/0xd895711d66d98b4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330300.284135:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:7148:x1798653942494208:12345-0@lo:1000:mdt_io00_002.0 Request processed in 43us (167us total) trans 0 rc 0/0 00010000:00010000:1.0:1715330300.284135:0:17206:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d7a18c0/0xd895711d66d98b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330300.284140:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2931 00000100:00100000:1.0:1715330300.284345:0:17206:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+6:3691:x1798653942493824:12345-0@lo:6:osp-syn-0-1.0 Request processed in 6569us (6888us total) trans 4294969887 rc 0/0 00000100:00100000:1.0:1715330300.284351:0:17206:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5214 00000004:00080000:0.0:1715330300.284710:0:3691:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d777480/2, rc 0, transno 2591 00000100:00100000:2.0:1715330300.284712:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba67800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942494208:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330300.284811:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba67800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942494272:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1715330300.284819:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d777480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942493824:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1715330300.284829:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330300.284838:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1715330300.284845:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942494272 00000100:00100000:2.0:1715330300.284847:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942494272 00000100:00100000:2.0:1715330300.284919:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2932 00000100:00100000:2.0:1715330300.284923:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:7148:x1798653942494272:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330300.284967:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:7148:x1798653942494272:12345-0@lo:1000:mdt_io00_002.0 Request processed in 43us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.284973:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2932 00000100:00100000:2.0:1715330300.284993:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba67800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942494272:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330300.285064:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba67800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942494336:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330300.285083:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330300.285103:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47e180 going to sleep for 11 seconds 00000100:00100000:0.0:1715330300.285123:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942494336 00000100:00100000:0.0:1715330300.285126:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942494336 00000100:00100000:0.0:1715330300.285322:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2933 00000100:00100000:0.0:1715330300.285326:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:7148:x1798653942494336:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1715330300.285378:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:7148:x1798653942494336:12345-0@lo:1000:mdt_io00_002.0 Request processed in 51us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330300.285382:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2933 00000100:00100000:2.0:1715330300.285435:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba67800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942494336:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330300.285587:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba67800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942494400:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330300.285608:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330300.285628:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47e180 going to sleep for 11 seconds 00000100:00100000:0.0:1715330300.285670:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942494400 00000100:00100000:0.0:1715330300.285674:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942494400 00000100:00100000:0.0:1715330300.285703:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2934 00000100:00100000:0.0:1715330300.285707:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+8:7148:x1798653942494400:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1715330300.285787:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+8:7148:x1798653942494400:12345-0@lo:1000:mdt_io00_002.0 Request processed in 78us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330300.285793:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2934 00000100:00080000:3.0:1715330300.285802:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330270 00000100:00100000:2.0:1715330300.287394:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba67800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942494400:0@lo:1000:mdt_io00_002.0 00000040:00080000:2.0:1715330300.288054:0:7148:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].379, 1264 off570848 00000040:00080000:2.0:1715330300.288113:0:7148:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].378, 1344 off615000 00000100:00100000:2.0:1715330300.288148:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba67800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942494464:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330300.288199:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330300.288227:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330300.288242:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942494464 00000100:00100000:0.0:1715330300.288248:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942494464 00000100:00100000:0.0:1715330300.288285:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2935 00000100:00100000:0.0:1715330300.288301:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:7148:x1798653942494464:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1715330300.288413:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:7148:x1798653942494464:12345-0@lo:1000:mdt_io00_002.0 Request processed in 120us (213us total) trans 4294969888 rc 0/0 00000100:00100000:0.0:1715330300.288422:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2935 00000100:00100000:2.0:1715330300.288436:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba67800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942494464:0@lo:1000:mdt_io00_002.0 00000004:00080000:2.0:1715330300.288443:0:7148:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88012f47e600 with version 723 00000004:00080000:3.0:1715330300.288498:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 723 rpc_version 723 00000020:00100000:3.0:1715330300.288519:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1715330300.288524:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008d777b80 x1798653942494592/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3088/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1715330300.288537:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d777b80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942494592:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1715330300.288563:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.288579:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63d80 going to sleep for 11 seconds 00000100:00100000:0.0:1715330300.288610:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942494592 00000100:00100000:0.0:1715330300.288612:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942494592 00000100:00100000:0.0:1715330300.288630:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2936 00000100:00100000:0.0:1715330300.288634:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d776d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:8587:x1798653942494592:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330300.288971:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d776d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:8587:x1798653942494592:12345-0@lo:1000:osp_up1-0.0 Request processed in 332us (403us total) trans 4294968464 rc 0/0 00000100:00100000:0.0:1715330300.288977:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2936 00000004:00010000:2.0:1715330300.289055:0:7148:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008d775f80 reply state ffff880091fd8000 transno 4294983549 ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d98d0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1528:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00000100:00100000:3.0:1715330300.289073:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d777b80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942494592:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1715330300.289077:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d98d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1528:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.289086:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1528:0x0].0x0 (ffff8800b5206900) 00010000:00010000:2.0:1715330300.289089:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:2.0:1715330300.289092:0:7148:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1715330300.289101:0:7148:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d98c2 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.289107:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d98c2 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.289113:0:7148:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d98c2 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.289120:0:7148:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d98c2 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.289125:0:7148:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457e880 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.289129:0:7148:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d98c2 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.289136:0:7148:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d98c2 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.289145:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff8800aa391b00) 00010000:00010000:2.0:1715330300.289147:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.289150:0:7148:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d98c2 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.289155:0:7148:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d98c2 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00000004:00010000:2.0:1715330300.289173:0:7148:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008d775f80 reply state ffff880091fd8000 transno 4294983549 ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c900/0xd895711d66d98c9 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.289180:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c900/0xd895711d66d98c9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.289184:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x39 (ffff8800aa391f00) 00010000:00010000:2.0:1715330300.289185:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330300.289187:0:7148:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00080000:2.0:1715330300.289190:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00010000:00010000:2.0:1715330300.289196:0:7148:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c240/0xd895711d66d9898 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d989f expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.289203:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c240/0xd895711d66d9898 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d989f expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.289209:0:7148:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c240/0xd895711d66d9898 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d989f expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.289232:0:7148:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1715330300.289237:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00010000:00010000:2.0:1715330300.289242:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e400/0xd895711d66d98ad lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d98bb expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.289248:0:7148:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e400/0xd895711d66d98ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d98bb expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715330300.289335:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x193:0x0] 00010000:00010000:2.0:1715330300.289342:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66d9891 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.289347:0:7148:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66d9891 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.289352:0:7148:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66d9891 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.289355:0:7148:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a1440 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.289358:0:7148:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66d9891 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.289362:0:7148:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66d9891 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.289369:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff88008b233100) 00010000:00010000:2.0:1715330300.289371:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.289373:0:7148:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66d9891 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.289377:0:7148:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66d9891 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:0.0:1715330300.289393:0:9415:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715330300.289400:0:9415:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c240/0xd895711d66d9898 lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d989f expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.289406:0:9415:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457c240 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330300.289409:0:9415:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c240/0xd895711d66d9898 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d989f expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330300.289415:0:9415:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c240/0xd895711d66d9898 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d989f expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.289436:0:9415:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c240/0xd895711d66d9898 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d989f expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.289442:0:9415:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330300.289472:0:9415:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c240/0xd895711d66d9898 lrc: 1/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d989f expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.289478:0:9415:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c240/0xd895711d66d9898 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d989f expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.289497:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330300.289498:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330300.289500:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330300.289507:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1715330300.289516:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134566d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942494656:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1715330300.289591:0:7148:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d775f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:72de1896-1df4-4b3a-930a-9116d2c66168+19:17766:x1798653938061696:12345-192.168.204.49@tcp:36:lfs.0 Request processed in 26226us (26448us total) trans 4294983549 rc 0/0 00000100:00100000:2.0:1715330300.289599:0:7148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 8 00000100:00100000:0.0:1715330300.290092:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330300.290192:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942494656 00000100:00100000:1.0:1715330300.290198:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942494656 00000100:00100000:1.0:1715330300.290238:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1395 00000100:00100000:1.0:1715330300.290244:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134567100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+8:3690:x1798653942494656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330300.290255:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330300.290271:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a1f80/0xd895711d66d989f lrc: 0/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d9898 expref: 8 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.290287:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff880091ea7700) 00010000:00010000:1.0:1715330300.290306:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330300.290332:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134567100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+7:3690:x1798653942494656:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330300.290337:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1395 00000100:00100000:0.0:1715330300.290418:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880134566d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942494656:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1715330300.291305:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942494720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1715330300.291338:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330300.291381:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942494720 00000100:00100000:2.0:1715330300.291386:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942494720 00000100:00100000:2.0:1715330300.291423:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1715330300.291429:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d774000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3688:x1798653942494720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1715330300.291452:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 57344 granted 50773440 pending 114688 free 3923501056 avail 3691978752 00000100:00100000:2.0:1715330300.291487:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d774000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3688:x1798653942494720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.291493:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1715330300.292041:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942494720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1715330300.292926:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.293011:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938061888 00000100:00100000:2.0:1715330300.293016:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938061888 00000100:00100000:2.0:1715330300.293049:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23548 00000100:00100000:2.0:1715330300.293055:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134566d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+19:17766:x1798653938061888:12345-192.168.204.49@tcp:34:lfs.0 00010000:00010000:2.0:1715330300.293123:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d98d7 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.294696:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d98d7 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.294711:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d98d7 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.294746:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d98de lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.294753:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d98de lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.294759:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d98de lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.294825:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d98e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1527:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.294834:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d98e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1527:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.294839:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d98e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1527:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00010000:2.0:1715330300.294884:0:7135:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d98e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1527:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.294895:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d98d7 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.294900:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d98d7 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.294904:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d98d7 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.294909:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d98d7 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.294914:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db67180 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.294918:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d98d7 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.294924:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d98d7 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.294935:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff8800b4207c00) 00010000:00010000:2.0:1715330300.294938:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.294941:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d98d7 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.294946:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d98d7 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.294964:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d98de lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.294969:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d98de lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.294973:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d98de lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.294977:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db67600 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.294979:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d98de lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.294983:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d98de lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.294989:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x36 (ffff8800b4207e00) 00010000:00010000:2.0:1715330300.294991:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.294993:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d98de lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.294997:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66d98de lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.295004:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d98e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1527:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.295008:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d98e5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1527:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.295013:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d98e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1527:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.295017:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64d80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.295019:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d98e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1527:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.295023:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d98e5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1527:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.295027:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1527:0x0].0x0 (ffff88008d5eeb00) 00010000:00010000:2.0:1715330300.295029:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.295032:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d98e5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1527:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.295036:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d98e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1527:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00000100:00100000:2.0:1715330300.295130:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134566d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+19:17766:x1798653938061888:12345-192.168.204.49@tcp:34:lfs.0 Request processed in 2070us (2203us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.295140:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23548 00000100:00100000:3.0:1715330300.297971:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.298028:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938062016 00000100:00100000:2.0:1715330300.298037:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938062016 00000100:00100000:2.0:1715330300.298085:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23549 00000100:00100000:2.0:1715330300.298091:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d776300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+19:17766:x1798653938062016:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:2.0:1715330300.298111:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330300.298131:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d98ec lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1527:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfba67 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.298227:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d98f3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1527:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.298239:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d98f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1527:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.298249:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d98f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1527:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00200000:2.0:1715330300.298260:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1527:0x0]: returning size 2 00010000:00010000:2.0:1715330300.298375:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66d98ec lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1527:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba67 expref: 22 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.298393:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d98f3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1527:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba67 expref: 21 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.298400:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1527:0x0].0x0 (ffff88008d5eeb00) 00010000:00010000:2.0:1715330300.298402:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1715330300.298405:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db66f40, rc 0) 00000100:00100000:2.0:1715330300.298464:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d776300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+21:17766:x1798653938062016:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 372us (503us total) trans 4294983550 rc 0/0 00000100:00100000:2.0:1715330300.298471:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23549 00000100:00100000:1.0:1715330300.302946:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.303108:0:17206:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938062080 00000100:00100000:2.0:1715330300.303118:0:17206:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938062080 00000100:00100000:2.0:1715330300.303171:0:17206:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5215 00000100:00100000:2.0:1715330300.303179:0:17206:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:72de1896-1df4-4b3a-930a-9116d2c66168+17:2012:x1798653938062080:12345-192.168.204.49@tcp:1:lfs.0 00010000:00010000:2.0:1715330300.303229:0:17206:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011db66d00/0xd895711d66d9901 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.303247:0:17206:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011db64240/0xd895711d66d972c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba05 expref: 17 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.303254:0:17206:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1715330300.303256:0:17206:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1715330300.303259:0:17206:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db66d00/0xd895711d66d9901 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.303313:0:17206:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011db64240/0xd895711d66d972c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba05 expref: 17 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.303327:0:17206:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011db64240/0xd895711d66d972c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba05 expref: 17 pid: 9633 timeout: 374 lvb_type: 0 00000100:00100000:2.0:1715330300.303345:0:17206:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba64380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:17206:1798653942494784:192.168.204.49@tcp:104: 00000100:00100000:2.0:1715330300.303431:0:17206:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330300.305954:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330300.306028:0:9403:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938062144 00000100:00100000:1.0:1715330300.306038:0:9403:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938062144 00002000:00100000:1.0:1715330300.306085:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9cc:0x0] (0->1) req@ffff880134567480 x1798653938062144/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:511/0 lens 496/0 e 0 to 0 dl 1715330311 ref 1 fl New:/200/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 00002000:00100000:1.0:1715330300.306094:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880134567480 with x1798653938062144 ext(0->1) 00010000:00010000:1.0:1715330300.306107:0:9403:0:(ldlm_extent.c:692:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011db64240/0xd895711d66d972c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba05 expref: 18 pid: 9633 timeout: 374 lvb_type: 0 00010000:00010000:1.0:1715330300.306120:0:9403:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011db64240/0xd895711d66d972c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba05 expref: 18 pid: 9633 timeout: 374 lvb_type: 0 00002000:00010000:1.0:1715330300.306127:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134567480 00000100:00100000:1.0:1715330300.306162:0:9403:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 7 00000100:00100000:1.0:1715330300.306170:0:9403:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134567480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+18:2012:x1798653938062144:12345-192.168.204.49@tcp:4:bash.0 00000100:00100000:2.0:1715330300.306603:0:17206:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba64380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:17206:1798653942494784:192.168.204.49@tcp:104: 00010000:00010000:2.0:1715330300.306769:0:17206:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88011db66d00/0xd895711d66d9901 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330300.308153:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1715330300.308175:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942494848:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1715330300.308245:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.308321:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942494848 00000100:00100000:3.0:1715330300.308329:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942494848 00000100:00100000:3.0:1715330300.308366:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1715330300.308374:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3688:x1798653942494848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1715330300.308398:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 57344 granted 50773440 pending 114688 free 3923501056 avail 3691978752 00000100:00100000:3.0:1715330300.308456:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3688:x1798653942494848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.308463:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1715330300.308556:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942494848:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1715330300.309492:0:9403:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134567480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+20:2012:x1798653938062144:12345-192.168.204.49@tcp:4:bash.0 Request processed in 3312us (3535us total) trans 4294969888 rc 0/0 00000100:00100000:1.0:1715330300.309505:0:9403:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 7 00002000:00100000:1.0:1715330300.309516:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9cc:0x0] (0->1) req@ffff880134567480 x1798653938062144/t4294969888(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:511/0 lens 496/448 e 0 to 0 dl 1715330311 ref 1 fl Complete:H/200/0 rc 0/0 job:'bash.0' uid:0 gid:0 00002000:00100000:1.0:1715330300.309530:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880134567480 with x1798653938062144 ext(0->1) 00010000:00010000:1.0:1715330300.309538:0:9403:0:(ldlm_extent.c:692:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011db64240/0xd895711d66d972c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba05 expref: 20 pid: 9633 timeout: 374 lvb_type: 0 00010000:00010000:1.0:1715330300.309551:0:9403:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011db64240/0xd895711d66d972c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba05 expref: 20 pid: 9633 timeout: 374 lvb_type: 0 00002000:00010000:1.0:1715330300.309557:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134567480 00000100:00100000:3.0:1715330300.314723:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.315023:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938062208 00000100:00100000:2.0:1715330300.315034:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938062208 00010000:00010000:2.0:1715330300.315076:0:10674:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011db64240/0xd895711d66d972c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba05 expref: 20 pid: 9633 timeout: 374 lvb_type: 0 00000100:00100000:2.0:1715330300.315128:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1564 00000100:00100000:2.0:1715330300.315138:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:72de1896-1df4-4b3a-930a-9116d2c66168+20:2011:x1798653938062208:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1715330300.315155:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1715330300.315176:0:10674:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0x9cc:0x0] updating lvb size from disk: 0 -> 2 00002000:00010000:2.0:1715330300.315179:0:10674:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x9cc:0x0] updating lvb mtime from disk: 0 -> 1715330300 00002000:00010000:2.0:1715330300.315181:0:10674:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0x9cc:0x0] updating lvb ctime from disk: 0 -> 1715330300 00002000:00010000:2.0:1715330300.315183:0:10674:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0x9cc:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1715330300.315188:0:10674:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011db64240/0xd895711d66d972c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba05 expref: 20 pid: 9633 timeout: 374 lvb_type: 0 00010000:00010000:2.0:1715330300.315201:0:10674:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011db64240/0xd895711d66d972c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba05 expref: 20 pid: 9633 timeout: 374 lvb_type: 0 00010000:00010000:2.0:1715330300.315229:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011db64240/0xd895711d66d972c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba05 expref: 20 pid: 9633 timeout: 374 lvb_type: 0 00010000:00010000:2.0:1715330300.315261:0:10674:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330300.315263:0:10674:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330300.315268:0:10674:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011db66d00/0xd895711d66d9901 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.315278:0:10674:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db66d00/0xd895711d66d9901 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.315316:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330300.321719:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:72de1896-1df4-4b3a-930a-9116d2c66168+19:2011:x1798653938062208:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 6565us (6992us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.321751:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1564 00010000:00010000:2.0:1715330300.321821:0:17206:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88011db66d00/0xd895711d66d9901 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.321832:0:17206:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011db66d00/0xd895711d66d9901 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.321862:0:17206:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011db66d00/0xd895711d66d9901 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.321868:0:17206:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88011db66d00/0xd895711d66d9901 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.321876:0:17206:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88011db66d00/0xd895711d66d9901 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.321882:0:17206:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66d00 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330300.321886:0:17206:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88011db66d00/0xd895711d66d9901 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.321894:0:17206:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88011db66d00/0xd895711d66d9901 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.321916:0:17206:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88011db66d00/0xd895711d66d9901 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.321922:0:17206:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011db66d00/0xd895711d66d9901 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330300.322017:0:17206:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:72de1896-1df4-4b3a-930a-9116d2c66168+18:2012:x1798653938062080:12345-192.168.204.49@tcp:1:lfs.0 Request processed in 18837us (19085us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.322026:0:17206:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5215 00000100:00100000:3.0:1715330300.326444:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.326552:0:7148:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938062336 00000100:00100000:2.0:1715330300.326562:0:7148:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938062336 00000100:00100000:2.0:1715330300.326694:0:7148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 9 00000100:00100000:2.0:1715330300.326702:0:7148:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:72de1896-1df4-4b3a-930a-9116d2c66168+21:17766:x1798653938062336:12345-192.168.204.49@tcp:36:lfs.0 00010000:00010000:2.0:1715330300.326834:0:7148:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330300.326867:0:7148:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d971e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1527:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9fe expref: 21 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.326886:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1527:0x0].0x0 (ffff88008d5eeb00) 00010000:00010000:2.0:1715330300.326891:0:7148:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330300.326915:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d9908 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.326927:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d9908 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.326937:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d9908 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00000100:00100000:2.0:1715330300.326997:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba64700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942494912:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330300.327049:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330300.327070:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330300.327086:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942494912 00000100:00100000:0.0:1715330300.327090:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942494912 00000100:00100000:0.0:1715330300.327122:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2937 00000100:00100000:0.0:1715330300.327127:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:7148:x1798653942494912:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1715330300.327209:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:7148:x1798653942494912:12345-0@lo:1000:mdt_io00_002.0 Request processed in 81us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330300.327216:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2937 00000100:00100000:3.0:1715330300.327326:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba64700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942494912:0@lo:1000:mdt_io00_002.0 00000004:00080000:3.0:1715330300.327358:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x193:0x0] 00000100:00100000:3.0:1715330300.327554:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942494976:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.327576:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.327591:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63b40 going to sleep for 11 seconds 00000100:00100000:2.0:1715330300.327608:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942494976 00000100:00100000:2.0:1715330300.327612:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942494976 00000100:00100000:2.0:1715330300.327634:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2938 00000100:00100000:2.0:1715330300.327638:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:7148:x1798653942494976:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330300.327695:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:7148:x1798653942494976:12345-0@lo:1000:mdt_io00_002.0 Request processed in 55us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.327701:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2938 00000100:00100000:3.0:1715330300.327765:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942494976:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.329326:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942495040:0@lo:403:mdt_io00_002.0 00000100:00100000:3.0:1715330300.329375:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.329403:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63d80 going to sleep for 11 seconds 00000100:00100000:2.0:1715330300.329469:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942495040 00000100:00100000:2.0:1715330300.329475:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942495040 00000100:00100000:2.0:1715330300.330073:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2939 00000100:00100000:2.0:1715330300.330080:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:7148:x1798653942495040:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1715330300.331842:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:7148:x1798653942495040:12345-0@lo:403:mdt_io00_002.0 Request processed in 1754us (2458us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.331855:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2939 00000100:00100000:3.0:1715330300.332181:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942495040:0@lo:403:mdt_io00_002.0 00010000:00010000:3.0:1715330300.333095:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e880/0xd895711d66d990f lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.333105:0:7148:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e880/0xd895711d66d990f lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.333115:0:7148:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e880/0xd895711d66d990f lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7148 initiator: MDT0 00000100:00100000:3.0:1715330300.333135:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942495104:0@lo:101:mdt_io00_002.0 00000100:00100000:3.0:1715330300.333172:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.333834:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63d80 going to sleep for 11 seconds 00000100:00100000:0.0:1715330300.333881:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942495104 00000100:00100000:0.0:1715330300.333889:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942495104 00000100:00100000:0.0:1715330300.333939:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2940 00000100:00100000:0.0:1715330300.333947:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:7148:x1798653942495104:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:0.0:1715330300.333966:0:8592:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330300.333986:0:8592:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a1200/0xd895711d66d9916 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d990f expref: -99 pid: 8592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.334012:0:8592:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a1200/0xd895711d66d9916 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d990f expref: 8 pid: 8592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.334107:0:8592:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a1200/0xd895711d66d9916 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d990f expref: 8 pid: 8592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.334116:0:8592:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff88008b233800) 00010000:00010000:0.0:1715330300.334119:0:8592:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330300.334123:0:8592:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a1200, rc 0) 00000100:00100000:0.0:1715330300.334323:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:7148:x1798653942495104:12345-0@lo:101:mdt_io00_002.0 Request processed in 377us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330300.334329:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2940 00000100:00100000:3.0:1715330300.334952:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942495104:0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1715330300.334969:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e880/0xd895711d66d990f lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9916 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.334979:0:7148:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e880/0xd895711d66d990f lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9916 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330300.334999:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00010000:00010000:3.0:1715330300.335023:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457dd40/0xd895711d66d991d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.335030:0:7148:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457dd40/0xd895711d66d991d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.335041:0:7148:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457dd40/0xd895711d66d991d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7148 initiator: MDT0 00000100:00100000:3.0:1715330300.335054:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942495168:0@lo:101:mdt_io00_002.0 00000100:00100000:3.0:1715330300.335079:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.335101:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63d80 going to sleep for 11 seconds 00000100:00100000:0.0:1715330300.335150:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942495168 00000100:00100000:0.0:1715330300.335154:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942495168 00000100:00100000:0.0:1715330300.335184:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2941 00000100:00100000:0.0:1715330300.335189:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:7148:x1798653942495168:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:0.0:1715330300.335196:0:8592:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330300.335206:0:8592:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a06c0/0xd895711d66d9924 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d991d expref: -99 pid: 8592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.335220:0:8592:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a06c0/0xd895711d66d9924 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d991d expref: 9 pid: 8592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.335228:0:8592:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a06c0/0xd895711d66d9924 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d991d expref: 9 pid: 8592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.335235:0:8592:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x36 (ffff88008b233200) 00010000:00010000:0.0:1715330300.335237:0:8592:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330300.335239:0:8592:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a06c0, rc 0) 00000100:00100000:0.0:1715330300.335266:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:7148:x1798653942495168:12345-0@lo:101:mdt_io00_002.0 Request processed in 77us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330300.335272:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2941 00000100:00100000:3.0:1715330300.335333:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942495168:0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1715330300.335341:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457dd40/0xd895711d66d991d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9924 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.335348:0:7148:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457dd40/0xd895711d66d991d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9924 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330300.335357:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00010000:00010000:3.0:1715330300.335373:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cfc0/0xd895711d66d992b lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.335379:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cfc0/0xd895711d66d992b lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.335387:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cfc0/0xd895711d66d992b lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.335396:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457fa80/0xd895711d66d9932 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.335401:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457fa80/0xd895711d66d9932 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.335406:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457fa80/0xd895711d66d9932 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.335445:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d200/0xd895711d66d9939 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1527:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.335455:0:7148:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d98f3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1527:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba67 expref: 20 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.335462:0:7148:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d200/0xd895711d66d9939 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1527:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.335481:0:7148:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d98f3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1527:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba67 expref: 20 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.335492:0:7148:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d98f3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1527:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba67 expref: 20 pid: 7135 timeout: 374 lvb_type: 0 00000100:00100000:3.0:1715330300.335501:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:7148:1798653942495232:192.168.204.49@tcp:104: 00000100:00100000:3.0:1715330300.335554:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63d80 going to sleep for 11 seconds 00010000:00010000:3.0:1715330300.338785:0:7148:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.204.49@tcp) returned -22 from blocking AST (req@ffff88008d48c380 x1798653942495232) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d98f3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1527:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba67 expref: 20 pid: 7135 timeout: 374 lvb_type: 0 00010000:00010000:3.0:1715330300.338807:0:7148:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d98f3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1527:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba67 expref: 20 pid: 7135 timeout: 374 lvb_type: 0 00010000:00010000:3.0:1715330300.338837:0:7148:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d98f3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1527:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba67 expref: 20 pid: 7135 timeout: 374 lvb_type: 0 00000100:00100000:3.0:1715330300.338863:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:7148:1798653942495232:192.168.204.49@tcp:104: 00010000:00010000:3.0:1715330300.338889:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1527:0x0].0x0 (ffff88008d5eeb00) 00010000:00010000:3.0:1715330300.338895:0:7148:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d200/0xd895711d66d9939 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1527:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.338904:0:7148:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d200/0xd895711d66d9939 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1527:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.338912:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d200/0xd895711d66d9939 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1527:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.338930:0:7148:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d200/0xd895711d66d9939 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1527:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.338938:0:7148:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d200/0xd895711d66d9939 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1527:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.338942:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d200/0xd895711d66d9939 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1527:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00000100:00100000:3.0:1715330300.339090:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942495296:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.339135:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.339169:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63b40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330300.339284:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942495296 00000100:00100000:1.0:1715330300.339300:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942495296 00000100:00100000:1.0:1715330300.339349:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2942 00000100:00100000:1.0:1715330300.339355:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:7148:x1798653942495296:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1715330300.339498:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:7148:x1798653942495296:12345-0@lo:1000:mdt_io00_002.0 Request processed in 142us (362us total) trans 0 rc -2/-2 00000100:00100000:1.0:1715330300.339505:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2942 00000100:00100000:3.0:1715330300.339550:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942495296:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.339583:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942495360:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.339600:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.339620:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63b40 going to sleep for 11 seconds 00000100:00100000:2.0:1715330300.339645:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942495360 00000100:00100000:2.0:1715330300.339650:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942495360 00000100:00100000:2.0:1715330300.339680:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2943 00000100:00100000:2.0:1715330300.339685:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:7148:x1798653942495360:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330300.339797:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:7148:x1798653942495360:12345-0@lo:1000:mdt_io00_002.0 Request processed in 110us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.339803:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2943 00000100:00100000:3.0:1715330300.339821:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942495360:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.339889:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942495424:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.339907:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.339928:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63b40 going to sleep for 11 seconds 00000100:00100000:2.0:1715330300.339974:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942495424 00000100:00100000:2.0:1715330300.339977:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942495424 00000100:00100000:2.0:1715330300.339999:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2944 00000100:00100000:2.0:1715330300.340003:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:7148:x1798653942495424:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330300.340050:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:7148:x1798653942495424:12345-0@lo:1000:mdt_io00_002.0 Request processed in 46us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.340055:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2944 00000100:00100000:3.0:1715330300.340097:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942495424:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.340231:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942495488:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.340253:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.340272:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa000 going to sleep for 11 seconds 00000100:00100000:2.0:1715330300.340320:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942495488 00000100:00100000:2.0:1715330300.340324:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942495488 00000100:00080000:3.0:1715330300.340370:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330270 00000100:00100000:2.0:1715330300.340383:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2945 00000100:00100000:2.0:1715330300.340387:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+8:7148:x1798653942495488:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330300.340459:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+8:7148:x1798653942495488:12345-0@lo:1000:mdt_io00_002.0 Request processed in 71us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.340464:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2945 00000100:00100000:3.0:1715330300.340473:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942495488:0@lo:1000:mdt_io00_002.0 00000040:00080000:3.0:1715330300.340771:0:7148:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].380, 1264 off572112 00000040:00080000:3.0:1715330300.340821:0:7148:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].379, 1344 off616344 00000100:00100000:3.0:1715330300.340838:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942495552:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.340856:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.340876:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffab40 going to sleep for 11 seconds 00000100:00100000:2.0:1715330300.340979:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942495552 00000100:00100000:2.0:1715330300.340983:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942495552 00000100:00100000:2.0:1715330300.341022:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2946 00000100:00100000:2.0:1715330300.341027:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+8:7148:x1798653942495552:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330300.341112:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:7148:x1798653942495552:12345-0@lo:1000:mdt_io00_002.0 Request processed in 81us (251us total) trans 4294969889 rc 0/0 00000100:00100000:2.0:1715330300.341118:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2946 00000100:00100000:3.0:1715330300.341142:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942495552:0@lo:1000:mdt_io00_002.0 00000004:00080000:3.0:1715330300.341149:0:7148:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88011db63780 with version 724 00000004:00080000:0.0:1715330300.341203:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 724 rpc_version 724 00000020:00100000:0.0:1715330300.341224:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1715330300.341230:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880134567800 x1798653942495680/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3088/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715330300.341244:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134567800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942495680:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330300.341279:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330300.341306:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009d7e3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1715330300.341406:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942495680 00000100:00100000:2.0:1715330300.341409:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942495680 00000100:00100000:2.0:1715330300.341434:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2947 00000100:00100000:2.0:1715330300.341438:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134567b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:8587:x1798653942495680:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1715330300.341677:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134567b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+10:8587:x1798653942495680:12345-0@lo:1000:osp_up1-0.0 Request processed in 238us (398us total) trans 4294968465 rc 0/0 00000100:00100000:2.0:1715330300.341682:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2947 00000100:00100000:0.0:1715330300.341756:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880134567800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942495680:0@lo:1000:osp_up1-0.0 00000004:00010000:3.0:1715330300.341833:0:7148:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008d48e680 reply state ffff88009aef2000 transno 4294983551 ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d200/0xd895711d66d9939 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1527:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.341850:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d200/0xd895711d66d9939 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1527:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.341859:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1527:0x0].0x0 (ffff88008d5eeb00) 00010000:00010000:3.0:1715330300.341862:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:3.0:1715330300.341866:0:7148:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330300.341875:0:7148:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cfc0/0xd895711d66d992b lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.341881:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cfc0/0xd895711d66d992b lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.341886:0:7148:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cfc0/0xd895711d66d992b lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.341897:0:7148:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cfc0/0xd895711d66d992b lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.341902:0:7148:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457cfc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330300.341906:0:7148:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cfc0/0xd895711d66d992b lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.341913:0:7148:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cfc0/0xd895711d66d992b lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.341922:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff880093a11100) 00010000:00010000:3.0:1715330300.341924:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330300.341927:0:7148:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cfc0/0xd895711d66d992b lrc: 3/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.341933:0:7148:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cfc0/0xd895711d66d992b lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00000004:00010000:3.0:1715330300.341949:0:7148:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008d48e680 reply state ffff88009aef2000 transno 4294983551 ns: mdt-lustre-MDT0000_UUID lock: ffff88013457fa80/0xd895711d66d9932 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.341956:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457fa80/0xd895711d66d9932 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.341960:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x36 (ffff880093a11b00) 00010000:00010000:3.0:1715330300.341962:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330300.341963:0:7148:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00080000:3.0:1715330300.341968:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00010000:00010000:3.0:1715330300.341975:0:7148:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e880/0xd895711d66d990f lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9916 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.341981:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e880/0xd895711d66d990f lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9916 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.341987:0:7148:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e880/0xd895711d66d990f lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9916 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.343026:0:7148:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1715330300.343037:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00010000:00010000:1.0:1715330300.343041:0:7124:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1715330300.343044:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457dd40/0xd895711d66d991d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9924 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.343048:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e880/0xd895711d66d990f lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d9916 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.343052:0:7148:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457dd40/0xd895711d66d991d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9924 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.343056:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457e880 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330300.343060:0:7124:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e880/0xd895711d66d990f lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d9916 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330300.343066:0:7124:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e880/0xd895711d66d990f lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d9916 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.343094:0:7124:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e880/0xd895711d66d990f lrc: 2/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9916 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.343101:0:7124:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330300.343133:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e880/0xd895711d66d990f lrc: 1/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9916 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.343139:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e880/0xd895711d66d990f lrc: 0/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9916 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.343159:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330300.343160:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330300.343162:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330300.343163:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942495744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330300.343213:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1715330300.343322:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x193:0x0] 00010000:00010000:3.0:1715330300.343329:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d9908 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.343335:0:7148:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d9908 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.343339:0:7148:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d9908 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.343343:0:7148:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db65b00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330300.343346:0:7148:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d9908 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.343351:0:7148:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d9908 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.343360:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff8800b4207e00) 00010000:00010000:3.0:1715330300.343363:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330300.343365:0:7148:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d9908 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00000100:00100000:2.0:1715330300.343512:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942495744 00000100:00100000:2.0:1715330300.343518:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942495744 00000100:00100000:2.0:1715330300.343565:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1396 00000100:00100000:2.0:1715330300.343572:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ab789c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+10:3690:x1798653942495744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715330300.343584:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330300.343600:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a1200/0xd895711d66d9916 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d990f expref: 10 pid: 8592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.343617:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff88008b233800) 00010000:00010000:2.0:1715330300.343624:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330300.343662:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ab789c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+9:3690:x1798653942495744:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.343669:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1396 00010000:00010000:3.0:1715330300.343760:0:7148:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d9908 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00000100:00100000:3.0:1715330300.343840:0:7148:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:72de1896-1df4-4b3a-930a-9116d2c66168+21:17766:x1798653938062336:12345-192.168.204.49@tcp:36:lfs.0 Request processed in 17137us (17405us total) trans 4294983551 rc 0/0 00000100:00100000:3.0:1715330300.343847:0:7148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 9 00000100:00100000:0.0:1715330300.343919:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942495744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330300.346981:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.347102:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938062400 00000100:00100000:2.0:1715330300.347112:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938062400 00000100:00100000:2.0:1715330300.347166:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23550 00000100:00100000:2.0:1715330300.347174:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134565c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+21:17766:x1798653938062400:12345-192.168.204.49@tcp:34:lfs.0 00010000:00010000:2.0:1715330300.347257:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d9940 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.347272:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d9940 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.347321:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d9940 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.347335:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66d9947 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.347340:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66d9947 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.347345:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66d9947 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.347405:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d994e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1529:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.347412:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d994e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1529:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.347418:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d994e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1529:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00010000:2.0:1715330300.347463:0:7135:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d994e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1529:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.347472:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d9940 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.347478:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d9940 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.347483:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d9940 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.347489:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d9940 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.347494:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db65200 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.347497:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d9940 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.347503:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d9940 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.347512:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff8800b4207c00) 00010000:00010000:2.0:1715330300.347515:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.347518:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d9940 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.347522:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d9940 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.347659:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66d9947 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.347665:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66d9947 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.347669:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66d9947 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.347673:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66d00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.347675:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66d9947 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.347679:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66d9947 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.347686:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x3031 (ffff8800b4207800) 00010000:00010000:2.0:1715330300.347688:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.347690:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66d9947 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.347694:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66d9947 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.347704:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d994e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1529:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.347708:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d994e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1529:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.347712:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d994e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1529:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.347716:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db65d40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.347718:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d994e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1529:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.347721:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d994e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1529:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.347726:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1529:0x0].0x0 (ffff8800b5206f00) 00010000:00010000:2.0:1715330300.347775:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.347778:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d994e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1529:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.347787:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d994e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1529:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00000100:00100000:2.0:1715330300.347854:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134565c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+21:17766:x1798653938062400:12345-192.168.204.49@tcp:34:lfs.0 Request processed in 679us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.347861:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23550 00000100:00100000:2.0:1715330300.351244:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330300.351325:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938062528 00000100:00100000:0.0:1715330300.351334:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938062528 00000100:00100000:0.0:1715330300.351376:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23551 00000100:00100000:0.0:1715330300.351384:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+21:17766:x1798653938062528:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:0.0:1715330300.351403:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330300.351423:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0d80/0xd895711d66d9955 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1529:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfba6e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.351533:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2400/0xd895711d66d995c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1529:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.351547:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2400/0xd895711d66d995c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1529:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.351561:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2400/0xd895711d66d995c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1529:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00200000:0.0:1715330300.351571:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1529:0x0]: returning size 3 00010000:00010000:0.0:1715330300.351669:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0d80/0xd895711d66d9955 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1529:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba6e expref: 24 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.351703:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2400/0xd895711d66d995c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1529:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba6e expref: 23 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.351711:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1529:0x0].0x0 (ffff8800b5206f00) 00010000:00010000:0.0:1715330300.351713:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1715330300.351716:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a2400, rc 0) 00000100:00100000:0.0:1715330300.351791:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+23:17766:x1798653938062528:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 406us (557us total) trans 4294983552 rc 0/0 00000100:00100000:0.0:1715330300.351797:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23551 00000100:00100000:1.0:1715330300.354117:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.354154:0:17206:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938062592 00000100:00100000:2.0:1715330300.354163:0:17206:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938062592 00000100:00100000:2.0:1715330300.354213:0:17206:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5216 00000100:00100000:2.0:1715330300.354220:0:17206:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:72de1896-1df4-4b3a-930a-9116d2c66168+18:2011:x1798653938062592:12345-192.168.204.49@tcp:1:lfs.0 00010000:00010000:2.0:1715330300.354260:0:17206:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011db65b00/0xd895711d66d996a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.354277:0:17206:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011db64b40/0xd895711d66d9780 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba21 expref: 18 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.354284:0:17206:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1715330300.354286:0:17206:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1715330300.354301:0:17206:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db65b00/0xd895711d66d996a lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.354339:0:17206:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011db64b40/0xd895711d66d9780 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba21 expref: 18 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.354352:0:17206:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011db64b40/0xd895711d66d9780 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba21 expref: 18 pid: 9633 timeout: 374 lvb_type: 0 00000100:00100000:2.0:1715330300.354371:0:17206:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344c8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:17206:1798653942495808:192.168.204.49@tcp:104: 00000100:00100000:2.0:1715330300.354438:0:17206:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47e900 going to sleep for 11 seconds 00000100:00100000:2.0:1715330300.356008:0:17206:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344c8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:17206:1798653942495808:192.168.204.49@tcp:104: 00010000:00010000:2.0:1715330300.356030:0:17206:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88011db65b00/0xd895711d66d996a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330300.357070:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.357205:0:9403:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938062656 00000100:00100000:2.0:1715330300.357212:0:9403:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938062656 00002000:00100000:2.0:1715330300.357253:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9cd:0x0] (0->2) req@ffff88009b5ec380 x1798653938062656/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:511/0 lens 496/0 e 0 to 0 dl 1715330311 ref 1 fl New:/200/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 00002000:00100000:2.0:1715330300.357262:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b5ec380 with x1798653938062656 ext(0->2) 00010000:00010000:2.0:1715330300.357270:0:9403:0:(ldlm_extent.c:692:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011db64b40/0xd895711d66d9780 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba21 expref: 19 pid: 9633 timeout: 374 lvb_type: 0 00010000:00010000:2.0:1715330300.357282:0:9403:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011db64b40/0xd895711d66d9780 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba21 expref: 19 pid: 9633 timeout: 374 lvb_type: 0 00002000:00010000:2.0:1715330300.357288:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b5ec380 00000100:00100000:2.0:1715330300.357327:0:9403:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 8 00000100:00100000:2.0:1715330300.357333:0:9403:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+19:2011:x1798653938062656:12345-192.168.204.49@tcp:4:bash.0 00000100:00100000:2.0:1715330300.359657:0:9403:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+21:2011:x1798653938062656:12345-192.168.204.49@tcp:4:bash.0 Request processed in 2312us (2579us total) trans 4294969890 rc 0/0 00000100:00100000:2.0:1715330300.359678:0:9403:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 8 00002000:00100000:2.0:1715330300.359689:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9cd:0x0] (0->2) req@ffff88009b5ec380 x1798653938062656/t4294969890(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:511/0 lens 496/448 e 0 to 0 dl 1715330311 ref 1 fl Complete:H/200/0 rc 0/0 job:'bash.0' uid:0 gid:0 00002000:00100000:2.0:1715330300.359699:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b5ec380 with x1798653938062656 ext(0->2) 00010000:00010000:2.0:1715330300.359708:0:9403:0:(ldlm_extent.c:692:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011db64b40/0xd895711d66d9780 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba21 expref: 21 pid: 9633 timeout: 374 lvb_type: 0 00010000:00010000:2.0:1715330300.359724:0:9403:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011db64b40/0xd895711d66d9780 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba21 expref: 21 pid: 9633 timeout: 374 lvb_type: 0 00002000:00010000:2.0:1715330300.359756:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b5ec380 00000100:00100000:0.0:1715330300.367074:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330300.367184:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938062720 00000100:00100000:1.0:1715330300.367195:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938062720 00010000:00010000:1.0:1715330300.367236:0:7121:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011db64b40/0xd895711d66d9780 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba21 expref: 21 pid: 9633 timeout: 374 lvb_type: 0 00000100:00100000:1.0:1715330300.367339:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1565 00000100:00100000:1.0:1715330300.367348:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134565f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+21:2011:x1798653938062720:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1715330300.367366:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1715330300.367386:0:7121:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0x9cd:0x0] updating lvb size from disk: 0 -> 3 00002000:00010000:1.0:1715330300.367388:0:7121:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x9cd:0x0] updating lvb mtime from disk: 0 -> 1715330300 00002000:00010000:1.0:1715330300.367390:0:7121:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0x9cd:0x0] updating lvb ctime from disk: 0 -> 1715330300 00002000:00010000:1.0:1715330300.367392:0:7121:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0x9cd:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1715330300.367398:0:7121:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011db64b40/0xd895711d66d9780 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba21 expref: 21 pid: 9633 timeout: 374 lvb_type: 0 00010000:00010000:1.0:1715330300.367416:0:7121:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011db64b40/0xd895711d66d9780 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba21 expref: 21 pid: 9633 timeout: 374 lvb_type: 0 00010000:00010000:1.0:1715330300.367446:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011db64b40/0xd895711d66d9780 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba21 expref: 21 pid: 9633 timeout: 374 lvb_type: 0 00010000:00010000:1.0:1715330300.367477:0:7121:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330300.367480:0:7121:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330300.367483:0:7121:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011db65b00/0xd895711d66d996a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.367492:0:7121:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db65b00/0xd895711d66d996a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.368187:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330300.368249:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134565f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+20:2011:x1798653938062720:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 899us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330300.368257:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1565 00010000:00010000:2.0:1715330300.368447:0:17206:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88011db65b00/0xd895711d66d996a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.368456:0:17206:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011db65b00/0xd895711d66d996a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.368473:0:17206:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011db65b00/0xd895711d66d996a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.368480:0:17206:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88011db65b00/0xd895711d66d996a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.368486:0:17206:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88011db65b00/0xd895711d66d996a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.368491:0:17206:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db65b00 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330300.368494:0:17206:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88011db65b00/0xd895711d66d996a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.368507:0:17206:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88011db65b00/0xd895711d66d996a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.368518:0:17206:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88011db65b00/0xd895711d66d996a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.368523:0:17206:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011db65b00/0xd895711d66d996a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330300.368702:0:17206:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:72de1896-1df4-4b3a-930a-9116d2c66168+19:2011:x1798653938062592:12345-192.168.204.49@tcp:1:lfs.0 Request processed in 14481us (14591us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.368711:0:17206:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5216 00000100:00100000:0.0:1715330300.372572:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330300.372962:0:7148:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938062848 00000100:00100000:3.0:1715330300.372972:0:7148:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938062848 00000100:00100000:3.0:1715330300.373034:0:7148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 10 00000100:00100000:3.0:1715330300.373043:0:7148:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134566a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:72de1896-1df4-4b3a-930a-9116d2c66168+23:17766:x1798653938062848:12345-192.168.204.49@tcp:36:lfs.0 00010000:00010000:3.0:1715330300.373100:0:7148:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330300.373129:0:7148:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d9772 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1529:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba1a expref: 23 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.373162:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1529:0x0].0x0 (ffff8800b5206f00) 00010000:00010000:3.0:1715330300.373166:0:7148:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330300.373191:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d9971 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.373202:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d9971 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.373211:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d9971 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00000100:00100000:3.0:1715330300.373271:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48d880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942495872:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.374433:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.374777:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496f540 going to sleep for 11 seconds 00000100:00100000:1.0:1715330300.374957:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942495872 00000100:00100000:1.0:1715330300.374964:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942495872 00000100:00100000:1.0:1715330300.375017:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2948 00000100:00100000:1.0:1715330300.375023:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:7148:x1798653942495872:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1715330300.375110:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:7148:x1798653942495872:12345-0@lo:1000:mdt_io00_002.0 Request processed in 86us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330300.375117:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2948 00000100:00100000:3.0:1715330300.375229:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48d880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942495872:0@lo:1000:mdt_io00_002.0 00000004:00080000:3.0:1715330300.375268:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x193:0x0] 00000100:00100000:3.0:1715330300.375333:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48d880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942495936:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.375357:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.376550:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496f540 going to sleep for 11 seconds 00000100:00100000:2.0:1715330300.377202:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942495936 00000100:00100000:2.0:1715330300.377211:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942495936 00000100:00100000:2.0:1715330300.377251:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2949 00000100:00100000:2.0:1715330300.377258:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:7148:x1798653942495936:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330300.377372:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:7148:x1798653942495936:12345-0@lo:1000:mdt_io00_002.0 Request processed in 113us (2012us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.377379:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2949 00000100:00100000:3.0:1715330300.377416:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48d880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942495936:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.378022:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48d880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942496000:0@lo:403:mdt_io00_002.0 00000100:00100000:3.0:1715330300.378064:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.378089:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1715330300.378110:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942496000 00000100:00100000:1.0:1715330300.378118:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942496000 00000100:00100000:1.0:1715330300.378151:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2950 00000100:00100000:1.0:1715330300.378156:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:7148:x1798653942496000:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:1.0:1715330300.379825:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:7148:x1798653942496000:12345-0@lo:403:mdt_io00_002.0 Request processed in 1663us (1756us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.380106:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48d880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942496000:0@lo:403:mdt_io00_002.0 00010000:00010000:3.0:1715330300.380774:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e1c0/0xd895711d66d9978 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.380783:0:7148:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e1c0/0xd895711d66d9978 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.380793:0:7148:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e1c0/0xd895711d66d9978 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7148 initiator: MDT0 00000100:00100000:3.0:1715330300.380809:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48d880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942496064:0@lo:101:mdt_io00_002.0 00000100:00100000:3.0:1715330300.380839:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.380851:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1715330300.380905:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942496064 00000100:00100000:2.0:1715330300.380911:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942496064 00000100:00100000:2.0:1715330300.380942:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2951 00000100:00100000:2.0:1715330300.380948:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+10:7148:x1798653942496064:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:2.0:1715330300.380961:0:19960:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330300.380978:0:19960:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67cc0/0xd895711d66d997f lrc: 2/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d9978 expref: -99 pid: 19960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.381000:0:19960:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67cc0/0xd895711d66d997f lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d9978 expref: 11 pid: 19960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.381012:0:19960:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67cc0/0xd895711d66d997f lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9978 expref: 11 pid: 19960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.381019:0:19960:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff8800b4207c00) 00010000:00010000:2.0:1715330300.381021:0:19960:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.381024:0:19960:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db67cc0, rc 0) 00000100:00100000:2.0:1715330300.381044:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+11:7148:x1798653942496064:12345-0@lo:101:mdt_io00_002.0 Request processed in 96us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.381049:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2951 00000100:00100000:3.0:1715330300.381143:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48d880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942496064:0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1715330300.381153:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e1c0/0xd895711d66d9978 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d997f expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.381161:0:7148:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e1c0/0xd895711d66d9978 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d997f expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330300.381176:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00010000:00010000:3.0:1715330300.381187:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457db00/0xd895711d66d9986 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.381192:0:7148:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457db00/0xd895711d66d9986 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.381197:0:7148:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457db00/0xd895711d66d9986 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7148 initiator: MDT0 00000100:00100000:3.0:1715330300.381204:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48d880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942496128:0@lo:101:mdt_io00_002.0 00000100:00100000:3.0:1715330300.381219:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.382008:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1715330300.382035:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942496128 00000100:00100000:0.0:1715330300.382040:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942496128 00000100:00100000:0.0:1715330300.382073:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2952 00000100:00100000:0.0:1715330300.382077:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+11:7148:x1798653942496128:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:0.0:1715330300.382086:0:7138:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330300.382096:0:7138:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a0d80/0xd895711d66d998d lrc: 2/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d9986 expref: -99 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.382109:0:7138:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a0d80/0xd895711d66d998d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d9986 expref: 12 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.382121:0:7138:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a0d80/0xd895711d66d998d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9986 expref: 12 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.382126:0:7138:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x3031 (ffff88008b233700) 00010000:00010000:0.0:1715330300.382128:0:7138:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330300.382130:0:7138:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a0d80, rc 0) 00000100:00100000:0.0:1715330300.382152:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:7148:x1798653942496128:12345-0@lo:101:mdt_io00_002.0 Request processed in 75us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330300.382157:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2952 00000100:00100000:3.0:1715330300.382400:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48d880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942496128:0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1715330300.382412:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457db00/0xd895711d66d9986 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d998d expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.382419:0:7148:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457db00/0xd895711d66d9986 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d998d expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330300.382431:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00010000:00010000:3.0:1715330300.382446:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c000/0xd895711d66d9994 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.382452:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c000/0xd895711d66d9994 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.382459:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c000/0xd895711d66d9994 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.382469:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c6c0/0xd895711d66d999b lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.382474:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c6c0/0xd895711d66d999b lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.382478:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c6c0/0xd895711d66d999b lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.382525:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d99a2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1529:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.382536:0:7148:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2400/0xd895711d66d995c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1529:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba6e expref: 22 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.382543:0:7148:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d99a2 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1529:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.382570:0:7148:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2400/0xd895711d66d995c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1529:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba6e expref: 22 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.382583:0:7148:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2400/0xd895711d66d995c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1529:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba6e expref: 22 pid: 7135 timeout: 374 lvb_type: 0 00000100:00100000:3.0:1715330300.382594:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c2d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:7148:1798653942496192:192.168.204.49@tcp:104: 00000100:00100000:3.0:1715330300.382645:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1715330300.383196:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2950 00010000:00010000:3.0:1715330300.385993:0:7148:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.204.49@tcp) returned -22 from blocking AST (req@ffff88008b0c2d80 x1798653942496192) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2400/0xd895711d66d995c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1529:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba6e expref: 22 pid: 7135 timeout: 374 lvb_type: 0 00010000:00010000:3.0:1715330300.386015:0:7148:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2400/0xd895711d66d995c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1529:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba6e expref: 22 pid: 7135 timeout: 374 lvb_type: 0 00010000:00010000:3.0:1715330300.386042:0:7148:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2400/0xd895711d66d995c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1529:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba6e expref: 22 pid: 7135 timeout: 374 lvb_type: 0 00000100:00100000:3.0:1715330300.386061:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c2d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:7148:1798653942496192:192.168.204.49@tcp:104: 00010000:00010000:3.0:1715330300.386085:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1529:0x0].0x0 (ffff8800b5206f00) 00010000:00010000:3.0:1715330300.386090:0:7148:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d99a2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1529:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.386098:0:7148:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d99a2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1529:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.386105:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d99a2 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1529:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.386122:0:7148:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d99a2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1529:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.386130:0:7148:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d99a2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1529:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.386135:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d99a2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1529:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00000100:00100000:3.0:1715330300.386281:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c2d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942496256:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.386342:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.387179:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496f540 going to sleep for 11 seconds 00000100:00100000:1.0:1715330300.387338:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942496256 00000100:00100000:1.0:1715330300.387345:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942496256 00000100:00100000:1.0:1715330300.387633:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2953 00000100:00100000:1.0:1715330300.387641:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:7148:x1798653942496256:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1715330300.388420:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:7148:x1798653942496256:12345-0@lo:1000:mdt_io00_002.0 Request processed in 778us (2077us total) trans 0 rc -2/-2 00000100:00100000:1.0:1715330300.388428:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2953 00000100:00100000:3.0:1715330300.388434:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c2d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942496256:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.388495:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c2d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942496320:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.388519:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.388641:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496f540 going to sleep for 11 seconds 00000100:00100000:1.0:1715330300.388682:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942496320 00000100:00100000:1.0:1715330300.388687:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942496320 00000100:00100000:1.0:1715330300.388714:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2954 00000100:00100000:1.0:1715330300.388719:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:7148:x1798653942496320:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1715330300.388774:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:7148:x1798653942496320:12345-0@lo:1000:mdt_io00_002.0 Request processed in 54us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330300.388779:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2954 00000100:00100000:3.0:1715330300.388825:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c2d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942496320:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.388913:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c2d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942496384:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.388931:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.388940:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496f540 going to sleep for 11 seconds 00000100:00100000:1.0:1715330300.388981:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942496384 00000100:00100000:1.0:1715330300.388984:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942496384 00000100:00100000:1.0:1715330300.389008:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2955 00000100:00100000:1.0:1715330300.389012:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:7148:x1798653942496384:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1715330300.389050:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:7148:x1798653942496384:12345-0@lo:1000:mdt_io00_002.0 Request processed in 38us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330300.389055:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2955 00000100:00100000:3.0:1715330300.389106:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c2d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942496384:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.389179:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c2d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942496448:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.389199:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.389207:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496f600 going to sleep for 11 seconds 00000100:00100000:1.0:1715330300.389244:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942496448 00000100:00100000:1.0:1715330300.389247:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942496448 00000100:00100000:1.0:1715330300.389262:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2956 00000100:00100000:1.0:1715330300.389266:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:7148:x1798653942496448:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1715330300.389491:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:7148:x1798653942496448:12345-0@lo:1000:mdt_io00_002.0 Request processed in 223us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330300.389497:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2956 00000100:00100000:3.0:1715330300.389552:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c2d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942496448:0@lo:1000:mdt_io00_002.0 00000040:00080000:3.0:1715330300.390086:0:7148:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].381, 1264 off573376 00000040:00080000:3.0:1715330300.390132:0:7148:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].380, 1344 off617688 00000100:00100000:3.0:1715330300.390149:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c2d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942496512:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.390166:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.390174:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496f900 going to sleep for 11 seconds 00000100:00100000:2.0:1715330300.390595:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942496512 00000100:00100000:2.0:1715330300.390601:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942496512 00000100:00100000:2.0:1715330300.390696:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2957 00000100:00100000:2.0:1715330300.390702:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:7148:x1798653942496512:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330300.390803:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+10:7148:x1798653942496512:12345-0@lo:1000:mdt_io00_002.0 Request processed in 101us (636us total) trans 4294969891 rc 0/0 00000100:00100000:2.0:1715330300.390809:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2957 00000100:00100000:3.0:1715330300.390911:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c2d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942496512:0@lo:1000:mdt_io00_002.0 00000004:00080000:3.0:1715330300.390918:0:7148:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8800b496f0c0 with version 725 00000004:00080000:0.0:1715330300.390932:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 725 rpc_version 725 00000020:00100000:0.0:1715330300.390974:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1715330300.390980:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880134566680 x1798653942496640/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3088/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715330300.390992:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134566680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942496640:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330300.391019:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330300.391029:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009d7e3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1715330300.391121:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942496640 00000100:00100000:2.0:1715330300.391123:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942496640 00000100:00100000:2.0:1715330300.391148:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2958 00000100:00100000:2.0:1715330300.391152:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134567100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+11:8587:x1798653942496640:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1715330300.391431:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134567100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:8587:x1798653942496640:12345-0@lo:1000:osp_up1-0.0 Request processed in 278us (411us total) trans 4294968466 rc 0/0 00000100:00100000:2.0:1715330300.391437:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2958 00000100:00100000:1.0:1715330300.391543:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880134566680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942496640:0@lo:1000:osp_up1-0.0 00000004:00010000:3.0:1715330300.391582:0:7148:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880134566a00 reply state ffff8800938e3000 transno 4294983553 ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d99a2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1529:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.391601:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d99a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1529:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.391611:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1529:0x0].0x0 (ffff8800b5206f00) 00010000:00010000:3.0:1715330300.391617:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:3.0:1715330300.391621:0:7148:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330300.391632:0:7148:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c000/0xd895711d66d9994 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.391638:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c000/0xd895711d66d9994 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.391646:0:7148:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c000/0xd895711d66d9994 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.391652:0:7148:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c000/0xd895711d66d9994 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.391659:0:7148:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457c000 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330300.391664:0:7148:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c000/0xd895711d66d9994 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.391671:0:7148:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c000/0xd895711d66d9994 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.392338:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff880093a11500) 00010000:00010000:3.0:1715330300.392341:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330300.392345:0:7148:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c000/0xd895711d66d9994 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.392350:0:7148:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c000/0xd895711d66d9994 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00000004:00010000:3.0:1715330300.392369:0:7148:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880134566a00 reply state ffff8800938e3000 transno 4294983553 ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c6c0/0xd895711d66d999b lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.392376:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c6c0/0xd895711d66d999b lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.392381:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x3031 (ffff880093a11100) 00010000:00010000:3.0:1715330300.392383:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330300.392385:0:7148:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00080000:3.0:1715330300.392390:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00010000:00010000:3.0:1715330300.392396:0:7148:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e1c0/0xd895711d66d9978 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d997f expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.392407:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e1c0/0xd895711d66d9978 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d997f expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.392413:0:7148:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e1c0/0xd895711d66d9978 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d997f expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.392440:0:7148:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1715330300.392444:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00010000:00010000:3.0:1715330300.392448:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457db00/0xd895711d66d9986 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d998d expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.392455:0:7148:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457db00/0xd895711d66d9986 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d998d expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.392461:0:7123:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715330300.392466:0:7123:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e1c0/0xd895711d66d9978 lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d997f expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.392472:0:7123:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457e1c0 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330300.392475:0:7123:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e1c0/0xd895711d66d9978 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d997f expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330300.392481:0:7123:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e1c0/0xd895711d66d9978 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d997f expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.392508:0:7123:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e1c0/0xd895711d66d9978 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d997f expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.392512:0:7123:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000004:00080000:3.0:1715330300.392535:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x193:0x0] 00010000:00010000:0.0:1715330300.392538:0:7123:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e1c0/0xd895711d66d9978 lrc: 1/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d997f expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.392541:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d9971 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:0.0:1715330300.392544:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e1c0/0xd895711d66d9978 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d997f expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.392546:0:7148:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d9971 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.392550:0:7148:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d9971 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.392554:0:7148:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457e880 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330300.392557:0:7148:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d9971 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:0.0:1715330300.392558:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330300.392559:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330300.392560:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715330300.392561:0:7148:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d9971 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7148 initiator: MDT0 00000100:00100000:0.0:1715330300.392568:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1715330300.392571:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff880093a11e00) 00010000:00010000:3.0:1715330300.392573:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330300.392575:0:7148:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d9971 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00000100:00100000:0.0:1715330300.392578:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134566300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942496704:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1715330300.392579:0:7148:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e880/0xd895711d66d9971 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00000100:00100000:0.0:1715330300.392607:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.392655:0:7148:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134566a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:72de1896-1df4-4b3a-930a-9116d2c66168+23:17766:x1798653938062848:12345-192.168.204.49@tcp:36:lfs.0 Request processed in 19610us (20095us total) trans 4294983553 rc 0/0 00000100:00100000:1.0:1715330300.392655:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942496704 00000100:00100000:1.0:1715330300.392659:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942496704 00000100:00100000:3.0:1715330300.392662:0:7148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 10 00000100:00100000:1.0:1715330300.392683:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1397 00000100:00100000:1.0:1715330300.392688:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134565180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+12:3690:x1798653942496704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330300.392697:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330300.392711:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67cc0/0xd895711d66d997f lrc: 0/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d9978 expref: 12 pid: 19960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.392721:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff8800b4207c00) 00010000:00010000:1.0:1715330300.392742:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330300.393089:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134565180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+11:3690:x1798653942496704:12345-0@lo:103:ldlm_bl.0 Request processed in 399us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330300.393096:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1397 00000100:00100000:0.0:1715330300.393303:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880134566300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942496704:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330300.398474:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330300.398531:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938062912 00000100:00100000:0.0:1715330300.398539:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938062912 00000100:00100000:0.0:1715330300.398592:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23552 00000100:00100000:0.0:1715330300.398598:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+23:17766:x1798653938062912:12345-192.168.204.49@tcp:34:lfs.0 00010000:00010000:0.0:1715330300.398681:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2400/0xd895711d66d99a9 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.398695:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2400/0xd895711d66d99a9 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.398707:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2400/0xd895711d66d99a9 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.398716:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2640/0xd895711d66d99b0 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.398720:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2640/0xd895711d66d99b0 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.398724:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2640/0xd895711d66d99b0 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.398790:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3600/0xd895711d66d99b7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1525:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.398796:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3600/0xd895711d66d99b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1525:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.398800:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3600/0xd895711d66d99b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1525:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00010000:0.0:1715330300.398839:0:7135:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3600/0xd895711d66d99b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1525:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.398851:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2400/0xd895711d66d99a9 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.398856:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2400/0xd895711d66d99a9 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.398861:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2400/0xd895711d66d99a9 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.398867:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2400/0xd895711d66d99a9 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.398872:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a2400 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330300.398876:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2400/0xd895711d66d99a9 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.398883:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2400/0xd895711d66d99a9 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.398893:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff88008b233600) 00010000:00010000:0.0:1715330300.398896:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330300.398899:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2400/0xd895711d66d99a9 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.398904:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2400/0xd895711d66d99a9 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.398923:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2640/0xd895711d66d99b0 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.398928:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2640/0xd895711d66d99b0 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.398932:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2640/0xd895711d66d99b0 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.398936:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a2640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330300.398937:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2640/0xd895711d66d99b0 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.398942:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2640/0xd895711d66d99b0 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.398947:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x31 (ffff88008b233900) 00010000:00010000:0.0:1715330300.398949:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330300.398951:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2640/0xd895711d66d99b0 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.398959:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2640/0xd895711d66d99b0 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.398966:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3600/0xd895711d66d99b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1525:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.398970:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3600/0xd895711d66d99b7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1525:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.398974:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3600/0xd895711d66d99b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1525:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.398977:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a3600 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330300.398979:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3600/0xd895711d66d99b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1525:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.398983:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3600/0xd895711d66d99b7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1525:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.398988:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1525:0x0].0x0 (ffff88009bbf0800) 00010000:00010000:0.0:1715330300.398990:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330300.398991:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3600/0xd895711d66d99b7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1525:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.398996:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3600/0xd895711d66d99b7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1525:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00000100:00100000:0.0:1715330300.399056:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+23:17766:x1798653938062912:12345-192.168.204.49@tcp:34:lfs.0 Request processed in 456us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330300.399063:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23552 00000100:00100000:0.0:1715330300.401255:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.401390:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938063040 00000100:00100000:2.0:1715330300.401400:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938063040 00000100:00100000:2.0:1715330300.401456:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23553 00000100:00100000:2.0:1715330300.401465:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134566300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+23:17766:x1798653938063040:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:2.0:1715330300.401486:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330300.401509:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d99be lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1525:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfba75 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.401618:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d99c5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1525:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.401632:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d99c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1525:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.401642:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d99c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1525:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00200000:2.0:1715330300.401654:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1525:0x0]: returning size 2 00010000:00010000:2.0:1715330300.401803:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d99be lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1525:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba75 expref: 26 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.401833:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d99c5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1525:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba75 expref: 25 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.401841:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1525:0x0].0x0 (ffff88009bbf0800) 00010000:00010000:2.0:1715330300.401844:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1715330300.401846:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db67840, rc 0) 00000100:00100000:2.0:1715330300.402905:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134566300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+25:17766:x1798653938063040:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 1435us (1653us total) trans 4294983554 rc 0/0 00000100:00100000:2.0:1715330300.402915:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23553 00000100:00100000:0.0:1715330300.405533:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.405614:0:17206:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938063104 00000100:00100000:2.0:1715330300.405628:0:17206:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938063104 00000100:00100000:2.0:1715330300.405966:0:17206:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5217 00000100:00100000:2.0:1715330300.405974:0:17206:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134564000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:72de1896-1df4-4b3a-930a-9116d2c66168+19:2014:x1798653938063104:12345-192.168.204.49@tcp:1:lfs.0 00010000:00010000:2.0:1715330300.406024:0:17206:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011db66ac0/0xd895711d66d99d3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.406042:0:17206:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011db64480/0xd895711d66d96d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9e9 expref: 19 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.406049:0:17206:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1715330300.406051:0:17206:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1715330300.406054:0:17206:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db66ac0/0xd895711d66d99d3 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.406086:0:17206:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011db64480/0xd895711d66d96d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9e9 expref: 19 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.406099:0:17206:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011db64480/0xd895711d66d96d8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9e9 expref: 19 pid: 17200 timeout: 374 lvb_type: 0 00000100:00100000:2.0:1715330300.406113:0:17206:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344c8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:17206:1798653942496768:192.168.204.49@tcp:104: 00000100:00100000:2.0:1715330300.406175:0:17206:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1715330300.409015:0:17206:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344c8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:17206:1798653942496768:192.168.204.49@tcp:104: 00010000:00010000:2.0:1715330300.409041:0:17206:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88011db66ac0/0xd895711d66d99d3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330300.409446:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.409908:0:9403:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938063168 00000100:00100000:2.0:1715330300.409916:0:9403:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938063168 00002000:00100000:2.0:1715330300.409970:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9cb:0x0] (0->1) req@ffff880134564e00 x1798653938063168/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:511/0 lens 496/0 e 0 to 0 dl 1715330311 ref 1 fl New:/200/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 00002000:00100000:2.0:1715330300.409978:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880134564e00 with x1798653938063168 ext(0->1) 00010000:00010000:2.0:1715330300.409986:0:9403:0:(ldlm_extent.c:692:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011db64480/0xd895711d66d96d8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9e9 expref: 20 pid: 17200 timeout: 374 lvb_type: 0 00010000:00010000:2.0:1715330300.409998:0:9403:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011db64480/0xd895711d66d96d8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9e9 expref: 20 pid: 17200 timeout: 374 lvb_type: 0 00002000:00010000:2.0:1715330300.410004:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134564e00 00000100:00100000:2.0:1715330300.410065:0:9403:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 9 00000100:00100000:3.0:1715330300.410070:0:9404:0:(service.c:3202:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1715330300.410073:0:9403:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134564e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+20:2012:x1798653938063168:12345-192.168.204.49@tcp:4:bash.0 00000100:00100000:3.0:1715330300.410080:0:9404:0:(service.c:3261:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1715330300.410884:0:9403:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134564e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+22:2012:x1798653938063168:12345-192.168.204.49@tcp:4:bash.0 Request processed in 806us (1434us total) trans 4294969892 rc 0/0 00000100:00100000:3.0:1715330300.410900:0:9403:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 9 00002000:00100000:3.0:1715330300.410908:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9cb:0x0] (0->1) req@ffff880134564e00 x1798653938063168/t4294969892(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:511/0 lens 496/448 e 0 to 0 dl 1715330311 ref 1 fl Complete:H/200/0 rc 0/0 job:'bash.0' uid:0 gid:0 00002000:00100000:3.0:1715330300.410917:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880134564e00 with x1798653938063168 ext(0->1) 00010000:00010000:3.0:1715330300.410923:0:9403:0:(ldlm_extent.c:692:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011db64480/0xd895711d66d96d8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9e9 expref: 22 pid: 17200 timeout: 374 lvb_type: 0 00010000:00010000:3.0:1715330300.410934:0:9403:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011db64480/0xd895711d66d96d8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9e9 expref: 22 pid: 17200 timeout: 374 lvb_type: 0 00002000:00010000:3.0:1715330300.410940:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134564e00 00000100:00100000:1.0:1715330300.413848:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.414013:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938063232 00000100:00100000:2.0:1715330300.414023:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938063232 00010000:00010000:2.0:1715330300.414067:0:7121:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011db64480/0xd895711d66d96d8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9e9 expref: 22 pid: 17200 timeout: 374 lvb_type: 0 00000100:00100000:2.0:1715330300.414273:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1566 00000100:00100000:2.0:1715330300.414281:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+22:2013:x1798653938063232:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1715330300.414303:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1715330300.414321:0:7121:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0x9cb:0x0] updating lvb size from disk: 0 -> 2 00002000:00010000:2.0:1715330300.414324:0:7121:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x9cb:0x0] updating lvb mtime from disk: 0 -> 1715330300 00002000:00010000:2.0:1715330300.414326:0:7121:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0x9cb:0x0] updating lvb ctime from disk: 0 -> 1715330300 00002000:00010000:2.0:1715330300.414329:0:7121:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0x9cb:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1715330300.414333:0:7121:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011db64480/0xd895711d66d96d8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9e9 expref: 22 pid: 17200 timeout: 374 lvb_type: 0 00010000:00010000:2.0:1715330300.414347:0:7121:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011db64480/0xd895711d66d96d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9e9 expref: 22 pid: 17200 timeout: 374 lvb_type: 0 00010000:00010000:2.0:1715330300.414377:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011db64480/0xd895711d66d96d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9e9 expref: 22 pid: 17200 timeout: 374 lvb_type: 0 00010000:00010000:2.0:1715330300.414409:0:7121:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330300.414412:0:7121:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330300.414416:0:7121:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011db66ac0/0xd895711d66d99d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.414426:0:7121:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db66ac0/0xd895711d66d99d3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.414451:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330300.414459:0:17206:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88011db66ac0/0xd895711d66d99d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.414467:0:17206:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011db66ac0/0xd895711d66d99d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.414483:0:17206:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011db66ac0/0xd895711d66d99d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.414489:0:17206:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88011db66ac0/0xd895711d66d99d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.414497:0:17206:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88011db66ac0/0xd895711d66d99d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.414503:0:17206:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66ac0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330300.414507:0:17206:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88011db66ac0/0xd895711d66d99d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.414515:0:17206:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88011db66ac0/0xd895711d66d99d3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.414528:0:17206:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88011db66ac0/0xd895711d66d99d3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.414533:0:17206:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011db66ac0/0xd895711d66d99d3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330300.414863:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+21:2013:x1798653938063232:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 581us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.414871:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1566 00000100:00100000:3.0:1715330300.415073:0:17206:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134564000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:72de1896-1df4-4b3a-930a-9116d2c66168+20:2014:x1798653938063104:12345-192.168.204.49@tcp:1:lfs.0 Request processed in 9096us (9546us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.415180:0:17206:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5217 00000100:00100000:0.0:1715330300.418128:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330300.418219:0:7148:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938063360 00000100:00100000:3.0:1715330300.418229:0:7148:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938063360 00000100:00100000:3.0:1715330300.418384:0:7148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 11 00000100:00100000:3.0:1715330300.418391:0:7148:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:72de1896-1df4-4b3a-930a-9116d2c66168+25:17766:x1798653938063360:12345-192.168.204.49@tcp:36:lfs.0 00010000:00010000:3.0:1715330300.418446:0:7148:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330300.418475:0:7148:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3cc0/0xd895711d66d96ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1525:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9e2 expref: 25 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.418492:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1525:0x0].0x0 (ffff88009bbf0800) 00010000:00010000:3.0:1715330300.418496:0:7148:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330300.418520:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d99da lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.418532:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d99da lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.418541:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d99da lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00000100:00100000:3.0:1715330300.418606:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48d880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942496832:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.418655:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.419271:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496f900 going to sleep for 11 seconds 00000100:00100000:0.0:1715330300.419397:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942496832 00000100:00100000:0.0:1715330300.419401:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942496832 00000100:00100000:0.0:1715330300.419473:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2959 00000100:00100000:0.0:1715330300.419479:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+11:7148:x1798653942496832:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1715330300.419855:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+11:7148:x1798653942496832:12345-0@lo:1000:mdt_io00_002.0 Request processed in 375us (1197us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330300.419862:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2959 00000100:00100000:3.0:1715330300.419944:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48d880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942496832:0@lo:1000:mdt_io00_002.0 00000004:00080000:3.0:1715330300.419973:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x193:0x0] 00000100:00100000:3.0:1715330300.419994:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4ca80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942496896:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.420010:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.420018:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496f900 going to sleep for 11 seconds 00000100:00100000:0.0:1715330300.420058:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942496896 00000100:00100000:0.0:1715330300.420060:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942496896 00000100:00100000:0.0:1715330300.420109:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2960 00000100:00100000:0.0:1715330300.420112:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+11:7148:x1798653942496896:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1715330300.420170:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+11:7148:x1798653942496896:12345-0@lo:1000:mdt_io00_002.0 Request processed in 56us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330300.420175:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2960 00000100:00100000:3.0:1715330300.420350:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4ca80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942496896:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.420829:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4ca80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942496960:0@lo:403:mdt_io00_002.0 00000100:00100000:3.0:1715330300.420854:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.420868:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715330300.421460:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942496960 00000100:00100000:2.0:1715330300.421465:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942496960 00000100:00100000:2.0:1715330300.421534:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2961 00000100:00100000:2.0:1715330300.421540:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+11:7148:x1798653942496960:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1715330300.423226:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+11:7148:x1798653942496960:12345-0@lo:403:mdt_io00_002.0 Request processed in 1681us (2366us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.423238:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2961 00000100:00100000:3.0:1715330300.423476:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4ca80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942496960:0@lo:403:mdt_io00_002.0 00010000:00010000:3.0:1715330300.424174:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e880/0xd895711d66d99e1 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.424183:0:7148:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e880/0xd895711d66d99e1 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.424192:0:7148:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e880/0xd895711d66d99e1 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7148 initiator: MDT0 00000100:00100000:3.0:1715330300.424210:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4ca80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942497024:0@lo:101:mdt_io00_002.0 00000100:00100000:3.0:1715330300.424244:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.425680:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330300.425717:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942497024 00000100:00100000:1.0:1715330300.425725:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942497024 00000100:00100000:1.0:1715330300.425873:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2962 00000100:00100000:1.0:1715330300.425881:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+11:7148:x1798653942497024:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1715330300.425902:0:19960:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330300.425923:0:19960:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d99e8 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d99e1 expref: -99 pid: 19960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.425952:0:19960:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d99e8 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d99e1 expref: 12 pid: 19960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.425966:0:19960:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d99e8 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d99e1 expref: 12 pid: 19960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.425975:0:19960:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff88008d4e1f00) 00010000:00010000:1.0:1715330300.425979:0:19960:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330300.425982:0:19960:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfcfc0, rc 0) 00000100:00100000:1.0:1715330300.426023:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+12:7148:x1798653942497024:12345-0@lo:101:mdt_io00_002.0 Request processed in 143us (1779us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330300.426029:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2962 00000100:00100000:3.0:1715330300.426107:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4ca80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942497024:0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1715330300.426121:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e880/0xd895711d66d99e1 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d99e8 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.426130:0:7148:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e880/0xd895711d66d99e1 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d99e8 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330300.426147:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00010000:00010000:3.0:1715330300.426167:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c000/0xd895711d66d99ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.426173:0:7148:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c000/0xd895711d66d99ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.426181:0:7148:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c000/0xd895711d66d99ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7148 initiator: MDT0 00000100:00100000:3.0:1715330300.426193:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4ca80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942497088:0@lo:101:mdt_io00_002.0 00000100:00100000:3.0:1715330300.426218:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.427422:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330300.427499:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942497088 00000100:00100000:0.0:1715330300.427505:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942497088 00000100:00100000:0.0:1715330300.428104:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2963 00000100:00100000:0.0:1715330300.428111:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:7148:x1798653942497088:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:0.0:1715330300.428126:0:7138:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330300.428145:0:7138:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a3600/0xd895711d66d99f6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d99ef expref: -99 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.428168:0:7138:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a3600/0xd895711d66d99f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d99ef expref: 13 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.428180:0:7138:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a3600/0xd895711d66d99f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d99ef expref: 13 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.428187:0:7138:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x31 (ffff88008b233000) 00010000:00010000:0.0:1715330300.428190:0:7138:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330300.428192:0:7138:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a3600, rc 0) 00000100:00100000:0.0:1715330300.428328:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+13:7148:x1798653942497088:12345-0@lo:101:mdt_io00_002.0 Request processed in 217us (2108us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330300.428334:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2963 00000100:00100000:3.0:1715330300.428401:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4ca80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942497088:0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1715330300.428415:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c000/0xd895711d66d99ef lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d99f6 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.428424:0:7148:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c000/0xd895711d66d99ef lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d99f6 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330300.428440:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00010000:00010000:3.0:1715330300.428457:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d99fd lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.428464:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d99fd lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.428470:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d99fd lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.428478:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cfc0/0xd895711d66d9a04 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.428482:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cfc0/0xd895711d66d9a04 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.428486:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cfc0/0xd895711d66d9a04 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.428526:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d9a0b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1525:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.428535:0:7148:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d99c5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1525:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba75 expref: 24 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.428541:0:7148:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d9a0b lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1525:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.428564:0:7148:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d99c5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1525:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba75 expref: 24 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.428577:0:7148:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d99c5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1525:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba75 expref: 24 pid: 7135 timeout: 374 lvb_type: 0 00000100:00100000:3.0:1715330300.428589:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4ca80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:7148:1798653942497152:192.168.204.49@tcp:104: 00000100:00100000:3.0:1715330300.428638:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496f6c0 going to sleep for 11 seconds 00010000:00010000:3.0:1715330300.432696:0:7148:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.204.49@tcp) returned -22 from blocking AST (req@ffff88012fa4ca80 x1798653942497152) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d99c5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1525:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba75 expref: 24 pid: 7135 timeout: 374 lvb_type: 0 00010000:00010000:3.0:1715330300.432724:0:7148:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d99c5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1525:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba75 expref: 24 pid: 7135 timeout: 374 lvb_type: 0 00010000:00010000:3.0:1715330300.432800:0:7148:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d99c5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1525:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba75 expref: 24 pid: 7135 timeout: 374 lvb_type: 0 00000100:00100000:3.0:1715330300.432829:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4ca80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:7148:1798653942497152:192.168.204.49@tcp:104: 00010000:00010000:3.0:1715330300.432853:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1525:0x0].0x0 (ffff88009bbf0800) 00010000:00010000:3.0:1715330300.432860:0:7148:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d9a0b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1525:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.432871:0:7148:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d9a0b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1525:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.432880:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d9a0b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1525:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.432899:0:7148:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d9a0b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1525:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.432907:0:7148:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d9a0b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1525:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.432912:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d9a0b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1525:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00000100:00100000:3.0:1715330300.433084:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4ca80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942497216:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.433155:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.433185:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496f900 going to sleep for 11 seconds 00000100:00100000:1.0:1715330300.433364:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942497216 00000100:00100000:1.0:1715330300.433371:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942497216 00000100:00100000:1.0:1715330300.433412:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2964 00000100:00100000:1.0:1715330300.433418:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093980000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+13:7148:x1798653942497216:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1715330300.433885:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093980000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+13:7148:x1798653942497216:12345-0@lo:1000:mdt_io00_002.0 Request processed in 465us (729us total) trans 0 rc -2/-2 00000100:00100000:1.0:1715330300.433893:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2964 00000100:00100000:3.0:1715330300.434186:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4ca80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942497216:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.434229:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093980380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942497280:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.434250:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.434834:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496f900 going to sleep for 11 seconds 00000100:00100000:1.0:1715330300.434976:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942497280 00000100:00100000:1.0:1715330300.434982:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942497280 00000100:00100000:1.0:1715330300.435021:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2965 00000100:00100000:1.0:1715330300.435027:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093980700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+13:7148:x1798653942497280:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1715330300.435392:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093980700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+13:7148:x1798653942497280:12345-0@lo:1000:mdt_io00_002.0 Request processed in 363us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330300.435400:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2965 00000100:00100000:3.0:1715330300.435474:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093980380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942497280:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.435602:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093980380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942497344:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.435633:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.435653:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496f900 going to sleep for 11 seconds 00000100:00100000:1.0:1715330300.435844:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942497344 00000100:00100000:1.0:1715330300.435847:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942497344 00000100:00100000:1.0:1715330300.435904:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2966 00000100:00100000:1.0:1715330300.435909:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc14450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+13:7148:x1798653942497344:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1715330300.436037:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc14450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+13:7148:x1798653942497344:12345-0@lo:1000:mdt_io00_002.0 Request processed in 127us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330300.436043:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2966 00000100:00100000:3.0:1715330300.436309:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093980380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942497344:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.436402:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093980380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942497408:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.436425:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.436443:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330300.436472:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942497408 00000100:00100000:1.0:1715330300.436475:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942497408 00000100:00100000:1.0:1715330300.436518:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2967 00000100:00100000:1.0:1715330300.436522:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093980a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+10:7148:x1798653942497408:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1715330300.437245:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093980a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+10:7148:x1798653942497408:12345-0@lo:1000:mdt_io00_002.0 Request processed in 720us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330300.437252:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2967 00000100:00100000:3.0:1715330300.437353:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093980380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942497408:0@lo:1000:mdt_io00_002.0 00000040:00080000:3.0:1715330300.437775:0:7148:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].382, 1264 off574640 00000040:00080000:3.0:1715330300.437822:0:7148:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].381, 1344 off619032 00000100:00100000:3.0:1715330300.437843:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093980380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942497472:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.437870:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.437881:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496f540 going to sleep for 11 seconds 00000100:00100000:1.0:1715330300.437926:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942497472 00000100:00100000:1.0:1715330300.437930:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942497472 00000100:00100000:1.0:1715330300.437948:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2968 00000100:00100000:1.0:1715330300.437952:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093980e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+10:7148:x1798653942497472:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1715330300.438029:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093980e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+11:7148:x1798653942497472:12345-0@lo:1000:mdt_io00_002.0 Request processed in 76us (157us total) trans 4294969893 rc 0/0 00000100:00100000:1.0:1715330300.438034:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2968 00000100:00100000:3.0:1715330300.438239:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093980380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942497472:0@lo:1000:mdt_io00_002.0 00000004:00080000:3.0:1715330300.438246:0:7148:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8800b496f840 with version 726 00000004:00080000:1.0:1715330300.438316:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 726 rpc_version 726 00000020:00100000:1.0:1715330300.438336:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1715330300.438342:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88009b5eca80 x1798653942497600/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3088/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1715330300.438357:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5eca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942497600:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330300.438383:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330300.438754:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4b2f900 going to sleep for 11 seconds 00000100:00100000:0.0:1715330300.438882:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942497600 00000100:00100000:0.0:1715330300.438887:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942497600 00000100:00100000:0.0:1715330300.438912:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2969 00000100:00100000:0.0:1715330300.438916:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7ec1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+13:8587:x1798653942497600:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330300.439485:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7ec1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+14:8587:x1798653942497600:12345-0@lo:1000:osp_up1-0.0 Request processed in 566us (1099us total) trans 4294968467 rc 0/0 00000100:00100000:0.0:1715330300.439491:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2969 00000100:00100000:2.0:1715330300.439559:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5eca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942497600:0@lo:1000:osp_up1-0.0 00000004:00010000:3.0:1715330300.439587:0:7148:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880091e98000 reply state ffff8800938e2000 transno 4294983555 ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d9a0b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1525:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.439605:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d9a0b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1525:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.439613:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1525:0x0].0x0 (ffff88009bbf0800) 00010000:00010000:3.0:1715330300.439616:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:3.0:1715330300.439620:0:7148:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330300.439629:0:7148:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d99fd lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.439635:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d99fd lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.439639:0:7148:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d99fd lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.439645:0:7148:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d99fd lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.439652:0:7148:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457e1c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330300.439656:0:7148:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d99fd lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.439663:0:7148:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d99fd lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.439673:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff88011d537600) 00010000:00010000:3.0:1715330300.439676:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330300.439679:0:7148:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d99fd lrc: 3/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.439684:0:7148:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d99fd lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00000004:00010000:3.0:1715330300.439703:0:7148:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880091e98000 reply state ffff8800938e2000 transno 4294983555 ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cfc0/0xd895711d66d9a04 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.439708:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cfc0/0xd895711d66d9a04 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.439713:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x31 (ffff88011d537400) 00010000:00010000:3.0:1715330300.439715:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330300.439716:0:7148:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00080000:3.0:1715330300.439720:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00010000:00010000:3.0:1715330300.439726:0:7148:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e880/0xd895711d66d99e1 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d99e8 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.439751:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e880/0xd895711d66d99e1 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d99e8 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.439757:0:7148:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e880/0xd895711d66d99e1 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d99e8 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.439774:0:7148:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1715330300.439778:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00010000:00010000:3.0:1715330300.439782:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c000/0xd895711d66d99ef lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d99f6 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.439789:0:7148:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c000/0xd895711d66d99ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d99f6 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330300.439860:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x193:0x0] 00010000:00010000:3.0:1715330300.439867:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d99da lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.439871:0:7148:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d99da lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.439875:0:7148:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d99da lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.439879:0:7148:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457ef40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330300.439881:0:7148:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d99da lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.439885:0:7148:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d99da lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.439891:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff88007d600500) 00010000:00010000:3.0:1715330300.439893:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330300.439895:0:7148:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d99da lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.439898:0:7148:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d99da lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00000100:00100000:3.0:1715330300.440012:0:7148:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:72de1896-1df4-4b3a-930a-9116d2c66168+25:17766:x1798653938063360:12345-192.168.204.49@tcp:36:lfs.0 Request processed in 21618us (21889us total) trans 4294983555 rc 0/0 00000100:00100000:3.0:1715330300.440019:0:7148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 11 00010000:00010000:0.0:1715330300.440092:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715330300.440099:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e880/0xd895711d66d99e1 lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d99e8 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.440105:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457e880 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330300.440108:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e880/0xd895711d66d99e1 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d99e8 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330300.440114:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e880/0xd895711d66d99e1 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d99e8 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.440139:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e880/0xd895711d66d99e1 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d99e8 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.440148:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330300.440168:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e880/0xd895711d66d99e1 lrc: 1/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d99e8 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.440174:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e880/0xd895711d66d99e1 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d99e8 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.440193:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330300.440195:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330300.440196:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330300.440201:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091e98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942497664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1715330300.440232:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330300.440489:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942497664 00000100:00100000:2.0:1715330300.440496:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942497664 00000100:00100000:2.0:1715330300.440540:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1398 00000100:00100000:2.0:1715330300.440546:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093981180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+14:3688:x1798653942497664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715330300.440559:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330300.440576:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d99e8 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d99e1 expref: 14 pid: 19960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.440593:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff88008d4e1f00) 00010000:00010000:2.0:1715330300.440601:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330300.440640:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093981180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+13:3688:x1798653942497664:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.440647:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1398 00000100:00100000:3.0:1715330300.440671:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091e98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942497664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330300.442652:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.442778:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938063424 00000100:00100000:2.0:1715330300.442785:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938063424 00000100:00100000:2.0:1715330300.442835:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23554 00000100:00100000:2.0:1715330300.442841:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+25:17766:x1798653938063424:12345-192.168.204.49@tcp:34:lfs.0 00010000:00010000:2.0:1715330300.442919:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d9a12 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.442934:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d9a12 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.442944:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d9a12 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.442960:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d9a19 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.442966:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d9a19 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.442971:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d9a19 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.443021:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9a20 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1526:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.443028:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9a20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1526:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.443034:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9a20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1526:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00010000:2.0:1715330300.443072:0:7135:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9a20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1526:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.443083:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d9a12 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.443088:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d9a12 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.443093:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d9a12 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.443098:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d9a12 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.443103:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64480 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.443107:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d9a12 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.443113:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d9a12 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.443122:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff8800b4207500) 00010000:00010000:2.0:1715330300.443125:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.443127:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d9a12 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.443132:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d9a12 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.443149:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d9a19 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.443153:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d9a19 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.443158:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d9a19 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.443162:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64000 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.443164:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d9a19 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.443168:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d9a19 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.443173:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x35 (ffff8800b4207200) 00010000:00010000:2.0:1715330300.443175:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.443176:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d9a19 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.443185:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d9a19 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.443193:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9a20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1526:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.443197:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9a20 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1526:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.443201:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9a20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1526:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.443204:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64900 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.443206:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9a20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1526:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.443561:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9a20 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1526:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.443570:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1526:0x0].0x0 (ffff88008d5eee00) 00010000:00010000:2.0:1715330300.443572:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.443575:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9a20 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1526:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.443579:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9a20 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1526:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00000100:00100000:2.0:1715330300.443636:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+25:17766:x1798653938063424:12345-192.168.204.49@tcp:34:lfs.0 Request processed in 793us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.443643:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23554 00000100:00100000:0.0:1715330300.447086:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.447181:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938063552 00000100:00100000:2.0:1715330300.447191:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938063552 00000100:00100000:2.0:1715330300.447248:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23555 00000100:00100000:2.0:1715330300.447256:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+25:17766:x1798653938063552:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:2.0:1715330300.447277:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330300.447309:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d9a27 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1526:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfba7c expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.447415:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d9a2e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1526:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.447428:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d9a2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1526:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.447439:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d9a2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1526:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00200000:2.0:1715330300.447449:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1526:0x0]: returning size 2 00010000:00010000:2.0:1715330300.447544:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66d9a27 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1526:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba7c expref: 28 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.447562:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d9a2e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1526:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba7c expref: 27 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.447569:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1526:0x0].0x0 (ffff88008d5eee00) 00010000:00010000:2.0:1715330300.447572:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1715330300.447574:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db67840, rc 0) 00000100:00100000:2.0:1715330300.447634:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+27:17766:x1798653938063552:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 377us (557us total) trans 4294983556 rc 0/0 00000100:00100000:2.0:1715330300.447640:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23555 00000100:00100000:1.0:1715330300.450216:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330300.450279:0:17206:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938063616 00000100:00100000:3.0:1715330300.450298:0:17206:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938063616 00000100:00100000:3.0:1715330300.450350:0:17206:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5218 00000100:00100000:3.0:1715330300.450358:0:17206:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:72de1896-1df4-4b3a-930a-9116d2c66168+19:2012:x1798653938063616:12345-192.168.204.49@tcp:1:lfs.0 00010000:00010000:3.0:1715330300.450407:0:17206:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88013457e640/0xd895711d66d9a3c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.450424:0:17206:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011db661c0/0xd895711d66d9702 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9f7 expref: 19 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.450432:0:17206:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1715330300.450434:0:17206:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1715330300.450437:0:17206:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013457e640/0xd895711d66d9a3c lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.450472:0:17206:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011db661c0/0xd895711d66d9702 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9f7 expref: 19 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.450488:0:17206:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011db661c0/0xd895711d66d9702 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9f7 expref: 19 pid: 17200 timeout: 374 lvb_type: 0 00000100:00100000:3.0:1715330300.450506:0:17206:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093981500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:17206:1798653942497728:192.168.204.49@tcp:104: 00000100:00100000:3.0:1715330300.450576:0:17206:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496f540 going to sleep for 11 seconds 00000100:00100000:3.0:1715330300.453121:0:17206:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093981500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:17206:1798653942497728:192.168.204.49@tcp:104: 00010000:00010000:3.0:1715330300.453155:0:17206:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88013457e640/0xd895711d66d9a3c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330300.453473:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330300.453537:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938063680 00000100:00100000:0.0:1715330300.453544:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938063680 00002000:00100000:0.0:1715330300.453589:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9cc:0x0] (0->1) req@ffff88008d774380 x1798653938063680/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:511/0 lens 496/0 e 0 to 0 dl 1715330311 ref 1 fl New:/200/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 00002000:00100000:0.0:1715330300.453598:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d774380 with x1798653938063680 ext(0->1) 00010000:00010000:0.0:1715330300.453605:0:27574:0:(ldlm_extent.c:692:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011db661c0/0xd895711d66d9702 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9f7 expref: 20 pid: 17200 timeout: 374 lvb_type: 0 00010000:00010000:0.0:1715330300.453616:0:27574:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011db661c0/0xd895711d66d9702 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9f7 expref: 20 pid: 17200 timeout: 374 lvb_type: 0 00002000:00010000:0.0:1715330300.453622:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008d774380 00000100:00100000:3.0:1715330300.453814:0:9403:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 10 00000100:00100000:3.0:1715330300.453821:0:9403:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d774380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+20:2011:x1798653938063680:12345-192.168.204.49@tcp:4:bash.0 00000100:00100000:3.0:1715330300.454496:0:9403:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d774380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+22:2011:x1798653938063680:12345-192.168.204.49@tcp:4:bash.0 Request processed in 672us (1023us total) trans 4294969889 rc 0/0 00000100:00100000:3.0:1715330300.454504:0:9403:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 10 00002000:00100000:3.0:1715330300.454510:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9cc:0x0] (0->1) req@ffff88008d774380 x1798653938063680/t4294969889(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:511/0 lens 496/448 e 0 to 0 dl 1715330311 ref 1 fl Complete:H/200/0 rc 0/0 job:'bash.0' uid:0 gid:0 00002000:00100000:3.0:1715330300.454517:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d774380 with x1798653938063680 ext(0->1) 00010000:00010000:3.0:1715330300.454522:0:9403:0:(ldlm_extent.c:692:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011db661c0/0xd895711d66d9702 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9f7 expref: 22 pid: 17200 timeout: 374 lvb_type: 0 00010000:00010000:3.0:1715330300.454532:0:9403:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011db661c0/0xd895711d66d9702 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9f7 expref: 22 pid: 17200 timeout: 374 lvb_type: 0 00002000:00010000:3.0:1715330300.454537:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008d774380 00000100:00100000:0.0:1715330300.456489:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.456581:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938063744 00000100:00100000:2.0:1715330300.456591:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938063744 00010000:00010000:2.0:1715330300.456630:0:7121:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011db661c0/0xd895711d66d9702 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9f7 expref: 22 pid: 17200 timeout: 374 lvb_type: 0 00000100:00100000:2.0:1715330300.456656:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1567 00000100:00100000:2.0:1715330300.456663:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e98e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+22:2011:x1798653938063744:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1715330300.456677:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1715330300.456692:0:7121:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x9cc:0x0] updating lvb size from disk: 0 -> 2 00002000:00010000:2.0:1715330300.456695:0:7121:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x9cc:0x0] updating lvb mtime from disk: 0 -> 1715330300 00002000:00010000:2.0:1715330300.456697:0:7121:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000401:0x9cc:0x0] updating lvb ctime from disk: 0 -> 1715330300 00002000:00010000:2.0:1715330300.456699:0:7121:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000401:0x9cc:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1715330300.456703:0:7121:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011db661c0/0xd895711d66d9702 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9f7 expref: 22 pid: 17200 timeout: 374 lvb_type: 0 00010000:00010000:2.0:1715330300.456714:0:7121:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011db661c0/0xd895711d66d9702 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9f7 expref: 22 pid: 17200 timeout: 374 lvb_type: 0 00010000:00010000:2.0:1715330300.456770:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011db661c0/0xd895711d66d9702 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9f7 expref: 22 pid: 17200 timeout: 374 lvb_type: 0 00010000:00010000:2.0:1715330300.457006:0:7121:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330300.457009:0:7121:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330300.457015:0:7121:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013457e640/0xd895711d66d9a3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.457025:0:7121:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013457e640/0xd895711d66d9a3c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.457274:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715330300.457398:0:17206:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88013457e640/0xd895711d66d9a3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.457411:0:17206:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013457e640/0xd895711d66d9a3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.457429:0:17206:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88013457e640/0xd895711d66d9a3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.457436:0:17206:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88013457e640/0xd895711d66d9a3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.457443:0:17206:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88013457e640/0xd895711d66d9a3c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.457449:0:17206:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457e640 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330300.457453:0:17206:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88013457e640/0xd895711d66d9a3c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.457461:0:17206:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88013457e640/0xd895711d66d9a3c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.457474:0:17206:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88013457e640/0xd895711d66d9a3c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.457479:0:17206:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013457e640/0xd895711d66d9a3c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330300.457516:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e98e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+21:2011:x1798653938063744:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 851us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.457522:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1567 00000100:00100000:0.0:1715330300.458054:0:17206:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:72de1896-1df4-4b3a-930a-9116d2c66168+20:2012:x1798653938063616:12345-192.168.204.49@tcp:1:lfs.0 Request processed in 7696us (7844us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330300.458064:0:17206:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5218 00000100:00100000:0.0:1715330300.460477:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330300.460824:0:7148:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938063872 00000100:00100000:3.0:1715330300.460834:0:7148:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938063872 00000100:00100000:3.0:1715330300.461383:0:7148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 12 00000100:00100000:3.0:1715330300.461391:0:7148:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:72de1896-1df4-4b3a-930a-9116d2c66168+27:17766:x1798653938063872:12345-192.168.204.49@tcp:36:lfs.0 00010000:00010000:3.0:1715330300.461451:0:7148:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330300.461482:0:7148:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d96f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1526:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9f0 expref: 27 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.461517:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1526:0x0].0x0 (ffff88008d5eee00) 00010000:00010000:3.0:1715330300.461522:0:7148:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330300.461549:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d9a43 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.461560:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d9a43 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.461568:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d9a43 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00000100:00100000:3.0:1715330300.461633:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093981500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942497792:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.461691:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.461709:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496f540 going to sleep for 11 seconds 00000100:00100000:0.0:1715330300.461783:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942497792 00000100:00100000:0.0:1715330300.461788:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942497792 00000100:00100000:0.0:1715330300.461835:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2970 00000100:00100000:0.0:1715330300.461840:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093981880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+13:7148:x1798653942497792:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1715330300.462162:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093981880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+13:7148:x1798653942497792:12345-0@lo:1000:mdt_io00_002.0 Request processed in 320us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330300.462168:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2970 00000100:00100000:3.0:1715330300.462246:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093981500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942497792:0@lo:1000:mdt_io00_002.0 00000004:00080000:3.0:1715330300.462277:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x193:0x0] 00000100:00100000:3.0:1715330300.462306:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093981500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942497856:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.462323:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.462330:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496f540 going to sleep for 11 seconds 00000100:00100000:0.0:1715330300.462386:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942497856 00000100:00100000:0.0:1715330300.462389:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942497856 00000100:00100000:0.0:1715330300.462409:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2971 00000100:00100000:0.0:1715330300.462414:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093981c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+13:7148:x1798653942497856:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1715330300.462462:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093981c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+13:7148:x1798653942497856:12345-0@lo:1000:mdt_io00_002.0 Request processed in 48us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330300.462468:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2971 00000100:00100000:3.0:1715330300.462509:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093981500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942497856:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.463025:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093981500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942497920:0@lo:403:mdt_io00_002.0 00000100:00100000:3.0:1715330300.463053:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.463524:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496f180 going to sleep for 11 seconds 00000100:00100000:1.0:1715330300.463619:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942497920 00000100:00100000:1.0:1715330300.463624:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942497920 00000100:00100000:1.0:1715330300.463693:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2972 00000100:00100000:1.0:1715330300.463698:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+13:7148:x1798653942497920:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:1.0:1715330300.465379:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+13:7148:x1798653942497920:12345-0@lo:403:mdt_io00_002.0 Request processed in 1673us (2318us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330300.465389:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2972 00000100:00100000:3.0:1715330300.465543:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093981500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942497920:0@lo:403:mdt_io00_002.0 00010000:00010000:3.0:1715330300.466252:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f3c0/0xd895711d66d9a4a lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.466470:0:7148:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f3c0/0xd895711d66d9a4a lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.466481:0:7148:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f3c0/0xd895711d66d9a4a lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7148 initiator: MDT0 00000100:00100000:3.0:1715330300.466501:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093981500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942497984:0@lo:101:mdt_io00_002.0 00000100:00100000:3.0:1715330300.466540:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.466567:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496f180 going to sleep for 11 seconds 00000100:00100000:1.0:1715330300.466623:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942497984 00000100:00100000:1.0:1715330300.466630:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942497984 00000100:00100000:1.0:1715330300.466673:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2973 00000100:00100000:1.0:1715330300.466679:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093982300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+13:7148:x1798653942497984:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1715330300.466698:0:7138:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330300.466717:0:7138:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d9a51 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d9a4a expref: -99 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.466757:0:7138:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d9a51 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d9a4a expref: 14 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.466768:0:7138:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d9a51 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9a4a expref: 14 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.466774:0:7138:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff88008d4e1c00) 00010000:00010000:1.0:1715330300.466777:0:7138:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330300.466780:0:7138:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bff3c0, rc 0) 00000100:00100000:1.0:1715330300.466801:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093982300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+14:7148:x1798653942497984:12345-0@lo:101:mdt_io00_002.0 Request processed in 122us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330300.466807:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2973 00000100:00100000:3.0:1715330300.466910:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093981500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942497984:0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1715330300.466921:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f3c0/0xd895711d66d9a4a lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9a51 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.466930:0:7148:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f3c0/0xd895711d66d9a4a lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9a51 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330300.466942:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00010000:00010000:3.0:1715330300.466955:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f600/0xd895711d66d9a58 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.466960:0:7148:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f600/0xd895711d66d9a58 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.466965:0:7148:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f600/0xd895711d66d9a58 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7148 initiator: MDT0 00000100:00100000:3.0:1715330300.466972:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093981500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942498048:0@lo:101:mdt_io00_002.0 00000100:00100000:3.0:1715330300.466990:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.467007:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496f180 going to sleep for 11 seconds 00000100:00100000:2.0:1715330300.467044:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942498048 00000100:00100000:2.0:1715330300.467047:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942498048 00000100:00100000:2.0:1715330300.467063:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2974 00000100:00100000:2.0:1715330300.467067:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093982680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+14:7148:x1798653942498048:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:2.0:1715330300.467074:0:19960:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330300.467085:0:19960:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64fc0/0xd895711d66d9a5f lrc: 2/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d9a58 expref: -99 pid: 19960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.467096:0:19960:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64fc0/0xd895711d66d9a5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d9a58 expref: 15 pid: 19960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.467104:0:19960:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64fc0/0xd895711d66d9a5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9a58 expref: 15 pid: 19960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.467109:0:19960:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x35 (ffff8800b4207500) 00010000:00010000:2.0:1715330300.467111:0:19960:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.467113:0:19960:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db64fc0, rc 0) 00000100:00100000:2.0:1715330300.467133:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093982680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+15:7148:x1798653942498048:12345-0@lo:101:mdt_io00_002.0 Request processed in 66us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.467137:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2974 00000100:00100000:3.0:1715330300.467203:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093981500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942498048:0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1715330300.467211:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f600/0xd895711d66d9a58 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9a5f expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.467217:0:7148:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f600/0xd895711d66d9a58 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9a5f expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330300.467226:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00010000:00010000:3.0:1715330300.467239:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d9a66 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.467245:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d9a66 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.467252:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d9a66 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.467263:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d9a6d lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.467268:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d9a6d lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.467273:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d9a6d lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.467317:0:7148:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d9a74 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1526:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.467329:0:7148:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d9a2e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1526:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba7c expref: 26 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.467341:0:7148:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d9a74 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1526:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.467364:0:7148:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d9a2e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1526:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba7c expref: 26 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.467378:0:7148:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d9a2e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1526:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba7c expref: 26 pid: 7135 timeout: 374 lvb_type: 0 00000100:00100000:3.0:1715330300.467390:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093981500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:7148:1798653942498112:192.168.204.49@tcp:104: 00000100:00100000:3.0:1715330300.467437:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496f180 going to sleep for 11 seconds 00010000:00010000:3.0:1715330300.469955:0:7148:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.204.49@tcp) returned -22 from blocking AST (req@ffff880093981500 x1798653942498112) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d9a2e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1526:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba7c expref: 26 pid: 7135 timeout: 374 lvb_type: 0 00010000:00010000:3.0:1715330300.469977:0:7148:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d9a2e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1526:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba7c expref: 26 pid: 7135 timeout: 374 lvb_type: 0 00010000:00010000:3.0:1715330300.470004:0:7148:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d9a2e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1526:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba7c expref: 26 pid: 7135 timeout: 374 lvb_type: 0 00000100:00100000:3.0:1715330300.470066:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093981500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:7148:1798653942498112:192.168.204.49@tcp:104: 00010000:00010000:3.0:1715330300.470090:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1526:0x0].0x0 (ffff88008d5eee00) 00010000:00010000:3.0:1715330300.470096:0:7148:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d9a74 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1526:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.470104:0:7148:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d9a74 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1526:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.470115:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d9a74 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1526:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.470133:0:7148:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d9a74 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1526:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.470141:0:7148:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d9a74 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1526:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.470146:0:7148:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d9a74 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1526:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00000100:00100000:3.0:1715330300.470311:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093981500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942498176:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.470362:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.470385:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496f540 going to sleep for 11 seconds 00000100:00100000:1.0:1715330300.470424:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942498176 00000100:00100000:1.0:1715330300.470431:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942498176 00000100:00100000:1.0:1715330300.470482:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2975 00000100:00100000:1.0:1715330300.470490:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+15:7148:x1798653942498176:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1715330300.470621:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+15:7148:x1798653942498176:12345-0@lo:1000:mdt_io00_002.0 Request processed in 131us (258us total) trans 0 rc -2/-2 00000100:00100000:1.0:1715330300.470628:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2975 00000100:00100000:3.0:1715330300.470765:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093981500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942498176:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330300.470855:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344c8000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942498240:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330300.470893:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330300.470915:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1715330300.470939:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942498240 00000100:00100000:0.0:1715330300.470943:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942498240 00000100:00100000:0.0:1715330300.470968:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2976 00000100:00100000:0.0:1715330300.470973:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+15:7148:x1798653942498240:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1715330300.471038:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+15:7148:x1798653942498240:12345-0@lo:1000:mdt_io00_002.0 Request processed in 64us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330300.471044:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2976 00000100:00100000:2.0:1715330300.471107:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344c8000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942498240:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330300.471197:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344c8000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942498304:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330300.471219:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330300.471237:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1715330300.471251:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942498304 00000100:00100000:1.0:1715330300.471255:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942498304 00000100:00100000:1.0:1715330300.471269:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2977 00000100:00100000:1.0:1715330300.471273:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+15:7148:x1798653942498304:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1715330300.471323:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+15:7148:x1798653942498304:12345-0@lo:1000:mdt_io00_002.0 Request processed in 48us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330300.471328:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2977 00000100:00100000:2.0:1715330300.471470:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344c8000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942498304:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330300.471554:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344c8000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942498368:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1715330300.471577:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330300.471962:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff8801344356c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330300.472498:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942498368 00000100:00100000:0.0:1715330300.472503:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942498368 00000100:00100000:0.0:1715330300.472539:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2978 00000100:00100000:0.0:1715330300.472544:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:7148:x1798653942498368:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1715330300.472648:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:7148:x1798653942498368:12345-0@lo:1000:mdt_io00_002.0 Request processed in 102us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330300.472654:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2978 00000100:00100000:3.0:1715330300.472728:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344c8000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942498368:0@lo:1000:mdt_io00_002.0 00000040:00080000:3.0:1715330300.473108:0:7148:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].383, 1264 off575904 00000040:00080000:3.0:1715330300.473159:0:7148:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].382, 1344 off620376 00000100:00100000:3.0:1715330300.473184:0:7148:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093981500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942498432:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1715330300.473213:0:7148:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.473236:0:7148:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496f900 going to sleep for 11 seconds 00000100:00100000:1.0:1715330300.473252:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942498432 00000100:00100000:1.0:1715330300.473265:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942498432 00000100:00100000:1.0:1715330300.473833:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2979 00000100:00100000:1.0:1715330300.473840:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093982d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:7148:x1798653942498432:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1715330300.473968:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093982d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:7148:x1798653942498432:12345-0@lo:1000:mdt_io00_002.0 Request processed in 128us (754us total) trans 4294969890 rc 0/0 00000100:00100000:1.0:1715330300.473974:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2979 00000100:00100000:3.0:1715330300.474176:0:7148:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093981500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:7148:1798653942498432:0@lo:1000:mdt_io00_002.0 00000004:00080000:3.0:1715330300.474188:0:7148:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88012f47ea80 with version 727 00000004:00080000:2.0:1715330300.474317:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 727 rpc_version 727 00000020:00100000:2.0:1715330300.474341:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1715330300.474348:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880091ccb480 x1798653942498560/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3088/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1715330300.474362:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091ccb480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942498560:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1715330300.474392:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330300.474414:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435000 going to sleep for 11 seconds 00000100:00100000:0.0:1715330300.474455:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942498560 00000100:00100000:0.0:1715330300.474461:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942498560 00000100:00100000:0.0:1715330300.474490:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2980 00000100:00100000:0.0:1715330300.474494:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091ccad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+15:8587:x1798653942498560:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330300.474801:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091ccad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+16:8587:x1798653942498560:12345-0@lo:1000:osp_up1-0.0 Request processed in 305us (408us total) trans 4294968468 rc 0/0 00000100:00100000:0.0:1715330300.474808:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2980 00000100:00100000:2.0:1715330300.474978:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091ccb480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942498560:0@lo:1000:osp_up1-0.0 00000004:00010000:3.0:1715330300.475092:0:7148:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880091e99180 reply state ffff880091e51000 transno 4294983557 ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d9a74 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1526:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.475111:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d9a74 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1526:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.475120:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1526:0x0].0x0 (ffff88008d5eee00) 00010000:00010000:3.0:1715330300.475123:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:3.0:1715330300.475126:0:7148:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330300.475135:0:7148:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d9a66 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.475141:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d9a66 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.475145:0:7148:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d9a66 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.475150:0:7148:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d9a66 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.475155:0:7148:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457e640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330300.475158:0:7148:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d9a66 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.475164:0:7148:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d9a66 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.475184:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff88011d537600) 00010000:00010000:3.0:1715330300.475186:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330300.475189:0:7148:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d9a66 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.475194:0:7148:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e640/0xd895711d66d9a66 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00000004:00010000:3.0:1715330300.475211:0:7148:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880091e99180 reply state ffff880091e51000 transno 4294983557 ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d9a6d lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.475217:0:7148:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d9a6d lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.475223:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x35 (ffff88009bbb0600) 00010000:00010000:3.0:1715330300.475225:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330300.475226:0:7148:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00080000:3.0:1715330300.475231:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00010000:00010000:3.0:1715330300.475237:0:7148:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f3c0/0xd895711d66d9a4a lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9a51 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.475243:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f3c0/0xd895711d66d9a4a lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9a51 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.475248:0:7148:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f3c0/0xd895711d66d9a4a lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9a51 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.475263:0:7148:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1715330300.475270:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00010000:00010000:3.0:1715330300.475274:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f600/0xd895711d66d9a58 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9a5f expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.475279:0:7148:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f600/0xd895711d66d9a58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9a5f expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330300.475367:0:7148:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x193:0x0] 00010000:00010000:3.0:1715330300.475372:0:7148:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d9a43 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.475377:0:7148:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d9a43 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.475382:0:7148:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d9a43 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.475385:0:7148:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457c240 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330300.475388:0:7148:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d9a43 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.475393:0:7148:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d9a43 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.475399:0:7148:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff88011d537200) 00010000:00010000:3.0:1715330300.475400:0:7148:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330300.475402:0:7148:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d9a43 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:3.0:1715330300.475406:0:7148:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c240/0xd895711d66d9a43 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:0.0:1715330300.475510:0:9415:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715330300.475516:0:9415:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f3c0/0xd895711d66d9a4a lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d9a51 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.475522:0:9415:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457f3c0 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330300.475525:0:9415:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f3c0/0xd895711d66d9a4a lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d9a51 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330300.475531:0:9415:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f3c0/0xd895711d66d9a4a lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d9a51 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.475552:0:9415:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f3c0/0xd895711d66d9a4a lrc: 2/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9a51 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.475557:0:9415:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330300.475576:0:9415:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f3c0/0xd895711d66d9a4a lrc: 1/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9a51 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.475586:0:9415:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f3c0/0xd895711d66d9a4a lrc: 0/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9a51 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330300.476460:0:7148:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:72de1896-1df4-4b3a-930a-9116d2c66168+27:17766:x1798653938063872:12345-192.168.204.49@tcp:36:lfs.0 Request processed in 15066us (15989us total) trans 4294983557 rc 0/0 00000100:00100000:3.0:1715330300.476467:0:7148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 12 00000100:00100000:3.0:1715330300.476493:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1715330300.476504:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091e99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942498624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1715330300.476543:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1715330300.476617:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330300.476620:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330300.476621:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330300.478723:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942498624 00000100:00100000:2.0:1715330300.478748:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942498624 00000100:00100000:2.0:1715330300.478808:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1399 00000100:00100000:2.0:1715330300.478815:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093983100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+16:3688:x1798653942498624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715330300.478830:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330300.478858:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d9a51 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d9a4a expref: 16 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.478891:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff88008d4e1c00) 00010000:00010000:2.0:1715330300.478902:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330300.478960:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093983100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+15:3688:x1798653942498624:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (2416us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.478970:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1399 00000100:00100000:0.0:1715330300.478986:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091e99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942498624:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330300.480572:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.481447:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938063936 00000100:00100000:2.0:1715330300.481458:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938063936 00000100:00100000:2.0:1715330300.481521:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23556 00000100:00100000:2.0:1715330300.481528:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d774700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+27:17766:x1798653938063936:12345-192.168.204.49@tcp:34:lfs.0 00010000:00010000:2.0:1715330300.481622:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d9a7b lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.481640:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d9a7b lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.481652:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d9a7b lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.481663:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9a82 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.481667:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9a82 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.481671:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9a82 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.481721:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d9a89 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1524:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.481728:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d9a89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1524:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.481755:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d9a89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1524:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00000004:00010000:2.0:1715330300.481810:0:25569:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d9a89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1524:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.481824:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d9a7b lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.481829:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d9a7b lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.481834:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d9a7b lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.481840:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d9a7b lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.481845:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db67a80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.481849:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d9a7b lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.481869:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d9a7b lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.481879:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff8800b4207700) 00010000:00010000:2.0:1715330300.481882:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.481887:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d9a7b lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.481892:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d9a7b lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.481910:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9a82 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.481914:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9a82 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.481919:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9a82 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.481923:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64900 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.481925:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9a82 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.481930:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9a82 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.481935:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x30 (ffff8800b4207600) 00010000:00010000:2.0:1715330300.481937:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.481939:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9a82 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.481944:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9a82 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.481951:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d9a89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1524:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.481954:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d9a89 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1524:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.481958:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d9a89 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1524:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.481962:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64000 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.481964:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d9a89 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1524:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.481968:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d9a89 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1524:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.481972:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1524:0x0].0x0 (ffff88009bbf0d00) 00010000:00010000:2.0:1715330300.481975:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.481977:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d9a89 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1524:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.481981:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d9a89 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1524:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00000100:00100000:2.0:1715330300.482059:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d774700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+27:17766:x1798653938063936:12345-192.168.204.49@tcp:34:lfs.0 Request processed in 530us (1505us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.482066:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23556 00000100:00100000:1.0:1715330300.485172:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330300.485248:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938064064 00000100:00100000:0.0:1715330300.485258:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938064064 00000100:00100000:0.0:1715330300.485325:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23557 00000100:00100000:0.0:1715330300.485335:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d774a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+27:17766:x1798653938064064:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:0.0:1715330300.485357:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330300.485380:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3cc0/0xd895711d66d9a90 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1524:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfba83 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.485498:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2640/0xd895711d66d9a97 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1524:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.485513:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2640/0xd895711d66d9a97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1524:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.485524:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2640/0xd895711d66d9a97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1524:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00200000:0.0:1715330300.485534:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1524:0x0]: returning size 2 00010000:00010000:0.0:1715330300.485642:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3cc0/0xd895711d66d9a90 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1524:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba83 expref: 30 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.485672:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2640/0xd895711d66d9a97 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1524:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba83 expref: 29 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.485680:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1524:0x0].0x0 (ffff88009bbf0d00) 00010000:00010000:0.0:1715330300.485683:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1715330300.485686:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a2640, rc 0) 00000100:00100000:0.0:1715330300.485762:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d774a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+29:17766:x1798653938064064:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 428us (601us total) trans 4294983558 rc 0/0 00000100:00100000:0.0:1715330300.485769:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23557 00000100:00100000:0.0:1715330300.488772:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.488968:0:17206:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938064128 00000100:00100000:2.0:1715330300.488978:0:17206:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938064128 00000100:00100000:2.0:1715330300.489023:0:17206:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5219 00000100:00100000:2.0:1715330300.489030:0:17206:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:72de1896-1df4-4b3a-930a-9116d2c66168+20:2011:x1798653938064128:12345-192.168.204.49@tcp:1:lfs.0 00010000:00010000:2.0:1715330300.489083:0:17206:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011db64480/0xd895711d66d9aa5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.489100:0:17206:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011db646c0/0xd895711d66d96ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9db expref: 20 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.489107:0:17206:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1715330300.489110:0:17206:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1715330300.489113:0:17206:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db64480/0xd895711d66d9aa5 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.489147:0:17206:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011db646c0/0xd895711d66d96ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9db expref: 20 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.489159:0:17206:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011db646c0/0xd895711d66d96ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9db expref: 20 pid: 17200 timeout: 374 lvb_type: 0 00000100:00100000:2.0:1715330300.489178:0:17206:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091cca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:17206:1798653942498688:192.168.204.49@tcp:104: 00000100:00100000:2.0:1715330300.489244:0:17206:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435000 going to sleep for 11 seconds 00000100:00100000:2.0:1715330300.493528:0:17206:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091cca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:17206:1798653942498688:192.168.204.49@tcp:104: 00010000:00010000:2.0:1715330300.493563:0:17206:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88011db64480/0xd895711d66d9aa5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330300.493910:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330300.494205:0:9403:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938064192 00000100:00100000:3.0:1715330300.494213:0:9403:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938064192 00002000:00100000:3.0:1715330300.494258:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9cb:0x0] (0->1) req@ffff880091e99880 x1798653938064192/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:511/0 lens 496/0 e 0 to 0 dl 1715330311 ref 1 fl New:/200/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 00002000:00100000:3.0:1715330300.494268:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091e99880 with x1798653938064192 ext(0->1) 00010000:00010000:3.0:1715330300.494276:0:9403:0:(ldlm_extent.c:692:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011db646c0/0xd895711d66d96ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9db expref: 21 pid: 17200 timeout: 374 lvb_type: 0 00010000:00010000:3.0:1715330300.494297:0:9403:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011db646c0/0xd895711d66d96ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9db expref: 21 pid: 17200 timeout: 374 lvb_type: 0 00002000:00010000:3.0:1715330300.494310:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091e99880 00000100:00100000:3.0:1715330300.494331:0:9403:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 11 00000100:00100000:3.0:1715330300.494339:0:9403:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+21:2011:x1798653938064192:12345-192.168.204.49@tcp:4:bash.0 00000100:00100000:3.0:1715330300.495619:0:9403:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+23:2011:x1798653938064192:12345-192.168.204.49@tcp:4:bash.0 Request processed in 1271us (1701us total) trans 4294969891 rc 0/0 00000100:00100000:3.0:1715330300.495632:0:9403:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 11 00002000:00100000:3.0:1715330300.495642:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9cb:0x0] (0->1) req@ffff880091e99880 x1798653938064192/t4294969891(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:511/0 lens 496/448 e 0 to 0 dl 1715330311 ref 1 fl Complete:H/200/0 rc 0/0 job:'bash.0' uid:0 gid:0 00002000:00100000:3.0:1715330300.495651:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091e99880 with x1798653938064192 ext(0->1) 00010000:00010000:3.0:1715330300.495659:0:9403:0:(ldlm_extent.c:692:ldlm_lock_prolong_one()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011db646c0/0xd895711d66d96ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9db expref: 23 pid: 17200 timeout: 374 lvb_type: 0 00010000:00010000:3.0:1715330300.495672:0:9403:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011db646c0/0xd895711d66d96ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9db expref: 23 pid: 17200 timeout: 374 lvb_type: 0 00002000:00010000:3.0:1715330300.495679:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091e99880 00000100:00100000:1.0:1715330300.499158:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.499924:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938064256 00000100:00100000:2.0:1715330300.499934:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938064256 00010000:00010000:2.0:1715330300.499976:0:7121:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011db646c0/0xd895711d66d96ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9db expref: 23 pid: 17200 timeout: 374 lvb_type: 0 00000100:00100000:2.0:1715330300.500512:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1568 00000100:00100000:2.0:1715330300.500519:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ab789850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+23:2014:x1798653938064256:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1715330300.500537:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1715330300.500557:0:7121:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x9cb:0x0] updating lvb size from disk: 0 -> 2 00002000:00010000:2.0:1715330300.500560:0:7121:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x9cb:0x0] updating lvb mtime from disk: 0 -> 1715330300 00002000:00010000:2.0:1715330300.500563:0:7121:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000401:0x9cb:0x0] updating lvb ctime from disk: 0 -> 1715330300 00002000:00010000:2.0:1715330300.500565:0:7121:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000401:0x9cb:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1715330300.500572:0:7121:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011db646c0/0xd895711d66d96ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9db expref: 23 pid: 17200 timeout: 374 lvb_type: 0 00010000:00010000:2.0:1715330300.500585:0:7121:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011db646c0/0xd895711d66d96ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9db expref: 23 pid: 17200 timeout: 374 lvb_type: 0 00010000:00010000:2.0:1715330300.500616:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011db646c0/0xd895711d66d96ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9db expref: 23 pid: 17200 timeout: 374 lvb_type: 0 00010000:00010000:2.0:1715330300.500653:0:7121:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330300.500655:0:7121:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330300.500659:0:7121:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011db64480/0xd895711d66d9aa5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.500668:0:7121:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db64480/0xd895711d66d9aa5 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.500703:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330300.500817:0:17206:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88011db64480/0xd895711d66d9aa5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.500825:0:17206:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011db64480/0xd895711d66d9aa5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.500842:0:17206:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011db64480/0xd895711d66d9aa5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330300.501073:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ab789850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+22:2014:x1798653938064256:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 552us (1925us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.501081:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1568 00010000:00010000:3.0:1715330300.501160:0:17206:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88011db64480/0xd895711d66d9aa5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.501169:0:17206:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88011db64480/0xd895711d66d9aa5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.501175:0:17206:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64480 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330300.501179:0:17206:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88011db64480/0xd895711d66d9aa5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.501186:0:17206:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88011db64480/0xd895711d66d9aa5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.501197:0:17206:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88011db64480/0xd895711d66d9aa5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.501203:0:17206:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011db64480/0xd895711d66d9aa5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330300.501253:0:17206:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:72de1896-1df4-4b3a-930a-9116d2c66168+21:2011:x1798653938064128:12345-192.168.204.49@tcp:1:lfs.0 Request processed in 12223us (12534us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.501261:0:17206:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5219 00000100:00100000:1.0:1715330300.504595:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330300.504673:0:7148:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938064384 00000100:00100000:3.0:1715330300.504683:0:7148:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938064384 00000100:00100000:1.0:1715330300.504792:0:7147:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 13 00000100:00100000:1.0:1715330300.504799:0:7147:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d774e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+29:17766:x1798653938064384:12345-192.168.204.49@tcp:36:lfs.0 00010000:00010000:1.0:1715330300.504850:0:7147:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330300.504877:0:7147:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0b40/0xd895711d66d96a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1524:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9d4 expref: 29 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.504907:0:7147:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1524:0x0].0x0 (ffff88009bbf0d00) 00010000:00010000:1.0:1715330300.504911:0:7147:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330300.504933:0:7147:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d9aac lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 00010000:00010000:1.0:1715330300.504945:0:7147:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d9aac lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 00010000:00010000:1.0:1715330300.504954:0:7147:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d9aac lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 00000100:00100000:1.0:1715330300.505026:0:7147:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d776680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:7147:1798653942498752:0@lo:1000:mdt_io00_001.0 00000100:00100000:1.0:1715330300.505073:0:7147:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330300.505099:0:7147:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4b2f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330300.505200:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942498752 00000100:00100000:0.0:1715330300.505204:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942498752 00000100:00100000:0.0:1715330300.505227:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2981 00000100:00100000:0.0:1715330300.505232:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d776a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+15:7147:x1798653942498752:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:0.0:1715330300.505305:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d776a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+15:7147:x1798653942498752:12345-0@lo:1000:mdt_io00_001.0 Request processed in 73us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330300.505312:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2981 00000100:00100000:1.0:1715330300.505409:0:7147:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d776680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:7147:1798653942498752:0@lo:1000:mdt_io00_001.0 00000004:00080000:1.0:1715330300.505434:0:7147:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x193:0x0] 00000100:00100000:1.0:1715330300.505453:0:7147:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d776680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:7147:1798653942498816:0@lo:1000:mdt_io00_001.0 00000100:00100000:1.0:1715330300.505468:0:7147:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330300.505987:0:7147:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4b2f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715330300.506146:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942498816 00000100:00100000:2.0:1715330300.506151:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942498816 00000100:00100000:2.0:1715330300.506181:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2982 00000100:00100000:2.0:1715330300.506186:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d776d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+15:7147:x1798653942498816:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1715330300.506265:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d776d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+15:7147:x1798653942498816:12345-0@lo:1000:mdt_io00_001.0 Request processed in 78us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.506271:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2982 00000100:00100000:1.0:1715330300.506329:0:7147:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d776680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:7147:1798653942498816:0@lo:1000:mdt_io00_001.0 00000100:00100000:1.0:1715330300.506770:0:7147:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d776680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:7147:1798653942498880:0@lo:403:mdt_io00_001.0 00000100:00100000:1.0:1715330300.506798:0:7147:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330300.506805:0:7147:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4b2f900 going to sleep for 11 seconds 00000100:00100000:0.0:1715330300.506858:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942498880 00000100:00100000:0.0:1715330300.506862:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942498880 00000100:00100000:0.0:1715330300.506892:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2983 00000100:00100000:0.0:1715330300.506896:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d777800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+15:7147:x1798653942498880:12345-0@lo:403:mdt_io00_001.0 00000100:00100000:0.0:1715330300.508607:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d777800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+15:7147:x1798653942498880:12345-0@lo:403:mdt_io00_001.0 Request processed in 1704us (1802us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330300.508618:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2983 00000100:00100000:1.0:1715330300.508904:0:7147:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d776680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:7147:1798653942498880:0@lo:403:mdt_io00_001.0 00010000:00010000:1.0:1715330300.509501:0:7147:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe1c0/0xd895711d66d9ab3 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7147 initiator: MDT0 00010000:00010000:1.0:1715330300.509510:0:7147:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe1c0/0xd895711d66d9ab3 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7147 initiator: MDT0 00010000:00010000:1.0:1715330300.509520:0:7147:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe1c0/0xd895711d66d9ab3 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7147 initiator: MDT0 00000100:00100000:1.0:1715330300.509537:0:7147:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d776680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:7147:1798653942498944:0@lo:101:mdt_io00_001.0 00000100:00100000:1.0:1715330300.509571:0:7147:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330300.509584:0:7147:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4b2f900 going to sleep for 11 seconds 00000100:00100000:2.0:1715330300.509645:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942498944 00000100:00100000:2.0:1715330300.509652:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942498944 00000100:00100000:2.0:1715330300.509690:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2984 00000100:00100000:2.0:1715330300.509696:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+15:7147:x1798653942498944:12345-0@lo:101:mdt_io00_001.0 00010000:00010000:2.0:1715330300.509711:0:19960:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330300.509748:0:19960:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66ac0/0xd895711d66d9aba lrc: 2/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d9ab3 expref: -99 pid: 19960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.509778:0:19960:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66ac0/0xd895711d66d9aba lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d9ab3 expref: 16 pid: 19960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.509789:0:19960:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66ac0/0xd895711d66d9aba lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9ab3 expref: 16 pid: 19960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.509796:0:19960:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff8800b4207e00) 00010000:00010000:2.0:1715330300.509799:0:19960:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.509802:0:19960:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db66ac0, rc 0) 00000100:00100000:2.0:1715330300.509823:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+16:7147:x1798653942498944:12345-0@lo:101:mdt_io00_001.0 Request processed in 128us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.509828:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2984 00000100:00100000:1.0:1715330300.509944:0:7147:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d776680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:7147:1798653942498944:0@lo:101:mdt_io00_001.0 00010000:00010000:1.0:1715330300.509955:0:7147:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe1c0/0xd895711d66d9ab3 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9aba expref: -99 pid: 7147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.509962:0:7147:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe1c0/0xd895711d66d9ab3 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9aba expref: -99 pid: 7147 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330300.509973:0:7147:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00010000:00010000:1.0:1715330300.509985:0:7147:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfeac0/0xd895711d66d9ac1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7147 initiator: MDT0 00010000:00010000:1.0:1715330300.509990:0:7147:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfeac0/0xd895711d66d9ac1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7147 initiator: MDT0 00010000:00010000:1.0:1715330300.509999:0:7147:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfeac0/0xd895711d66d9ac1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7147 initiator: MDT0 00000100:00100000:1.0:1715330300.510006:0:7147:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba67b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:7147:1798653942499008:0@lo:101:mdt_io00_001.0 00000100:00100000:1.0:1715330300.510020:0:7147:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330300.510036:0:7147:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4b2f900 going to sleep for 11 seconds 00000100:00100000:3.0:1715330300.510070:0:7139:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942499008 00000100:00100000:3.0:1715330300.510074:0:7139:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942499008 00000100:00100000:3.0:1715330300.510432:0:7139:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2985 00000100:00100000:3.0:1715330300.510437:0:7139:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+16:7147:x1798653942499008:12345-0@lo:101:mdt_io00_001.0 00010000:00010000:3.0:1715330300.510445:0:7139:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330300.510456:0:7139:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c240/0xd895711d66d9ac8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d9ac1 expref: -99 pid: 7139 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.510467:0:7139:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c240/0xd895711d66d9ac8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d9ac1 expref: 17 pid: 7139 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.510475:0:7139:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c240/0xd895711d66d9ac8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9ac1 expref: 17 pid: 7139 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.510480:0:7139:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x30 (ffff88009bbb0100) 00010000:00010000:3.0:1715330300.510482:0:7139:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330300.510484:0:7139:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013457c240, rc 0) 00000100:00100000:3.0:1715330300.510519:0:7139:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+17:7147:x1798653942499008:12345-0@lo:101:mdt_io00_001.0 Request processed in 81us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.510523:0:7139:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2985 00000100:00100000:1.0:1715330300.510579:0:7147:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba67b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:7147:1798653942499008:0@lo:101:mdt_io00_001.0 00010000:00010000:1.0:1715330300.510588:0:7147:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfeac0/0xd895711d66d9ac1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9ac8 expref: -99 pid: 7147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.510595:0:7147:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfeac0/0xd895711d66d9ac1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9ac8 expref: -99 pid: 7147 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330300.510604:0:7147:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00010000:00010000:1.0:1715330300.510617:0:7147:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d9acf lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 00010000:00010000:1.0:1715330300.510623:0:7147:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d9acf lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 00010000:00010000:1.0:1715330300.510629:0:7147:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d9acf lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 00010000:00010000:1.0:1715330300.510638:0:7147:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd8c0/0xd895711d66d9ad6 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 00010000:00010000:1.0:1715330300.510642:0:7147:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd8c0/0xd895711d66d9ad6 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 00010000:00010000:1.0:1715330300.510647:0:7147:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd8c0/0xd895711d66d9ad6 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 00010000:00010000:1.0:1715330300.510686:0:7147:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d9add lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1524:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7147 initiator: MDT0 00010000:00010000:1.0:1715330300.510696:0:7147:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2640/0xd895711d66d9a97 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1524:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba83 expref: 28 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.510702:0:7147:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d9add lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1524:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 00010000:00010000:1.0:1715330300.510722:0:7147:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2640/0xd895711d66d9a97 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1524:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba83 expref: 28 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.510755:0:7147:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2640/0xd895711d66d9a97 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1524:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba83 expref: 28 pid: 7135 timeout: 374 lvb_type: 0 00000100:00100000:1.0:1715330300.510765:0:7147:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba67b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000_UUID:7147:1798653942499072:192.168.204.49@tcp:104: 00000100:00100000:1.0:1715330300.510816:0:7147:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4b2f900 going to sleep for 11 seconds 00010000:00010000:1.0:1715330300.514978:0:7147:0:(ldlm_lockd.c:794:ldlm_handle_ast_error()) ### client (nid 192.168.204.49@tcp) returned -22 from blocking AST (req@ffff88009ba67b80 x1798653942499072) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2640/0xd895711d66d9a97 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1524:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba83 expref: 28 pid: 7135 timeout: 374 lvb_type: 0 00010000:00010000:1.0:1715330300.514997:0:7147:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2640/0xd895711d66d9a97 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1524:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba83 expref: 28 pid: 7135 timeout: 374 lvb_type: 0 00010000:00010000:1.0:1715330300.515023:0:7147:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2640/0xd895711d66d9a97 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1524:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba83 expref: 28 pid: 7135 timeout: 374 lvb_type: 0 00000100:00100000:1.0:1715330300.515038:0:7147:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba67b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000_UUID:7147:1798653942499072:192.168.204.49@tcp:104: 00010000:00010000:1.0:1715330300.515058:0:7147:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1524:0x0].0x0 (ffff88009bbf0d00) 00010000:00010000:1.0:1715330300.515063:0:7147:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d9add lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1524:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 00010000:00010000:1.0:1715330300.515071:0:7147:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d9add lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1524:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 7147 initiator: MDT0 00010000:00010000:1.0:1715330300.515078:0:7147:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d9add lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1524:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 7147 initiator: MDT0 00010000:00010000:1.0:1715330300.515093:0:7147:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d9add lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1524:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 00010000:00010000:1.0:1715330300.515101:0:7147:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d9add lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1524:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 00010000:00010000:1.0:1715330300.515105:0:7147:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d9add lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1524:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 00000100:00100000:1.0:1715330300.515256:0:7147:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba67b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:7147:1798653942499136:0@lo:1000:mdt_io00_001.0 00000100:00100000:1.0:1715330300.515319:0:7147:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330300.515901:0:7147:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4b2f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715330300.515976:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942499136 00000100:00100000:2.0:1715330300.515984:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942499136 00000100:00100000:2.0:1715330300.516192:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2986 00000100:00100000:2.0:1715330300.516200:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+17:7147:x1798653942499136:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1715330300.516567:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+17:7147:x1798653942499136:12345-0@lo:1000:mdt_io00_001.0 Request processed in 367us (1247us total) trans 0 rc -2/-2 00000100:00100000:2.0:1715330300.516575:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2986 00000100:00100000:0.0:1715330300.516654:0:7147:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba67b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:7147:1798653942499136:0@lo:1000:mdt_io00_001.0 00000100:00100000:0.0:1715330300.516713:0:7147:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091e99c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:7147:1798653942499200:0@lo:1000:mdt_io00_001.0 00000100:00100000:0.0:1715330300.516777:0:7147:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330300.516787:0:7147:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009d7e3600 going to sleep for 11 seconds 00000100:00100000:2.0:1715330300.516862:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942499200 00000100:00100000:2.0:1715330300.516866:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942499200 00000100:00100000:2.0:1715330300.516891:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2987 00000100:00100000:2.0:1715330300.516894:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+17:7147:x1798653942499200:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1715330300.516938:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+17:7147:x1798653942499200:12345-0@lo:1000:mdt_io00_001.0 Request processed in 42us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.516943:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2987 00000100:00100000:0.0:1715330300.517038:0:7147:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091e99c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:7147:1798653942499200:0@lo:1000:mdt_io00_001.0 00000100:00100000:0.0:1715330300.517120:0:7147:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091e99c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:7147:1798653942499264:0@lo:1000:mdt_io00_001.0 00000100:00100000:0.0:1715330300.517135:0:7147:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330300.517666:0:7147:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009d7e3600 going to sleep for 11 seconds 00000100:00100000:3.0:1715330300.518280:0:7139:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942499264 00000100:00100000:3.0:1715330300.518294:0:7139:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942499264 00000100:00100000:3.0:1715330300.518358:0:7139:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2988 00000100:00100000:3.0:1715330300.518363:0:7139:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+17:7147:x1798653942499264:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:3.0:1715330300.518444:0:7139:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+17:7147:x1798653942499264:12345-0@lo:1000:mdt_io00_001.0 Request processed in 80us (1307us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.518450:0:7139:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2988 00000100:00100000:1.0:1715330300.518527:0:7147:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091e99c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:7147:1798653942499264:0@lo:1000:mdt_io00_001.0 00000100:00100000:1.0:1715330300.518631:0:7147:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba64a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:7147:1798653942499328:0@lo:1000:mdt_io00_001.0 00000100:00100000:1.0:1715330300.518660:0:7147:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330300.518671:0:7147:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4b2f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715330300.518771:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942499328 00000100:00100000:2.0:1715330300.518775:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942499328 00000100:00100000:2.0:1715330300.518793:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2989 00000100:00100000:2.0:1715330300.518797:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+10:7147:x1798653942499328:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1715330300.518854:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+10:7147:x1798653942499328:12345-0@lo:1000:mdt_io00_001.0 Request processed in 56us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.518859:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2989 00000100:00100000:1.0:1715330300.519022:0:7147:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba64a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:7147:1798653942499328:0@lo:1000:mdt_io00_001.0 00000040:00080000:1.0:1715330300.519343:0:7147:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].384, 1264 off577168 00000040:00080000:1.0:1715330300.519394:0:7147:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].383, 1344 off621720 00000100:00100000:1.0:1715330300.519412:0:7147:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba64a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:7147:1798653942499392:0@lo:1000:mdt_io00_001.0 00000100:00100000:1.0:1715330300.519436:0:7147:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330300.519637:0:7147:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f780 going to sleep for 11 seconds 00000100:00100000:3.0:1715330300.519680:0:7139:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942499392 00000100:00100000:3.0:1715330300.519684:0:7139:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942499392 00000100:00100000:3.0:1715330300.519778:0:7139:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2990 00000100:00100000:3.0:1715330300.519783:0:7139:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:7147:x1798653942499392:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:3.0:1715330300.520014:0:7139:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:7147:x1798653942499392:12345-0@lo:1000:mdt_io00_001.0 Request processed in 230us (577us total) trans 4294969892 rc 0/0 00000100:00100000:3.0:1715330300.520020:0:7139:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2990 00000100:00100000:1.0:1715330300.520095:0:7147:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba64a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-mdtlov_UUID:7147:1798653942499392:0@lo:1000:mdt_io00_001.0 00000004:00080000:1.0:1715330300.520102:0:7147:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8800b4b2f0c0 with version 728 00000004:00080000:2.0:1715330300.520218:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 728 rpc_version 728 00000020:00100000:2.0:1715330300.520238:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1715330300.520243:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880091cca680 x1798653942499520/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3088/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1715330300.520256:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091cca680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942499520:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1715330300.520284:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330300.520375:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435900 going to sleep for 11 seconds 00000100:00100000:3.0:1715330300.520416:0:7139:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942499520 00000100:00100000:3.0:1715330300.520420:0:7139:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942499520 00000100:00100000:3.0:1715330300.520564:0:7139:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2991 00000100:00100000:3.0:1715330300.520569:0:7139:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+17:8587:x1798653942499520:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1715330300.520864:0:7139:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+18:8587:x1798653942499520:12345-0@lo:1000:osp_up1-0.0 Request processed in 294us (579us total) trans 4294968469 rc 0/0 00000100:00100000:3.0:1715330300.520870:0:7139:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2991 00000100:00100000:2.0:1715330300.521176:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091cca680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942499520:0@lo:1000:osp_up1-0.0 00000004:00010000:1.0:1715330300.521277:0:7147:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008d774e00 reply state ffff88012fba7000 transno 4294983559 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d9add lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1524:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 00010000:00010000:1.0:1715330300.521304:0:7147:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d9add lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1524:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 00010000:00010000:1.0:1715330300.521313:0:7147:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1524:0x0].0x0 (ffff88009bbf0d00) 00010000:00010000:1.0:1715330300.521315:0:7147:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:1.0:1715330300.521319:0:7147:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1715330300.521325:0:7147:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d9acf lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 00010000:00010000:1.0:1715330300.521330:0:7147:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d9acf lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 00010000:00010000:1.0:1715330300.521336:0:7147:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d9acf lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 00010000:00010000:1.0:1715330300.521341:0:7147:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfd440 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330300.521345:0:7147:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d9acf lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 00010000:00010000:1.0:1715330300.521351:0:7147:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d9acf lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 00010000:00010000:1.0:1715330300.521360:0:7147:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff88008d4e1800) 00010000:00010000:1.0:1715330300.521362:0:7147:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330300.521365:0:7147:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d9acf lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 00010000:00010000:1.0:1715330300.521369:0:7147:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d9acf lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 00000004:00010000:1.0:1715330300.521388:0:7147:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008d774e00 reply state ffff88012fba7000 transno 4294983559 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd8c0/0xd895711d66d9ad6 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7147 initiator: MDT0 00010000:00010000:1.0:1715330300.521395:0:7147:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd8c0/0xd895711d66d9ad6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 00010000:00010000:1.0:1715330300.521399:0:7147:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x30 (ffff88008d4e1c00) 00010000:00010000:1.0:1715330300.521401:0:7147:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330300.521402:0:7147:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00080000:1.0:1715330300.521409:0:7147:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00010000:00010000:1.0:1715330300.521415:0:7147:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe1c0/0xd895711d66d9ab3 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9aba expref: -99 pid: 7147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.521421:0:7147:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe1c0/0xd895711d66d9ab3 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9aba expref: -99 pid: 7147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.521426:0:7147:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe1c0/0xd895711d66d9ab3 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9aba expref: -99 pid: 7147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.521542:0:7147:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1715330300.521547:0:7147:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000400:0xca:0x0] 00010000:00010000:1.0:1715330300.521552:0:7147:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfeac0/0xd895711d66d9ac1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9ac8 expref: -99 pid: 7147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.521558:0:7147:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfeac0/0xd895711d66d9ac1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9ac8 expref: -99 pid: 7147 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330300.521642:0:7147:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000402:0x193:0x0] 00010000:00010000:1.0:1715330300.521649:0:7147:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d9aac lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 00010000:00010000:1.0:1715330300.521657:0:7147:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d9aac lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 00010000:00010000:1.0:1715330300.521662:0:7147:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d9aac lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 00010000:00010000:1.0:1715330300.521666:0:7147:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bffa80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330300.521668:0:7147:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d9aac lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 00010000:00010000:1.0:1715330300.521672:0:7147:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d9aac lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 00010000:00010000:1.0:1715330300.521678:0:7147:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff88008d4e1600) 00010000:00010000:1.0:1715330300.521681:0:7147:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330300.521683:0:7147:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d9aac lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 00010000:00010000:1.0:1715330300.521687:0:7147:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d9aac lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 00010000:00010000:2.0:1715330300.521835:0:7124:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1715330300.521841:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe1c0/0xd895711d66d9ab3 lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d9aba expref: -99 pid: 7147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.521847:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfe1c0 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:2.0:1715330300.521850:0:7124:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe1c0/0xd895711d66d9ab3 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d9aba expref: -99 pid: 7147 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1715330300.521856:0:7124:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe1c0/0xd895711d66d9ab3 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d9aba expref: -99 pid: 7147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.521882:0:7124:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe1c0/0xd895711d66d9ab3 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9aba expref: -99 pid: 7147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.521892:0:7124:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1715330300.521917:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe1c0/0xd895711d66d9ab3 lrc: 1/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9aba expref: -99 pid: 7147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.521922:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfe1c0/0xd895711d66d9ab3 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9aba expref: -99 pid: 7147 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.521935:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330300.521936:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330300.521938:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330300.521978:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091cc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942499584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330300.522616:0:7147:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d774e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+29:17766:x1798653938064384:12345-192.168.204.49@tcp:36:lfs.0 Request processed in 17812us (18026us total) trans 4294983559 rc 0/0 00000100:00100000:1.0:1715330300.522626:0:7147:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 13 00000100:00100000:0.0:1715330300.523156:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330300.523283:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942499584 00000100:00100000:2.0:1715330300.523298:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942499584 00000100:00100000:2.0:1715330300.523332:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1400 00000100:00100000:2.0:1715330300.523337:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e9a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+18:3690:x1798653942499584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715330300.523350:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330300.523368:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db66ac0/0xd895711d66d9aba lrc: 0/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d9ab3 expref: 18 pid: 19960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.523382:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff8800b4207e00) 00010000:00010000:2.0:1715330300.523389:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330300.524031:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e9a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+17:3690:x1798653942499584:12345-0@lo:103:ldlm_bl.0 Request processed in 692us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.524037:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1400 00000100:00100000:1.0:1715330300.525019:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091cc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942499584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330300.526076:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330300.526964:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938064512 00000100:00100000:1.0:1715330300.526974:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938064512 00000100:00100000:1.0:1715330300.527538:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5095 00000100:00100000:1.0:1715330300.527546:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+6:17766:x1798653938064512:12345-192.168.204.49@tcp:35:lfs.0 00000100:00100000:1.0:1715330300.527805:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+7:17766:x1798653938064512:12345-192.168.204.49@tcp:35:lfs.0 Request processed in 258us (1734us total) trans 4294968470 rc 0/0 00000100:00100000:1.0:1715330300.527813:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5095 00000100:00100000:2.0:1715330300.539095:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330300.539198:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938064640 00000100:00100000:0.0:1715330300.539207:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938064640 00000100:00100000:0.0:1715330300.539269:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23558 00000100:00100000:0.0:1715330300.539277:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091cc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+29:17767:x1798653938064640:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:0.0:1715330300.539316:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330300.539340:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2400/0xd895711d66d9ae4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfba8a expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.539421:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66d9aeb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.539434:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66d9aeb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.539447:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66d9aeb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.539460:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1f80/0xd895711d66d9af2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6088621d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.539470:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1f80/0xd895711d66d9af2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.539475:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1f80/0xd895711d66d9af2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.539535:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66d9af9 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x193:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.539542:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66d9af9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.539547:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66d9af9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.539560:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66d9aeb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.539565:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66d9aeb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.539570:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66d9aeb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.539575:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66d9aeb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.539581:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a1200 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330300.539585:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66d9aeb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.539592:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66d9aeb lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.539606:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:0.0:1715330300.539609:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330300.539613:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66d9aeb lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.539618:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66d9aeb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.539694:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1f80/0xd895711d66d9af2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.539700:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1f80/0xd895711d66d9af2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.539704:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1f80/0xd895711d66d9af2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.539707:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a1f80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330300.539709:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1f80/0xd895711d66d9af2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.539713:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1f80/0xd895711d66d9af2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.539719:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6088621d (ffff88008b233900) 00010000:00010000:0.0:1715330300.539721:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330300.539724:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1f80/0xd895711d66d9af2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.539728:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1f80/0xd895711d66d9af2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.539778:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2400/0xd895711d66d9ae4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba8a expref: 31 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.539790:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66d9af9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba8a expref: 30 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.539796:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x193:0x0].0x0 (ffff880091ea7f00) 00010000:00010000:0.0:1715330300.539797:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1715330300.539799:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a1440, rc 0) 00000100:00100000:0.0:1715330300.539865:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091cc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+30:17767:x1798653938064640:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 587us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330300.539871:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23558 00000100:00100000:0.0:1715330300.545088:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.545158:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938064768 00000100:00100000:2.0:1715330300.545169:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938064768 00000100:00100000:0.0:1715330300.545222:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.545235:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23559 00000100:00100000:2.0:1715330300.545244:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+7:17767:x1798653938064768:12345-192.168.204.49@tcp:101:lfs.0 00000100:00100000:0.0:1715330300.545266:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938064832 00000100:00100000:0.0:1715330300.545269:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938064832 00010000:00010000:2.0:1715330300.545277:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330300.545314:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64480/0xd895711d66d9b00 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x193:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfba91 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330300.545325:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1401 00000100:00100000:0.0:1715330300.545330:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e9b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+30:2014:x1798653938064832:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1715330300.545343:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330300.545367:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66d9af9 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba8a expref: 30 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.545385:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x193:0x0].0x0 (ffff880091ea7f00) 00010000:00010000:0.0:1715330300.545389:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330300.545432:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e9b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+29:2014:x1798653938064832:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 102us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330300.545437:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1401 00000004:00200000:2.0:1715330300.545480:0:25569:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x193:0x0]: returning size 4096 00010000:00010000:2.0:1715330300.545572:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64480/0xd895711d66d9b00 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba91 expref: 9 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.545579:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64480/0xd895711d66d9b00 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba91 expref: 9 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.545598:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db64480, rc 0) 00000100:00100000:2.0:1715330300.545622:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+8:17767:x1798653938064768:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 379us (548us total) trans 4294968471 rc 301/301 00000100:00100000:2.0:1715330300.545627:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23559 00000100:00100000:0.0:1715330300.549423:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.549935:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938064896 00000100:00100000:2.0:1715330300.549944:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938064896 00000100:00100000:2.0:1715330300.550001:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5096 00000100:00100000:2.0:1715330300.550010:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+8:17767:x1798653938064896:12345-192.168.204.49@tcp:33:lfs.0 00000004:00200000:2.0:1715330300.550154:0:7137:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x193:0x0]: returning size 4096 00000004:00200000:2.0:1715330300.550158:0:7137:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00000100:00100000:2.0:1715330300.550223:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+8:17767:x1798653938064896:12345-192.168.204.49@tcp:33:lfs.0 Request processed in 213us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.550230:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5096 00000100:00100000:2.0:1715330300.554988:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330300.555064:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938065024 00000100:00100000:1.0:1715330300.555073:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938065024 00000100:00100000:1.0:1715330300.555146:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5097 00000100:00100000:1.0:1715330300.555154:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+8:17767:x1798653938065024:12345-192.168.204.49@tcp:35:lfs.0 00000100:00100000:1.0:1715330300.555420:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+9:17767:x1798653938065024:12345-192.168.204.49@tcp:35:lfs.0 Request processed in 266us (442us total) trans 4294968472 rc 0/0 00000100:00100000:1.0:1715330300.555427:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5097 00000100:00100000:1.0:1715330300.559093:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330300.559658:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938065088 00000100:00100000:3.0:1715330300.559668:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938065088 00000100:00100000:3.0:1715330300.559725:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23560 00000100:00100000:3.0:1715330300.559751:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+9:17567:x1798653938065088:12345-192.168.204.49@tcp:101:bash.0 00010000:00010000:3.0:1715330300.559778:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330300.559803:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e640/0xd895711d66d9b0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfba98 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.559878:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e880/0xd895711d66d9b15 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x193:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.559891:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e880/0xd895711d66d9b15 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x193:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.559903:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e880/0xd895711d66d9b15 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x193:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000004:00200000:3.0:1715330300.560046:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x193:0x0]: returning size 4096 00000004:00200000:3.0:1715330300.560052:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00000004:00010000:3.0:1715330300.560172:0:7135:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e880/0xd895711d66d9b15 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x193:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.560196:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e640/0xd895711d66d9b0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba98 expref: 11 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.560218:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e880/0xd895711d66d9b15 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x193:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba98 expref: 10 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.560226:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x193:0x0].0x0 (ffff88009bbb0d00) 00010000:00010000:3.0:1715330300.560229:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1715330300.560233:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013457e880, rc 0) 00000100:00100000:3.0:1715330300.560362:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+10:17567:x1798653938065088:12345-192.168.204.49@tcp:101:bash.0 Request processed in 629us (1281us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.560368:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23560 00000100:00100000:0.0:1715330300.563222:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330300.564268:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938065152 00000100:00100000:3.0:1715330300.564281:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938065152 00000100:00100000:3.0:1715330300.564609:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23561 00000100:00100000:3.0:1715330300.564619:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+10:17567:x1798653938065152:12345-192.168.204.49@tcp:101:bash.0 00010000:00010000:3.0:1715330300.564642:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330300.564667:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f3c0/0xd895711d66d9b1c lrc: 2/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfba9f expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.564851:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48f180/0xd895711d66d9b23 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.564864:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48f180/0xd895711d66d9b23 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.564874:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48f180/0xd895711d66d9b23 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000004:00200000:3.0:1715330300.564913:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000400:0xca:0x0]: returning size 4096 00000004:00200000:3.0:1715330300.564917:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:3.0:1715330300.564949:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457f3c0/0xd895711d66d9b1c lrc: 0/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba9f expref: 12 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.564968:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48f180/0xd895711d66d9b23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba9f expref: 11 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.564975:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff88009ef57100) 00010000:00010000:3.0:1715330300.564978:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1715330300.564981:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f48f180, rc 0) 00000100:00100000:3.0:1715330300.565043:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+11:17567:x1798653938065152:12345-192.168.204.49@tcp:101:bash.0 Request processed in 425us (1832us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.565050:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23561 00000100:00100000:0.0:1715330300.573512:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330300.573620:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938065216 00000100:00100000:3.0:1715330300.573630:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938065216 00000100:00100000:2.0:1715330300.574178:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23562 00000100:00100000:2.0:1715330300.574189:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+29:17567:x1798653938065216:12345-192.168.204.49@tcp:101:bash.0 00010000:00010000:2.0:1715330300.574218:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330300.574254:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d9b2a lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbaa6 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.574367:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d9b31 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.574384:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d9b31 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.574394:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d9b31 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00000004:00200000:2.0:1715330300.574443:0:25569:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000400:0xcd:0x0]: returning size 4096 00000004:00200000:2.0:1715330300.574447:0:25569:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:2.0:1715330300.574493:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d9b2a lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbaa6 expref: 31 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.574526:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d9b31 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbaa6 expref: 30 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.574536:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff8800b4207200) 00010000:00010000:2.0:1715330300.574539:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1715330300.574543:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db67cc0, rc 0) 00000100:00100000:2.0:1715330300.574634:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+30:17567:x1798653938065216:12345-192.168.204.49@tcp:101:bash.0 Request processed in 447us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.574641:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23562 00000100:00100000:1.0:1715330300.577929:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330300.578025:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938065344 00000100:00100000:3.0:1715330300.578035:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938065344 00000100:00100000:3.0:1715330300.578087:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23563 00000100:00100000:3.0:1715330300.578098:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+11:17567:x1798653938065344:12345-192.168.204.49@tcp:101:bash.0 00010000:00010000:3.0:1715330300.578120:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330300.578141:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d8c0/0xd895711d66d9b38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbaad expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.578328:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48f840/0xd895711d66d9b3f lrc: 3/1,0 mode: --/CR res: [0x240000402:0x193:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.578341:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48f840/0xd895711d66d9b3f lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x193:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.578352:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48f840/0xd895711d66d9b3f lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x193:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000004:00200000:3.0:1715330300.578362:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x193:0x0]: returning size 4096 00010000:00010000:3.0:1715330300.578453:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d8c0/0xd895711d66d9b38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbaad expref: 14 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.578475:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48f840/0xd895711d66d9b3f lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x193:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbaad expref: 13 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.578483:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x193:0x0].0x0 (ffff88009bbb0d00) 00010000:00010000:3.0:1715330300.578485:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1715330300.578488:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f48f840, rc 0) 00000100:00100000:3.0:1715330300.578534:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+13:17567:x1798653938065344:12345-192.168.204.49@tcp:101:bash.0 Request processed in 435us (616us total) trans 4294968473 rc 0/0 00000100:00100000:3.0:1715330300.578540:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23563 00000100:00100000:0.0:1715330300.582510:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330300.582605:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938065408 00000100:00100000:1.0:1715330300.582617:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938065408 00000100:00100000:1.0:1715330300.582678:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5098 00000100:00100000:1.0:1715330300.582685:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fbef450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+13:17567:x1798653938065408:12345-192.168.204.49@tcp:37:bash.0 00000100:00100000:2.0:1715330300.589471:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fbef450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+13:17567:x1798653938065408:12345-192.168.204.49@tcp:37:bash.0 Request processed in 6774us (6960us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.589486:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5098 00000100:00100000:0.0:1715330300.593495:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.593659:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938065472 00000100:00100000:2.0:1715330300.593668:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938065472 00000100:00100000:2.0:1715330300.593722:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5099 00000100:00100000:2.0:1715330300.593753:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+30:17567:x1798653938065472:12345-192.168.204.49@tcp:37:bash.0 00000100:00100000:2.0:1715330300.596260:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+30:17567:x1798653938065472:12345-192.168.204.49@tcp:37:bash.0 Request processed in 2523us (2768us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.596274:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5099 00000100:00100000:0.0:1715330300.611013:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.611276:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938065536 00000100:00100000:2.0:1715330300.611297:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938065536 00000100:00100000:2.0:1715330300.611842:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23564 00000100:00100000:2.0:1715330300.611850:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+30:17769:x1798653938065536:12345-192.168.204.49@tcp:101:cmp.0 00010000:00010000:2.0:1715330300.611869:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330300.611893:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d9b4d lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbab4 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.611955:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d9b54 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.611966:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d9b54 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.611975:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d9b54 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.611987:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d9b5b lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x736c74 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.611992:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d9b5b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x736c74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.611996:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d9b5b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x736c74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.612031:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d9b54 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.612036:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d9b54 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.612040:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d9b54 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.612045:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d9b54 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.612050:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64b40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.612052:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d9b54 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.612057:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d9b54 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.612066:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff8800b4207200) 00010000:00010000:2.0:1715330300.612068:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.612072:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d9b54 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.612076:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d9b54 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.612099:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d9b5b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x736c74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.612103:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d9b5b lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x736c74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.612107:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d9b5b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x736c74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.612111:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db65d40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.612113:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d9b5b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x736c74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.612117:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d9b5b lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x736c74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.612121:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x736c74 (ffff8800b4207700) 00010000:00010000:2.0:1715330300.612123:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.612124:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d9b5b lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x736c74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.612127:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d9b5b lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x736c74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.612154:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d9b4d lrc: 1/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbab4 expref: 31 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.612160:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d9b4d lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbab4 expref: 31 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.612167:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db65b00, rc 0) 00000100:00100000:2.0:1715330300.612218:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+30:17769:x1798653938065536:12345-192.168.204.49@tcp:101:cmp.0 Request processed in 368us (1215us total) trans 0 rc 301/301 00000100:00100000:2.0:1715330300.612229:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23564 00000100:00100000:0.0:1715330300.614122:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330300.614342:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938065600 00000100:00100000:3.0:1715330300.614351:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938065600 00000100:00100000:3.0:1715330300.614401:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23565 00000100:00100000:3.0:1715330300.614409:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+13:17769:x1798653938065600:12345-192.168.204.49@tcp:101:cmp.0 00010000:00010000:3.0:1715330300.614426:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330300.614452:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c900/0xd895711d66d9b62 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbabb expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.614504:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48db00/0xd895711d66d9b69 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.614514:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48db00/0xd895711d66d9b69 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.614525:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48db00/0xd895711d66d9b69 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.614535:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d440/0xd895711d66d9b70 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0x736c74 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.614541:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d440/0xd895711d66d9b70 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x736c74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.614545:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d440/0xd895711d66d9b70 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x736c74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.614578:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48db00/0xd895711d66d9b69 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.614583:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48db00/0xd895711d66d9b69 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.614588:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48db00/0xd895711d66d9b69 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.614594:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48db00/0xd895711d66d9b69 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.614599:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48db00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330300.614602:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48db00/0xd895711d66d9b69 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.614608:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48db00/0xd895711d66d9b69 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.614619:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff88009ef57100) 00010000:00010000:3.0:1715330300.614622:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330300.614626:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48db00/0xd895711d66d9b69 lrc: 3/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.614630:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48db00/0xd895711d66d9b69 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.614662:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d440/0xd895711d66d9b70 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x736c74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.614667:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d440/0xd895711d66d9b70 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x736c74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.614672:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d440/0xd895711d66d9b70 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x736c74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.614675:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48d440 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330300.614678:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d440/0xd895711d66d9b70 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x736c74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.614682:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d440/0xd895711d66d9b70 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x736c74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.614687:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x736c74 (ffff88009ef57a00) 00010000:00010000:3.0:1715330300.614689:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330300.614691:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d440/0xd895711d66d9b70 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xca:0x0].0x736c74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.614695:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d440/0xd895711d66d9b70 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xca:0x0].0x736c74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.614720:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c900/0xd895711d66d9b62 lrc: 1/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbabb expref: 14 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.614727:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c900/0xd895711d66d9b62 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbabb expref: 14 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.614760:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f48c900, rc 0) 00000100:00100000:3.0:1715330300.614803:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+13:17769:x1798653938065600:12345-192.168.204.49@tcp:101:cmp.0 Request processed in 394us (690us total) trans 0 rc 301/301 00000100:00100000:3.0:1715330300.614809:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23565 00000100:00100000:0.0:1715330300.617379:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.617461:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938065664 00000100:00100000:2.0:1715330300.617470:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938065664 00000100:00100000:2.0:1715330300.617516:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23566 00000100:00100000:2.0:1715330300.617523:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+30:17769:x1798653938065664:12345-192.168.204.49@tcp:101:cmp.0 00010000:00010000:2.0:1715330300.617543:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330300.617562:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66d9b77 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbac2 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.617619:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d9b7e lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.617630:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d9b7e lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.617640:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d9b7e lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.617650:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d9b85 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x5f366cae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.617656:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d9b85 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x5f366cae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.617661:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d9b85 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x5f366cae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.617693:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d9b7e lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.617698:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d9b7e lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.617702:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d9b7e lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.617707:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d9b7e lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.617713:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db65200 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.617717:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d9b7e lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.617722:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d9b7e lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.617748:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff8800b4207200) 00010000:00010000:2.0:1715330300.617751:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.617754:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d9b7e lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.617760:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d9b7e lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.617783:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d9b85 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x5f366cae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.617788:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d9b85 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x5f366cae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.617793:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d9b85 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x5f366cae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.617796:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66f40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.617799:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d9b85 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x5f366cae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.617803:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d9b85 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x5f366cae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.617809:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x5f366cae (ffff8800b4207900) 00010000:00010000:2.0:1715330300.617811:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.617813:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d9b85 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x5f366cae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.617820:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66d9b85 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x5f366cae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.617845:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66d9b77 lrc: 1/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbac2 expref: 31 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.617851:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66d9b77 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbac2 expref: 31 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.617857:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db66d00, rc 0) 00000100:00100000:2.0:1715330300.617896:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+30:17769:x1798653938065664:12345-192.168.204.49@tcp:101:cmp.0 Request processed in 372us (526us total) trans 0 rc 301/301 00000100:00100000:2.0:1715330300.617902:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23566 00000100:00100000:0.0:1715330300.621939:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330300.622079:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938065728 00000100:00100000:3.0:1715330300.622088:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938065728 00000100:00100000:3.0:1715330300.622306:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23567 00000100:00100000:3.0:1715330300.622313:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+13:17769:x1798653938065728:12345-192.168.204.49@tcp:101:cmp.0 00010000:00010000:3.0:1715330300.622336:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330300.622358:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48fa80/0xd895711d66d9b8c lrc: 2/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbac9 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.622418:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48f600/0xd895711d66d9b93 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.622431:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48f600/0xd895711d66d9b93 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.622442:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48f600/0xd895711d66d9b93 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.622453:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e1c0/0xd895711d66d9b9a lrc: 3/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0x5f366cae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.622457:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e1c0/0xd895711d66d9b9a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x5f366cae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.622461:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e1c0/0xd895711d66d9b9a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x5f366cae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.622499:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48f600/0xd895711d66d9b93 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.622505:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48f600/0xd895711d66d9b93 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.622510:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48f600/0xd895711d66d9b93 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.622515:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48f600/0xd895711d66d9b93 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.622520:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48f600 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330300.622524:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48f600/0xd895711d66d9b93 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.622530:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48f600/0xd895711d66d9b93 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.622540:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff88009ef57100) 00010000:00010000:3.0:1715330300.622542:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330300.622546:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48f600/0xd895711d66d9b93 lrc: 3/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.622550:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48f600/0xd895711d66d9b93 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.623138:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e1c0/0xd895711d66d9b9a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x5f366cae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.623145:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e1c0/0xd895711d66d9b9a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x5f366cae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.623150:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e1c0/0xd895711d66d9b9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x5f366cae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.623155:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48e1c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330300.623158:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e1c0/0xd895711d66d9b9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x5f366cae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.623162:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e1c0/0xd895711d66d9b9a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x5f366cae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.623170:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x5f366cae (ffff88009ef57200) 00010000:00010000:3.0:1715330300.623172:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330300.623174:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e1c0/0xd895711d66d9b9a lrc: 2/0,0 mode: --/PR res: [0x240000400:0xca:0x0].0x5f366cae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.623178:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e1c0/0xd895711d66d9b9a lrc: 0/0,0 mode: --/PR res: [0x240000400:0xca:0x0].0x5f366cae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.623207:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48fa80/0xd895711d66d9b8c lrc: 1/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbac9 expref: 14 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.623215:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48fa80/0xd895711d66d9b8c lrc: 0/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbac9 expref: 14 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.623222:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f48fa80, rc 0) 00000100:00100000:3.0:1715330300.623553:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+13:17769:x1798653938065728:12345-192.168.204.49@tcp:101:cmp.0 Request processed in 1237us (1622us total) trans 0 rc 301/301 00000100:00100000:3.0:1715330300.623560:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23567 00000100:00100000:0.0:1715330300.633389:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330300.633543:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938065856 00000100:00100000:3.0:1715330300.633554:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938065856 00000100:00100000:3.0:1715330300.634190:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23568 00000100:00100000:3.0:1715330300.634199:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b163480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+30:17769:x1798653938065856:12345-192.168.204.49@tcp:101:cmp.0 00010000:00010000:3.0:1715330300.634227:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330300.634282:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cb40/0xd895711d66d9ba1 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbad0 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.634384:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48eac0/0xd895711d66d9ba8 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.634399:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48eac0/0xd895711d66d9ba8 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.634410:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48eac0/0xd895711d66d9ba8 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.634419:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48fcc0/0xd895711d66d9baf lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x30 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.634424:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48fcc0/0xd895711d66d9baf lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.634429:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48fcc0/0xd895711d66d9baf lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.634465:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48eac0/0xd895711d66d9ba8 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.634469:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48eac0/0xd895711d66d9ba8 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.634474:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48eac0/0xd895711d66d9ba8 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.634479:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48eac0/0xd895711d66d9ba8 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.634484:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48eac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330300.634488:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48eac0/0xd895711d66d9ba8 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.634494:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48eac0/0xd895711d66d9ba8 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.634504:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff8800b4207200) 00010000:00010000:3.0:1715330300.634507:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330300.634511:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48eac0/0xd895711d66d9ba8 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.634516:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48eac0/0xd895711d66d9ba8 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.634546:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48fcc0/0xd895711d66d9baf lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.634551:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48fcc0/0xd895711d66d9baf lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.634555:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48fcc0/0xd895711d66d9baf lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.634558:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48fcc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330300.634560:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48fcc0/0xd895711d66d9baf lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.634564:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48fcc0/0xd895711d66d9baf lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.634568:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x30 (ffff88008d4e1c00) 00010000:00010000:3.0:1715330300.634570:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330300.634572:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48fcc0/0xd895711d66d9baf lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.634581:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48fcc0/0xd895711d66d9baf lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.634603:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cb40/0xd895711d66d9ba1 lrc: 1/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbad0 expref: 31 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.634610:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cb40/0xd895711d66d9ba1 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbad0 expref: 31 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.634617:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f48cb40, rc 0) 00000100:00100000:3.0:1715330300.634671:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b163480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+30:17769:x1798653938065856:12345-192.168.204.49@tcp:101:cmp.0 Request processed in 473us (1293us total) trans 0 rc 301/301 00000100:00100000:3.0:1715330300.634679:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23568 00000100:00100000:0.0:1715330300.638964:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330300.639075:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938065984 00000100:00100000:3.0:1715330300.639085:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938065984 00000100:00100000:3.0:1715330300.639141:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23569 00000100:00100000:3.0:1715330300.639149:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+13:17769:x1798653938065984:12345-192.168.204.49@tcp:101:cmp.0 00010000:00010000:3.0:1715330300.639170:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330300.639191:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c6c0/0xd895711d66d9bb6 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbad7 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.639277:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48ed00/0xd895711d66d9bbd lrc: 3/1,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.639300:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48ed00/0xd895711d66d9bbd lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.639310:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48ed00/0xd895711d66d9bbd lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.639322:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d200/0xd895711d66d9bc4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0x30 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.639330:0:7135:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c240/0xd895711d66d9ac8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9ac1 expref: 16 pid: 7139 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.639337:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d200/0xd895711d66d9bc4 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.639366:0:7135:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c240/0xd895711d66d9ac8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd895711d66d9ac1 expref: 16 pid: 7139 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330300.639381:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093983480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7135:1798653942499648:0@lo:104: 00000100:00100000:3.0:1715330300.639423:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.639454:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63b40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330300.639793:0:9413:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942499648 00000100:00100000:1.0:1715330300.639798:0:9413:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942499648 00000100:00100000:1.0:1715330300.639827:0:9413:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1184 00000100:00100000:1.0:1715330300.639831:0:9413:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093983800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:7135:x1798653942499648:12345-0@lo:104: 00010000:00010000:1.0:1715330300.639842:0:9413:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfeac0/0xd895711d66d9ac1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d9ac8 expref: -99 pid: 7147 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.639906:0:9413:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1715330300.639912:0:9413:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093983800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:7135:x1798653942499648:12345-0@lo:104: Request processed in 80us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330300.639918:0:9413:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1184 00010000:00010000:0.0:1715330300.640207:0:7123:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715330300.640213:0:7123:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfeac0/0xd895711d66d9ac1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d9ac8 expref: -99 pid: 7147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.640220:0:7123:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfeac0 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330300.640225:0:7123:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfeac0/0xd895711d66d9ac1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x30 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd895711d66d9ac8 expref: -99 pid: 7147 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330300.640232:0:7123:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfeac0/0xd895711d66d9ac1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x30 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd895711d66d9ac8 expref: -99 pid: 7147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.640256:0:7123:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfeac0/0xd895711d66d9ac1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x30 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d9ac8 expref: -99 pid: 7147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.640262:0:7123:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330300.640299:0:7123:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfeac0/0xd895711d66d9ac1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x30 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d9ac8 expref: -99 pid: 7147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.640306:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff880093bfeac0/0xd895711d66d9ac1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x30 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d9ac8 expref: -99 pid: 7147 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.640335:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330300.640336:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330300.640338:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330300.640354:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1715330300.640364:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b160000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942499712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330300.640390:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330300.640421:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942499712 00000100:00100000:0.0:1715330300.640424:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942499712 00000100:00100000:3.0:1715330300.640429:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093983480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7135:1798653942499648:0@lo:104: 00010000:00010000:0.0:1715330300.640441:0:10674:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c240/0xd895711d66d9ac8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd895711d66d9ac1 expref: 17 pid: 7139 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.640456:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d200/0xd895711d66d9bc4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000100:00100000:0.0:1715330300.640458:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1569 00000100:00100000:0.0:1715330300.640462:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b161500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+17:3690:x1798653942499712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330300.640471:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:3.0:1715330300.643168:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968473 is committed 00000001:00080000:3.0:1715330300.643186:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968469 is committed 00000020:00080000:3.0:1715330300.643196:0:8267:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0001: 390 batchid updated 00000020:00080000:0.0:1715330300.643283:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 390 00000004:00080000:0.0:1715330300.643344:0:8285:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88009d7e36c0 with version 750 00000020:00080000:0.0:1715330300.643846:0:8285:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 390 cancel update log [0x200000401:0x3:0x0].391: rc = 0 00000020:00080000:0.0:1715330300.643915:0:8285:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 390 cancel update log [0x240000400:0x3:0x0].389: rc = 0 00000020:00080000:0.0:1715330300.643922:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 390 00010000:00010000:1.0:1715330300.644028:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457c240/0xd895711d66d9ac8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x30 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd895711d66d9ac1 expref: 11 pid: 7139 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.644047:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x30 (ffff88009bbb0100) 00010000:00010000:1.0:1715330300.644051:0:10674:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d200/0xd895711d66d9bc4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330300.644060:0:10674:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d200/0xd895711d66d9bc4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330300.644066:0:10674:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d200/0xd895711d66d9bc4 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330300.644163:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330300.644235:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b161500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+10:3690:x1798653942499712:12345-0@lo:103:ldlm_bl.0 Request processed in 3770us (3842us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330300.644245:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1569 00000100:00100000:0.0:1715330300.644267:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b160000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942499712:0@lo:103:ldlm_bl.0 00000004:00080000:1.0:1715330300.644269:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 750 rpc_version 750 00000020:00100000:1.0:1715330300.644307:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:3.0:1715330300.644655:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d200/0xd895711d66d9bc4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.644662:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d200/0xd895711d66d9bc4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.644760:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48ef40/0xd895711d66d9bcb lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.644772:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48ef40/0xd895711d66d9bcb lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.644779:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48ef40/0xd895711d66d9bcb lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000004:00200000:3.0:1715330300.644787:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x199:0x0]: returning size 2 00010000:00010000:3.0:1715330300.644835:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48ed00/0xd895711d66d9bbd lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.644841:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48ed00/0xd895711d66d9bbd lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.644846:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48ed00/0xd895711d66d9bbd lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.644851:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48ed00/0xd895711d66d9bbd lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.644856:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48ed00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330300.644859:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48ed00/0xd895711d66d9bbd lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.644865:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48ed00/0xd895711d66d9bbd lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.644872:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff88009ef57100) 00010000:00010000:3.0:1715330300.644874:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330300.644877:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48ed00/0xd895711d66d9bbd lrc: 3/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.644881:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48ed00/0xd895711d66d9bbd lrc: 0/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00000100:00100000:1.0:1715330300.645150:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88009ba67100 x1798653942499840/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1715330300.645169:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba67100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942499840:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1715330300.645208:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1715330300.645642:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d200/0xd895711d66d9bc4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.645648:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d200/0xd895711d66d9bc4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.645653:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d200/0xd895711d66d9bc4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.645657:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48d200 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330300.645659:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d200/0xd895711d66d9bc4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.645663:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d200/0xd895711d66d9bc4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.645671:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x30 (ffff88009bbb0100) 00010000:00010000:3.0:1715330300.645673:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330300.645675:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d200/0xd895711d66d9bc4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xca:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.645680:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d200/0xd895711d66d9bc4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xca:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.645726:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c6c0/0xd895711d66d9bb6 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbad7 expref: 12 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.645751:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48ef40/0xd895711d66d9bcb lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbad7 expref: 11 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.645758:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff88009b985400) 00010000:00010000:3.0:1715330300.645761:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330300.645763:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f48ef40, rc 0) 00000100:00100000:3.0:1715330300.645802:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+11:17769:x1798653938065984:12345-192.168.204.49@tcp:101:cmp.0 Request processed in 6653us (6848us total) trans 4294968474 rc 0/0 00000100:00100000:3.0:1715330300.645810:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23569 00000100:00100000:0.0:1715330300.645996:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942499840 00000100:00100000:1.0:1715330300.645997:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330300.646002:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942499840 00000100:00100000:0.0:1715330300.646170:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2992 00000100:00100000:0.0:1715330300.646175:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:8278:x1798653942499840:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715330300.646282:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:8278:x1798653942499840:12345-0@lo:1000:osp_up0-1.0 Request processed in 106us (1074us total) trans 4294983560 rc 0/0 00000100:00100000:0.0:1715330300.646298:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2992 00000100:00100000:1.0:1715330300.646325:0:8278:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983547 gen 2 00000004:00080000:1.0:1715330300.646330:0:8278:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983547 committed transno 4294983547 00000020:00080000:1.0:1715330300.646335:0:8278:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff88011db63f00 refcount 2 committed 0 result 0 batchid 391 00000020:00080000:1.0:1715330300.646338:0:8278:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880135e32200 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff88011db63a80 00000020:00080000:1.0:1715330300.646342:0:8278:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].392 00000020:00080000:1.0:1715330300.646344:0:8278:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880135e32e00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88009d4b2c00 00000020:00080000:1.0:1715330300.646348:0:8278:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].390 00000100:00100000:1.0:1715330300.646391:0:8278:0:(client.c:3000:ptlrpc_free_committed()) @@@ stopping search req@ffff88009ba67100 x1798653942499840/t4294983560(4294983560) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1715330316 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 00000100:00100000:1.0:1715330300.646405:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba67100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942499840:0@lo:1000:osp_up0-1.0 00000020:00080000:0.0:1715330300.646681:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 391 committed batchid 390 00000020:00080000:0.0:1715330300.646708:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 390 00000100:00100000:0.0:1715330300.651557:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330300.651824:0:17206:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938066048 00000100:00100000:3.0:1715330300.651833:0:17206:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938066048 00000100:00100000:3.0:1715330300.652990:0:17206:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5220 00000100:00100000:3.0:1715330300.652998:0:17206:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b160000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:72de1896-1df4-4b3a-930a-9116d2c66168+21:2012:x1798653938066048:12345-192.168.204.49@tcp:101:cmp.0 00010000:00010000:3.0:1715330300.653016:0:17206:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330300.653037:0:17206:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f48d680/0xd895711d66d9bd9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbade expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1715330300.653058:0:17206:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9cb:0x0] initial LVB size: 2, mtime: 0x663ddcfc, atime: 0x0, ctime: 0x663ddcfc, blocks: 0x8 00010000:00010000:3.0:1715330300.653076:0:17206:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330300.653078:0:17206:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330300.653086:0:17206:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f48d680/0xd895711d66d9bd9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbade expref: 22 pid: 17206 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1715330300.653099:0:17206:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f48d680/0xd895711d66d9bd9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbade expref: 22 pid: 17206 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1715330300.653109:0:17206:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f48d680, rc 0) 00000100:00100000:3.0:1715330300.653172:0:17206:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b160000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:72de1896-1df4-4b3a-930a-9116d2c66168+22:2012:x1798653938066048:12345-192.168.204.49@tcp:101:cmp.0 Request processed in 174us (1622us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.653178:0:17206:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5220 00000100:00100000:3.0:1715330300.657870:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330300.657945:0:9403:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938066176 00000100:00100000:0.0:1715330300.657954:0:9403:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938066176 00002000:00100000:0.0:1715330300.657991:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9cb:0x0] (0->4095) req@ffff880093983480 x1798653938066176/t0(0) o3->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:511/0 lens 488/0 e 0 to 0 dl 1715330311 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1715330300.658000:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093983480 with x1798653938066176 ext(0->4095) 00002000:00010000:0.0:1715330300.658005:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093983480 00000100:00100000:0.0:1715330300.658231:0:9403:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 8 00000100:00100000:0.0:1715330300.658238:0:9403:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093983480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+22:2014:x1798653938066176:12345-192.168.204.49@tcp:3:cmp.0 00000100:00100000:0.0:1715330300.658471:0:9403:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093983480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+22:2014:x1798653938066176:12345-192.168.204.49@tcp:3:cmp.0 Request processed in 232us (607us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1715330300.658477:0:9403:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 8 00002000:00100000:0.0:1715330300.658483:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9cb:0x0] (0->4095) req@ffff880093983480 x1798653938066176/t0(0) o3->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:511/0 lens 488/4536 e 0 to 0 dl 1715330311 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1715330300.658488:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093983480 with x1798653938066176 ext(0->4095) 00002000:00010000:0.0:1715330300.658490:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093983480 00000100:00100000:0.0:1715330300.663553:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.663619:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938066304 00000100:00100000:2.0:1715330300.663629:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938066304 00000100:00100000:2.0:1715330300.663678:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5100 00000100:00100000:2.0:1715330300.663685:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+11:17769:x1798653938066304:12345-192.168.204.49@tcp:35:cmp.0 00000100:00100000:2.0:1715330300.663978:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+12:17769:x1798653938066304:12345-192.168.204.49@tcp:35:cmp.0 Request processed in 291us (430us total) trans 4294968475 rc 0/0 00000100:00100000:2.0:1715330300.663985:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5100 00000100:00100000:1.0:1715330300.677086:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330300.677720:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938066432 00000100:00100000:3.0:1715330300.677764:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938066432 00000100:00100000:3.0:1715330300.677815:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23570 00000100:00100000:3.0:1715330300.677823:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+30:17771:x1798653938066432:12345-192.168.204.49@tcp:101:cmp.0 00010000:00010000:3.0:1715330300.677841:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330300.677859:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c240/0xd895711d66d9be0 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbae5 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.677922:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48df80/0xd895711d66d9be7 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.677932:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48df80/0xd895711d66d9be7 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.677941:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48df80/0xd895711d66d9be7 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.677949:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66d9bee lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x31 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.677954:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66d9bee lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.677958:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66d9bee lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.677987:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48df80/0xd895711d66d9be7 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.677992:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48df80/0xd895711d66d9be7 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.677997:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48df80/0xd895711d66d9be7 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.678002:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48df80/0xd895711d66d9be7 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.678007:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48df80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330300.678010:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48df80/0xd895711d66d9be7 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.678015:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48df80/0xd895711d66d9be7 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.678023:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff8800b4207200) 00010000:00010000:3.0:1715330300.678026:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330300.678029:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48df80/0xd895711d66d9be7 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.678034:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48df80/0xd895711d66d9be7 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.678054:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66d9bee lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.678059:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66d9bee lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.678063:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66d9bee lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.678067:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48cd80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330300.678069:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66d9bee lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.678073:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66d9bee lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.678079:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x31 (ffff88011d537400) 00010000:00010000:3.0:1715330300.678081:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330300.678083:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66d9bee lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.678087:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66d9bee lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.678108:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c240/0xd895711d66d9be0 lrc: 1/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbae5 expref: 31 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.678115:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c240/0xd895711d66d9be0 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbae5 expref: 31 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.678122:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f48c240, rc 0) 00000100:00100000:3.0:1715330300.679482:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+30:17771:x1798653938066432:12345-192.168.204.49@tcp:101:cmp.0 Request processed in 1654us (2397us total) trans 0 rc 301/301 00000100:00100000:3.0:1715330300.679489:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23570 00000100:00100000:3.0:1715330300.682404:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330300.682476:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938066560 00000100:00100000:0.0:1715330300.682484:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938066560 00000100:00100000:0.0:1715330300.682531:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23571 00000100:00100000:0.0:1715330300.682538:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093983b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+12:17771:x1798653938066560:12345-192.168.204.49@tcp:101:cmp.0 00010000:00010000:0.0:1715330300.682565:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330300.682586:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a18c0/0xd895711d66d9bf5 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbaec expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.682652:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a1b00/0xd895711d66d9bfc lrc: 3/1,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.682663:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a1b00/0xd895711d66d9bfc lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330300.682673:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a1b00/0xd895711d66d9bfc lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330300.682681:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a33c0/0xd895711d66d9c03 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0x31 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330300.682689:0:7135:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a3600/0xd895711d66d99f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d99ef expref: 9 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.682694:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a33c0/0xd895711d66d9c03 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330300.682720:0:7135:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a3600/0xd895711d66d99f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd895711d66d99ef expref: 9 pid: 7138 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330300.682775:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7135:1798653942499904:0@lo:104: 00000100:00100000:0.0:1715330300.682817:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330300.682844:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009d7e3000 going to sleep for 11 seconds 00000100:00100000:3.0:1715330300.683006:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942499904 00000100:00100000:3.0:1715330300.683009:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942499904 00000100:00100000:3.0:1715330300.683040:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1185 00000100:00100000:3.0:1715330300.683045:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7135:x1798653942499904:12345-0@lo:104: 00010000:00010000:3.0:1715330300.683054:0:7118:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c000/0xd895711d66d99ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d99f6 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330300.683168:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7135:1798653942499904:0@lo:104: 00010000:00010000:1.0:1715330300.683183:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a33c0/0xd895711d66d9c03 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.683388:0:7118:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1715330300.683393:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7135:x1798653942499904:12345-0@lo:104: Request processed in 347us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.683400:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1185 00010000:00010000:2.0:1715330300.683471:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1715330300.683477:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c000/0xd895711d66d99ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d99f6 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.683483:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457c000 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:2.0:1715330300.683487:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c000/0xd895711d66d99ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x31 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd895711d66d99f6 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1715330300.683497:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c000/0xd895711d66d99ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x31 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd895711d66d99f6 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.683518:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c000/0xd895711d66d99ef lrc: 2/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x31 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d99f6 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.683522:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1715330300.683542:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c000/0xd895711d66d99ef lrc: 1/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x31 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d99f6 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.683547:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457c000/0xd895711d66d99ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x31 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d99f6 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.683562:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330300.683563:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330300.683564:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330300.683603:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1715330300.683612:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942499968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1715330300.683636:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.683660:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942499968 00000100:00100000:3.0:1715330300.683663:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942499968 00010000:00010000:3.0:1715330300.683675:0:10674:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a3600/0xd895711d66d99f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd895711d66d99ef expref: 10 pid: 7138 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330300.683699:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1570 00000100:00100000:3.0:1715330300.683703:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093981180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+10:3689:x1798653942499968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1715330300.683710:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:3.0:1715330300.685002:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968475 is committed 00000020:00080000:3.0:1715330300.685010:0:8267:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0001: 391 batchid updated 00000020:00080000:0.0:1715330300.685300:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 391 00000004:00080000:0.0:1715330300.685347:0:8285:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88009d7e30c0 with version 751 00000020:00080000:0.0:1715330300.685465:0:8285:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 391 cancel update log [0x200000401:0x3:0x0].392: rc = 0 00000020:00080000:0.0:1715330300.685522:0:8285:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 391 cancel update log [0x240000400:0x3:0x0].390: rc = 0 00000020:00080000:0.0:1715330300.685530:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 391 00000004:00080000:1.0:1715330300.685797:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 751 rpc_version 751 00000020:00100000:1.0:1715330300.685824:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1715330300.685832:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012b55dc00 x1798653942500096/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1715330300.685851:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55dc00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942500096:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1715330300.685893:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330300.685916:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1715330300.685966:0:7139:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942500096 00000100:00100000:3.0:1715330300.685973:0:7139:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942500096 00000100:00100000:3.0:1715330300.686011:0:7139:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2993 00000100:00100000:3.0:1715330300.686016:0:7139:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d775880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:8278:x1798653942500096:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1715330300.686116:0:7139:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d775880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:8278:x1798653942500096:12345-0@lo:1000:osp_up0-1.0 Request processed in 99us (221us total) trans 4294983561 rc 0/0 00000100:00100000:3.0:1715330300.686122:0:7139:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2993 00010000:00010000:2.0:1715330300.686226:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a3600/0xd895711d66d99f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x31 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd895711d66d99ef expref: 10 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.686239:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x31 (ffff88008b233000) 00010000:00010000:2.0:1715330300.686243:0:10674:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a33c0/0xd895711d66d9c03 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330300.686251:0:10674:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a33c0/0xd895711d66d9c03 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330300.686257:0:10674:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a33c0/0xd895711d66d9c03 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330300.686272:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330300.686311:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093981180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+9:3689:x1798653942499968:12345-0@lo:103:ldlm_bl.0 Request processed in 2606us (2673us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.686319:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1570 00000100:00100000:1.0:1715330300.686414:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55dc00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942500096:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1715330300.686428:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a33c0/0xd895711d66d9c03 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330300.686434:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a33c0/0xd895711d66d9c03 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330300.686506:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd200/0xd895711d66d9c0a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x197:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330300.686515:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd200/0xd895711d66d9c0a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330300.686525:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd200/0xd895711d66d9c0a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000004:00200000:1.0:1715330300.686532:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x197:0x0]: returning size 2 00010000:00010000:1.0:1715330300.686578:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a1b00/0xd895711d66d9bfc lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330300.686583:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a1b00/0xd895711d66d9bfc lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330300.686588:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a1b00/0xd895711d66d9bfc lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330300.686592:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a1b00/0xd895711d66d9bfc lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330300.686598:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a1b00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330300.686602:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a1b00/0xd895711d66d9bfc lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330300.686607:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a1b00/0xd895711d66d9bfc lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330300.686614:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff88009ef57100) 00010000:00010000:1.0:1715330300.686617:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330300.686619:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a1b00/0xd895711d66d9bfc lrc: 3/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330300.686624:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a1b00/0xd895711d66d9bfc lrc: 0/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330300.686636:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a33c0/0xd895711d66d9c03 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330300.686645:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a33c0/0xd895711d66d9c03 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330300.686649:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a33c0/0xd895711d66d9c03 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330300.686652:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a33c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330300.686654:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a33c0/0xd895711d66d9c03 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330300.686658:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a33c0/0xd895711d66d9c03 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330300.686664:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x31 (ffff88008b233000) 00010000:00010000:1.0:1715330300.686666:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330300.686668:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a33c0/0xd895711d66d9c03 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xca:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330300.686671:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a33c0/0xd895711d66d9c03 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xca:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:1.0:1715330300.686706:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a18c0/0xd895711d66d9bf5 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbaec expref: 13 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.686718:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd200/0xd895711d66d9c0a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbaec expref: 12 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.686722:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x197:0x0].0x0 (ffff88008d4e1300) 00010000:00010000:1.0:1715330300.686724:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715330300.686725:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfd200, rc 0) 00000100:00100000:1.0:1715330300.686788:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093983b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+12:17771:x1798653938066560:12345-192.168.204.49@tcp:101:cmp.0 Request processed in 4249us (4389us total) trans 4294968476 rc 0/0 00000100:00100000:1.0:1715330300.686794:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23571 00000100:00100000:3.0:1715330300.687259:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942499968:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330300.690578:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.690701:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938066624 00000100:00100000:2.0:1715330300.690710:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938066624 00000100:00100000:2.0:1715330300.690778:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5221 00000100:00100000:2.0:1715330300.690784:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72de1896-1df4-4b3a-930a-9116d2c66168+20:2011:x1798653938066624:12345-192.168.204.49@tcp:101:cmp.0 00010000:00010000:2.0:1715330300.690799:0:9633:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330300.690817:0:9633:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011db64240/0xd895711d66d9c18 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbaf3 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1715330300.690838:0:9633:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9cb:0x0] initial LVB size: 2, mtime: 0x663ddcfc, atime: 0x0, ctime: 0x663ddcfc, blocks: 0x8 00010000:00010000:2.0:1715330300.690855:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330300.690857:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330300.690865:0:9633:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db64240/0xd895711d66d9c18 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbaf3 expref: 21 pid: 9633 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1715330300.690879:0:9633:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011db64240/0xd895711d66d9c18 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbaf3 expref: 21 pid: 9633 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1715330300.690889:0:9633:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db64240, rc 0) 00000100:00100000:2.0:1715330300.690928:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72de1896-1df4-4b3a-930a-9116d2c66168+21:2011:x1798653938066624:12345-192.168.204.49@tcp:101:cmp.0 Request processed in 143us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.690934:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5221 00000100:00100000:1.0:1715330300.698698:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330300.699046:0:9403:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938066752 00000100:00100000:0.0:1715330300.699055:0:9403:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938066752 00002000:00100000:0.0:1715330300.699091:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9cb:0x0] (0->4095) req@ffff88008d776680 x1798653938066752/t0(0) o3->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:511/0 lens 488/0 e 0 to 0 dl 1715330311 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1715330300.699101:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d776680 with x1798653938066752 ext(0->4095) 00002000:00010000:0.0:1715330300.699105:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d776680 00000100:00100000:0.0:1715330300.700030:0:9403:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 9 00000100:00100000:0.0:1715330300.700038:0:9403:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d776680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+21:2013:x1798653938066752:12345-192.168.204.49@tcp:3:cmp.0 00000100:00100000:0.0:1715330300.700183:0:9403:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d776680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+21:2013:x1798653938066752:12345-192.168.204.49@tcp:3:cmp.0 Request processed in 144us (1490us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1715330300.700189:0:9403:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 9 00002000:00100000:0.0:1715330300.700194:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9cb:0x0] (0->4095) req@ffff88008d776680 x1798653938066752/t0(0) o3->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:511/0 lens 488/4536 e 0 to 0 dl 1715330311 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1715330300.700202:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d776680 with x1798653938066752 ext(0->4095) 00002000:00010000:0.0:1715330300.700205:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d776680 00000100:00100000:0.0:1715330300.704377:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.704646:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938066880 00000100:00100000:2.0:1715330300.704655:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938066880 00000100:00100000:2.0:1715330300.704753:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5101 00000100:00100000:2.0:1715330300.704761:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+12:17771:x1798653938066880:12345-192.168.204.49@tcp:35:cmp.0 00000100:00100000:2.0:1715330300.705240:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+13:17771:x1798653938066880:12345-192.168.204.49@tcp:35:cmp.0 Request processed in 477us (870us total) trans 4294968477 rc 0/0 00000100:00100000:2.0:1715330300.705246:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5101 00000100:00100000:0.0:1715330300.715390:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330300.715462:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938067008 00000100:00100000:1.0:1715330300.715471:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938067008 00000100:00100000:1.0:1715330300.715517:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23572 00000100:00100000:1.0:1715330300.715523:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+30:17773:x1798653938067008:12345-192.168.204.49@tcp:101:cmp.0 00010000:00010000:1.0:1715330300.715540:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330300.715557:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66d9c1f lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbafa expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.715617:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d9c26 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330300.715628:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d9c26 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330300.715635:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d9c26 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330300.715641:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d9c2d lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x3031 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330300.715645:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d9c2d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330300.715647:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d9c2d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330300.715673:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d9c26 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330300.715677:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d9c26 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330300.715680:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d9c26 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330300.715684:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d9c26 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330300.715686:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bffa80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330300.715689:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d9c26 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330300.715692:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d9c26 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330300.715698:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff8800b4207200) 00010000:00010000:1.0:1715330300.715700:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330300.715702:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d9c26 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330300.715705:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66d9c26 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330300.715711:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d9c2d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330300.715713:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d9c2d lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330300.715715:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d9c2d lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330300.715718:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfd440 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330300.715719:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d9c2d lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330300.715724:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d9c2d lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330300.715727:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x3031 (ffff880093a11100) 00010000:00010000:1.0:1715330300.715728:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330300.715760:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d9c2d lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330300.715764:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66d9c2d lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330300.715786:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66d9c1f lrc: 1/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbafa expref: 31 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.715792:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66d9c1f lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbafa expref: 31 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.715797:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfeac0, rc 0) 00000100:00100000:1.0:1715330300.715842:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+30:17773:x1798653938067008:12345-192.168.204.49@tcp:101:cmp.0 Request processed in 318us (456us total) trans 0 rc 301/301 00000100:00100000:1.0:1715330300.715848:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23572 00000100:00100000:1.0:1715330300.718211:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.718379:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938067136 00000100:00100000:2.0:1715330300.718386:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938067136 00000100:00100000:2.0:1715330300.718559:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23573 00000100:00100000:2.0:1715330300.718566:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+13:17773:x1798653938067136:12345-192.168.204.49@tcp:101:cmp.0 00010000:00010000:2.0:1715330300.718583:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330300.718597:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d9c34 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbb01 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.718652:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d9c3b lrc: 3/1,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.718663:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d9c3b lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330300.718671:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d9c3b lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330300.718678:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d9c42 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0x3031 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.718685:0:7135:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a0d80/0xd895711d66d998d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x3031 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9986 expref: 8 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.718690:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d9c42 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0x3031 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330300.718716:0:7135:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a0d80/0xd895711d66d998d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x3031 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd895711d66d9986 expref: 8 pid: 7138 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330300.718756:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091cc8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7135:1798653942500160:0@lo:104: 00000100:00100000:2.0:1715330300.718792:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330300.718811:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880134435900 going to sleep for 11 seconds 00000100:00100000:3.0:1715330300.718854:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942500160 00000100:00100000:3.0:1715330300.718859:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942500160 00000100:00100000:3.0:1715330300.718893:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1186 00000100:00100000:3.0:1715330300.718897:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7135:x1798653942500160:12345-0@lo:104: 00010000:00010000:3.0:1715330300.718913:0:7118:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457db00/0xd895711d66d9986 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d998d expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.719268:0:7118:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1715330300.719274:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7135:x1798653942500160:12345-0@lo:104: Request processed in 376us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.719281:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1186 00000100:00100000:2.0:1715330300.719358:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091cc8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7135:1798653942500160:0@lo:104: 00010000:00010000:2.0:1715330300.719372:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d9c42 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0x3031 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330300.719445:0:9415:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715330300.719452:0:9415:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457db00/0xd895711d66d9986 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d998d expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.719460:0:9415:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457db00 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330300.719464:0:9415:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457db00/0xd895711d66d9986 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x3031 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd895711d66d998d expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330300.719472:0:9415:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457db00/0xd895711d66d9986 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x3031 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd895711d66d998d expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.719499:0:9415:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457db00/0xd895711d66d9986 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x3031 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d998d expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.719505:0:9415:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1715330300.719620:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d647480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942500224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1715330300.719647:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1715330300.719670:0:9415:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457db00/0xd895711d66d9986 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x3031 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d998d expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.719680:0:9415:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457db00/0xd895711d66d9986 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x3031 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d998d expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.719700:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330300.719769:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330300.719770:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330300.719887:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942500224 00000100:00100000:2.0:1715330300.719893:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942500224 00010000:00010000:2.0:1715330300.719906:0:10674:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a0d80/0xd895711d66d998d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x3031 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd895711d66d9986 expref: 9 pid: 7138 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330300.719932:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1571 00000100:00100000:2.0:1715330300.719937:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093983100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+9:3689:x1798653942500224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715330300.719945:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:3.0:1715330300.721365:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968477 is committed 00010000:00010000:2.0:1715330300.721507:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a0d80/0xd895711d66d998d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x3031 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd895711d66d9986 expref: 9 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.721522:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x3031 (ffff88008b233700) 00010000:00010000:2.0:1715330300.721526:0:10674:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d9c42 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0x3031 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330300.721533:0:10674:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d9c42 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x3031 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330300.721539:0:10674:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d9c42 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x3031 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330300.721555:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330300.721591:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093983100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+8:3689:x1798653942500224:12345-0@lo:103:ldlm_bl.0 Request processed in 1653us (1944us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.721598:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1571 00000100:00100000:3.0:1715330300.721672:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d647480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942500224:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1715330300.721692:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d9c42 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.721697:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d9c42 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.721801:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e400/0xd895711d66d9c49 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x196:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.721808:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e400/0xd895711d66d9c49 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.721814:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e400/0xd895711d66d9c49 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000004:00200000:3.0:1715330300.721822:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x196:0x0]: returning size 3 00010000:00010000:3.0:1715330300.721888:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d9c3b lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.721894:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d9c3b lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.721898:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d9c3b lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.721902:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d9c3b lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.721908:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64d80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330300.721912:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d9c3b lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.721917:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d9c3b lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.721924:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff88009ef57100) 00010000:00010000:3.0:1715330300.721927:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330300.721929:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d9c3b lrc: 3/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.721933:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d9c3b lrc: 0/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.722370:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d9c42 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.722376:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d9c42 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.722380:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d9c42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.722384:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db67600 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330300.722386:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d9c42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.722390:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d9c42 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.722396:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x3031 (ffff88008b233700) 00010000:00010000:3.0:1715330300.722398:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330300.722400:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d9c42 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xca:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.722403:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d9c42 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xca:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.722441:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d9c34 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb01 expref: 14 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.722453:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e400/0xd895711d66d9c49 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb01 expref: 13 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.722459:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x196:0x0].0x0 (ffff88009b985500) 00010000:00010000:3.0:1715330300.722461:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330300.722463:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f48e400, rc 0) 00000100:00100000:3.0:1715330300.722643:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+13:17773:x1798653938067136:12345-192.168.204.49@tcp:101:cmp.0 Request processed in 4075us (4436us total) trans 4294968478 rc 0/0 00000100:00100000:3.0:1715330300.722649:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23573 00000100:00100000:0.0:1715330300.727930:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330300.728019:0:17206:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938067200 00000100:00100000:3.0:1715330300.728028:0:17206:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938067200 00000100:00100000:3.0:1715330300.728077:0:17206:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5222 00000100:00100000:3.0:1715330300.728084:0:17206:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d644380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:72de1896-1df4-4b3a-930a-9116d2c66168+21:2011:x1798653938067200:12345-192.168.204.49@tcp:101:cmp.0 00010000:00010000:3.0:1715330300.728100:0:17206:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330300.728120:0:17206:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f48c480/0xd895711d66d9c57 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbb08 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1715330300.728147:0:17206:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9cd:0x0] initial LVB size: 3, mtime: 0x663ddcfc, atime: 0x0, ctime: 0x663ddcfc, blocks: 0x8 00010000:00010000:3.0:1715330300.728163:0:17206:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330300.728165:0:17206:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330300.728173:0:17206:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f48c480/0xd895711d66d9c57 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb08 expref: 22 pid: 17206 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1715330300.728186:0:17206:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f48c480/0xd895711d66d9c57 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb08 expref: 22 pid: 17206 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1715330300.728196:0:17206:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f48c480, rc 0) 00000100:00100000:3.0:1715330300.728244:0:17206:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d644380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:72de1896-1df4-4b3a-930a-9116d2c66168+22:2011:x1798653938067200:12345-192.168.204.49@tcp:101:cmp.0 Request processed in 159us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.728250:0:17206:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5222 00000100:00100000:0.0:1715330300.732783:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.732879:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938067328 00000100:00100000:2.0:1715330300.732887:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938067328 00002000:00100000:2.0:1715330300.732922:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x9cd:0x0] (0->4095) req@ffff88009d647480 x1798653938067328/t0(0) o3->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:511/0 lens 488/0 e 0 to 0 dl 1715330311 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1715330300.732931:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d647480 with x1798653938067328 ext(0->4095) 00002000:00010000:2.0:1715330300.732935:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d647480 00000100:00100000:2.0:1715330300.732951:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 10 00000100:00100000:2.0:1715330300.732957:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d647480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+22:2011:x1798653938067328:12345-192.168.204.49@tcp:3:cmp.0 00000100:00100000:2.0:1715330300.733578:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d647480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+22:2011:x1798653938067328:12345-192.168.204.49@tcp:3:cmp.0 Request processed in 619us (800us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1715330300.733586:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 10 00002000:00100000:2.0:1715330300.733592:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x9cd:0x0] (0->4095) req@ffff88009d647480 x1798653938067328/t0(0) o3->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:511/0 lens 488/4536 e 0 to 0 dl 1715330311 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1715330300.733599:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d647480 with x1798653938067328 ext(0->4095) 00002000:00010000:2.0:1715330300.733601:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d647480 00000100:00100000:1.0:1715330300.743268:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.743377:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938067456 00000100:00100000:2.0:1715330300.743385:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938067456 00000100:00100000:2.0:1715330300.743642:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5102 00000100:00100000:2.0:1715330300.743648:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+13:17773:x1798653938067456:12345-192.168.204.49@tcp:35:cmp.0 00000100:00100000:2.0:1715330300.745379:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+14:17773:x1798653938067456:12345-192.168.204.49@tcp:35:cmp.0 Request processed in 1618us (2005us total) trans 4294968479 rc 0/0 00000100:00100000:2.0:1715330300.745389:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5102 00000100:00100000:0.0:1715330300.758187:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330300.759372:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938067584 00000100:00100000:3.0:1715330300.759382:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938067584 00000100:00100000:3.0:1715330300.759435:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23574 00000100:00100000:3.0:1715330300.759443:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+30:17775:x1798653938067584:12345-192.168.204.49@tcp:101:cmp.0 00010000:00010000:3.0:1715330300.759460:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330300.759476:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c000/0xd895711d66d9c5e lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbb0f expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.759553:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e880/0xd895711d66d9c65 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.759564:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e880/0xd895711d66d9c65 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.759576:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e880/0xd895711d66d9c65 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.759585:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e640/0xd895711d66d9c6c lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x35 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.759594:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e640/0xd895711d66d9c6c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.759600:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e640/0xd895711d66d9c6c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.759635:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e880/0xd895711d66d9c65 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.759641:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e880/0xd895711d66d9c65 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.759645:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e880/0xd895711d66d9c65 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.759650:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e880/0xd895711d66d9c65 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.759655:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48e880 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330300.759658:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e880/0xd895711d66d9c65 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.759664:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e880/0xd895711d66d9c65 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.759673:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff8800b4207200) 00010000:00010000:3.0:1715330300.759675:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330300.759679:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e880/0xd895711d66d9c65 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.759683:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e880/0xd895711d66d9c65 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.759707:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e640/0xd895711d66d9c6c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.759711:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e640/0xd895711d66d9c6c lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.759716:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e640/0xd895711d66d9c6c lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.759719:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48e640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330300.759721:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e640/0xd895711d66d9c6c lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.759724:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e640/0xd895711d66d9c6c lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.759745:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x35 (ffff88009bbb0600) 00010000:00010000:3.0:1715330300.759747:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330300.759749:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e640/0xd895711d66d9c6c lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.759753:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e640/0xd895711d66d9c6c lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.759773:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c000/0xd895711d66d9c5e lrc: 1/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb0f expref: 31 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.759780:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c000/0xd895711d66d9c5e lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb0f expref: 31 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.759786:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f48c000, rc 0) 00000100:00100000:3.0:1715330300.759825:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+30:17775:x1798653938067584:12345-192.168.204.49@tcp:101:cmp.0 Request processed in 383us (1647us total) trans 0 rc 301/301 00000100:00100000:3.0:1715330300.759832:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23574 00000100:00100000:0.0:1715330300.763149:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330300.763393:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938067712 00000100:00100000:1.0:1715330300.763401:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938067712 00000100:00100000:1.0:1715330300.763444:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23575 00000100:00100000:1.0:1715330300.763450:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+14:17775:x1798653938067712:12345-192.168.204.49@tcp:101:cmp.0 00010000:00010000:1.0:1715330300.763469:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330300.763484:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d9c73 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbb16 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.763537:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d9c7a lrc: 3/1,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330300.763548:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d9c7a lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330300.763556:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d9c7a lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330300.763563:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d9c81 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0x35 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330300.763570:0:25569:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64fc0/0xd895711d66d9a5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9a58 expref: 7 pid: 19960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.763576:0:25569:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d9c81 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:1.0:1715330300.763598:0:25569:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64fc0/0xd895711d66d9a5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd895711d66d9a58 expref: 7 pid: 19960 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330300.763610:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:25569:1798653942500288:0@lo:104: 00000100:00100000:1.0:1715330300.763641:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330300.763667:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f480 going to sleep for 11 seconds 00000100:00100000:2.0:1715330300.763913:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942500288 00000100:00100000:2.0:1715330300.763917:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942500288 00000100:00100000:2.0:1715330300.763937:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1187 00000100:00100000:2.0:1715330300.763941:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:25569:x1798653942500288:12345-0@lo:104: 00010000:00010000:2.0:1715330300.763950:0:7118:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f600/0xd895711d66d9a58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d9a5f expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.763993:0:7118:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1715330300.763998:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:25569:x1798653942500288:12345-0@lo:104: Request processed in 56us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.764003:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1187 00010000:00010000:2.0:1715330300.764019:0:7124:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1715330300.764023:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f600/0xd895711d66d9a58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d9a5f expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.764033:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457f600 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:2.0:1715330300.764038:0:7124:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f600/0xd895711d66d9a58 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x35 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd895711d66d9a5f expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1715330300.764045:0:7124:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f600/0xd895711d66d9a58 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x35 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd895711d66d9a5f expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.764066:0:7124:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f600/0xd895711d66d9a58 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x35 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d9a5f expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.764071:0:7124:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1715330300.764086:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f600/0xd895711d66d9a58 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x35 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d9a5f expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.764091:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457f600/0xd895711d66d9a58 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x35 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d9a5f expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.764108:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330300.764110:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330300.764111:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330300.764131:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091cc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942500352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1715330300.764151:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330300.764226:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:25569:1798653942500288:0@lo:104: 00010000:00010000:0.0:1715330300.764240:0:25569:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d9c81 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00000100:00100000:3.0:1715330300.765387:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942500352 00000100:00100000:3.0:1715330300.765393:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942500352 00010000:00010000:3.0:1715330300.765411:0:10674:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64fc0/0xd895711d66d9a5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd895711d66d9a58 expref: 8 pid: 19960 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330300.765432:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1572 00000100:00100000:3.0:1715330300.765436:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+8:3690:x1798653942500352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1715330300.765445:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:2.0:1715330300.767803:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968479 is committed 00010000:00010000:3.0:1715330300.768587:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64fc0/0xd895711d66d9a5f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x35 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd895711d66d9a58 expref: 8 pid: 19960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.768624:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x35 (ffff8800b4207500) 00010000:00010000:3.0:1715330300.768628:0:10674:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d9c81 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.768636:0:10674:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d9c81 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.768642:0:10674:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d9c81 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.768670:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715330300.768701:0:25569:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d9c81 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:0.0:1715330300.768709:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d9c81 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00000100:00100000:3.0:1715330300.768758:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+7:3690:x1798653942500352:12345-0@lo:103:ldlm_bl.0 Request processed in 3320us (4604us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.768767:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1572 00010000:00010000:0.0:1715330300.768823:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a3600/0xd895711d66d9c88 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x198:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.768832:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a3600/0xd895711d66d9c88 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:0.0:1715330300.768839:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a3600/0xd895711d66d9c88 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00000004:00200000:0.0:1715330300.768848:0:25569:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x198:0x0]: returning size 2 00010000:00010000:0.0:1715330300.768915:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d9c7a lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:0.0:1715330300.768921:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d9c7a lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00010000:00010000:0.0:1715330300.768926:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d9c7a lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00010000:00010000:0.0:1715330300.768931:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d9c7a lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:0.0:1715330300.768936:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bff3c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330300.768940:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d9c7a lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:0.0:1715330300.768945:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d9c7a lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT1 00010000:00010000:0.0:1715330300.768953:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff88009ef57100) 00010000:00010000:0.0:1715330300.768955:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330300.768958:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d9c7a lrc: 3/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:0.0:1715330300.768966:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bff3c0/0xd895711d66d9c7a lrc: 0/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:0.0:1715330300.768977:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d9c81 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:0.0:1715330300.768982:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d9c81 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00010000:00010000:0.0:1715330300.768986:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d9c81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:0.0:1715330300.768990:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfcfc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330300.768992:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d9c81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:0.0:1715330300.768996:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d9c81 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT1 00010000:00010000:0.0:1715330300.769001:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x35 (ffff8800b4207500) 00010000:00010000:0.0:1715330300.769003:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330300.769005:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d9c81 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xca:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:0.0:1715330300.769009:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfcfc0/0xd895711d66d9c81 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xca:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:0.0:1715330300.769050:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfe1c0/0xd895711d66d9c73 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb16 expref: 15 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.769061:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a3600/0xd895711d66d9c88 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb16 expref: 14 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.769071:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x198:0x0].0x0 (ffff88008b233000) 00010000:00010000:0.0:1715330300.769073:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715330300.769075:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a3600, rc 0) 00000100:00100000:0.0:1715330300.769111:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+14:17775:x1798653938067712:12345-192.168.204.49@tcp:101:cmp.0 Request processed in 5661us (5968us total) trans 4294968480 rc 0/0 00000100:00100000:0.0:1715330300.769117:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23575 00000100:00100000:2.0:1715330300.770383:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091cc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942500352:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1715330300.775291:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.775346:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938067776 00000100:00100000:2.0:1715330300.775355:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938067776 00000100:00100000:2.0:1715330300.775403:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5223 00000100:00100000:2.0:1715330300.775411:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72de1896-1df4-4b3a-930a-9116d2c66168+22:2011:x1798653938067776:12345-192.168.204.49@tcp:101:cmp.0 00010000:00010000:2.0:1715330300.775426:0:9633:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330300.775446:0:9633:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011db67180/0xd895711d66d9c96 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbb1d expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1715330300.775464:0:9633:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9cc:0x0] initial LVB size: 2, mtime: 0x663ddcfc, atime: 0x0, ctime: 0x663ddcfc, blocks: 0x8 00010000:00010000:2.0:1715330300.775480:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330300.775482:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330300.775488:0:9633:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db67180/0xd895711d66d9c96 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb1d expref: 23 pid: 9633 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1715330300.775720:0:9633:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011db67180/0xd895711d66d9c96 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb1d expref: 23 pid: 9633 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1715330300.775755:0:9633:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db67180, rc 0) 00000100:00100000:2.0:1715330300.776028:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72de1896-1df4-4b3a-930a-9116d2c66168+23:2011:x1798653938067776:12345-192.168.204.49@tcp:101:cmp.0 Request processed in 616us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.776035:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5223 00000100:00100000:0.0:1715330300.781057:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.781152:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938067904 00000100:00100000:2.0:1715330300.781160:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938067904 00002000:00100000:2.0:1715330300.781203:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9cc:0x0] (0->4095) req@ffff8800a7ec3100 x1798653938067904/t0(0) o3->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:511/0 lens 488/0 e 0 to 0 dl 1715330311 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1715330300.781212:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7ec3100 with x1798653938067904 ext(0->4095) 00002000:00010000:2.0:1715330300.781216:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a7ec3100 00000100:00100000:2.0:1715330300.781243:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 11 00000100:00100000:2.0:1715330300.781249:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7ec3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+23:2013:x1798653938067904:12345-192.168.204.49@tcp:3:cmp.0 00000100:00100000:2.0:1715330300.781916:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7ec3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+23:2013:x1798653938067904:12345-192.168.204.49@tcp:3:cmp.0 Request processed in 664us (863us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1715330300.781923:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 11 00002000:00100000:2.0:1715330300.781929:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9cc:0x0] (0->4095) req@ffff8800a7ec3100 x1798653938067904/t0(0) o3->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:511/0 lens 488/4536 e 0 to 0 dl 1715330311 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1715330300.781936:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a7ec3100 with x1798653938067904 ext(0->4095) 00002000:00010000:2.0:1715330300.781939:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a7ec3100 00000100:00100000:0.0:1715330300.787563:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.787818:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938068032 00000100:00100000:2.0:1715330300.787827:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938068032 00000100:00100000:2.0:1715330300.787872:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5103 00000100:00100000:2.0:1715330300.787879:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7ec0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+14:17775:x1798653938068032:12345-192.168.204.49@tcp:35:cmp.0 00000100:00100000:2.0:1715330300.788126:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7ec0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+15:17775:x1798653938068032:12345-192.168.204.49@tcp:35:cmp.0 Request processed in 246us (571us total) trans 4294968481 rc 0/0 00000100:00100000:2.0:1715330300.788133:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5103 00000100:00100000:3.0:1715330300.797463:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330300.797565:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938068160 00000100:00100000:0.0:1715330300.797574:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938068160 00000100:00100000:0.0:1715330300.797621:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23576 00000100:00100000:0.0:1715330300.797628:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093980700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+30:17777:x1798653938068160:12345-192.168.204.49@tcp:101:cmp.0 00010000:00010000:0.0:1715330300.797647:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330300.797664:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0480/0xd895711d66d9c9d lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbb24 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.797767:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3180/0xd895711d66d9ca4 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.797778:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3180/0xd895711d66d9ca4 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.797787:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3180/0xd895711d66d9ca4 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.797795:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66d9cab lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x36 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.797801:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66d9cab lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.797807:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66d9cab lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.797840:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3180/0xd895711d66d9ca4 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.797846:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3180/0xd895711d66d9ca4 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.797851:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3180/0xd895711d66d9ca4 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.797855:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3180/0xd895711d66d9ca4 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.797860:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a3180 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330300.797864:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3180/0xd895711d66d9ca4 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.797869:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3180/0xd895711d66d9ca4 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.797877:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff8800b4207200) 00010000:00010000:0.0:1715330300.797879:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330300.797882:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3180/0xd895711d66d9ca4 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.797888:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3180/0xd895711d66d9ca4 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.797918:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66d9cab lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.797923:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66d9cab lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.797928:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66d9cab lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.797932:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a2880 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330300.797934:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66d9cab lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.797939:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66d9cab lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.797945:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x36 (ffff880093a11b00) 00010000:00010000:0.0:1715330300.797947:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330300.797949:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66d9cab lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.797953:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66d9cab lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330300.797974:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0480/0xd895711d66d9c9d lrc: 1/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb24 expref: 31 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.797981:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0480/0xd895711d66d9c9d lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb24 expref: 31 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.797988:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a0480, rc 0) 00000100:00100000:0.0:1715330300.798032:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093980700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+30:17777:x1798653938068160:12345-192.168.204.49@tcp:101:cmp.0 Request processed in 403us (575us total) trans 0 rc 301/301 00000100:00100000:0.0:1715330300.798037:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23576 00000100:00100000:1.0:1715330300.801115:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330300.801758:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938068288 00000100:00100000:3.0:1715330300.801767:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938068288 00000100:00100000:3.0:1715330300.801830:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23577 00000100:00100000:3.0:1715330300.801836:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+15:17777:x1798653938068288:12345-192.168.204.49@tcp:101:cmp.0 00010000:00010000:3.0:1715330300.801855:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330300.801871:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48f3c0/0xd895711d66d9cb2 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbb2b expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.801933:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48cfc0/0xd895711d66d9cb9 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.801943:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48cfc0/0xd895711d66d9cb9 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.801952:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48cfc0/0xd895711d66d9cb9 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.801959:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48dd40/0xd895711d66d9cc0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0x36 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.801967:0:7135:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a06c0/0xd895711d66d9924 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d991d expref: 6 pid: 8592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.802199:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48dd40/0xd895711d66d9cc0 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.802226:0:7135:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a06c0/0xd895711d66d9924 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd895711d66d991d expref: 6 pid: 8592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330300.802237:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344c8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7135:1798653942500416:0@lo:104: 00000100:00100000:3.0:1715330300.802275:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.802667:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63b40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330300.802713:0:9413:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942500416 00000100:00100000:1.0:1715330300.802716:0:9413:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942500416 00000100:00100000:2.0:1715330300.802900:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1188 00000100:00100000:2.0:1715330300.802904:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7135:x1798653942500416:12345-0@lo:104: 00010000:00010000:2.0:1715330300.802913:0:7118:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457dd40/0xd895711d66d991d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d9924 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.803134:0:7118:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1715330300.803139:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:7135:x1798653942500416:12345-0@lo:104: Request processed in 234us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.803145:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1188 00000100:00100000:3.0:1715330300.803210:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344c8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:7135:1798653942500416:0@lo:104: 00010000:00010000:3.0:1715330300.803223:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48dd40/0xd895711d66d9cc0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330300.803264:0:7123:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715330300.803269:0:7123:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457dd40/0xd895711d66d991d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d9924 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.803277:0:7123:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457dd40 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330300.803281:0:7123:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457dd40/0xd895711d66d991d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x36 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd895711d66d9924 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330300.803295:0:7123:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457dd40/0xd895711d66d991d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x36 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd895711d66d9924 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.803315:0:7123:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457dd40/0xd895711d66d991d lrc: 2/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x36 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d9924 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.803319:0:7123:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330300.803378:0:7123:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457dd40/0xd895711d66d991d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x36 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d9924 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.803384:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457dd40/0xd895711d66d991d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x36 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d9924 expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330300.803428:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a7ec1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942500480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330300.803457:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1715330300.803479:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330300.803480:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330300.803482:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330300.803576:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942500480 00000100:00100000:3.0:1715330300.803579:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942500480 00010000:00010000:3.0:1715330300.803593:0:10674:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a06c0/0xd895711d66d9924 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd895711d66d991d expref: 7 pid: 8592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330300.803617:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1573 00000100:00100000:3.0:1715330300.803621:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ab789450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+7:3691:x1798653942500480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1715330300.803629:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:3.0:1715330300.805339:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968481 is committed 00010000:00010000:0.0:1715330300.805602:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a06c0/0xd895711d66d9924 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x36 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd895711d66d991d expref: 7 pid: 8592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.805616:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x36 (ffff88008b233200) 00010000:00010000:0.0:1715330300.805619:0:10674:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48dd40/0xd895711d66d9cc0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330300.805625:0:10674:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48dd40/0xd895711d66d9cc0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330300.805633:0:10674:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48dd40/0xd895711d66d9cc0 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7135 initiator: MDT1 00010000:00010000:0.0:1715330300.806306:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330300.806369:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ab789450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+6:3691:x1798653942500480:12345-0@lo:103:ldlm_bl.0 Request processed in 2745us (2909us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330300.806377:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1573 00000100:00100000:1.0:1715330300.806473:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a7ec1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942500480:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1715330300.806587:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48dd40/0xd895711d66d9cc0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.806594:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48dd40/0xd895711d66d9cc0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.806679:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c000/0xd895711d66d9cc7 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x195:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.806687:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c000/0xd895711d66d9cc7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.806693:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c000/0xd895711d66d9cc7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000004:00200000:3.0:1715330300.806701:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x195:0x0]: returning size 2 00010000:00010000:3.0:1715330300.806776:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48cfc0/0xd895711d66d9cb9 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.806781:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48cfc0/0xd895711d66d9cb9 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.806785:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48cfc0/0xd895711d66d9cb9 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.806789:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48cfc0/0xd895711d66d9cb9 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.806797:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48cfc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330300.806800:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48cfc0/0xd895711d66d9cb9 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.806805:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48cfc0/0xd895711d66d9cb9 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.806812:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff88009ef57100) 00010000:00010000:3.0:1715330300.806814:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330300.806817:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48cfc0/0xd895711d66d9cb9 lrc: 3/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.806821:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48cfc0/0xd895711d66d9cb9 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.806831:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48dd40/0xd895711d66d9cc0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.806835:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48dd40/0xd895711d66d9cc0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.806839:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48dd40/0xd895711d66d9cc0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.806842:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48dd40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330300.806844:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48dd40/0xd895711d66d9cc0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.806848:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48dd40/0xd895711d66d9cc0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.806852:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x36 (ffff88008b233200) 00010000:00010000:3.0:1715330300.806853:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330300.806856:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48dd40/0xd895711d66d9cc0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xca:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.806859:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48dd40/0xd895711d66d9cc0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xca:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330300.806894:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48f3c0/0xd895711d66d9cb2 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb2b expref: 16 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.806903:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c000/0xd895711d66d9cc7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb2b expref: 15 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.806907:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x195:0x0].0x0 (ffff88009b985000) 00010000:00010000:3.0:1715330300.806909:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330300.806911:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f48c000, rc 0) 00000100:00100000:3.0:1715330300.807435:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+15:17777:x1798653938068288:12345-192.168.204.49@tcp:101:cmp.0 Request processed in 5596us (6324us total) trans 4294968482 rc 0/0 00000100:00100000:3.0:1715330300.807442:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23577 00000100:00100000:0.0:1715330300.814316:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.814396:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938068352 00000100:00100000:2.0:1715330300.814406:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938068352 00000100:00100000:2.0:1715330300.814452:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5224 00000100:00100000:2.0:1715330300.814459:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72de1896-1df4-4b3a-930a-9116d2c66168+22:2011:x1798653938068352:12345-192.168.204.49@tcp:101:cmp.0 00010000:00010000:2.0:1715330300.814472:0:9633:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330300.814489:0:9633:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011db66640/0xd895711d66d9cd5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbb32 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1715330300.814506:0:9633:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9cc:0x0] initial LVB size: 2, mtime: 0x663ddcfc, atime: 0x0, ctime: 0x663ddcfc, blocks: 0x8 00010000:00010000:2.0:1715330300.814521:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330300.814523:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330300.814530:0:9633:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db66640/0xd895711d66d9cd5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb32 expref: 23 pid: 9633 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1715330300.814543:0:9633:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011db66640/0xd895711d66d9cd5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb32 expref: 23 pid: 9633 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1715330300.814552:0:9633:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db66640, rc 0) 00000100:00100000:2.0:1715330300.814597:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72de1896-1df4-4b3a-930a-9116d2c66168+23:2011:x1798653938068352:12345-192.168.204.49@tcp:101:cmp.0 Request processed in 138us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.814606:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5224 00000100:00100000:2.0:1715330300.820477:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330300.820642:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938068480 00000100:00100000:0.0:1715330300.820650:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938068480 00002000:00100000:0.0:1715330300.820696:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x9cc:0x0] (0->4095) req@ffff880091cc8a80 x1798653938068480/t0(0) o3->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:511/0 lens 488/0 e 0 to 0 dl 1715330311 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1715330300.820705:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091cc8a80 with x1798653938068480 ext(0->4095) 00002000:00010000:0.0:1715330300.820710:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091cc8a80 00000100:00100000:2.0:1715330300.820756:0:9403:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 12 00000100:00100000:2.0:1715330300.820763:0:9403:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+23:2014:x1798653938068480:12345-192.168.204.49@tcp:3:cmp.0 00000100:00100000:2.0:1715330300.820893:0:9403:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+23:2014:x1798653938068480:12345-192.168.204.49@tcp:3:cmp.0 Request processed in 130us (423us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1715330300.820900:0:9403:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 12 00002000:00100000:2.0:1715330300.820906:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9cc:0x0] (0->4095) req@ffff880091cc8a80 x1798653938068480/t0(0) o3->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:511/0 lens 488/4536 e 0 to 0 dl 1715330311 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1715330300.820912:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091cc8a80 with x1798653938068480 ext(0->4095) 00002000:00010000:2.0:1715330300.820915:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091cc8a80 00000100:00100000:1.0:1715330300.834246:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330300.834338:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938068608 00000100:00100000:0.0:1715330300.834346:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938068608 00000100:00100000:0.0:1715330300.834387:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5104 00000100:00100000:0.0:1715330300.834394:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fbef050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+15:17777:x1798653938068608:12345-192.168.204.49@tcp:35:cmp.0 00000100:00100000:0.0:1715330300.835163:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fbef050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+16:17777:x1798653938068608:12345-192.168.204.49@tcp:35:cmp.0 Request processed in 768us (923us total) trans 4294968483 rc 0/0 00000100:00100000:0.0:1715330300.835171:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5104 00000100:00100000:0.0:1715330300.844710:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330300.844953:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938068736 00000100:00100000:3.0:1715330300.844962:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938068736 00000100:00100000:3.0:1715330300.845000:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23578 00000100:00100000:3.0:1715330300.845008:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7ec0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+30:17779:x1798653938068736:12345-192.168.204.49@tcp:101:cmp.0 00010000:00010000:3.0:1715330300.845026:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330300.845043:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e640/0xd895711d66d9cdc lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbb39 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.845108:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e880/0xd895711d66d9ce3 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.845118:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e880/0xd895711d66d9ce3 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.845128:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e880/0xd895711d66d9ce3 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.845136:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c240/0xd895711d66d9cea lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x39 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.845141:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c240/0xd895711d66d9cea lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.845145:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c240/0xd895711d66d9cea lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.845174:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e880/0xd895711d66d9ce3 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.845179:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e880/0xd895711d66d9ce3 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.845184:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e880/0xd895711d66d9ce3 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.845188:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e880/0xd895711d66d9ce3 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.845193:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48e880 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330300.845197:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e880/0xd895711d66d9ce3 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.845202:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e880/0xd895711d66d9ce3 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.845210:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff8800b4207200) 00010000:00010000:3.0:1715330300.845212:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330300.845216:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e880/0xd895711d66d9ce3 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.845220:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e880/0xd895711d66d9ce3 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.845240:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c240/0xd895711d66d9cea lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.845245:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c240/0xd895711d66d9cea lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.845249:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c240/0xd895711d66d9cea lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.845252:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48c240 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330300.845255:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c240/0xd895711d66d9cea lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.845259:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c240/0xd895711d66d9cea lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.845264:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x39 (ffff8800aa391f00) 00010000:00010000:3.0:1715330300.845266:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330300.845269:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c240/0xd895711d66d9cea lrc: 2/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.845273:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c240/0xd895711d66d9cea lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330300.845304:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e640/0xd895711d66d9cdc lrc: 1/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb39 expref: 31 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.845310:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e640/0xd895711d66d9cdc lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb39 expref: 31 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.845321:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f48e640, rc 0) 00000100:00100000:3.0:1715330300.845358:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7ec0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+30:17779:x1798653938068736:12345-192.168.204.49@tcp:101:cmp.0 Request processed in 351us (655us total) trans 0 rc 301/301 00000100:00100000:3.0:1715330300.845363:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23578 00000100:00100000:0.0:1715330300.853603:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.853794:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938068864 00000100:00100000:2.0:1715330300.853933:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938068864 00000100:00100000:2.0:1715330300.854157:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23579 00000100:00100000:2.0:1715330300.854164:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7ec1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+16:17779:x1798653938068864:12345-192.168.204.49@tcp:101:cmp.0 00010000:00010000:2.0:1715330300.854187:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330300.855135:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64fc0/0xd895711d66d9cf1 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbb40 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.855202:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d9cf8 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.855212:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d9cf8 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330300.855221:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d9cf8 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330300.855229:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d9cff lrc: 3/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0x39 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.855236:0:25569:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457df80/0xd895711d66d98bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d98ad expref: 5 pid: 8592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.855242:0:25569:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d9cff lrc: 4/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330300.855269:0:25569:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff88013457df80/0xd895711d66d98bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd895711d66d98ad expref: 5 pid: 8592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330300.855293:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091cc9880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:25569:1798653942500544:0@lo:104: 00000100:00100000:2.0:1715330300.855340:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330300.856525:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091cb5240 going to sleep for 11 seconds 00000100:00100000:0.0:1715330300.857138:0:7118:0:(service.c:168:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1715330300.857152:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942500544 00000100:00100000:0.0:1715330300.857158:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942500544 00000100:00100000:0.0:1715330300.857194:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1189 00000100:00100000:0.0:1715330300.857202:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7ee450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:25569:x1798653942500544:12345-0@lo:104: 00010000:00010000:0.0:1715330300.857214:0:7118:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e400/0xd895711d66d98ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d98bb expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.857294:0:7118:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1715330300.857300:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7ee450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:25569:x1798653942500544:12345-0@lo:104: Request processed in 98us (1959us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330300.857306:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1189 00010000:00010000:3.0:1715330300.857407:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1715330300.857413:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e400/0xd895711d66d98ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd895711d66d98bb expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.857421:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457e400 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:3.0:1715330300.857425:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e400/0xd895711d66d98ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x39 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd895711d66d98bb expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1715330300.857434:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e400/0xd895711d66d98ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x39 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd895711d66d98bb expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.857461:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e400/0xd895711d66d98ad lrc: 2/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x39 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d98bb expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.857466:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1715330300.857484:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e400/0xd895711d66d98ad lrc: 1/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x39 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d98bb expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.857490:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff88013457e400/0xd895711d66d98ad lrc: 0/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x39 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd895711d66d98bb expref: -99 pid: 7148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.857509:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715330300.857511:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715330300.857512:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330300.857519:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1715330300.857530:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942500608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1715330300.857559:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.857590:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942500608 00000100:00100000:3.0:1715330300.857594:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942500608 00010000:00010000:3.0:1715330300.857608:0:10674:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff88013457df80/0xd895711d66d98bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd895711d66d98ad expref: 6 pid: 8592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330300.857627:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1574 00000100:00100000:3.0:1715330300.857631:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+6:3689:x1798653942500608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1715330300.857639:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1715330300.857926:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091cc9880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:25569:1798653942500544:0@lo:104: 00010000:00010000:2.0:1715330300.857946:0:25569:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d9cff lrc: 3/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0x39 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00000001:00080000:3.0:1715330300.861856:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968483 is committed 00010000:00010000:0.0:1715330300.861956:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457df80/0xd895711d66d98bb lrc: 0/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x39 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd895711d66d98ad expref: 6 pid: 8592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.861982:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x39 (ffff8800aa391300) 00010000:00010000:0.0:1715330300.861987:0:7121:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d9cff lrc: 3/1,0 mode: --/PR res: [0x240000400:0xca:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:0.0:1715330300.861995:0:7121:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d9cff lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 25569 initiator: MDT1 00010000:00010000:0.0:1715330300.862002:0:7121:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d9cff lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 25569 initiator: MDT1 00010000:00010000:0.0:1715330300.862028:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330300.862084:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942500608:12345-0@lo:103:ldlm_bl.0 Request processed in 4450us (4523us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330300.862093:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1574 00000100:00100000:3.0:1715330300.862172:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942500608:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715330300.862237:0:25569:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d9cff lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330300.862244:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d9cff lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330300.862346:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d9d06 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x194:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.862354:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d9d06 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330300.862360:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d9d06 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00000004:00200000:2.0:1715330300.862369:0:25569:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x194:0x0]: returning size 2 00010000:00010000:2.0:1715330300.862431:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d9cf8 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330300.862436:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d9cf8 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330300.862441:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d9cf8 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330300.862445:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d9cf8 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330300.862449:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db65440 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.862453:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d9cf8 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330300.862457:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d9cf8 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330300.862464:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff88009ef57100) 00010000:00010000:2.0:1715330300.862466:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.862469:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d9cf8 lrc: 3/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330300.862472:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65440/0xd895711d66d9cf8 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330300.862484:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d9cff lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330300.862488:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d9cff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330300.862495:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d9cff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330300.862498:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db67600 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.862500:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d9cff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330300.862504:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d9cff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xca:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330300.862509:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x39 (ffff8800aa391300) 00010000:00010000:2.0:1715330300.862511:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.862512:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d9cff lrc: 2/0,0 mode: --/PR res: [0x240000400:0xca:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330300.862516:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db67600/0xd895711d66d9cff lrc: 0/0,0 mode: --/PR res: [0x240000400:0xca:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330300.862555:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64fc0/0xd895711d66d9cf1 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xca:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb40 expref: 17 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.862564:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d9d06 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb40 expref: 16 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.862569:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x194:0x0].0x0 (ffff880135e32200) 00010000:00010000:2.0:1715330300.862570:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330300.862572:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db64d80, rc 0) 00000100:00100000:2.0:1715330300.862606:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7ec1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+16:17779:x1798653938068864:12345-192.168.204.49@tcp:101:cmp.0 Request processed in 8443us (9012us total) trans 4294968484 rc 0/0 00000100:00100000:2.0:1715330300.862613:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23579 00000100:00100000:2.0:1715330300.869165:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330300.869443:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938068928 00000100:00100000:0.0:1715330300.869452:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938068928 00000100:00100000:0.0:1715330300.869505:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5225 00000100:00100000:0.0:1715330300.869512:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72de1896-1df4-4b3a-930a-9116d2c66168+23:2011:x1798653938068928:12345-192.168.204.49@tcp:101:cmp.0 00010000:00010000:0.0:1715330300.869530:0:9633:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330300.869551:0:9633:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d7a2f40/0xd895711d66d9d14 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbb47 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1715330300.869570:0:9633:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9cd:0x0] initial LVB size: 2, mtime: 0x663ddcfc, atime: 0x0, ctime: 0x663ddcfc, blocks: 0x8 00010000:00010000:0.0:1715330300.869586:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330300.869588:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330300.869595:0:9633:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7a2f40/0xd895711d66d9d14 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb47 expref: 24 pid: 9633 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1715330300.869608:0:9633:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d7a2f40/0xd895711d66d9d14 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb47 expref: 24 pid: 9633 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1715330300.869617:0:9633:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a2f40, rc 0) 00000100:00100000:0.0:1715330300.869671:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72de1896-1df4-4b3a-930a-9116d2c66168+24:2011:x1798653938068928:12345-192.168.204.49@tcp:101:cmp.0 Request processed in 158us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330300.869677:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5225 00000100:00100000:0.0:1715330300.876621:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.876694:0:9403:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938069056 00000100:00100000:2.0:1715330300.876703:0:9403:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938069056 00002000:00100000:2.0:1715330300.876774:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9cd:0x0] (0->4095) req@ffff88009ba65500 x1798653938069056/t0(0) o3->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:511/0 lens 488/0 e 0 to 0 dl 1715330311 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1715330300.876784:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba65500 with x1798653938069056 ext(0->4095) 00002000:00010000:2.0:1715330300.876790:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba65500 00000100:00100000:2.0:1715330300.876809:0:9403:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 13 00000100:00100000:2.0:1715330300.876816:0:9403:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+24:2013:x1798653938069056:12345-192.168.204.49@tcp:3:cmp.0 00000100:00100000:2.0:1715330300.876950:0:9403:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+24:2013:x1798653938069056:12345-192.168.204.49@tcp:3:cmp.0 Request processed in 133us (336us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1715330300.876956:0:9403:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 13 00002000:00100000:2.0:1715330300.876961:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9cd:0x0] (0->4095) req@ffff88009ba65500 x1798653938069056/t0(0) o3->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:511/0 lens 488/4536 e 0 to 0 dl 1715330311 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1715330300.876968:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba65500 with x1798653938069056 ext(0->4095) 00002000:00010000:2.0:1715330300.876970:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba65500 00000100:00100000:0.0:1715330300.882877:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.882953:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938069184 00000100:00100000:2.0:1715330300.882964:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938069184 00000100:00100000:2.0:1715330300.883026:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5105 00000100:00100000:2.0:1715330300.883035:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+16:17779:x1798653938069184:12345-192.168.204.49@tcp:35:cmp.0 00000100:00100000:2.0:1715330300.884291:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:17779:x1798653938069184:12345-192.168.204.49@tcp:35:cmp.0 Request processed in 1242us (1409us total) trans 4294968485 rc 0/0 00000100:00100000:2.0:1715330300.884300:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5105 00000100:00100000:0.0:1715330300.897509:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.897634:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938069312 00000100:00100000:2.0:1715330300.897642:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938069312 00000100:00100000:2.0:1715330300.900893:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23580 00000100:00100000:2.0:1715330300.900905:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+17:17780:x1798653938069312:12345-192.168.204.49@tcp:36:rm.0 00010000:00010000:2.0:1715330300.900963:0:25569:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330300.900987:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009d7a3600/0xd895711d66d9c88 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb16 expref: 17 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.902254:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x198:0x0].0x0 (ffff88008b233000) 00010000:00010000:2.0:1715330300.902270:0:25569:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330300.902328:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d9d1b lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.902335:0:25569:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d9d1b lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330300.902344:0:25569:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d9d1b lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 25569 initiator: MDT1 00000100:00100000:2.0:1715330300.902364:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091cc9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942500672:0@lo:101:mdt00_005.0 00000100:00100000:2.0:1715330300.902415:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330300.902930:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942500672 00000100:00100000:0.0:1715330300.902937:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942500672 00000100:00100000:0.0:1715330300.903125:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2994 00000100:00100000:0.0:1715330300.903131:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091cca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942500672:12345-0@lo:101:mdt00_005.0 00010000:00010000:0.0:1715330300.903146:0:7138:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330300.903159:0:7138:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2d00/0xd895711d66d9d22 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d9d1b expref: -99 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.903179:0:7138:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d9b31 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbaa6 expref: 29 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.903187:0:7138:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2d00/0xd895711d66d9d22 lrc: 4/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d9d1b expref: 15 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.903207:0:7138:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d9b31 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbaa6 expref: 29 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.903219:0:7138:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d9b31 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbaa6 expref: 29 pid: 25569 timeout: 375 lvb_type: 0 00000100:00100000:0.0:1715330300.903227:0:7138:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f2680 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:7138:1798653942500736:192.168.204.49@tcp:104: 00000100:00100000:0.0:1715330300.903403:0:7138:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009d7e3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1715330300.903917:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091cb5240 going to sleep for 11 seconds 00000100:00100000:2.0:1715330300.908181:0:7138:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f2680 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:7138:1798653942500736:192.168.204.49@tcp:104: 00010000:00010000:2.0:1715330300.908208:0:7138:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2d00/0xd895711d66d9d22 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9d1b expref: 15 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.908218:0:7138:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff8800b4207200) 00010000:00010000:2.0:1715330300.908220:0:7138:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.908223:0:7138:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2d00/0xd895711d66d9d22 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9d1b expref: 15 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.908230:0:7138:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a2d00, rc 0) 00000100:00100000:2.0:1715330300.908271:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091cca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:25569:x1798653942500672:12345-0@lo:101:mdt00_005.0 Request processed in 5140us (5856us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.908278:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2994 00000100:00100000:0.0:1715330300.908407:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091cc9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942500672:0@lo:101:mdt00_005.0 00010000:00010000:0.0:1715330300.908424:0:25569:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d9d1b lrc: 4/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9d22 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.908431:0:25569:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d9d1b lrc: 4/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9d22 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330300.909249:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.909312:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938069376 00000100:00100000:2.0:1715330300.909317:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938069376 00010000:00010000:2.0:1715330300.909338:0:7121:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d9b31 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbaa6 expref: 30 pid: 25569 timeout: 375 lvb_type: 0 00000100:00100000:2.0:1715330300.909362:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1575 00000100:00100000:2.0:1715330300.909368:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+30:2011:x1798653938069376:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1715330300.909377:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330300.909382:0:7121:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d9b31 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbaa6 expref: 30 pid: 25569 timeout: 375 lvb_type: 0 00010000:00010000:2.0:1715330300.909389:0:7121:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d9b31 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbaa6 expref: 30 pid: 25569 timeout: 375 lvb_type: 0 00010000:00010000:2.0:1715330300.909405:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66d9b31 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xcd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbaa6 expref: 30 pid: 25569 timeout: 375 lvb_type: 0 00010000:00010000:2.0:1715330300.909421:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff8800b4207200) 00010000:00010000:2.0:1715330300.909425:0:7121:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2d00/0xd895711d66d9d22 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9d1b expref: 14 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.909432:0:7121:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2d00/0xd895711d66d9d22 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d9d1b expref: 14 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.909438:0:7121:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2d00/0xd895711d66d9d22 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d9d1b expref: 14 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.909463:0:7121:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2d00/0xd895711d66d9d22 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9d1b expref: 14 pid: 7138 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330300.909473:0:7121:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091ccaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:7121:1798653942500800:0@lo:105: 00000100:00100000:2.0:1715330300.909496:0:7121:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330300.909512:0:7121:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091cb5480 going to sleep for 11 seconds 00000100:00100000:1.0:1715330300.909790:0:9413:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942500800 00000100:00100000:1.0:1715330300.909794:0:9413:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942500800 00000100:00100000:1.0:1715330300.909812:0:9413:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1190 00000100:00100000:1.0:1715330300.909816:0:9413:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091ccb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:7121:x1798653942500800:12345-0@lo:105: 00010000:00010000:1.0:1715330300.909823:0:9413:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d9d1b lrc: 5/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9d22 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.909830:0:9413:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d9d1b lrc: 5/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9d22 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.909837:0:9413:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d9d1b lrc: 5/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9d22 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.909843:0:9413:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d9d1b lrc: 5/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d9d22 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.909847:0:9413:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d9d1b lrc: 6/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d9d22 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.909853:0:9413:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d9d1b lrc: 6/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d9d22 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.909872:0:9413:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88011db66d00) 00000100:00100000:1.0:1715330300.909903:0:9413:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091ccb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:7121:x1798653942500800:12345-0@lo:105: Request processed in 87us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330300.909908:0:9413:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1190 00000100:00100000:3.0:1715330300.910059:0:7121:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091ccaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:7121:1798653942500800:0@lo:105: 00010000:00010000:3.0:1715330300.910071:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715330300.910095:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+29:2011:x1798653938069376:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 727us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.910101:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1575 00010000:00010000:2.0:1715330300.910250:0:25569:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d9d1b lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9d22 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.910258:0:25569:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d9d1b lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9d22 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715330300.910274:0:25569:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00010000:00010000:2.0:1715330300.910305:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d9d29 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330300.910311:0:25569:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d9d29 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330300.910319:0:25569:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d9d29 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 25569 initiator: MDT1 00000100:00100000:2.0:1715330300.910331:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091cc9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942500864:0@lo:101:mdt00_005.0 00000100:00100000:2.0:1715330300.910350:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330300.910886:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091cb53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330300.911047:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942500864 00000100:00100000:0.0:1715330300.911052:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942500864 00000100:00100000:0.0:1715330300.911081:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2995 00000100:00100000:0.0:1715330300.911085:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091ccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:25569:x1798653942500864:12345-0@lo:101:mdt00_005.0 00010000:00010000:0.0:1715330300.911098:0:7138:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330300.911110:0:7138:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3600/0xd895711d66d9d30 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x35 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d9d29 expref: -99 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.911130:0:7138:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d9a6d lrc: 2/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7148 initiator: MDT0 00010000:00010000:0.0:1715330300.911136:0:7138:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3600/0xd895711d66d9d30 lrc: 4/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d9d29 expref: 16 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.911147:0:7138:0:(ldlm_request.c:381:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d9a6d lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 7148 initiator: MDT0 00080000:00080000:0.0:1715330300.911166:0:7138:0:(osd_handler.c:2696:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:0.0:1715330300.911195:0:7138:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3600/0xd895711d66d9d30 lrc: 3/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9d29 expref: 16 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.911201:0:7138:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x35 (ffff88009bbb0600) 00010000:00010000:0.0:1715330300.911204:0:7138:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330300.911206:0:7138:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3600/0xd895711d66d9d30 lrc: 3/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9d29 expref: 16 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.911211:0:7138:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a3600, rc 0) 00000100:00100000:0.0:1715330300.911240:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091ccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+16:25569:x1798653942500864:12345-0@lo:101:mdt00_005.0 Request processed in 155us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330300.911245:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2995 00000100:00100000:2.0:1715330300.911708:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091cc9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942500864:0@lo:101:mdt00_005.0 00010000:00010000:2.0:1715330300.911719:0:25569:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d9d29 lrc: 4/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9d30 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.911746:0:25569:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d9d29 lrc: 4/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9d30 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1715330300.913700:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983561 is committed 00000001:00080000:1.0:1715330300.913763:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983559 is committed 00010000:00010000:2.0:1715330300.913901:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c900/0xd895711d66d98c9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.913910:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c900/0xd895711d66d98c9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.913915:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c900/0xd895711d66d98c9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.913921:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457c900 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.913924:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c900/0xd895711d66d98c9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.913930:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c900/0xd895711d66d98c9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.913944:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x39 (ffff8800aa391f00) 00010000:00010000:2.0:1715330300.913947:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.913950:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c900/0xd895711d66d98c9 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.913955:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c900/0xd895711d66d98c9 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.913971:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d98d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1528:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.913975:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d98d0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1528:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.913982:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d98d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1528:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.913986:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457d680 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.913988:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d98d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1528:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.913992:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d98d0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1528:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.913998:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1528:0x0].0x0 (ffff8800b5206900) 00010000:00010000:2.0:1715330300.914000:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:2.0:1715330300.914002:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d98d0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1528:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914005:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d680/0xd895711d66d98d0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1528:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914018:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457fa80/0xd895711d66d9932 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914023:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457fa80/0xd895711d66d9932 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914027:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457fa80/0xd895711d66d9932 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914030:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457fa80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.914032:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457fa80/0xd895711d66d9932 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914036:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457fa80/0xd895711d66d9932 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914044:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x36 (ffff880093a11b00) 00010000:00010000:2.0:1715330300.914046:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.914048:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457fa80/0xd895711d66d9932 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914051:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457fa80/0xd895711d66d9932 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914059:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d200/0xd895711d66d9939 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1527:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914062:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d200/0xd895711d66d9939 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1527:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914066:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d200/0xd895711d66d9939 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1527:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914069:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457d200 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.914071:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d200/0xd895711d66d9939 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1527:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914075:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d200/0xd895711d66d9939 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1527:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914079:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1527:0x0].0x0 (ffff88008d5eeb00) 00010000:00010000:2.0:1715330300.914081:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:2.0:1715330300.914083:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d200/0xd895711d66d9939 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1527:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914087:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d200/0xd895711d66d9939 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1527:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914096:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c6c0/0xd895711d66d999b lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914101:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c6c0/0xd895711d66d999b lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914104:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c6c0/0xd895711d66d999b lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914108:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457c6c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.914110:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c6c0/0xd895711d66d999b lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914114:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c6c0/0xd895711d66d999b lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914119:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x3031 (ffff880093a11100) 00010000:00010000:2.0:1715330300.914121:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.914123:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c6c0/0xd895711d66d999b lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914127:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c6c0/0xd895711d66d999b lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914136:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d99a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1529:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914141:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d99a2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1529:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914145:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d99a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1529:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914148:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457f840 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.914150:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d99a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1529:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914158:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d99a2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1529:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914163:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1529:0x0].0x0 (ffff8800b5206f00) 00010000:00010000:2.0:1715330300.914164:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:2.0:1715330300.914166:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d99a2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1529:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914169:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457f840/0xd895711d66d99a2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1529:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914179:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cfc0/0xd895711d66d9a04 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914183:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cfc0/0xd895711d66d9a04 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914187:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cfc0/0xd895711d66d9a04 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914190:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457cfc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.914192:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cfc0/0xd895711d66d9a04 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914196:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cfc0/0xd895711d66d9a04 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914201:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x31 (ffff88011d537400) 00010000:00010000:2.0:1715330300.914202:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.914204:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cfc0/0xd895711d66d9a04 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914208:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457cfc0/0xd895711d66d9a04 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914216:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d9a0b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1525:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914220:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d9a0b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1525:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914224:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d9a0b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1525:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914227:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457eac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.914228:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d9a0b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1525:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914232:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d9a0b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1525:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914236:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1525:0x0].0x0 (ffff88009bbf0800) 00010000:00010000:2.0:1715330300.914238:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:2.0:1715330300.914240:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d9a0b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1525:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914244:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457eac0/0xd895711d66d9a0b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1525:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914255:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d9a6d lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914259:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d9a6d lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914262:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d9a6d lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914265:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457ef40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.914268:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d9a6d lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914272:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d9a6d lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.914277:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x35 (ffff88009bbb0600) 00010000:00010000:2.0:1715330300.914289:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.914294:0:3674:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3600/0xd895711d66d9d30 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9d29 expref: 13 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.914303:0:3674:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3600/0xd895711d66d9d30 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d9d29 expref: 13 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.914309:0:3674:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3600/0xd895711d66d9d30 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d9d29 expref: 13 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.914339:0:3674:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3600/0xd895711d66d9d30 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9d29 expref: 13 pid: 7138 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330300.914349:0:3674:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091cc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3674:1798653942500928:0@lo:105: 00000100:00100000:2.0:1715330300.914390:0:3674:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330300.914407:0:3674:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091cb53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330300.914453:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942500928 00000100:00100000:1.0:1715330300.914458:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942500928 00000100:00100000:1.0:1715330300.914490:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1191 00000100:00100000:1.0:1715330300.914495:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:3674:x1798653942500928:12345-0@lo:105: 00010000:00010000:1.0:1715330300.914505:0:7118:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d9d29 lrc: 5/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9d30 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.914512:0:7118:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d9d29 lrc: 5/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9d30 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.914518:0:7118:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d9d29 lrc: 5/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9d30 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.914522:0:7118:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d9d29 lrc: 5/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d9d30 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.914527:0:7118:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d9d29 lrc: 6/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d9d30 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.914532:0:7118:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d9d29 lrc: 6/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d9d30 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.914550:0:7118:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88011db66f40) 00000100:00100000:1.0:1715330300.914576:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:3674:x1798653942500928:12345-0@lo:105: Request processed in 80us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330300.914581:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1191 00010000:00010000:3.0:1715330300.914673:0:25569:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d9d29 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9d30 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.914680:0:25569:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d9d29 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9d30 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330300.914697:0:25569:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00000100:00100000:3.0:1715330300.914748:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942500992:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1715330300.914772:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.914782:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330300.914824:0:7139:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942500992 00000100:00100000:0.0:1715330300.914828:0:7139:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942500992 00000100:00100000:0.0:1715330300.914846:0:7139:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2996 00000100:00100000:0.0:1715330300.914850:0:7139:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942500992:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1715330300.914904:0:7139:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942500992:12345-0@lo:1000:mdt00_005.0 Request processed in 54us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330300.914912:0:7139:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2996 00000100:00100000:3.0:1715330300.914965:0:25569:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983561 gen 2 00000004:00080000:3.0:1715330300.914969:0:25569:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983560 committed transno 4294983561 00000004:00080000:3.0:1715330300.914982:0:25569:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983561 committed transno 4294983561 00000100:00100000:3.0:1715330300.914994:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942500992:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1715330300.915026:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942501056:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1715330300.915043:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.915050:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496f300 going to sleep for 11 seconds 00000100:00100000:1.0:1715330300.915088:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942501056 00000100:00100000:1.0:1715330300.915091:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942501056 00000100:00100000:1.0:1715330300.915107:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2997 00000100:00100000:1.0:1715330300.915111:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942501056:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1715330300.915151:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942501056:12345-0@lo:1000:mdt00_005.0 Request processed in 39us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330300.915156:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2997 00000100:00100000:3.0:1715330300.915235:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942501056:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1715330300.915258:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942501120:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1715330300.915272:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.915278:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496f300 going to sleep for 11 seconds 00000100:00100000:0.0:1715330300.915319:0:7139:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942501120 00000100:00100000:0.0:1715330300.915322:0:7139:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942501120 00000100:00100000:0.0:1715330300.915341:0:7139:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2998 00000100:00100000:0.0:1715330300.915344:0:7139:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942501120:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1715330300.915385:0:7139:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942501120:12345-0@lo:1000:mdt00_005.0 Request processed in 41us (113us total) trans 0 rc -2/-2 00000100:00100000:0.0:1715330300.915390:0:7139:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2998 00000100:00100000:3.0:1715330300.915544:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942501120:0@lo:1000:mdt00_005.0 00000004:00080000:3.0:1715330300.915555:0:25569:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00010000:00010000:3.0:1715330300.915561:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d9d1b lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9d22 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.915566:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d9d1b lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9d22 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.915571:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d9d1b lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9d22 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.915827:0:25569:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1715330300.915832:0:25569:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00010000:00010000:3.0:1715330300.915834:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d9d29 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9d30 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.915843:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d9d29 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9d30 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.915847:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d9d29 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9d30 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.915854:0:25569:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1715330300.915948:0:7124:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1715330300.915953:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d9d1b lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d9d22 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.915959:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66d00 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:2.0:1715330300.915963:0:7124:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d9d1b lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d9d22 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1715330300.915972:0:7124:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d9d1b lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d9d22 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.915988:0:7124:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d9d1b lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9d22 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.915993:0:7124:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330300.916051:0:9415:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715330300.916055:0:9415:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d9d29 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d9d30 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.916060:0:9415:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66f40 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330300.916063:0:9415:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d9d29 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d9d30 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330300.916068:0:9415:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d9d29 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d9d30 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.916080:0:9415:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d9d29 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9d30 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.916084:0:9415:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1715330300.916109:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+16:17780:x1798653938069312:12345-192.168.204.49@tcp:36:rm.0 Request processed in 15205us (18605us total) trans 0 rc -2/-2 00000100:00100000:3.0:1715330300.916114:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23580 00000100:00100000:3.0:1715330300.916132:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091cc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942501184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1715330300.916151:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.916170:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942501184 00000100:00100000:3.0:1715330300.916172:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942501184 00000100:00100000:3.0:1715330300.916186:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1402 00000100:00100000:3.0:1715330300.916189:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+14:3689:x1798653942501184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1715330300.916196:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330300.916207:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2d00/0xd895711d66d9d22 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d9d1b expref: 14 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.916220:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff8800b4207200) 00010000:00010000:3.0:1715330300.916227:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715330300.916240:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+13:3689:x1798653942501184:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (89us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.916244:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1402 00000100:00100000:3.0:1715330300.916258:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091cc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942501184:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330300.916527:0:9415:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d9d29 lrc: 1/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9d30 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.916534:0:9415:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66f40/0xd895711d66d9d29 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9d30 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.916551:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330300.916553:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330300.916554:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330300.916561:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091e9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942501248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330300.916579:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1715330300.916763:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d9d1b lrc: 1/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9d22 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.916769:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db66d00/0xd895711d66d9d1b lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9d22 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.916779:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330300.916780:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330300.916781:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330300.916797:0:3674:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091cc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3674:1798653942500928:0@lo:105: 00010000:00010000:2.0:1715330300.916808:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d9a6d lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.916813:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457ef40/0xd895711d66d9a6d lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.916820:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d9a74 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1526:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.916825:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d9a74 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1526:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.916830:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d9a74 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1526:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.916837:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88013457e1c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.916840:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d9a74 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1526:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.916844:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d9a74 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1526:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.916850:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1526:0x0].0x0 (ffff88008d5eee00) 00010000:00010000:2.0:1715330300.916852:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:2.0:1715330300.916854:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d9a74 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1526:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.916858:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457e1c0/0xd895711d66d9a74 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1526:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7148 initiator: MDT0 00010000:00010000:2.0:1715330300.916870:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd8c0/0xd895711d66d9ad6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 00010000:00010000:2.0:1715330300.916874:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd8c0/0xd895711d66d9ad6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 00010000:00010000:2.0:1715330300.916878:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd8c0/0xd895711d66d9ad6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 00010000:00010000:2.0:1715330300.916881:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfd8c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.916883:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd8c0/0xd895711d66d9ad6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 00010000:00010000:2.0:1715330300.916887:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd8c0/0xd895711d66d9ad6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 00010000:00010000:2.0:1715330300.916892:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x30 (ffff88008d4e1c00) 00010000:00010000:2.0:1715330300.916894:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.916896:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd8c0/0xd895711d66d9ad6 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 00010000:00010000:2.0:1715330300.916899:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd8c0/0xd895711d66d9ad6 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 00010000:00010000:2.0:1715330300.916909:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d9add lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1524:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7147 initiator: MDT0 00010000:00010000:2.0:1715330300.916913:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d9add lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1524:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7147 initiator: MDT0 00010000:00010000:2.0:1715330300.916917:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d9add lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1524:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 00010000:00010000:2.0:1715330300.916920:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bffcc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.916922:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d9add lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1524:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7147 initiator: MDT0 00010000:00010000:2.0:1715330300.916926:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d9add lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1524:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7147 initiator: MDT0 00010000:00010000:2.0:1715330300.916930:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1524:0x0].0x0 (ffff88009bbf0d00) 00010000:00010000:2.0:1715330300.916931:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:2.0:1715330300.916933:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d9add lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1524:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 00010000:00010000:2.0:1715330300.916937:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d9add lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1524:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7147 initiator: MDT0 00000100:00100000:3.0:1715330300.917355:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942501248 00000100:00100000:3.0:1715330300.917359:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942501248 00000100:00100000:3.0:1715330300.917395:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1403 00000100:00100000:3.0:1715330300.917400:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e9a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+13:3690:x1798653942501248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1715330300.917408:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330300.917416:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3600/0xd895711d66d9d30 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x35 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d9d29 expref: 13 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.917425:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x35 (ffff88009bbb0600) 00010000:00010000:3.0:1715330300.917431:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715330300.917458:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e9a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942501248:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.917463:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1403 00000100:00100000:1.0:1715330300.917531:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091e9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942501248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330300.920917:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330300.921064:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938069504 00000100:00100000:3.0:1715330300.921073:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938069504 00000100:00100000:3.0:1715330300.921111:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23581 00000100:00100000:3.0:1715330300.921117:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+16:17780:x1798653938069504:12345-192.168.204.49@tcp:36:rm.0 00010000:00010000:3.0:1715330300.921158:0:25569:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330300.921178:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48f180/0xd895711d66d9b23 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xca:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba9f expref: 16 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.921191:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff88009ef57100) 00010000:00010000:3.0:1715330300.921200:0:25569:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330300.921219:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48cd80/0xd895711d66d9d37 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.921228:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48cd80/0xd895711d66d9d37 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.921238:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48cd80/0xd895711d66d9d37 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.921245:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48df80/0xd895711d66d9d3e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0x35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.921249:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48df80/0xd895711d66d9d3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.921252:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48df80/0xd895711d66d9d3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.921300:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c6c0/0xd895711d66d9d45 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x198:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.921304:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c6c0/0xd895711d66d9d45 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x198:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.921309:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c6c0/0xd895711d66d9d45 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x198:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00000040:00080000:3.0:1715330300.921483:0:25569:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:3.0:1715330300.921488:0:25569:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 275397755981ns, next at 276397754741ns, rc = 0 00010000:00010000:3.0:1715330300.921521:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d200/0xd895711d66d9d4c lrc: 3/0,1 mode: --/PW res: [0x240000402:0x198:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.921528:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d200/0xd895711d66d9d4c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x198:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.921533:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d200/0xd895711d66d9d4c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x198:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.921539:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d200/0xd895711d66d9d4c lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x198:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.921547:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d200/0xd895711d66d9d4c lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x198:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.921551:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d200/0xd895711d66d9d4c lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x198:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.921555:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d200/0xd895711d66d9d4c lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x198:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.921560:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48d200 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330300.921563:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d200/0xd895711d66d9d4c lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x198:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.921569:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d200/0xd895711d66d9d4c lrc: 5/0,0 mode: PW/PW res: [0x240000402:0x198:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.921575:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x198:0x0].0x0 (ffff88009b985200) 00010000:00010000:3.0:1715330300.921577:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330300.921579:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d200/0xd895711d66d9d4c lrc: 3/0,0 mode: --/PW res: [0x240000402:0x198:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.921583:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d200/0xd895711d66d9d4c lrc: 0/0,0 mode: --/PW res: [0x240000402:0x198:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.921600:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c6c0/0xd895711d66d9d45 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x198:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.921604:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c6c0/0xd895711d66d9d45 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x198:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.921607:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c6c0/0xd895711d66d9d45 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x198:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.921611:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48c6c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330300.921614:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c6c0/0xd895711d66d9d45 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x198:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.921617:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c6c0/0xd895711d66d9d45 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x198:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.921622:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x198:0x0].0x0 (ffff88009b985200) 00010000:00010000:3.0:1715330300.921623:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330300.921625:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c6c0/0xd895711d66d9d45 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x198:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.921628:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c6c0/0xd895711d66d9d45 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x198:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.921697:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48cd80/0xd895711d66d9d37 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.921701:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48cd80/0xd895711d66d9d37 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.921705:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48cd80/0xd895711d66d9d37 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.921708:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48cd80/0xd895711d66d9d37 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.921711:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48cd80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330300.921713:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48cd80/0xd895711d66d9d37 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.921717:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48cd80/0xd895711d66d9d37 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.921722:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff88009b985900) 00010000:00010000:3.0:1715330300.921724:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330300.921726:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48cd80/0xd895711d66d9d37 lrc: 3/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.921750:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48cd80/0xd895711d66d9d37 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00000004:00010000:3.0:1715330300.921757:0:25569:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880091e9b100 reply state ffff880093ac7000 transno 4294968486 ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48df80/0xd895711d66d9d3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.921763:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48df80/0xd895711d66d9d3e lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.921767:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x35 (ffff88009b985100) 00010000:00010000:3.0:1715330300.921769:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330300.921771:0:25569:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330300.921823:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+17:17780:x1798653938069504:12345-192.168.204.49@tcp:36:rm.0 Request processed in 705us (912us total) trans 4294968486 rc 0/0 00000100:00100000:3.0:1715330300.921828:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23581 00000100:00100000:0.0:1715330300.926001:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.927046:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938069632 00000100:00100000:2.0:1715330300.927055:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938069632 00000100:00100000:2.0:1715330300.927195:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23582 00000100:00100000:2.0:1715330300.927201:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:17780:x1798653938069632:12345-192.168.204.49@tcp:36:rm.0 00010000:00010000:2.0:1715330300.927249:0:7135:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330300.927270:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880093bfd200/0xd895711d66d9c0a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbaec expref: 17 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.927294:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x197:0x0].0x0 (ffff88008d4e1300) 00010000:00010000:2.0:1715330300.927303:0:7135:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330300.927341:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65200/0xd895711d66d9d53 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.927347:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65200/0xd895711d66d9d53 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330300.927355:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65200/0xd895711d66d9d53 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT1 00000100:00100000:2.0:1715330300.927371:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091cc8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942501312:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1715330300.927410:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330300.928292:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091cb56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330300.928349:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942501312 00000100:00100000:1.0:1715330300.928354:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942501312 00000100:00100000:1.0:1715330300.928382:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2999 00000100:00100000:1.0:1715330300.928387:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091cc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:7135:x1798653942501312:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330300.928396:0:19960:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330300.928410:0:19960:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfed00/0xd895711d66d9d5a lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d9d53 expref: -99 pid: 19960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.928427:0:19960:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfed00/0xd895711d66d9d5a lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d9d53 expref: 13 pid: 19960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.928437:0:19960:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfed00/0xd895711d66d9d5a lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9d53 expref: 13 pid: 19960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.928442:0:19960:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff88009d5e7c00) 00010000:00010000:1.0:1715330300.928444:0:19960:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330300.928446:0:19960:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfed00, rc 0) 00000100:00100000:1.0:1715330300.928487:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091cc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:7135:x1798653942501312:12345-0@lo:101:mdt00_002.0 Request processed in 99us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330300.928492:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2999 00000100:00100000:2.0:1715330300.928596:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091cc8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942501312:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1715330300.928608:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65200/0xd895711d66d9d53 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9d5a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.928616:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65200/0xd895711d66d9d53 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9d5a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715330300.928630:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00010000:00010000:2.0:1715330300.928647:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65b00/0xd895711d66d9d61 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.928653:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65b00/0xd895711d66d9d61 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330300.928660:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65b00/0xd895711d66d9d61 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT1 00000100:00100000:2.0:1715330300.928669:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091cc8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942501376:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1715330300.928688:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330300.928891:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091cb56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330300.929469:0:7139:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942501376 00000100:00100000:0.0:1715330300.929475:0:7139:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942501376 00000100:00100000:0.0:1715330300.929572:0:7139:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3000 00000100:00100000:0.0:1715330300.929578:0:7139:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:7135:x1798653942501376:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330300.929588:0:7139:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330300.929599:0:7139:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66d9d68 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d9d61 expref: -99 pid: 7139 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.929613:0:7139:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66d9d68 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d9d61 expref: 14 pid: 7139 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.929622:0:7139:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66d9d68 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9d61 expref: 14 pid: 7139 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.929628:0:7139:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x31 (ffff88008b233d00) 00010000:00010000:0.0:1715330300.929630:0:7139:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330300.929632:0:7139:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a0900, rc 0) 00000100:00100000:0.0:1715330300.929670:0:7139:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:7135:x1798653942501376:12345-0@lo:101:mdt00_002.0 Request processed in 92us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330300.929675:0:7139:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3000 00000100:00100000:2.0:1715330300.929765:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091cc8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942501376:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1715330300.929775:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65b00/0xd895711d66d9d61 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9d68 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.929781:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65b00/0xd895711d66d9d61 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9d68 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715330300.929792:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00000100:00100000:2.0:1715330300.929834:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091cc8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942501440:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1715330300.929857:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330300.929865:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091cb53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330300.929904:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942501440 00000100:00100000:1.0:1715330300.929907:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942501440 00000100:00100000:1.0:1715330300.929923:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3001 00000100:00100000:1.0:1715330300.929927:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091cc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+14:7135:x1798653942501440:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715330300.929989:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091cc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+14:7135:x1798653942501440:12345-0@lo:1000:mdt00_002.0 Request processed in 60us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330300.929994:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3001 00000100:00100000:2.0:1715330300.930234:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091cc8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942501440:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1715330300.930263:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091cc8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942501504:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1715330300.930293:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330300.930565:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091cb53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330300.930592:0:7139:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942501504 00000100:00100000:0.0:1715330300.930595:0:7139:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942501504 00000100:00100000:0.0:1715330300.930649:0:7139:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3002 00000100:00100000:0.0:1715330300.930653:0:7139:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:7135:x1798653942501504:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1715330300.931025:0:7139:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:7135:x1798653942501504:12345-0@lo:1000:mdt00_002.0 Request processed in 370us (744us total) trans 0 rc -2/-2 00000100:00100000:0.0:1715330300.931031:0:7139:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3002 00000100:00100000:2.0:1715330300.931075:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091cc8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942501504:0@lo:1000:mdt00_002.0 00000004:00080000:2.0:1715330300.931089:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00010000:00010000:2.0:1715330300.931094:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65200/0xd895711d66d9d53 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9d5a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.931100:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65200/0xd895711d66d9d53 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9d5a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.931107:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65200/0xd895711d66d9d53 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9d5a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.931119:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1715330300.931122:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00010000:00010000:2.0:1715330300.931124:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65b00/0xd895711d66d9d61 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9d68 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.931129:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65b00/0xd895711d66d9d61 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9d68 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.931133:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65b00/0xd895711d66d9d61 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9d68 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.931149:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1715330300.931195:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+16:17780:x1798653938069632:12345-192.168.204.49@tcp:36:rm.0 Request processed in 3994us (5201us total) trans 0 rc -2/-2 00000100:00100000:2.0:1715330300.931200:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23582 00010000:00010000:3.0:1715330300.931340:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1715330300.931347:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65200/0xd895711d66d9d53 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d9d5a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.931353:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db65200 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:3.0:1715330300.931357:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65200/0xd895711d66d9d53 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d9d5a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1715330300.931363:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65200/0xd895711d66d9d53 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d9d5a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.931385:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65200/0xd895711d66d9d53 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9d5a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.931390:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1715330300.931405:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65200/0xd895711d66d9d53 lrc: 1/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9d5a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.931411:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65200/0xd895711d66d9d53 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9d5a expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.931423:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1715330300.931425:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65b00/0xd895711d66d9d61 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d9d68 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.931428:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db65b00 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:3.0:1715330300.931431:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65b00/0xd895711d66d9d61 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d9d68 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1715330300.931435:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65b00/0xd895711d66d9d61 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d9d68 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.931445:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65b00/0xd895711d66d9d61 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9d68 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.931449:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1715330300.931457:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65b00/0xd895711d66d9d61 lrc: 1/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9d68 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.931462:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65b00/0xd895711d66d9d61 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9d68 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.931470:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715330300.931471:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715330300.931473:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330300.931480:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1715330300.931487:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942501632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1715330300.931513:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.931534:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942501632 00000100:00100000:3.0:1715330300.931537:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942501632 00000100:00100000:3.0:1715330300.931558:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1404 00000100:00100000:3.0:1715330300.931563:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+14:3689:x1798653942501632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1715330300.931570:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330300.931582:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66d9d68 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x31 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d9d61 expref: 14 pid: 7139 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.931591:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x31 (ffff88008b233d00) 00010000:00010000:3.0:1715330300.931596:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715330300.931611:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+13:3689:x1798653942501632:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.931615:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1404 00000100:00100000:3.0:1715330300.931632:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942501632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330300.931679:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942501568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330300.931698:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1715330300.931825:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330300.932550:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942501568 00000100:00100000:3.0:1715330300.932555:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942501568 00000100:00100000:3.0:1715330300.932599:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1405 00000100:00100000:3.0:1715330300.932604:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+13:3691:x1798653942501568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1715330300.932613:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330300.932631:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfed00/0xd895711d66d9d5a lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d9d53 expref: 13 pid: 19960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.932643:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff88009d5e7c00) 00010000:00010000:3.0:1715330300.932649:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715330300.932687:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+12:3691:x1798653942501568:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.932696:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1405 00000100:00100000:1.0:1715330300.932937:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942501568:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330300.934651:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.934753:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938069760 00000100:00100000:2.0:1715330300.934759:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938069760 00000100:00100000:2.0:1715330300.934832:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23583 00000100:00100000:2.0:1715330300.934837:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b161500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+16:17780:x1798653938069760:12345-192.168.204.49@tcp:36:rm.0 00010000:00010000:2.0:1715330300.934903:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d9d6f lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.934914:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d9d6f lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330300.934922:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d9d6f lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330300.934930:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64b40/0xd895711d66d9d76 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0x31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.934935:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64b40/0xd895711d66d9d76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330300.934939:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64b40/0xd895711d66d9d76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330300.934979:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db673c0/0xd895711d66d9d7d lrc: 3/0,1 mode: --/EX res: [0x240000402:0x197:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.934984:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db673c0/0xd895711d66d9d7d lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x197:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330300.934989:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db673c0/0xd895711d66d9d7d lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x197:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00000040:00080000:2.0:1715330300.935182:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1715330300.935187:0:7135:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 275411455742ns, next at 276411453995ns, rc = 0 00010000:00010000:2.0:1715330300.935221:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64480/0xd895711d66d9d84 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x197:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.935228:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64480/0xd895711d66d9d84 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x197:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330300.935234:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64480/0xd895711d66d9d84 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x197:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330300.935240:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64480/0xd895711d66d9d84 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x197:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330300.935244:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64480/0xd895711d66d9d84 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x197:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330300.935252:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64480/0xd895711d66d9d84 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x197:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330300.935257:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64480/0xd895711d66d9d84 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x197:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330300.935261:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64480 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330300.935264:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64480/0xd895711d66d9d84 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x197:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330300.935268:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64480/0xd895711d66d9d84 lrc: 5/0,0 mode: PW/PW res: [0x240000402:0x197:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330300.935275:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x197:0x0].0x0 (ffff88008b091600) 00010000:00010000:2.0:1715330300.935277:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1715330300.935288:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64480/0xd895711d66d9d84 lrc: 3/0,0 mode: --/PW res: [0x240000402:0x197:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330300.935292:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64480/0xd895711d66d9d84 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x197:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330300.935311:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db673c0/0xd895711d66d9d7d lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x197:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330300.935315:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db673c0/0xd895711d66d9d7d lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x197:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330300.935319:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011db673c0/0xd895711d66d9d7d lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x197:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330300.935322:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db673c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.935324:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db673c0/0xd895711d66d9d7d lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x197:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330300.935331:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db673c0/0xd895711d66d9d7d lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x197:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330300.935335:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x197:0x0].0x0 (ffff88008b091600) 00010000:00010000:2.0:1715330300.935337:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330300.935339:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011db673c0/0xd895711d66d9d7d lrc: 2/0,0 mode: --/EX res: [0x240000402:0x197:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330300.935342:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db673c0/0xd895711d66d9d7d lrc: 0/0,0 mode: --/EX res: [0x240000402:0x197:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330300.935412:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d9d6f lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330300.935416:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d9d6f lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330300.935419:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d9d6f lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330300.935423:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d9d6f lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330300.935426:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db65d40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330300.935427:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d9d6f lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330300.935431:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d9d6f lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330300.935435:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff88008b091800) 00010000:00010000:2.0:1715330300.935437:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.935438:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d9d6f lrc: 3/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330300.935443:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db65d40/0xd895711d66d9d6f lrc: 0/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00000004:00010000:2.0:1715330300.935450:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008b161500 reply state ffff880093828000 transno 4294968487 ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64b40/0xd895711d66d9d76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330300.935456:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64b40/0xd895711d66d9d76 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330300.935460:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x31 (ffff88008b091100) 00010000:00010000:2.0:1715330300.935461:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330300.935463:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1715330300.935505:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b161500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+18:17780:x1798653938069760:12345-192.168.204.49@tcp:36:rm.0 Request processed in 668us (858us total) trans 4294968487 rc 0/0 00000100:00100000:2.0:1715330300.935511:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23583 00000100:00100000:0.0:1715330300.939422:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330300.939536:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938069888 00000100:00100000:3.0:1715330300.939544:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938069888 00000100:00100000:3.0:1715330300.939590:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23584 00000100:00100000:3.0:1715330300.939596:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093983800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+18:17780:x1798653938069888:12345-192.168.204.49@tcp:36:rm.0 00010000:00010000:3.0:1715330300.939642:0:25569:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330300.939664:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c000/0xd895711d66d9cc7 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb2b expref: 18 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.939678:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x195:0x0].0x0 (ffff88009b985000) 00010000:00010000:3.0:1715330300.939687:0:25569:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330300.939723:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48ed00/0xd895711d66d9d8b lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.939759:0:25569:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48ed00/0xd895711d66d9d8b lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.939768:0:25569:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48ed00/0xd895711d66d9d8b lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 25569 initiator: MDT1 00000100:00100000:3.0:1715330300.939787:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba67100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942501696:0@lo:101:mdt00_005.0 00000100:00100000:3.0:1715330300.939838:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.939871:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330300.940614:0:7139:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942501696 00000100:00100000:0.0:1715330300.940619:0:7139:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942501696 00000100:00100000:0.0:1715330300.940863:0:7139:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3003 00000100:00100000:0.0:1715330300.940868:0:7139:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:25569:x1798653942501696:12345-0@lo:101:mdt00_005.0 00010000:00010000:0.0:1715330300.940878:0:7139:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330300.940891:0:7139:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a21c0/0xd895711d66d9d92 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d9d8b expref: -99 pid: 7139 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.940908:0:7139:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a21c0/0xd895711d66d9d92 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d9d8b expref: 13 pid: 7139 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.940917:0:7139:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a21c0/0xd895711d66d9d92 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9d8b expref: 13 pid: 7139 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.940922:0:7139:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff88008b233700) 00010000:00010000:0.0:1715330300.940925:0:7139:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330300.940926:0:7139:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a21c0, rc 0) 00000100:00100000:0.0:1715330300.940956:0:7139:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:25569:x1798653942501696:12345-0@lo:101:mdt00_005.0 Request processed in 88us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330300.940964:0:7139:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3003 00000100:00100000:3.0:1715330300.941118:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba67100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942501696:0@lo:101:mdt00_005.0 00010000:00010000:3.0:1715330300.941129:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48ed00/0xd895711d66d9d8b lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9d92 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.941136:0:25569:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48ed00/0xd895711d66d9d8b lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9d92 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330300.941154:0:25569:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00010000:00010000:3.0:1715330300.941168:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48cb40/0xd895711d66d9d99 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.941173:0:25569:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48cb40/0xd895711d66d9d99 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.941179:0:25569:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48cb40/0xd895711d66d9d99 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 25569 initiator: MDT1 00000100:00100000:3.0:1715330300.941187:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d608380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942501760:0@lo:101:mdt00_005.0 00000100:00100000:3.0:1715330300.941201:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.941219:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330300.941389:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942501760 00000100:00100000:1.0:1715330300.941393:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942501760 00000100:00100000:1.0:1715330300.941414:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3004 00000100:00100000:1.0:1715330300.941417:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:25569:x1798653942501760:12345-0@lo:101:mdt00_005.0 00010000:00010000:1.0:1715330300.941424:0:19960:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330300.941433:0:19960:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d9da0 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d9d99 expref: -99 pid: 19960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.941445:0:19960:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d9da0 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d9d99 expref: 14 pid: 19960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.941451:0:19960:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d9da0 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9d99 expref: 14 pid: 19960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.941457:0:19960:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x36 (ffff88009d5e7500) 00010000:00010000:1.0:1715330300.941458:0:19960:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330300.941460:0:19960:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfd200, rc 0) 00000100:00100000:1.0:1715330300.941478:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942501760:12345-0@lo:101:mdt00_005.0 Request processed in 61us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330300.941482:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3004 00000100:00100000:3.0:1715330300.941560:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d608380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942501760:0@lo:101:mdt00_005.0 00010000:00010000:3.0:1715330300.941567:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48cb40/0xd895711d66d9d99 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9da0 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.941573:0:25569:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48cb40/0xd895711d66d9d99 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9da0 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330300.941581:0:25569:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00000100:00100000:3.0:1715330300.941600:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d608380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942501824:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1715330300.941616:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.941892:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496f900 going to sleep for 11 seconds 00000100:00100000:0.0:1715330300.941939:0:7139:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942501824 00000100:00100000:0.0:1715330300.941943:0:7139:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942501824 00000100:00100000:0.0:1715330300.941959:0:7139:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3005 00000100:00100000:0.0:1715330300.941963:0:7139:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d608a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942501824:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1715330300.942012:0:7139:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d608a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942501824:12345-0@lo:1000:mdt00_005.0 Request processed in 48us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330300.942017:0:7139:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3005 00000100:00100000:3.0:1715330300.942145:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d608380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942501824:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1715330300.942174:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d608380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942501888:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1715330300.942191:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.942199:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496f900 going to sleep for 11 seconds 00000100:00100000:1.0:1715330300.942232:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942501888 00000100:00100000:1.0:1715330300.942235:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942501888 00000100:00100000:1.0:1715330300.942247:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3006 00000100:00100000:1.0:1715330300.942250:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942501888:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1715330300.942306:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942501888:12345-0@lo:1000:mdt00_005.0 Request processed in 54us (113us total) trans 0 rc -2/-2 00000100:00100000:1.0:1715330300.942310:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3006 00000100:00100000:3.0:1715330300.942443:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d608380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942501888:0@lo:1000:mdt00_005.0 00000004:00080000:3.0:1715330300.942454:0:25569:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00010000:00010000:3.0:1715330300.942457:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48ed00/0xd895711d66d9d8b lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9d92 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.942463:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48ed00/0xd895711d66d9d8b lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9d92 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.942468:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48ed00/0xd895711d66d9d8b lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9d92 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.942507:0:25569:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1715330300.942511:0:25569:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00010000:00010000:3.0:1715330300.942513:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48cb40/0xd895711d66d9d99 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9da0 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.942518:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48cb40/0xd895711d66d9d99 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9da0 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.942523:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48cb40/0xd895711d66d9d99 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9da0 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.942632:0:25569:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1715330300.942709:0:9415:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1715330300.942715:0:9415:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48ed00/0xd895711d66d9d8b lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d9d92 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.942721:0:9415:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48ed00 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330300.942725:0:9415:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48ed00/0xd895711d66d9d8b lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d9d92 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330300.942744:0:9415:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48ed00/0xd895711d66d9d8b lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d9d92 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.942760:0:9415:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48ed00/0xd895711d66d9d8b lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9d92 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.942765:0:9415:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330300.942780:0:9415:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48ed00/0xd895711d66d9d8b lrc: 1/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9d92 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.942786:0:9415:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48ed00/0xd895711d66d9d8b lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9d92 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.942804:0:9415:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715330300.942806:0:9415:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48cb40/0xd895711d66d9d99 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d9da0 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.942810:0:9415:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48cb40 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330300.942812:0:9415:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48cb40/0xd895711d66d9d99 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d9da0 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330300.942817:0:9415:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48cb40/0xd895711d66d9d99 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d9da0 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.942826:0:9415:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48cb40/0xd895711d66d9d99 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9da0 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.942829:0:9415:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1715330300.942882:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093983800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+17:17780:x1798653938069888:12345-192.168.204.49@tcp:36:rm.0 Request processed in 3284us (3467us total) trans 0 rc -2/-2 00000100:00100000:3.0:1715330300.942888:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23584 00000100:00100000:3.0:1715330300.942904:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942501952:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1715330300.942926:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.942946:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942501952 00000100:00100000:3.0:1715330300.942948:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942501952 00000100:00100000:3.0:1715330300.942964:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1406 00000100:00100000:3.0:1715330300.942967:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ab789050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+14:3689:x1798653942501952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1715330300.942973:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330300.942982:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a21c0/0xd895711d66d9d92 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d9d8b expref: 14 pid: 7139 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.942991:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff88008b233700) 00010000:00010000:3.0:1715330300.942997:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715330300.943010:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ab789050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+13:3689:x1798653942501952:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (84us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.943015:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1406 00000100:00100000:3.0:1715330300.943048:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942501952:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715330300.943092:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330300.943384:0:9415:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48cb40/0xd895711d66d9d99 lrc: 1/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9da0 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.943391:0:9415:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48cb40/0xd895711d66d9d99 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9da0 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.943403:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330300.943404:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330300.943406:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330300.943465:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093983100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942502016:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1715330300.943487:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.943764:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942502016 00000100:00100000:3.0:1715330300.943768:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942502016 00000100:00100000:3.0:1715330300.943792:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1407 00000100:00100000:3.0:1715330300.943796:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091cc8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+13:3690:x1798653942502016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1715330300.943802:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330300.943810:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66d9da0 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x36 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d9d99 expref: 13 pid: 19960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.943819:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x36 (ffff88009d5e7500) 00010000:00010000:3.0:1715330300.943823:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715330300.943847:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091cc8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942502016:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.943851:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1407 00000100:00100000:2.0:1715330300.943939:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093983100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942502016:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330300.946250:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330300.946360:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938070016 00000100:00100000:3.0:1715330300.946369:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938070016 00000100:00100000:3.0:1715330300.946402:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23585 00000100:00100000:3.0:1715330300.946408:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093983100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+17:17780:x1798653938070016:12345-192.168.204.49@tcp:36:rm.0 00010000:00010000:3.0:1715330300.946471:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48fcc0/0xd895711d66d9da7 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.946483:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48fcc0/0xd895711d66d9da7 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.946492:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48fcc0/0xd895711d66d9da7 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.946501:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48eac0/0xd895711d66d9dae lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0x36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.946505:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48eac0/0xd895711d66d9dae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.946510:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48eac0/0xd895711d66d9dae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.946554:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48fa80/0xd895711d66d9db5 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x195:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.946560:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48fa80/0xd895711d66d9db5 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x195:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.946565:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48fa80/0xd895711d66d9db5 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x195:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00000040:00080000:3.0:1715330300.946777:0:25569:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 64 off8576 00010000:00010000:3.0:1715330300.946813:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e1c0/0xd895711d66d9dbc lrc: 3/0,1 mode: --/PW res: [0x240000402:0x195:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.946820:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e1c0/0xd895711d66d9dbc lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x195:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.946827:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e1c0/0xd895711d66d9dbc lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x195:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.946832:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e1c0/0xd895711d66d9dbc lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x195:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.946837:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e1c0/0xd895711d66d9dbc lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x195:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.946841:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e1c0/0xd895711d66d9dbc lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x195:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.946846:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e1c0/0xd895711d66d9dbc lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x195:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.946851:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48e1c0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330300.946854:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e1c0/0xd895711d66d9dbc lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x195:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.946859:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e1c0/0xd895711d66d9dbc lrc: 5/0,0 mode: PW/PW res: [0x240000402:0x195:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.946869:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x195:0x0].0x0 (ffff88009b985900) 00010000:00010000:3.0:1715330300.946871:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330300.946874:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e1c0/0xd895711d66d9dbc lrc: 3/0,0 mode: --/PW res: [0x240000402:0x195:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.946879:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e1c0/0xd895711d66d9dbc lrc: 0/0,0 mode: --/PW res: [0x240000402:0x195:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.946902:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48fa80/0xd895711d66d9db5 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x195:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.946907:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48fa80/0xd895711d66d9db5 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x195:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.946911:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48fa80/0xd895711d66d9db5 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x195:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.946914:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48fa80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330300.946917:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48fa80/0xd895711d66d9db5 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x195:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.946921:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48fa80/0xd895711d66d9db5 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x195:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.946925:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x195:0x0].0x0 (ffff88009b985900) 00010000:00010000:3.0:1715330300.946927:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330300.946929:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48fa80/0xd895711d66d9db5 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x195:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.946932:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48fa80/0xd895711d66d9db5 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x195:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.947012:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48fcc0/0xd895711d66d9da7 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.947017:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48fcc0/0xd895711d66d9da7 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.947021:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48fcc0/0xd895711d66d9da7 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.947025:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48fcc0/0xd895711d66d9da7 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.947029:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48fcc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330300.947031:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48fcc0/0xd895711d66d9da7 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.947038:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48fcc0/0xd895711d66d9da7 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.947043:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff88009b985a00) 00010000:00010000:3.0:1715330300.947045:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330300.947047:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48fcc0/0xd895711d66d9da7 lrc: 3/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.947051:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48fcc0/0xd895711d66d9da7 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00000004:00010000:3.0:1715330300.947059:0:25569:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093983100 reply state ffff880093ac2000 transno 4294968488 ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48eac0/0xd895711d66d9dae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.947065:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48eac0/0xd895711d66d9dae lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.947069:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x36 (ffff88009b985c00) 00010000:00010000:3.0:1715330300.947070:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330300.947072:0:25569:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330300.947121:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093983100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+19:17780:x1798653938070016:12345-192.168.204.49@tcp:36:rm.0 Request processed in 713us (876us total) trans 4294968488 rc 0/0 00000100:00100000:3.0:1715330300.947127:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23585 00000100:00100000:0.0:1715330300.952085:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330300.953368:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938070144 00000100:00100000:2.0:1715330300.953378:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938070144 00000100:00100000:2.0:1715330300.953428:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23586 00000100:00100000:2.0:1715330300.953435:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+19:17780:x1798653938070144:12345-192.168.204.49@tcp:36:rm.0 00010000:00010000:2.0:1715330300.953483:0:7135:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330300.953506:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48ef40/0xd895711d66d9bcb lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbad7 expref: 19 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.953538:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff88009b985400) 00010000:00010000:2.0:1715330300.953548:0:7135:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330300.953586:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65d40/0xd895711d66d9dc3 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.953593:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65d40/0xd895711d66d9dc3 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330300.953601:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65d40/0xd895711d66d9dc3 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT1 00000100:00100000:2.0:1715330300.953617:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091cc9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942502080:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1715330300.953658:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330300.953673:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091cb5000 going to sleep for 11 seconds 00000100:00100000:2.0:1715330300.953683:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942502080 00000100:00100000:2.0:1715330300.953686:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942502080 00000100:00100000:2.0:1715330300.953717:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3007 00000100:00100000:2.0:1715330300.953721:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:7135:x1798653942502080:12345-0@lo:101:mdt00_002.0 00010000:00010000:2.0:1715330300.953745:0:7138:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330300.953757:0:7138:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d9dca lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d9dc3 expref: -99 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.953775:0:7138:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d9dca lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d9dc3 expref: 13 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.953784:0:7138:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d9dca lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9dc3 expref: 13 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.953790:0:7138:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff88008b091600) 00010000:00010000:2.0:1715330300.953793:0:7138:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.953794:0:7138:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db673c0, rc 0) 00000100:00100000:2.0:1715330300.953817:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:7135:x1798653942502080:12345-0@lo:101:mdt00_002.0 Request processed in 94us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.953822:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3007 00000100:00100000:2.0:1715330300.953853:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091cc9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942502080:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1715330300.953862:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65d40/0xd895711d66d9dc3 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9dca expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.953870:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65d40/0xd895711d66d9dc3 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9dca expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715330300.953883:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00010000:00010000:2.0:1715330300.953895:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64480/0xd895711d66d9dd1 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330300.953900:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64480/0xd895711d66d9dd1 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330300.953906:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64480/0xd895711d66d9dd1 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT1 00000100:00100000:2.0:1715330300.953914:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f579880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942502144:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1715330300.953931:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330300.953940:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091cb5000 going to sleep for 11 seconds 00000100:00100000:2.0:1715330300.953947:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942502144 00000100:00100000:2.0:1715330300.953949:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942502144 00000100:00100000:2.0:1715330300.953963:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3008 00000100:00100000:2.0:1715330300.953967:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f578000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:7135:x1798653942502144:12345-0@lo:101:mdt00_002.0 00010000:00010000:2.0:1715330300.953973:0:7138:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330300.953981:0:7138:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9dd8 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d9dd1 expref: -99 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.953993:0:7138:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9dd8 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d9dd1 expref: 14 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.954000:0:7138:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9dd8 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9dd1 expref: 14 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.954006:0:7138:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x30 (ffff88008b091e00) 00010000:00010000:2.0:1715330300.954009:0:7138:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.954011:0:7138:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db66ac0, rc 0) 00000100:00100000:2.0:1715330300.954027:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f578000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+14:7135:x1798653942502144:12345-0@lo:101:mdt00_002.0 Request processed in 59us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.954031:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3008 00000100:00100000:2.0:1715330300.954048:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f579880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942502144:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1715330300.954055:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64480/0xd895711d66d9dd1 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9dd8 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.954061:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64480/0xd895711d66d9dd1 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9dd8 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715330300.954069:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00000100:00100000:2.0:1715330300.954099:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f579880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942502208:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1715330300.954118:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330300.954126:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091cb5900 going to sleep for 11 seconds 00000100:00100000:2.0:1715330300.954133:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942502208 00000100:00100000:2.0:1715330300.954135:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942502208 00000100:00100000:2.0:1715330300.954148:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3009 00000100:00100000:2.0:1715330300.954151:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+14:7135:x1798653942502208:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1715330300.954192:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+14:7135:x1798653942502208:12345-0@lo:1000:mdt00_002.0 Request processed in 40us (73us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.954200:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3009 00000100:00100000:2.0:1715330300.954214:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f579880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942502208:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1715330300.954241:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f579880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942502272:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1715330300.954255:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330300.954262:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091cb5900 going to sleep for 11 seconds 00000100:00100000:2.0:1715330300.954267:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942502272 00000100:00100000:2.0:1715330300.954270:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942502272 00000100:00100000:2.0:1715330300.954293:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3010 00000100:00100000:2.0:1715330300.954297:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f578700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+14:7135:x1798653942502272:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1715330300.954376:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f578700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+14:7135:x1798653942502272:12345-0@lo:1000:mdt00_002.0 Request processed in 77us (119us total) trans 0 rc -2/-2 00000100:00100000:2.0:1715330300.954381:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3010 00000100:00100000:2.0:1715330300.954398:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f579880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942502272:0@lo:1000:mdt00_002.0 00000004:00080000:2.0:1715330300.954409:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00010000:00010000:2.0:1715330300.954412:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65d40/0xd895711d66d9dc3 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9dca expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.954419:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65d40/0xd895711d66d9dc3 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9dca expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.954424:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65d40/0xd895711d66d9dc3 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9dca expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.954436:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1715330300.954440:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00010000:00010000:2.0:1715330300.954442:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64480/0xd895711d66d9dd1 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9dd8 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.954451:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64480/0xd895711d66d9dd1 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9dd8 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.954457:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64480/0xd895711d66d9dd1 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9dd8 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.954465:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1715330300.954499:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+18:17780:x1798653938070144:12345-192.168.204.49@tcp:36:rm.0 Request processed in 1064us (2422us total) trans 0 rc -2/-2 00000100:00100000:2.0:1715330300.954504:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23586 00010000:00010000:3.0:1715330300.954749:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1715330300.954756:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65d40/0xd895711d66d9dc3 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d9dca expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.954763:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db65d40 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:3.0:1715330300.954768:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65d40/0xd895711d66d9dc3 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d9dca expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1715330300.954779:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65d40/0xd895711d66d9dc3 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d9dca expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.954807:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65d40/0xd895711d66d9dc3 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9dca expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.954813:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1715330300.954826:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65d40/0xd895711d66d9dc3 lrc: 1/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9dca expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.954833:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db65d40/0xd895711d66d9dc3 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9dca expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.954845:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1715330300.954847:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64480/0xd895711d66d9dd1 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d9dd8 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.954851:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64480 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:3.0:1715330300.954854:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64480/0xd895711d66d9dd1 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d9dd8 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1715330300.954860:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64480/0xd895711d66d9dd1 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d9dd8 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.954870:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64480/0xd895711d66d9dd1 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9dd8 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.954874:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1715330300.954884:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64480/0xd895711d66d9dd1 lrc: 1/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9dd8 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.954893:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64480/0xd895711d66d9dd1 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9dd8 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.954901:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715330300.954902:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715330300.954904:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330300.954910:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1715330300.954917:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d609180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942502400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1715330300.954942:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.954962:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942502400 00000100:00100000:3.0:1715330300.954965:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942502400 00000100:00100000:3.0:1715330300.954990:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1408 00010000:00010000:0.0:1715330300.954991:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330300.954994:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d609500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+14:3689:x1798653942502400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1715330300.955001:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330300.955010:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9dd8 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x30 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d9dd1 expref: 14 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.955019:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x30 (ffff88008b091e00) 00010000:00010000:3.0:1715330300.955025:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715330300.955044:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d609500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+13:3689:x1798653942502400:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.955049:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1408 00000100:00100000:1.0:1715330300.955059:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942502336:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1715330300.955071:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d609180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942502400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330300.955082:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.955104:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942502336 00000100:00100000:3.0:1715330300.955107:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942502336 00000100:00100000:3.0:1715330300.955120:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1409 00000100:00100000:3.0:1715330300.955124:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+13:3691:x1798653942502336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1715330300.955130:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330300.955138:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d9dca lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d9dc3 expref: 13 pid: 7138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.955146:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff88008b091600) 00010000:00010000:3.0:1715330300.955150:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715330300.955169:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+12:3691:x1798653942502336:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (85us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.955173:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1409 00000100:00100000:1.0:1715330300.955819:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942502336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330300.960241:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330300.960427:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938070272 00000100:00100000:3.0:1715330300.960440:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938070272 00000100:00100000:3.0:1715330300.960486:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23587 00000100:00100000:3.0:1715330300.960493:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+18:17780:x1798653938070272:12345-192.168.204.49@tcp:36:rm.0 00010000:00010000:3.0:1715330300.960574:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48fcc0/0xd895711d66d9ddf lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.960589:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48fcc0/0xd895711d66d9ddf lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.960598:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48fcc0/0xd895711d66d9ddf lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.960606:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48fa80/0xd895711d66d9de6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0x30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.960611:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48fa80/0xd895711d66d9de6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.960615:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48fa80/0xd895711d66d9de6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.960663:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e1c0/0xd895711d66d9ded lrc: 3/0,1 mode: --/EX res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.960668:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e1c0/0xd895711d66d9ded lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x199:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.960673:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e1c0/0xd895711d66d9ded lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x199:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00000040:00080000:3.0:1715330300.961340:0:25569:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 64 off8576 00010000:00010000:3.0:1715330300.961379:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c000/0xd895711d66d9df4 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.961385:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c000/0xd895711d66d9df4 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.961391:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c000/0xd895711d66d9df4 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.961396:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c000/0xd895711d66d9df4 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.961401:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c000/0xd895711d66d9df4 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.961405:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c000/0xd895711d66d9df4 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x199:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.961410:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c000/0xd895711d66d9df4 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x199:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.961414:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48c000 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330300.961417:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c000/0xd895711d66d9df4 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x199:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.961426:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c000/0xd895711d66d9df4 lrc: 5/0,0 mode: PW/PW res: [0x240000402:0x199:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.962889:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff88009b985000) 00010000:00010000:3.0:1715330300.962893:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330300.962897:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c000/0xd895711d66d9df4 lrc: 3/0,0 mode: --/PW res: [0x240000402:0x199:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.962903:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c000/0xd895711d66d9df4 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x199:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.962929:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e1c0/0xd895711d66d9ded lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x199:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.962933:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e1c0/0xd895711d66d9ded lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x199:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.962937:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e1c0/0xd895711d66d9ded lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x199:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.962941:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48e1c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330300.962943:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e1c0/0xd895711d66d9ded lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x199:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.962947:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e1c0/0xd895711d66d9ded lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x199:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.962953:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff88009b985000) 00010000:00010000:3.0:1715330300.962954:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330300.962956:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e1c0/0xd895711d66d9ded lrc: 2/0,0 mode: --/EX res: [0x240000402:0x199:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.962960:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e1c0/0xd895711d66d9ded lrc: 0/0,0 mode: --/EX res: [0x240000402:0x199:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.963057:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48fcc0/0xd895711d66d9ddf lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.963062:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48fcc0/0xd895711d66d9ddf lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.963066:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48fcc0/0xd895711d66d9ddf lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.963070:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48fcc0/0xd895711d66d9ddf lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.963074:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48fcc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330300.963076:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48fcc0/0xd895711d66d9ddf lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.963080:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48fcc0/0xd895711d66d9ddf lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.963086:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff88009b985a00) 00010000:00010000:3.0:1715330300.963088:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330300.963090:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48fcc0/0xd895711d66d9ddf lrc: 3/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.963093:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48fcc0/0xd895711d66d9ddf lrc: 0/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00000004:00010000:3.0:1715330300.963102:0:25569:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009b5ec000 reply state ffff88009d660000 transno 4294968489 ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48fa80/0xd895711d66d9de6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.963110:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48fa80/0xd895711d66d9de6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.963114:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x30 (ffff88009b985900) 00010000:00010000:3.0:1715330300.963117:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330300.963119:0:25569:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330300.963191:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+20:17780:x1798653938070272:12345-192.168.204.49@tcp:36:rm.0 Request processed in 2695us (2954us total) trans 4294968489 rc 0/0 00000100:00100000:3.0:1715330300.963199:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23587 00000100:00100000:0.0:1715330300.967646:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330300.967838:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938070400 00000100:00100000:3.0:1715330300.967847:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938070400 00000100:00100000:3.0:1715330300.967898:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23588 00000100:00100000:3.0:1715330300.967905:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+20:17780:x1798653938070400:12345-192.168.204.49@tcp:36:rm.0 00010000:00010000:3.0:1715330300.967956:0:25569:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330300.967977:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e400/0xd895711d66d9c49 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb01 expref: 20 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.967996:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x196:0x0].0x0 (ffff88009b985500) 00010000:00010000:3.0:1715330300.968005:0:25569:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330300.968653:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48fcc0/0xd895711d66d9dfb lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.968661:0:25569:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48fcc0/0xd895711d66d9dfb lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.968671:0:25569:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48fcc0/0xd895711d66d9dfb lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 25569 initiator: MDT1 00000100:00100000:3.0:1715330300.968690:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d609180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942502464:0@lo:101:mdt00_005.0 00000100:00100000:3.0:1715330300.968761:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.968780:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715330300.968834:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942502464 00000100:00100000:0.0:1715330300.968839:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942502464 00000100:00100000:0.0:1715330300.968888:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3011 00000100:00100000:0.0:1715330300.968893:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d609880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:25569:x1798653942502464:12345-0@lo:101:mdt00_005.0 00010000:00010000:0.0:1715330300.968904:0:19960:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330300.968921:0:19960:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2ac0/0xd895711d66d9e02 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d9dfb expref: -99 pid: 19960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.968942:0:19960:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2ac0/0xd895711d66d9e02 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d9dfb expref: 13 pid: 19960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.968953:0:19960:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2ac0/0xd895711d66d9e02 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9dfb expref: 13 pid: 19960 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.968960:0:19960:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff88008b233900) 00010000:00010000:0.0:1715330300.968962:0:19960:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330300.968964:0:19960:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a2ac0, rc 0) 00000100:00100000:0.0:1715330300.968991:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d609880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:25569:x1798653942502464:12345-0@lo:101:mdt00_005.0 Request processed in 98us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330300.968997:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3011 00000100:00100000:3.0:1715330300.969599:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d609180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942502464:0@lo:101:mdt00_005.0 00010000:00010000:3.0:1715330300.969613:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48fcc0/0xd895711d66d9dfb lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9e02 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.969621:0:25569:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48fcc0/0xd895711d66d9dfb lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9e02 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330300.969638:0:25569:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00010000:00010000:3.0:1715330300.969654:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48e1c0/0xd895711d66d9e09 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.969659:0:25569:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48e1c0/0xd895711d66d9e09 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.969665:0:25569:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48e1c0/0xd895711d66d9e09 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 25569 initiator: MDT1 00000100:00100000:3.0:1715330300.969674:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d609180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942502528:0@lo:101:mdt00_005.0 00000100:00100000:3.0:1715330300.969697:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.969718:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715330300.969755:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942502528 00000100:00100000:2.0:1715330300.969760:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942502528 00000100:00100000:2.0:1715330300.969779:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3012 00000100:00100000:2.0:1715330300.969783:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc14050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:25569:x1798653942502528:12345-0@lo:101:mdt00_005.0 00010000:00010000:2.0:1715330300.969792:0:8592:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330300.969803:0:8592:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db646c0/0xd895711d66d9e10 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d9e09 expref: -99 pid: 8592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.969816:0:8592:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db646c0/0xd895711d66d9e10 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d9e09 expref: 14 pid: 8592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.969826:0:8592:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db646c0/0xd895711d66d9e10 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9e09 expref: 14 pid: 8592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.969832:0:8592:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x3031 (ffff88008b091b00) 00010000:00010000:2.0:1715330300.969834:0:8592:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.969836:0:8592:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db646c0, rc 0) 00000100:00100000:2.0:1715330300.969860:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc14050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942502528:12345-0@lo:101:mdt00_005.0 Request processed in 76us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.969865:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3012 00000100:00100000:3.0:1715330300.969917:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d609180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942502528:0@lo:101:mdt00_005.0 00010000:00010000:3.0:1715330300.969926:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48e1c0/0xd895711d66d9e09 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9e10 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.969933:0:25569:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48e1c0/0xd895711d66d9e09 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9e10 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330300.969942:0:25569:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00000100:00100000:3.0:1715330300.969965:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d609180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942502592:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1715330300.969986:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.970175:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b496f900 going to sleep for 11 seconds 00000100:00100000:2.0:1715330300.970180:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942502592 00000100:00100000:2.0:1715330300.970183:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942502592 00000100:00100000:2.0:1715330300.970209:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3013 00000100:00100000:2.0:1715330300.970213:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942502592:12345-0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1715330300.970267:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942502592:12345-0@lo:1000:mdt00_005.0 Request processed in 53us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.970272:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3013 00000100:00100000:3.0:1715330300.970349:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d609180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942502592:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1715330300.970382:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d609180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942502656:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1715330300.970398:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.970652:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa600 going to sleep for 11 seconds 00000100:00100000:2.0:1715330300.970722:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942502656 00000100:00100000:2.0:1715330300.970725:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942502656 00000100:00100000:2.0:1715330300.970849:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3014 00000100:00100000:2.0:1715330300.970854:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942502656:12345-0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1715330300.970916:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942502656:12345-0@lo:1000:mdt00_005.0 Request processed in 61us (516us total) trans 0 rc -2/-2 00000100:00100000:2.0:1715330300.970921:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3014 00000100:00100000:3.0:1715330300.971000:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d609180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942502656:0@lo:1000:mdt00_005.0 00000004:00080000:3.0:1715330300.971013:0:25569:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00010000:00010000:3.0:1715330300.971018:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48fcc0/0xd895711d66d9dfb lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9e02 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.971024:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48fcc0/0xd895711d66d9dfb lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9e02 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.971029:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48fcc0/0xd895711d66d9dfb lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9e02 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.971040:0:25569:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1715330300.971044:0:25569:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00010000:00010000:3.0:1715330300.971046:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48e1c0/0xd895711d66d9e09 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9e10 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.971051:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48e1c0/0xd895711d66d9e09 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9e10 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.971055:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48e1c0/0xd895711d66d9e09 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9e10 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.971061:0:25569:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1715330300.971207:0:9415:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1715330300.971213:0:9415:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48fcc0/0xd895711d66d9dfb lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d9e02 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.971220:0:9415:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48fcc0 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330300.971224:0:9415:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48fcc0/0xd895711d66d9dfb lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d9e02 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330300.971231:0:9415:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48fcc0/0xd895711d66d9dfb lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d9e02 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.971250:0:9415:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48fcc0/0xd895711d66d9dfb lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9e02 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.971255:0:9415:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330300.971276:0:9415:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48fcc0/0xd895711d66d9dfb lrc: 1/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9e02 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.971290:0:9415:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48fcc0/0xd895711d66d9dfb lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9e02 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.971309:0:9415:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715330300.971312:0:9415:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48e1c0/0xd895711d66d9e09 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d9e10 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.971317:0:9415:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48e1c0 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330300.971320:0:9415:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48e1c0/0xd895711d66d9e09 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d9e10 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330300.971325:0:9415:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48e1c0/0xd895711d66d9e09 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d9e10 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.971337:0:9415:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48e1c0/0xd895711d66d9e09 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9e10 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.971341:0:9415:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1715330300.971883:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330300.971895:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942502784:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1715330300.971921:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330300.971947:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942502784 00000100:00100000:2.0:1715330300.971951:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942502784 00000100:00100000:2.0:1715330300.971976:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1410 00000100:00100000:2.0:1715330300.971981:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+14:3690:x1798653942502784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715330300.971990:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330300.972002:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db646c0/0xd895711d66d9e10 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d9e09 expref: 14 pid: 8592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330300.972196:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+19:17780:x1798653938070400:12345-192.168.204.49@tcp:36:rm.0 Request processed in 4287us (4556us total) trans 0 rc -2/-2 00000100:00100000:3.0:1715330300.972202:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23588 00000100:00100000:3.0:1715330300.972223:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942502720:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1715330300.972243:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1715330300.972693:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x3031 (ffff88008b091b00) 00010000:00010000:2.0:1715330300.972702:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330300.972752:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+13:3690:x1798653942502784:12345-0@lo:103:ldlm_bl.0 Request processed in 770us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.972758:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1410 00000100:00100000:2.0:1715330300.972769:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942502720 00000100:00100000:2.0:1715330300.972772:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942502720 00000100:00100000:2.0:1715330300.972799:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1411 00000100:00100000:2.0:1715330300.972803:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d609180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+13:3689:x1798653942502720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715330300.972810:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330300.972819:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2ac0/0xd895711d66d9e02 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d9dfb expref: 13 pid: 19960 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.972830:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff88008b233900) 00010000:00010000:2.0:1715330300.972835:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330300.972853:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d609180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+12:3689:x1798653942502720:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.972858:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1411 00000100:00100000:3.0:1715330300.972928:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942502784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1715330300.972946:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942502720:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715330300.973254:0:9415:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48e1c0/0xd895711d66d9e09 lrc: 1/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9e10 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.973262:0:9415:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48e1c0/0xd895711d66d9e09 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9e10 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330300.973289:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330300.973290:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330300.973292:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330300.980959:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330300.981052:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938070528 00000100:00100000:3.0:1715330300.981060:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938070528 00000100:00100000:3.0:1715330300.981150:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23589 00000100:00100000:3.0:1715330300.981157:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+19:17780:x1798653938070528:12345-192.168.204.49@tcp:36:rm.0 00010000:00010000:3.0:1715330300.981228:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e400/0xd895711d66d9e17 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.981241:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e400/0xd895711d66d9e17 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.981251:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e400/0xd895711d66d9e17 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.981259:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c000/0xd895711d66d9e1e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0x3031 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.981264:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c000/0xd895711d66d9e1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.981270:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c000/0xd895711d66d9e1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.981320:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48f600/0xd895711d66d9e25 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x196:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.981326:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48f600/0xd895711d66d9e25 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x196:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.981334:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48f600/0xd895711d66d9e25 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x196:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00000040:00080000:3.0:1715330300.981524:0:25569:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8640 00010000:00010000:3.0:1715330300.981559:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c900/0xd895711d66d9e2c lrc: 3/0,1 mode: --/PW res: [0x240000402:0x196:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.981566:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c900/0xd895711d66d9e2c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x196:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.981571:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c900/0xd895711d66d9e2c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x196:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.981577:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c900/0xd895711d66d9e2c lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x196:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.981582:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c900/0xd895711d66d9e2c lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x196:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.981586:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c900/0xd895711d66d9e2c lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x196:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.981592:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c900/0xd895711d66d9e2c lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x196:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.981597:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48c900 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330300.981600:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c900/0xd895711d66d9e2c lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x196:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.981605:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c900/0xd895711d66d9e2c lrc: 5/0,0 mode: PW/PW res: [0x240000402:0x196:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.981613:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x196:0x0].0x0 (ffff88009b985800) 00010000:00010000:3.0:1715330300.981616:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330300.981619:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c900/0xd895711d66d9e2c lrc: 3/0,0 mode: --/PW res: [0x240000402:0x196:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.981624:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c900/0xd895711d66d9e2c lrc: 0/0,0 mode: --/PW res: [0x240000402:0x196:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.981649:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48f600/0xd895711d66d9e25 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x196:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.981653:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48f600/0xd895711d66d9e25 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x196:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.981657:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48f600/0xd895711d66d9e25 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x196:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.981661:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48f600 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330300.981664:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48f600/0xd895711d66d9e25 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x196:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.981669:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48f600/0xd895711d66d9e25 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x196:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.981674:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x196:0x0].0x0 (ffff88009b985800) 00010000:00010000:3.0:1715330300.981676:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330300.981677:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48f600/0xd895711d66d9e25 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x196:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.981681:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48f600/0xd895711d66d9e25 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x196:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.981777:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e400/0xd895711d66d9e17 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.981782:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e400/0xd895711d66d9e17 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.981790:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e400/0xd895711d66d9e17 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.981795:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e400/0xd895711d66d9e17 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.981798:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48e400 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330300.981800:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e400/0xd895711d66d9e17 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.981804:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e400/0xd895711d66d9e17 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.981809:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff88009b985500) 00010000:00010000:3.0:1715330300.981811:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330300.981813:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e400/0xd895711d66d9e17 lrc: 3/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.981817:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e400/0xd895711d66d9e17 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00000004:00010000:3.0:1715330300.981826:0:25569:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009b5ef480 reply state ffff88009d662000 transno 4294968490 ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c000/0xd895711d66d9e1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.981833:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c000/0xd895711d66d9e1e lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.981837:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x3031 (ffff88009b985400) 00010000:00010000:3.0:1715330300.981838:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330300.981841:0:25569:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330300.982973:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+21:17780:x1798653938070528:12345-192.168.204.49@tcp:36:rm.0 Request processed in 1810us (2017us total) trans 4294968490 rc 0/0 00000100:00100000:3.0:1715330300.982984:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23589 00000100:00100000:0.0:1715330300.988438:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330300.988529:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938070656 00000100:00100000:3.0:1715330300.988538:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938070656 00000100:00100000:3.0:1715330300.988676:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23590 00000100:00100000:3.0:1715330300.988682:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+21:17780:x1798653938070656:12345-192.168.204.49@tcp:36:rm.0 00010000:00010000:3.0:1715330300.989075:0:25569:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330300.989097:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64d80/0xd895711d66d9d06 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb40 expref: 21 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.989542:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x194:0x0].0x0 (ffff880135e32200) 00010000:00010000:3.0:1715330300.989555:0:25569:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330300.989604:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48d440/0xd895711d66d9e33 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.989611:0:25569:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48d440/0xd895711d66d9e33 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.989619:0:25569:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48d440/0xd895711d66d9e33 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 25569 initiator: MDT1 00000100:00100000:3.0:1715330300.989638:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d60a300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942502848:0@lo:101:mdt00_005.0 00000100:00100000:3.0:1715330300.989679:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.989709:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa900 going to sleep for 11 seconds 00000100:00100000:1.0:1715330300.989867:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942502848 00000100:00100000:1.0:1715330300.989873:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942502848 00000100:00100000:1.0:1715330300.990466:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3015 00000100:00100000:1.0:1715330300.990471:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d60a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:25569:x1798653942502848:12345-0@lo:101:mdt00_005.0 00010000:00010000:1.0:1715330300.990483:0:19960:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330300.990496:0:19960:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d9e3a lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d9e33 expref: -99 pid: 19960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.990517:0:19960:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d9e3a lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d9e33 expref: 13 pid: 19960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.990528:0:19960:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d9e3a lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9e33 expref: 13 pid: 19960 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.990533:0:19960:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff88009d5e7a00) 00010000:00010000:1.0:1715330300.990536:0:19960:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330300.990538:0:19960:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bffcc0, rc 0) 00000100:00100000:1.0:1715330300.990567:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d60a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:25569:x1798653942502848:12345-0@lo:101:mdt00_005.0 Request processed in 96us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330300.990573:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3015 00000100:00100000:3.0:1715330300.990638:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d60a300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942502848:0@lo:101:mdt00_005.0 00010000:00010000:3.0:1715330300.990648:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48d440/0xd895711d66d9e33 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9e3a expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.990655:0:25569:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48d440/0xd895711d66d9e33 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9e3a expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330300.990669:0:25569:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00010000:00010000:3.0:1715330300.990683:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48db00/0xd895711d66d9e41 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.990688:0:25569:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48db00/0xd895711d66d9e41 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.990693:0:25569:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48db00/0xd895711d66d9e41 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 25569 initiator: MDT1 00000100:00100000:3.0:1715330300.990700:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d60a300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942502912:0@lo:101:mdt00_005.0 00000100:00100000:3.0:1715330300.990716:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.990793:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa900 going to sleep for 11 seconds 00000100:00100000:2.0:1715330300.990829:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942502912 00000100:00100000:2.0:1715330300.990832:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942502912 00000100:00100000:2.0:1715330300.991024:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3016 00000100:00100000:2.0:1715330300.991028:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d60aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:25569:x1798653942502912:12345-0@lo:101:mdt00_005.0 00010000:00010000:2.0:1715330300.991034:0:8592:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330300.991043:0:8592:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d9e48 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d9e41 expref: -99 pid: 8592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.991053:0:8592:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d9e48 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d9e41 expref: 14 pid: 8592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.991061:0:8592:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d9e48 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9e41 expref: 14 pid: 8592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.991066:0:8592:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x39 (ffff88008b091d00) 00010000:00010000:2.0:1715330300.991067:0:8592:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330300.991069:0:8592:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db64000, rc 0) 00000100:00100000:2.0:1715330300.991097:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d60aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942502912:12345-0@lo:101:mdt00_005.0 Request processed in 68us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330300.991101:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3016 00000100:00100000:3.0:1715330300.991167:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d60a300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942502912:0@lo:101:mdt00_005.0 00010000:00010000:3.0:1715330300.991174:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48db00/0xd895711d66d9e41 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9e48 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.991179:0:25569:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48db00/0xd895711d66d9e41 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9e48 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330300.991187:0:25569:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00000100:00100000:3.0:1715330300.991206:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d60a300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942502976:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1715330300.991222:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.991229:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa780 going to sleep for 11 seconds 00000100:00100000:1.0:1715330300.991259:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942502976 00000100:00100000:1.0:1715330300.991262:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942502976 00000100:00100000:1.0:1715330300.991273:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3017 00000100:00100000:1.0:1715330300.991276:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d60ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942502976:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1715330300.991327:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d60ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942502976:12345-0@lo:1000:mdt00_005.0 Request processed in 50us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330300.991332:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3017 00000100:00100000:3.0:1715330300.991493:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d60a300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942502976:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1715330300.991521:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d60a300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942503040:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1715330300.991537:0:25569:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.991558:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa780 going to sleep for 11 seconds 00000100:00100000:2.0:1715330300.991593:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942503040 00000100:00100000:2.0:1715330300.991596:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942503040 00000100:00100000:2.0:1715330300.991722:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3018 00000100:00100000:2.0:1715330300.991726:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d60b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942503040:12345-0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1715330300.991796:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d60b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:25569:x1798653942503040:12345-0@lo:1000:mdt00_005.0 Request processed in 69us (258us total) trans 0 rc -2/-2 00000100:00100000:2.0:1715330300.991801:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3018 00000100:00100000:3.0:1715330300.991840:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d60a300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:25569:1798653942503040:0@lo:1000:mdt00_005.0 00000004:00080000:3.0:1715330300.991851:0:25569:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00010000:00010000:3.0:1715330300.991863:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48d440/0xd895711d66d9e33 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9e3a expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.991870:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48d440/0xd895711d66d9e33 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9e3a expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.991875:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48d440/0xd895711d66d9e33 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9e3a expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.991885:0:25569:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1715330300.991888:0:25569:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00010000:00010000:3.0:1715330300.991891:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48db00/0xd895711d66d9e41 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9e48 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.991895:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48db00/0xd895711d66d9e41 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9e48 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.991900:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48db00/0xd895711d66d9e41 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9e48 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.991912:0:25569:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1715330300.992091:0:9414:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1715330300.992096:0:9414:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48d440/0xd895711d66d9e33 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d9e3a expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.992102:0:9414:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48d440 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:2.0:1715330300.992107:0:9414:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48d440/0xd895711d66d9e33 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d9e3a expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1715330300.992113:0:9414:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48d440/0xd895711d66d9e33 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d9e3a expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.992139:0:9414:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48d440/0xd895711d66d9e33 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9e3a expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.992142:0:7123:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1715330300.992144:0:9414:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715330300.992148:0:7123:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48db00/0xd895711d66d9e41 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d9e48 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.992155:0:7123:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48db00 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:1.0:1715330300.992158:0:7123:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48db00/0xd895711d66d9e41 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d9e48 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.992162:0:9414:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48d440/0xd895711d66d9e33 lrc: 1/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9e3a expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715330300.992164:0:7123:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48db00/0xd895711d66d9e41 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d9e48 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330300.992168:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48d440/0xd895711d66d9e33 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9e3a expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.992180:0:7123:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48db00/0xd895711d66d9e41 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9e48 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330300.992184:0:7123:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1715330300.992186:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330300.992187:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330300.992189:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330300.992310:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+20:17780:x1798653938070656:12345-192.168.204.49@tcp:36:rm.0 Request processed in 3625us (3877us total) trans 0 rc -2/-2 00010000:00010000:1.0:1715330300.992313:0:7123:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48db00/0xd895711d66d9e41 lrc: 1/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9e48 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330300.992315:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23590 00010000:00010000:1.0:1715330300.992319:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48db00/0xd895711d66d9e41 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9e48 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330300.992330:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1715330300.992336:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330300.992337:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f578000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942503104:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330300.992338:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330300.992339:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330300.992361:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.992383:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942503104 00000100:00100000:3.0:1715330300.992385:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942503104 00000100:00100000:3.0:1715330300.992403:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1412 00000100:00100000:3.0:1715330300.992407:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d60a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+14:3690:x1798653942503104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1715330300.992414:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330300.992424:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66d9e3a lrc: 0/0,0 mode: --/CW res: [0x200000400:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d9e33 expref: 14 pid: 19960 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.992434:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff88009d5e7a00) 00010000:00010000:3.0:1715330300.992439:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715330300.992457:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d60a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+13:3690:x1798653942503104:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.992462:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1412 00000100:00100000:3.0:1715330300.992480:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f578000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942503104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1715330300.992597:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1715330300.992604:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942503168:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1715330300.992627:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330300.993277:0:10673:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942503168 00000100:00100000:3.0:1715330300.993294:0:10673:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942503168 00000100:00100000:3.0:1715330300.993550:0:10673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1413 00000100:00100000:3.0:1715330300.993555:0:10673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ab788c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+13:3689:x1798653942503168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1715330300.993562:0:10673:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330300.993572:0:10673:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d9e48 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xcd:0x0].0x39 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d9e41 expref: 13 pid: 8592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330300.993581:0:10673:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x39 (ffff88008b091d00) 00010000:00010000:3.0:1715330300.993586:0:10673:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715330300.993706:0:10673:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ab788c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+12:3689:x1798653942503168:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330300.993714:0:10673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1413 00000100:00100000:2.0:1715330300.993834:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942503168:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330300.995395:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330300.995451:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938070784 00000100:00100000:3.0:1715330300.995457:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938070784 00000100:00100000:3.0:1715330300.995487:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23591 00000100:00100000:3.0:1715330300.995491:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+20:17780:x1798653938070784:12345-192.168.204.49@tcp:36:rm.0 00010000:00010000:3.0:1715330300.995551:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d8c0/0xd895711d66d9e4f lrc: 3/0,1 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.995563:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d8c0/0xd895711d66d9e4f lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.995572:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d8c0/0xd895711d66d9e4f lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.995582:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e400/0xd895711d66d9e56 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xca:0x0].0x39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.995587:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e400/0xd895711d66d9e56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.995591:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e400/0xd895711d66d9e56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.995632:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48f600/0xd895711d66d9e5d lrc: 3/0,1 mode: --/EX res: [0x240000402:0x194:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.995637:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48f600/0xd895711d66d9e5d lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x194:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.995641:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48f600/0xd895711d66d9e5d lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x194:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00000040:00080000:3.0:1715330300.995863:0:25569:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8640 00010000:00010000:3.0:1715330300.995901:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c900/0xd895711d66d9e64 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x194:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330300.995907:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c900/0xd895711d66d9e64 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x194:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.995913:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c900/0xd895711d66d9e64 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x194:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.995919:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c900/0xd895711d66d9e64 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x194:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.995924:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c900/0xd895711d66d9e64 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x194:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.995928:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c900/0xd895711d66d9e64 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x194:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.995932:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c900/0xd895711d66d9e64 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x194:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.995938:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48c900 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330300.995941:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c900/0xd895711d66d9e64 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x194:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.995946:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c900/0xd895711d66d9e64 lrc: 5/0,0 mode: PW/PW res: [0x240000402:0x194:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.995953:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x194:0x0].0x0 (ffff88009b985a00) 00010000:00010000:3.0:1715330300.995956:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330300.995958:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c900/0xd895711d66d9e64 lrc: 3/0,0 mode: --/PW res: [0x240000402:0x194:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.995963:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c900/0xd895711d66d9e64 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x194:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.995986:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48f600/0xd895711d66d9e5d lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x194:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.995991:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48f600/0xd895711d66d9e5d lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x194:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.995995:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48f600/0xd895711d66d9e5d lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x194:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.995999:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48f600 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330300.996001:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48f600/0xd895711d66d9e5d lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x194:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.996005:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48f600/0xd895711d66d9e5d lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x194:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.996010:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x194:0x0].0x0 (ffff88009b985a00) 00010000:00010000:3.0:1715330300.996012:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330300.996014:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48f600/0xd895711d66d9e5d lrc: 2/0,0 mode: --/EX res: [0x240000402:0x194:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.996018:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48f600/0xd895711d66d9e5d lrc: 0/0,0 mode: --/EX res: [0x240000402:0x194:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.996092:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d8c0/0xd895711d66d9e4f lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.996097:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d8c0/0xd895711d66d9e4f lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.996101:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d8c0/0xd895711d66d9e4f lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.996105:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d8c0/0xd895711d66d9e4f lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.996110:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48d8c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330300.996112:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d8c0/0xd895711d66d9e4f lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.996116:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d8c0/0xd895711d66d9e4f lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.996122:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff88009b985e00) 00010000:00010000:3.0:1715330300.996124:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330300.996126:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d8c0/0xd895711d66d9e4f lrc: 3/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.996130:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48d8c0/0xd895711d66d9e4f lrc: 0/0,0 mode: --/CW res: [0x240000400:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00000004:00010000:3.0:1715330300.996140:0:25569:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009b5ec700 reply state ffff88009d664000 transno 4294968491 ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e400/0xd895711d66d9e56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xca:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.996147:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e400/0xd895711d66d9e56 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:3.0:1715330300.996152:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x39 (ffff88009b985000) 00010000:00010000:3.0:1715330300.996154:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330300.996156:0:25569:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330300.996199:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+22:17780:x1798653938070784:12345-192.168.204.49@tcp:36:rm.0 Request processed in 705us (807us total) trans 4294968491 rc 0/0 00000100:00100000:3.0:1715330300.996204:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23591 00000100:00100000:0.0:1715330301.004030:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330301.004066:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330301.004155:0:10673:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938070848 00000100:00100000:3.0:1715330301.004162:0:10673:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938070848 00000100:00100000:3.0:1715330301.004215:0:10673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1414 00000100:00100000:3.0:1715330301.004221:0:10673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:72de1896-1df4-4b3a-930a-9116d2c66168+11:2012:x1798653938070848:12345-192.168.204.49@tcp:103:rm.0 00010000:00010000:3.0:1715330301.004233:0:10673:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330301.004251:0:10673:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457c480/0xd895711d66d9821 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba3d expref: 11 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330301.004265:0:10673:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x193:0x0].0x0 (ffff880091ea7f00) 00000100:00080000:1.0:1715330301.004268:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330271 00010000:00010000:3.0:1715330301.004272:0:10673:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715330301.004960:0:10673:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:72de1896-1df4-4b3a-930a-9116d2c66168+10:2012:x1798653938070848:12345-192.168.204.49@tcp:103:rm.0 Request processed in 737us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330301.004966:0:10673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1414 00000100:00100000:2.0:1715330301.005575:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938070976 00000100:00100000:2.0:1715330301.005581:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938070976 00000100:00080000:1.0:1715330301.005641:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330271 00000100:00100000:2.0:1715330301.005972:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5106 00000100:00100000:2.0:1715330301.005978:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+22:17780:x1798653938070976:12345-192.168.204.49@tcp:35:rm.0 00000100:00100000:2.0:1715330301.006682:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+23:17780:x1798653938070976:12345-192.168.204.49@tcp:35:rm.0 Request processed in 703us (2613us total) trans 4294968492 rc 0/0 00000100:00100000:2.0:1715330301.006689:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5106 00000100:00100000:0.0:1715330301.009847:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330301.010053:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938071104 00000100:00100000:2.0:1715330301.010061:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938071104 00000100:00100000:2.0:1715330301.010096:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23592 00000100:00100000:2.0:1715330301.010103:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+23:17780:x1798653938071104:12345-192.168.204.49@tcp:36:rm.0 00010000:00010000:2.0:1715330301.010147:0:7135:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1715330301.010169:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48f840/0xd895711d66d9b3f lrc: 0/0,0 mode: --/CR res: [0x240000402:0x193:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbaad expref: 23 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330301.010187:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457e880/0xd895711d66d9b15 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x193:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba98 expref: 22 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330301.010195:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x193:0x0].0x0 (ffff88009bbb0d00) 00010000:00010000:2.0:1715330301.010204:0:7135:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330301.010238:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64900/0xd895711d66d9e6b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330301.010245:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64900/0xd895711d66d9e6b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330301.010253:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64900/0xd895711d66d9e6b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT1 00000100:00100000:2.0:1715330301.010270:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f57a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942503232:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1715330301.010323:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330301.010339:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091cb53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330301.010423:0:7139:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942503232 00000100:00100000:1.0:1715330301.010427:0:7139:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942503232 00000100:00100000:1.0:1715330301.010460:0:7139:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3019 00000100:00100000:1.0:1715330301.010465:0:7139:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f578700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:7135:x1798653942503232:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330301.010474:0:7139:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330301.010485:0:7139:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd8c0/0xd895711d66d9e72 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d9e6b expref: -99 pid: 7139 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330301.010502:0:7139:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1680/0xd895711d66d9805 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba36 expref: 9 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330301.010509:0:7139:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd8c0/0xd895711d66d9e72 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d9e6b expref: 13 pid: 7139 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330301.010527:0:7139:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1680/0xd895711d66d9805 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba36 expref: 9 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330301.010537:0:7139:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1680/0xd895711d66d9805 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba36 expref: 9 pid: 25569 timeout: 375 lvb_type: 0 00000100:00100000:1.0:1715330301.010545:0:7139:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c1500 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:7139:1798653942503296:192.168.204.49@tcp:104: 00000100:00100000:1.0:1715330301.010579:0:7139:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330301.014692:0:7139:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c1500 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:7139:1798653942503296:192.168.204.49@tcp:104: 00010000:00010000:1.0:1715330301.014719:0:7139:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd8c0/0xd895711d66d9e72 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9e6b expref: 13 pid: 7139 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330301.014747:0:7139:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:1.0:1715330301.014750:0:7139:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330301.014752:0:7139:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd8c0/0xd895711d66d9e72 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9e6b expref: 13 pid: 7139 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330301.014759:0:7139:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfd8c0, rc 0) 00000100:00100000:1.0:1715330301.014803:0:7139:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f578700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:7135:x1798653942503232:12345-0@lo:101:mdt00_002.0 Request processed in 4337us (4479us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330301.014811:0:7139:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3019 00000100:00100000:2.0:1715330301.014917:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f57a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942503232:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1715330301.014932:0:7135:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64900/0xd895711d66d9e6b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9e72 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330301.014940:0:7135:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64900/0xd895711d66d9e6b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9e72 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330301.015094:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330301.015907:0:10673:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938071168 00000100:00100000:3.0:1715330301.015913:0:10673:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938071168 00010000:00010000:3.0:1715330301.015931:0:10673:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1680/0xd895711d66d9805 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba36 expref: 10 pid: 25569 timeout: 375 lvb_type: 0 00000100:00100000:3.0:1715330301.016046:0:10673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1576 00000100:00100000:3.0:1715330301.016051:0:10673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093980a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:72de1896-1df4-4b3a-930a-9116d2c66168+10:2012:x1798653938071168:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1715330301.016062:0:10673:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330301.016066:0:10673:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1680/0xd895711d66d9805 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba36 expref: 10 pid: 25569 timeout: 375 lvb_type: 0 00010000:00010000:3.0:1715330301.016075:0:10673:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1680/0xd895711d66d9805 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba36 expref: 10 pid: 25569 timeout: 375 lvb_type: 0 00010000:00010000:3.0:1715330301.016090:0:10673:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1680/0xd895711d66d9805 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfba36 expref: 10 pid: 25569 timeout: 375 lvb_type: 0 00010000:00010000:3.0:1715330301.016263:0:10673:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:3.0:1715330301.016269:0:10673:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd8c0/0xd895711d66d9e72 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9e6b expref: 12 pid: 7139 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330301.016284:0:10673:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd8c0/0xd895711d66d9e72 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d9e6b expref: 12 pid: 7139 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330301.016291:0:10673:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd8c0/0xd895711d66d9e72 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd895711d66d9e6b expref: 12 pid: 7139 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330301.016319:0:10673:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd8c0/0xd895711d66d9e72 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9e6b expref: 12 pid: 7139 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330301.016329:0:10673:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d609500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:10673:1798653942503360:0@lo:105: 00000100:00100000:3.0:1715330301.016358:0:10673:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330301.016382:0:10673:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffab40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330301.016422:0:9413:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942503360 00000100:00100000:1.0:1715330301.016425:0:9413:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942503360 00000100:00100000:1.0:1715330301.016458:0:9413:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1192 00000100:00100000:1.0:1715330301.016461:0:9413:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d609180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:10673:x1798653942503360:12345-0@lo:105: 00010000:00010000:1.0:1715330301.016469:0:9413:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64900/0xd895711d66d9e6b lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9e72 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330301.016476:0:9413:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64900/0xd895711d66d9e6b lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9e72 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330301.016482:0:9413:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64900/0xd895711d66d9e6b lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9e72 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330301.016487:0:9413:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64900/0xd895711d66d9e6b lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d9e72 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330301.016497:0:9413:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64900/0xd895711d66d9e6b lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd895711d66d9e72 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330301.016503:0:9413:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64900/0xd895711d66d9e6b lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd895711d66d9e72 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330301.016515:0:9413:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88011db64900) 00000100:00100000:1.0:1715330301.016539:0:9413:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d609180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:10673:x1798653942503360:12345-0@lo:105: Request processed in 77us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330301.016544:0:9413:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1192 00000100:00080000:2.0:1715330301.016593:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000-osp-MDT0001 older than 1715330271 00000100:00100000:3.0:1715330301.016669:0:10673:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d609500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:10673:1798653942503360:0@lo:105: 00010000:00010000:3.0:1715330301.016680:0:10673:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715330301.017444:0:10673:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093980a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:72de1896-1df4-4b3a-930a-9116d2c66168+9:2012:x1798653938071168:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 1389us (2348us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330301.017451:0:10673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1576 00010000:00010000:3.0:1715330301.017473:0:7135:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64900/0xd895711d66d9e6b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9e72 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330301.017480:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64900/0xd895711d66d9e6b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9e72 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330301.017497:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1715330301.017520:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48e1c0/0xd895711d66d9e79 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330301.017529:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48e1c0/0xd895711d66d9e79 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330301.017537:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48e1c0/0xd895711d66d9e79 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT1 00000100:00100000:3.0:1715330301.017548:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d609500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942503424:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1715330301.017572:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330301.017595:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffab40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330301.017642:0:7139:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942503424 00000100:00100000:1.0:1715330301.017646:0:7139:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942503424 00000100:00100000:1.0:1715330301.017674:0:7139:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3020 00000100:00100000:1.0:1715330301.017678:0:7139:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d60a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:7135:x1798653942503424:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330301.017692:0:7139:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330301.017705:0:7139:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66d9e80 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d9e79 expref: -99 pid: 7139 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330301.017720:0:7139:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66d9e80 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d9e79 expref: 14 pid: 7139 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330301.017743:0:7139:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66d9e80 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9e79 expref: 14 pid: 7139 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330301.017750:0:7139:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6088621d (ffff88009d5e7b00) 00010000:00010000:1.0:1715330301.017752:0:7139:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330301.017754:0:7139:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bff180, rc 0) 00000100:00100000:1.0:1715330301.017777:0:7139:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d60a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:7135:x1798653942503424:12345-0@lo:101:mdt00_002.0 Request processed in 97us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330301.017781:0:7139:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3020 00000100:00100000:3.0:1715330301.017972:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d609500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942503424:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1715330301.017981:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48e1c0/0xd895711d66d9e79 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9e80 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330301.017987:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48e1c0/0xd895711d66d9e79 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9e80 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330301.017996:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1715330301.018020:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d609500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942503488:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1715330301.018040:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330301.018061:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa900 going to sleep for 11 seconds 00000100:00100000:2.0:1715330301.018104:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942503488 00000100:00100000:2.0:1715330301.018108:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942503488 00000100:00100000:2.0:1715330301.018124:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3021 00000100:00100000:2.0:1715330301.018346:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d60b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:7135:x1798653942503488:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1715330301.018645:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d60b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:7135:x1798653942503488:12345-0@lo:1000:mdt00_002.0 Request processed in 515us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330301.018651:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3021 00000100:00100000:3.0:1715330301.018703:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d609500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942503488:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1715330301.018756:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d609500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942503552:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1715330301.018773:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330301.018787:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa900 going to sleep for 11 seconds 00000100:00100000:2.0:1715330301.019002:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942503552 00000100:00100000:2.0:1715330301.019005:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942503552 00000100:00100000:2.0:1715330301.019029:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3022 00000100:00100000:2.0:1715330301.019033:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d60b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:7135:x1798653942503552:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1715330301.019103:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d60b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:7135:x1798653942503552:12345-0@lo:1000:mdt00_002.0 Request processed in 69us (329us total) trans 0 rc 1/1 00000100:00100000:2.0:1715330301.019108:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3022 00000100:00100000:3.0:1715330301.019453:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d609500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942503552:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1715330301.019486:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48fcc0/0xd895711d66d9e87 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x193:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330301.019493:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48fcc0/0xd895711d66d9e87 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330301.019499:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48fcc0/0xd895711d66d9e87 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT1 00000100:00100000:3.0:1715330301.019508:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d609500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942503616:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1715330301.019526:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330301.019535:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffab40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330301.019806:0:7139:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942503616 00000100:00100000:1.0:1715330301.019810:0:7139:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942503616 00000100:00100000:1.0:1715330301.019826:0:7139:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3023 00000100:00100000:1.0:1715330301.019830:0:7139:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d60bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:7135:x1798653942503616:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715330301.019837:0:7139:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330301.019849:0:7139:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d9e8e lrc: 2/0,0 mode: --/EX res: [0x240000402:0x193:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d9e87 expref: -99 pid: 7139 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330301.019864:0:7139:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d9e8e lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d9e87 expref: 15 pid: 7139 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330301.019873:0:7139:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d9e8e lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9e87 expref: 15 pid: 7139 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330301.019878:0:7139:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x193:0x0].0x0 (ffff88009d5e7900) 00010000:00010000:1.0:1715330301.019881:0:7139:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1715330301.019883:0:7139:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfdb00, rc 0) 00000100:00100000:1.0:1715330301.019905:0:7139:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d60bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:7135:x1798653942503616:12345-0@lo:101:mdt00_002.0 Request processed in 74us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330301.019909:0:7139:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3023 00000100:00100000:3.0:1715330301.020002:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d609500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942503616:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1715330301.020012:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48fcc0/0xd895711d66d9e87 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9e8e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330301.020019:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48fcc0/0xd895711d66d9e87 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9e8e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330301.020035:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48ef40/0xd895711d66d9e95 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x193:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330301.020041:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48ef40/0xd895711d66d9e95 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330301.020047:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48ef40/0xd895711d66d9e95 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330301.020060:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48cb40/0xd895711d66d9e9c lrc: 3/0,1 mode: --/EX res: [0x240000400:0xca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330301.020064:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48cb40/0xd895711d66d9e9c lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330301.020069:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48cb40/0xd895711d66d9e9c lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330301.020083:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48ed00/0xd895711d66d9ea3 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330301.020088:0:7135:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48ed00/0xd895711d66d9ea3 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330301.020093:0:7135:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48ed00/0xd895711d66d9ea3 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7135 initiator: MDT1 00000100:00100000:3.0:1715330301.020101:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d609500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942503680:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1715330301.020119:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330301.020307:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffab40 going to sleep for 11 seconds 00000100:00100000:0.0:1715330301.020352:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942503680 00000100:00100000:0.0:1715330301.020355:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942503680 00000100:00100000:0.0:1715330301.020380:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3024 00000100:00100000:0.0:1715330301.020384:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+15:7135:x1798653942503680:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1715330301.020391:0:8592:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330301.020401:0:8592:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0fc0/0xd895711d66d9eaa lrc: 2/0,0 mode: --/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd895711d66d9ea3 expref: -99 pid: 8592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330301.020414:0:8592:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0fc0/0xd895711d66d9eaa lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd895711d66d9ea3 expref: 16 pid: 8592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330301.020421:0:8592:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0fc0/0xd895711d66d9eaa lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd895711d66d9ea3 expref: 16 pid: 8592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330301.020426:0:8592:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff88008b233c00) 00010000:00010000:0.0:1715330301.020428:0:8592:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715330301.020430:0:8592:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a0fc0, rc 0) 00000100:00100000:0.0:1715330301.020463:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+16:7135:x1798653942503680:12345-0@lo:101:mdt00_002.0 Request processed in 77us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330301.020468:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3024 00000100:00100000:3.0:1715330301.020548:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d609500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942503680:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1715330301.020556:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48ed00/0xd895711d66d9ea3 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9eaa expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330301.020562:0:7135:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48ed00/0xd895711d66d9ea3 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9eaa expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330301.021119:0:7135:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d609500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942503744:0@lo:403:mdt00_002.0 00000100:00100000:3.0:1715330301.021146:0:7135:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330301.021155:0:7135:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffab40 going to sleep for 11 seconds 00000100:00100000:1.0:1715330301.021330:0:7139:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942503744 00000100:00100000:1.0:1715330301.021333:0:7139:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942503744 00000100:00100000:1.0:1715330301.021350:0:7139:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3025 00000100:00100000:1.0:1715330301.021354:0:7139:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+16:7135:x1798653942503744:12345-0@lo:403:mdt00_002.0 00000100:00100000:1.0:1715330301.023829:0:7139:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+16:7135:x1798653942503744:12345-0@lo:403:mdt00_002.0 Request processed in 2467us (2676us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330301.023841:0:7139:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3025 00000100:00100000:3.0:1715330301.024025:0:7135:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d609500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7135:1798653942503744:0@lo:403:mdt00_002.0 00000040:00080000:3.0:1715330301.025004:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].392, 960 off590784 00000040:00080000:3.0:1715330301.025121:0:7135:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].393, 1040 off645752 00000004:00080000:3.0:1715330301.025125:0:7135:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff880091ffab40 with version 752 00000004:00080000:1.0:1715330301.025507:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 752 rpc_version 752 00000020:00100000:1.0:1715330301.025531:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1715330301.025537:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008b0c1500 x1798653942503872/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2368/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1715330301.025555:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c1500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942503872:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1715330301.025593:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330301.026302:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f49f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715330301.026359:0:7139:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942503872 00000100:00100000:2.0:1715330301.026365:0:7139:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942503872 00000100:00100000:2.0:1715330301.026946:0:7139:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3026 00000100:00100000:2.0:1715330301.026952:0:7139:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+16:8278:x1798653942503872:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1715330301.027304:0:7139:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+17:8278:x1798653942503872:12345-0@lo:1000:osp_up0-1.0 Request processed in 351us (1709us total) trans 4294983562 rc 0/0 00000100:00100000:2.0:1715330301.027310:0:7139:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3026 00000100:00100000:1.0:1715330301.027453:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c1500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942503872:0@lo:1000:osp_up0-1.0 00000004:00200000:3.0:1715330301.027496:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000402:0x193:0x0]: returning size 4096 00010000:00010000:3.0:1715330301.027515:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48cb40/0xd895711d66d9e9c lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330301.027523:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48cb40/0xd895711d66d9e9c lrc: 2/0,0 mode: EX/EX res: [0x240000400:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330301.027530:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48cb40/0xd895711d66d9e9c lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330301.027534:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48cb40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330301.027537:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48cb40/0xd895711d66d9e9c lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330301.027542:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48cb40/0xd895711d66d9e9c lrc: 4/0,0 mode: EX/EX res: [0x240000400:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330301.027554:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x0 (ffff88009b985e00) 00010000:00010000:3.0:1715330301.027556:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330301.027558:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48cb40/0xd895711d66d9e9c lrc: 2/0,0 mode: --/EX res: [0x240000400:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330301.027562:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48cb40/0xd895711d66d9e9c lrc: 0/0,0 mode: --/EX res: [0x240000400:0xca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330301.027576:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48ed00/0xd895711d66d9ea3 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9eaa expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330301.027581:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48ed00/0xd895711d66d9ea3 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9eaa expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330301.027586:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48ed00/0xd895711d66d9ea3 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9eaa expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330301.027600:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1715330301.027609:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000400:0xcd:0x0] 00010000:00010000:3.0:1715330301.027616:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48ef40/0xd895711d66d9e95 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330301.027620:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48ef40/0xd895711d66d9e95 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330301.027624:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48ef40/0xd895711d66d9e95 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330301.027627:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48ef40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330301.027629:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48ef40/0xd895711d66d9e95 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330301.027633:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48ef40/0xd895711d66d9e95 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330301.027637:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x193:0x0].0x0 (ffff88009b985500) 00010000:00010000:3.0:1715330301.027639:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330301.027641:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48ef40/0xd895711d66d9e95 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x193:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330301.027644:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48ef40/0xd895711d66d9e95 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x193:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:3.0:1715330301.027652:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48fcc0/0xd895711d66d9e87 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9e8e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330301.027657:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48fcc0/0xd895711d66d9e87 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9e8e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330301.027661:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48fcc0/0xd895711d66d9e87 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9e8e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330301.027669:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:3.0:1715330301.027813:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1715330301.027817:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64900/0xd895711d66d9e6b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd895711d66d9e72 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330301.027822:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64900/0xd895711d66d9e6b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9e72 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330301.027827:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64900/0xd895711d66d9e6b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd895711d66d9e72 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330301.027836:0:7135:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000004:00080000:3.0:1715330301.027838:0:7135:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1715330301.027842:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48e1c0/0xd895711d66d9e79 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9e80 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330301.027847:0:7135:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48e1c0/0xd895711d66d9e79 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd895711d66d9e80 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330301.027894:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+22:17780:x1798653938071104:12345-192.168.204.49@tcp:36:rm.0 Request processed in 17788us (18052us total) trans 4294968493 rc 0/0 00000100:00100000:3.0:1715330301.027900:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23592 00010000:00010000:0.0:1715330301.027957:0:7124:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1715330301.027963:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48ed00/0xd895711d66d9ea3 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d9eaa expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330301.027968:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48ed00 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330301.027971:0:7124:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48ed00/0xd895711d66d9ea3 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d9eaa expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330301.027977:0:7124:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48ed00/0xd895711d66d9ea3 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d9eaa expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330301.027999:0:7124:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48ed00/0xd895711d66d9ea3 lrc: 2/0,0 mode: --/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9eaa expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330301.028003:0:7124:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330301.028028:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48ed00/0xd895711d66d9ea3 lrc: 1/0,0 mode: --/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9eaa expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330301.028033:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48ed00/0xd895711d66d9ea3 lrc: 0/0,0 mode: --/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9eaa expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330301.028047:0:7124:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1715330301.028049:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48fcc0/0xd895711d66d9e87 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d9e8e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330301.028054:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48fcc0 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330301.028057:0:7124:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48fcc0/0xd895711d66d9e87 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d9e8e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330301.028062:0:7124:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48fcc0/0xd895711d66d9e87 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d9e8e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330301.028074:0:7124:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48fcc0/0xd895711d66d9e87 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9e8e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330301.028078:0:7124:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330301.028088:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48fcc0/0xd895711d66d9e87 lrc: 1/0,0 mode: --/EX res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9e8e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330301.028093:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48fcc0/0xd895711d66d9e87 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9e8e expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330301.028102:0:7124:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715330301.028104:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64900/0xd895711d66d9e6b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd895711d66d9e72 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330301.028108:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64900 already unused, calling callback (ffffffffa0ee9520) 00010000:00010000:0.0:1715330301.028110:0:7124:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64900/0xd895711d66d9e6b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d9e72 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330301.028115:0:7124:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64900/0xd895711d66d9e6b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d9e72 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330301.028126:0:7124:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64900/0xd895711d66d9e6b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9e72 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330301.028130:0:7124:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330301.028134:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64900/0xd895711d66d9e6b lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9e72 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330301.028143:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88011db64900/0xd895711d66d9e6b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9e72 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330301.028150:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330301.028151:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330301.028153:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330301.028159:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1715330301.028169:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093980e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942503936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715330301.028198:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330301.028337:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942504064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330301.028358:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330301.028371:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1715330301.028375:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093981880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942504000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330301.028388:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1715330301.028401:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330301.028439:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330301.028449:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942503936 00000100:00100000:2.0:1715330301.028455:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942503936 00000100:00100000:2.0:1715330301.028476:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942504064 00000100:00100000:2.0:1715330301.028478:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942504064 00000100:00100000:2.0:1715330301.028488:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942504000 00000100:00100000:2.0:1715330301.028489:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942504000 00000100:00100000:2.0:1715330301.028501:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1415 00000100:00100000:2.0:1715330301.028505:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093981f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+19:3688:x1798653942503936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715330301.028514:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330301.028527:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0fc0/0xd895711d66d9eaa lrc: 0/0,0 mode: --/EX res: [0x200000400:0xcd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d9ea3 expref: 19 pid: 8592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330301.028537:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcd:0x0].0x0 (ffff88008b233c00) 00010000:00010000:2.0:1715330301.028543:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330301.028564:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093981f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+18:3688:x1798653942503936:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330301.028569:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1415 00000100:00100000:2.0:1715330301.028578:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1416 00000100:00100000:2.0:1715330301.028581:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+17:3691:x1798653942504064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715330301.028586:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330301.028595:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd8c0/0xd895711d66d9e72 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d9e6b expref: 17 pid: 7139 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330301.028603:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:2.0:1715330301.028605:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330301.028620:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+16:3691:x1798653942504064:12345-0@lo:103:ldlm_bl.0 Request processed in 38us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330301.028624:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1416 00000100:00100000:2.0:1715330301.028632:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1417 00000100:00100000:2.0:1715330301.028635:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+15:3691:x1798653942504000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715330301.028639:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330301.028646:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66d9e8e lrc: 0/0,0 mode: --/EX res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d9e87 expref: 15 pid: 7139 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330301.028656:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x193:0x0].0x0 (ffff88009d5e7900) 00010000:00010000:2.0:1715330301.028660:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715330301.028671:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+14:3691:x1798653942504000:12345-0@lo:103:ldlm_bl.0 Request processed in 35us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330301.028675:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1417 00000100:00100000:1.0:1715330301.028764:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093980e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942503936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330301.028781:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093981880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942504000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715330301.028787:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942504064:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1715330301.176956:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330301.555130:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3688:1798653942504128:0@lo:400:kworker.0 00000100:00100000:0.0:1715330301.555132:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d609880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3691:1798653942504320:0@lo:400:kworker.0 00000100:00100000:3.0:1715330301.555165:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d608a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3689:1798653942504192:0@lo:400:kworker.0 00000100:00100000:1.0:1715330301.555363:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330301.555364:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330301.555380:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942504256:0@lo:400:kworker.0 00000100:00100000:0.0:1715330301.555389:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942504576:0@lo:400:kworker.0 00000100:00100000:3.0:1715330301.555402:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330301.555413:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330301.555422:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3690:1798653942504512:0@lo:400:kworker.0 00000100:00100000:3.0:1715330301.555435:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330301.555437:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091e99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942504832:0@lo:400:kworker.0 00000100:00100000:3.0:1715330301.555445:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3690:1798653942504768:0@lo:400:kworker.0 00000100:00100000:0.0:1715330301.555455:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330301.555458:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330301.555458:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942504384:0@lo:400:kworker.0 00000100:00100000:1.0:1715330301.555483:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330301.555487:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942504320 00000100:00100000:3.0:1715330301.555492:0:17206:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942504576 00000100:00100000:0.0:1715330301.555493:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942504320 00000100:00100000:3.0:1715330301.555498:0:17206:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942504576 00000100:00100000:1.0:1715330301.555509:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942504640:0@lo:400:kworker.0 00000100:00100000:2.0:1715330301.555511:0:7139:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942504256 00000100:00100000:2.0:1715330301.555516:0:7139:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942504256 00000100:00100000:3.0:1715330301.555527:0:17206:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942504832 00000100:00100000:1.0:1715330301.555527:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330301.555527:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942504512 00000100:00100000:3.0:1715330301.555529:0:17206:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942504832 00000100:00100000:0.0:1715330301.555530:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942504512 00000100:00100000:1.0:1715330301.555539:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091e9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942504896:0@lo:400:kworker.0 00000100:00100000:3.0:1715330301.555543:0:17206:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942504640 00000100:00100000:3.0:1715330301.555546:0:17206:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942504640 00000100:00100000:0.0:1715330301.555547:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942504768 00000100:00100000:0.0:1715330301.555550:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942504768 00000100:00100000:1.0:1715330301.555555:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330301.555561:0:17206:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942504896 00000100:00100000:0.0:1715330301.555562:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1715330301.555563:0:17206:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942504896 00000100:00100000:0.0:1715330301.555569:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093982300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3691:x1798653942504320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330301.555576:0:17206:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1715330301.555582:0:17206:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093982680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+6:3691:x1798653942504576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330301.555614:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093982300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3691:x1798653942504320:12345-0@lo:400:kworker.0 Request processed in 44us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330301.555620:0:17206:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093982680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+6:3691:x1798653942504576:12345-0@lo:400:kworker.0 Request processed in 37us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330301.555621:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1715330301.555625:0:17206:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1715330301.555636:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1715330301.555640:0:17206:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1715330301.555640:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3690:x1798653942504512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330301.555642:0:7129:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942504128 00000100:00100000:1.0:1715330301.555645:0:7129:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942504128 00000100:00100000:3.0:1715330301.555649:0:17206:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+6:3691:x1798653942504832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330301.555668:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3690:x1798653942504512:12345-0@lo:400:kworker.0 Request processed in 27us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330301.555670:0:7139:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942504384 00000100:00100000:0.0:1715330301.555672:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1715330301.555673:0:7139:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942504384 00000100:00100000:3.0:1715330301.555675:0:17206:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+6:3691:x1798653942504832:12345-0@lo:400:kworker.0 Request processed in 25us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330301.555678:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1715330301.555680:0:17206:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1715330301.555682:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3690:x1798653942504768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330301.555688:0:7139:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3027 00000100:00100000:3.0:1715330301.555689:0:17206:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1715330301.555693:0:17206:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+11:3688:x1798653942504640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330301.555693:0:7139:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:3690:x1798653942504256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330301.555701:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3690:x1798653942504768:12345-0@lo:400:kworker.0 Request processed in 18us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330301.555706:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1715330301.555717:0:17206:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+11:3688:x1798653942504640:12345-0@lo:400:kworker.0 Request processed in 23us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330301.555722:0:17206:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1715330301.555724:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3028 00000100:00100000:0.0:1715330301.555728:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942504384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330301.555745:0:7139:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:3690:x1798653942504256:12345-0@lo:400:kworker.0 Request processed in 37us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330301.555752:0:7139:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3027 00000100:00080000:2.0:1715330301.555767:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330271 00000100:00080000:2.0:1715330301.555770:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330271 00000100:00100000:0.0:1715330301.555788:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942504384:12345-0@lo:400:kworker.0 Request processed in 59us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330301.555794:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3028 00000100:00100000:1.0:1715330301.555822:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1715330301.555827:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3688:x1798653942504128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330301.555851:0:7129:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3688:x1798653942504128:12345-0@lo:400:kworker.0 Request processed in 24us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330301.555856:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1715330301.556359:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1715330301.556365:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3688:x1798653942504896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330301.556388:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330301.556393:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942504640:0@lo:400:kworker.0 00000100:00100000:2.0:1715330301.556394:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942504256:0@lo:400:kworker.0 00000100:00100000:0.0:1715330301.556395:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3688:x1798653942504896:12345-0@lo:400:kworker.0 Request processed in 31us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330301.556400:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1715330301.556401:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091e9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942504896:0@lo:400:kworker.0 00000100:00100000:3.0:1715330301.556404:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3689:1798653942504448:0@lo:400:kworker.0 00000100:00100000:2.0:1715330301.556405:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3690:1798653942504512:0@lo:400:kworker.0 00000100:00100000:1.0:1715330301.556406:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3688:1798653942504128:0@lo:400:kworker.0 00000100:00100000:1.0:1715330301.556411:0:3688:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968469 gen 2 00000100:00100000:2.0:1715330301.556414:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3690:1798653942504768:0@lo:400:kworker.0 00000004:00080000:1.0:1715330301.556415:0:3688:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968464 committed transno 4294968469 00000100:00100000:0.0:1715330301.556418:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942504192 00000020:00080000:1.0:1715330301.556420:0:3688:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88012f47ef00 refcount 2 committed 0 result 0 batchid 394 00000100:00100000:0.0:1715330301.556421:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942504192 00000020:00080000:1.0:1715330301.556422:0:3688:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800b4207b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88012f47ee40 00000100:00100000:3.0:1715330301.556424:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1715330301.556424:0:3688:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800b4207a00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88012f47e600 00000020:00080000:1.0:1715330301.556426:0:3688:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].378 00000020:00080000:1.0:1715330301.556427:0:3688:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800b4207400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88012de77c00 00000020:00080000:1.0:1715330301.556428:0:3688:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].379 00000100:00100000:0.0:1715330301.556433:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942504448 00000100:00100000:0.0:1715330301.556435:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942504448 00000100:00100000:3.0:1715330301.556436:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3689:1798653942504704:0@lo:400:kworker.0 00000100:00100000:0.0:1715330301.556446:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000004:00080000:1.0:1715330301.556447:0:3688:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968465 committed transno 4294968469 00000100:00100000:0.0:1715330301.556449:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1798653942504192:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1715330301.556450:0:3688:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff880091ffac00 refcount 2 committed 0 result 0 batchid 395 00000020:00080000:1.0:1715330301.556452:0:3688:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880093a11800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff880091ffacc0 00000020:00080000:1.0:1715330301.556454:0:3688:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880093a11d00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88011db63780 00000020:00080000:1.0:1715330301.556456:0:3688:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].379 00000020:00080000:1.0:1715330301.556457:0:3688:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880093a11f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88008d45f600 00000020:00080000:1.0:1715330301.556458:0:3688:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].380 00000100:00100000:3.0:1715330301.556459:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1715330301.556471:0:3688:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968466 committed transno 4294968469 00000100:00100000:0.0:1715330301.556473:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1798653942504192:12345-0@lo:400:kworker.0 Request processed in 24us (86us total) trans 0 rc 0/0 00000020:00080000:1.0:1715330301.556474:0:3688:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8800b496f000 refcount 2 committed 0 result 0 batchid 396 00000020:00080000:1.0:1715330301.556475:0:3688:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800aa391d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8800b496f780 00000020:00080000:1.0:1715330301.556476:0:3688:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880093a11a00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8800b496f0c0 00000020:00080000:1.0:1715330301.556477:0:3688:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].380 00000100:00100000:0.0:1715330301.556477:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000020:00080000:1.0:1715330301.556478:0:3688:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff880093a11c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88008d45ea00 00000020:00080000:1.0:1715330301.556479:0:3688:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].381 00000100:00080000:2.0:1715330301.556484:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330271 00000100:00100000:0.0:1715330301.556484:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942504704 00000100:00100000:0.0:1715330301.556486:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942504704 00000100:00100000:3.0:1715330301.556488:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d608a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3689:1798653942504192:0@lo:400:kworker.0 00000004:00080000:1.0:1715330301.556492:0:3688:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968467 committed transno 4294968469 00000020:00080000:1.0:1715330301.556495:0:3688:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8800b496fe40 refcount 2 committed 0 result 0 batchid 397 00000020:00080000:1.0:1715330301.556496:0:3688:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88011d537500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8800b496fd80 00000020:00080000:1.0:1715330301.556497:0:3688:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88011d537300 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8800b496f840 00000020:00080000:1.0:1715330301.556499:0:3688:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].381 00000020:00080000:1.0:1715330301.556500:0:3688:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88011d537700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88009d4b3800 00000020:00080000:1.0:1715330301.556501:0:3688:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].382 00000100:00080000:2.0:1715330301.556503:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330271 00000100:00100000:0.0:1715330301.556506:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1715330301.556510:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1798653942504448:12345-0@lo:400:kworker.0 00000004:00080000:1.0:1715330301.556514:0:3688:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968468 committed transno 4294968469 00000020:00080000:1.0:1715330301.556516:0:3688:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88012f47e900 refcount 2 committed 0 result 0 batchid 398 00000020:00080000:1.0:1715330301.556517:0:3688:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009bbb0300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8800b496f180 00000020:00080000:1.0:1715330301.556518:0:3688:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800b4207c00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88012f47ea80 00000020:00080000:1.0:1715330301.556519:0:3688:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].382 00000100:00100000:3.0:1715330301.556520:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000020:00080000:1.0:1715330301.556521:0:3688:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800b4207d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88009d698e00 00000020:00080000:1.0:1715330301.556523:0:3688:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].383 00000100:00100000:3.0:1715330301.556525:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3689:x1798653942504704:12345-0@lo:400:kworker.0 00000004:00080000:1.0:1715330301.556535:0:3688:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968469 committed transno 4294968469 00000100:00100000:0.0:1715330301.556536:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1798653942504448:12345-0@lo:400:kworker.0 Request processed in 26us (112us total) trans 0 rc 0/0 00000020:00080000:1.0:1715330301.556537:0:3688:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8800b4b2f480 refcount 2 committed 0 result 0 batchid 399 00000020:00080000:1.0:1715330301.556539:0:3688:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008d4e1400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8800b4b2f900 00000020:00080000:1.0:1715330301.556540:0:3688:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008d4e1200 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8800b4b2f0c0 00000020:00080000:1.0:1715330301.556541:0:3688:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].383 00000100:00100000:0.0:1715330301.556541:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000020:00080000:1.0:1715330301.556542:0:3688:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88008d4e1d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88012f5cae00 00000020:00080000:1.0:1715330301.556543:0:3688:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].384 00000100:00100000:1.0:1715330301.556555:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942504384:0@lo:400:kworker.0 00000100:00100000:3.0:1715330301.556556:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3689:x1798653942504704:12345-0@lo:400:kworker.0 Request processed in 30us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330301.556563:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000020:00080000:1.0:1715330301.556569:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 399 committed batchid 393 00000100:00100000:0.0:1715330301.556573:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091e99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942504832:0@lo:400:kworker.0 00000100:00100000:0.0:1715330301.556581:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d609880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3691:1798653942504320:0@lo:400:kworker.0 00000100:00100000:0.0:1715330301.556590:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942504576:0@lo:400:kworker.0 00000100:00100000:3.0:1715330301.556596:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3689:1798653942504448:0@lo:400:kworker.0 00000100:00100000:3.0:1715330301.556604:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3689:1798653942504704:0@lo:400:kworker.0 00000020:00080000:1.0:1715330301.556611:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 393 00000100:00100000:1.0:1715330301.586814:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1715330301.586830:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093982d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942504960:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1715330301.586874:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330301.586893:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942504960 00000100:00100000:3.0:1715330301.586907:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942504960 00000100:00100000:3.0:1715330301.586948:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1715330301.586954:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3688:x1798653942504960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1715330301.586988:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 67681728 pending 172032 free 3923525632 avail 3692003328 00000100:00100000:3.0:1715330301.587055:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3688:x1798653942504960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330301.587061:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1715330301.587063:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093982d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942504960:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1715330301.602841:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f579880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942505024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1715330301.602894:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330301.602927:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942505024 00000100:00100000:2.0:1715330301.602935:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942505024 00000100:00100000:2.0:1715330301.602963:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1715330301.602969:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+11:3690:x1798653942505024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1715330301.602993:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 67681728 pending 172032 free 3923525632 avail 3692003328 00000100:00100000:2.0:1715330301.603034:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+11:3690:x1798653942505024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330301.603041:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1715330301.603072:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f579880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942505024:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1715330302.179957:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330303.011283:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1715330303.011308:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942505088:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1715330303.011383:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330303.011434:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942505088 00000100:00100000:0.0:1715330303.011442:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942505088 00000100:00100000:0.0:1715330303.011497:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3029 00000100:00100000:0.0:1715330303.011504:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f579180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:3690:x1798653942505088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1715330303.011543:0:8592:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444052992 avail 1314590720 00000100:00100000:0.0:1715330303.011597:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f579180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:3690:x1798653942505088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330303.011604:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3029 00000100:00100000:3.0:1715330303.011720:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942505088:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1715330303.104153:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330303.104182:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330303.104204:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330303.104223:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330303.104286:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938071424 00000100:00100000:3.0:1715330303.104290:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938071296 00000100:00100000:1.0:1715330303.104294:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938071424 00000100:00100000:3.0:1715330303.104295:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938071296 00000100:00100000:1.0:1715330303.104330:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 189 00000100:00100000:3.0:1715330303.104334:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938071360 00000100:00100000:3.0:1715330303.104336:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938071360 00000100:00100000:1.0:1715330303.104336:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72de1896-1df4-4b3a-930a-9116d2c66168+24:2014:x1798653938071424:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:3.0:1715330303.104352:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 268 00000100:00100000:3.0:1715330303.104357:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093982d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+9:2014:x1798653938071296:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:2.0:1715330303.104371:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 269 00000100:00100000:2.0:1715330303.104377:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093981880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+22:2013:x1798653938071360:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:1.0:1715330303.104382:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72de1896-1df4-4b3a-930a-9116d2c66168+24:2014:x1798653938071424:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 47us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330303.104386:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 189 00000100:00100000:3.0:1715330303.104389:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093982d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+9:2014:x1798653938071296:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 31us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330303.104395:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 268 00000100:00100000:1.0:1715330303.104403:0:7130:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938071232 00000100:00100000:2.0:1715330303.104405:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093981880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+22:2013:x1798653938071360:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 29us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330303.104405:0:7130:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938071232 00000100:00100000:2.0:1715330303.104411:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 269 00000100:00100000:1.0:1715330303.104417:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 335 00000100:00100000:1.0:1715330303.104420:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2013:x1798653938071232:12345-192.168.204.49@tcp:400:kworker.0 00000100:00080000:3.0:1715330303.104421:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330273 00000100:00080000:3.0:1715330303.104423:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330273 00000100:00080000:3.0:1715330303.104425:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330273 00000100:00080000:3.0:1715330303.104427:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330273 00000100:00100000:1.0:1715330303.104431:0:7130:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2013:x1798653938071232:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 11us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330303.104435:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 335 00000100:00100000:0.0:1715330303.105635:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330303.105755:0:9399:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938071488 00000100:00100000:3.0:1715330303.105760:0:9399:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938071488 00000100:00080000:0.0:1715330303.105795:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330273 00000100:00100000:3.0:1715330303.105798:0:9399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 190 00000100:00100000:3.0:1715330303.105803:0:9399:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093980e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72de1896-1df4-4b3a-930a-9116d2c66168+23:2013:x1798653938071488:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:3.0:1715330303.105832:0:9399:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093980e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72de1896-1df4-4b3a-930a-9116d2c66168+23:2013:x1798653938071488:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 28us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330303.105837:0:9399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 190 00010000:00010000:1.0:1715330303.186846:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1715330303.242090:0:9395:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0000: transno 4294969892 is committed 00000001:00080000:0.0:1715330303.242099:0:9395:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0000: transno 4294969891 is committed 00000001:00080000:0.0:1715330303.242116:0:9395:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0000: transno 4294969887 is committed 00000001:00080000:2.0:1715330303.243779:0:10666:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4294969893 is committed 00000001:00080000:2.0:1715330303.243786:0:10666:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4294969892 is committed 00000001:00080000:2.0:1715330303.243801:0:10666:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4294969887 is committed 00010000:00010000:2.0:1715330304.193156:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1715330304.376147:0:27945:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_60i skipping SLOW test 60i 00000100:00100000:2.0:1715330304.467025:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091e9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942505152:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1715330304.467096:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330304.467258:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942505152 00000100:00100000:0.0:1715330304.467266:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942505152 00000100:00100000:0.0:1715330304.468139:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3030 00000100:00100000:0.0:1715330304.468145:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f579880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942505152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1715330304.468178:0:7138:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445085184 avail 1315622912 00000100:00100000:0.0:1715330304.468230:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f579880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942505152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330304.468236:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3030 00000100:00100000:3.0:1715330304.468315:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091e9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942505152:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1715330305.194914:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330305.299053:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942505216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1715330305.299136:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330305.299175:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942505216 00000100:00100000:3.0:1715330305.299184:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942505216 00000100:00080000:0.0:1715330305.299215:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330275 00000100:00100000:3.0:1715330305.299236:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1715330305.299242:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d777b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942505216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1715330305.299274:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 67476928 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1715330305.299316:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d777b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942505216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330305.299323:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1715330305.299373:0:3689:0:(client.c:2956:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969892 gen 2 00000004:00080000:0.0:1715330305.299379:0:3689:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294969881 committed transno 4294969892 00000004:00080000:0.0:1715330305.299405:0:3689:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294969883 committed transno 4294969892 00000004:00080000:0.0:1715330305.299421:0:3689:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294969885 committed transno 4294969892 00000004:00080000:0.0:1715330305.299436:0:3689:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294969888 committed transno 4294969892 00000004:00080000:0.0:1715330305.299453:0:3689:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294969890 committed transno 4294969892 00000004:00080000:0.0:1715330305.299467:0:3689:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294969892 committed transno 4294969892 00000100:00100000:0.0:1715330305.299487:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942505216:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1715330305.315625:0:9621:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 279791892289ns, next at 280791889157ns, rc = 0 00000100:00100000:1.0:1715330305.316407:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1715330305.316430:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f57a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942505280:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1715330305.316496:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330305.316621:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942505280 00000100:00100000:3.0:1715330305.316630:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942505280 00000100:00080000:0.0:1715330305.317048:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330275 00000100:00100000:3.0:1715330305.317351:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1715330305.317358:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942505280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1715330305.317384:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 67476928 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1715330305.317435:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942505280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330305.317441:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1715330305.317465:0:3691:0:(client.c:2956:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294969887 gen 2 00000004:00080000:0.0:1715330305.317474:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d777480, transno 4294969887 00000100:00100000:0.0:1715330305.317491:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f57a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942505280:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1715330306.197878:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1715330306.231668:0:8267:0:(osp_sync.c:1604:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 6 committed 00010000:00010000:0.0:1715330306.231718:0:8267:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48e1c0/0xd895711d66d9e79 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd895711d66d9e80 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715330306.231754:0:8267:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48e1c0/0xd895711d66d9e79 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd895711d66d9e80 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330306.231799:0:8267:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48e1c0/0xd895711d66d9e79 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9e80 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330306.231805:0:8267:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715330306.231828:0:8267:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f48e1c0/0xd895711d66d9e79 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd895711d66d9e80 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1715330306.231845:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968493 is committed 00000004:00080000:0.0:1715330306.231860:0:8267:0:(osp_sync.c:1604:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 5 committed 00000004:00080000:0.0:1715330306.231873:0:8267:0:(osp_sync.c:1604:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 5 committed 00000100:00100000:0.0:1715330306.231893:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d776a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942505344:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1715330306.231953:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1715330306.232076:0:7116:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0000: 399 batchid updated 00000001:00080000:1.0:1715330306.232093:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983562 is committed 00000020:00080000:1.0:1715330306.232101:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 399 00010000:00010000:2.0:1715330306.232134:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48df80/0xd895711d66d9d3e lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330306.232143:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48df80/0xd895711d66d9d3e lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00000004:00080000:1.0:1715330306.232148:0:7163:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88012f49f6c0 with version 729 00010000:00010000:2.0:1715330306.232149:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48df80/0xd895711d66d9d3e lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330306.232154:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48df80 already unused, calling callback (ffffffffa0ee8730) 00000020:00080000:1.0:1715330306.232156:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 394 cancel update log [0x240000401:0x3:0x0].378: rc = 0 00010000:00010000:2.0:1715330306.232157:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48df80/0xd895711d66d9d3e lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330306.232163:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48df80/0xd895711d66d9d3e lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330306.232175:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x35 (ffff88009b985100) 00010000:00010000:2.0:1715330306.232177:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330306.232180:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48df80/0xd895711d66d9d3e lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xca:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330306.232196:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48df80/0xd895711d66d9d3e lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xca:0x0].0x35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330306.232211:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64b40/0xd895711d66d9d76 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330306.232215:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64b40/0xd895711d66d9d76 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330306.232220:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64b40/0xd895711d66d9d76 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330306.232223:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64b40 already unused, calling callback (ffffffffa0ee8730) 00000020:00080000:1.0:1715330306.232223:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 394 cancel update log [0x200000400:0x3:0x0].379: rc = 0 00010000:00010000:2.0:1715330306.232224:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64b40/0xd895711d66d9d76 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330306.232228:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64b40/0xd895711d66d9d76 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330306.232234:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x31 (ffff88008b091100) 00010000:00010000:2.0:1715330306.232236:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330306.232238:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64b40/0xd895711d66d9d76 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xca:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00010000:00010000:2.0:1715330306.232241:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88011db64b40/0xd895711d66d9d76 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xca:0x0].0x31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT1 00000004:00080000:1.0:1715330306.232243:0:7163:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88012f49f0c0 with version 730 00000020:00080000:1.0:1715330306.232245:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 395 cancel update log [0x240000401:0x3:0x0].379: rc = 0 00010000:00010000:2.0:1715330306.232251:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48eac0/0xd895711d66d9dae lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330306.232255:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48eac0/0xd895711d66d9dae lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330306.232258:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48eac0/0xd895711d66d9dae lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00000020:00080000:1.0:1715330306.232259:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 395 cancel update log [0x200000400:0x3:0x0].380: rc = 0 00010000:00010000:2.0:1715330306.232262:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48eac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330306.232263:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48eac0/0xd895711d66d9dae lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330306.232267:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48eac0/0xd895711d66d9dae lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330306.232272:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x36 (ffff88009b985c00) 00010000:00010000:2.0:1715330306.232273:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00080000:1.0:1715330306.232273:0:7163:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88012f49f480 with version 731 00010000:00010000:2.0:1715330306.232275:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48eac0/0xd895711d66d9dae lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xca:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00000020:00080000:1.0:1715330306.232275:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 396 cancel update log [0x240000401:0x3:0x0].380: rc = 0 00010000:00010000:2.0:1715330306.232278:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48eac0/0xd895711d66d9dae lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xca:0x0].0x36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330306.232286:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48fa80/0xd895711d66d9de6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00000020:00080000:1.0:1715330306.232286:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 396 cancel update log [0x200000400:0x3:0x0].381: rc = 0 00010000:00010000:2.0:1715330306.232289:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48fa80/0xd895711d66d9de6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330306.232297:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48fa80/0xd895711d66d9de6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330306.232300:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48fa80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330306.232301:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48fa80/0xd895711d66d9de6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00000004:00080000:1.0:1715330306.232303:0:7163:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88009d7e3cc0 with version 732 00010000:00010000:2.0:1715330306.232304:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48fa80/0xd895711d66d9de6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT1 00000020:00080000:1.0:1715330306.232304:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 397 cancel update log [0x240000401:0x3:0x0].381: rc = 0 00010000:00010000:2.0:1715330306.232308:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x30 (ffff88009b985900) 00010000:00010000:2.0:1715330306.232309:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330306.232310:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48fa80/0xd895711d66d9de6 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xca:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330306.232313:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48fa80/0xd895711d66d9de6 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xca:0x0].0x30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00000020:00080000:1.0:1715330306.232316:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 397 cancel update log [0x200000400:0x3:0x0].382: rc = 0 00010000:00010000:2.0:1715330306.232322:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c000/0xd895711d66d9e1e lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330306.232326:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c000/0xd895711d66d9e1e lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330306.232330:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c000/0xd895711d66d9e1e lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00000004:00080000:1.0:1715330306.232331:0:7163:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff88009d7e3000 with version 733 00000020:00080000:1.0:1715330306.232332:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 398 cancel update log [0x240000401:0x3:0x0].382: rc = 0 00010000:00010000:2.0:1715330306.232333:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48c000 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330306.232334:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c000/0xd895711d66d9e1e lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330306.232336:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c000/0xd895711d66d9e1e lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330306.232341:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x3031 (ffff88009b985400) 00010000:00010000:2.0:1715330306.232343:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:1.0:1715330306.232343:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 398 cancel update log [0x200000400:0x3:0x0].383: rc = 0 00010000:00010000:2.0:1715330306.232344:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c000/0xd895711d66d9e1e lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xca:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330306.232347:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48c000/0xd895711d66d9e1e lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xca:0x0].0x3031 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330306.232356:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e400/0xd895711d66d9e56 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT1 00000004:00080000:1.0:1715330306.232359:0:7163:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff880091ffae40 with version 734 00010000:00010000:2.0:1715330306.232360:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e400/0xd895711d66d9e56 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT1 00000020:00080000:1.0:1715330306.232361:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 399 cancel update log [0x240000401:0x3:0x0].383: rc = 0 00010000:00010000:2.0:1715330306.232363:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e400/0xd895711d66d9e56 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330306.232366:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48e400 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330306.232367:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e400/0xd895711d66d9e56 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330306.232370:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e400/0xd895711d66d9e56 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xca:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT1 00000020:00080000:1.0:1715330306.232371:0:7163:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 399 cancel update log [0x200000400:0x3:0x0].384: rc = 0 00010000:00010000:2.0:1715330306.232375:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xca:0x0].0x39 (ffff88009b985000) 00010000:00010000:2.0:1715330306.232377:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:1.0:1715330306.232377:0:7163:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 399 00010000:00010000:2.0:1715330306.232378:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e400/0xd895711d66d9e56 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xca:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00010000:00010000:2.0:1715330306.232382:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f48e400/0xd895711d66d9e56 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xca:0x0].0x39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT1 00000004:00080000:1.0:1715330306.232383:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 729 rpc_version 729 00000100:00100000:2.0:1715330306.232398:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f57b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942505408:0@lo:6:osp-syn-0-1.0 00000020:00100000:1.0:1715330306.232403:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1715330306.232408:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88009b5eca80 x1798653942505792/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1715330306.232424:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5eca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942505792:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1715330306.232433:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330306.232450:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942505664:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1715330306.232457:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330306.232463:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330306.232471:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa840 going to sleep for 11 seconds 00000100:00100000:2.0:1715330306.232475:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1715330306.232480:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f578000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942505472:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1715330306.232485:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942505792 00000100:00100000:1.0:1715330306.232491:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942505792 00000100:00100000:2.0:1715330306.232492:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330306.232511:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942505408 00000100:00100000:2.0:1715330306.232514:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942505408 00000100:00100000:1.0:1715330306.232523:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3031 00000100:00100000:1.0:1715330306.232529:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134566680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:8587:x1798653942505792:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1715330306.232533:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942505664 00000100:00100000:2.0:1715330306.232534:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942505664 00000100:00100000:2.0:1715330306.232541:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942505472 00000100:00100000:2.0:1715330306.232543:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942505472 00000100:00100000:2.0:1715330306.232553:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5226 00000100:00100000:2.0:1715330306.232557:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+7:3688:x1798653942505408:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1715330306.232576:0:9633:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2504 count 1 00010000:00010000:2.0:1715330306.232598:0:9633:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011db67a80/0xd895711d66d9eb1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330306.232618:0:9633:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011db66400/0xd895711d66d933c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb941 expref: 11 pid: 17200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1715330306.232624:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330306.232626:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330306.232629:0:9633:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db67a80/0xd895711d66d9eb1 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330306.232636:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134566680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:8587:x1798653942505792:12345-0@lo:1000:osp_up1-0.0 Request processed in 107us (179us total) trans 4294968494 rc 0/0 00000100:00100000:1.0:1715330306.232643:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3031 00010000:00010000:2.0:1715330306.232648:0:9633:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011db66400/0xd895711d66d933c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb941 expref: 11 pid: 17200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1715330306.232663:0:9633:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011db66400/0xd895711d66d933c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb941 expref: 11 pid: 17200 timeout: 380 lvb_type: 1 00000100:00100000:1.0:1715330306.232666:0:9398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5227 00000100:00100000:1.0:1715330306.232669:0:9398:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+7:3688:x1798653942505664:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1715330306.232673:0:9633:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d609880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9633:1798653942505856:192.168.204.49@tcp:104: 00002000:00080000:1.0:1715330306.232680:0:9398:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2509 count 1 00010000:00010000:1.0:1715330306.232691:0:9398:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093bfdb00/0xd895711d66d9eb8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330306.232700:0:9398:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d7a2f40/0xd895711d66d9d14 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb47 expref: 11 pid: 9633 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1715330306.232706:0:9398:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330306.232707:0:9398:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330306.232708:0:9398:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093bfdb00/0xd895711d66d9eb8 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330306.232713:0:9633:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091cb5000 going to sleep for 11 seconds 00010000:00010000:1.0:1715330306.232721:0:9398:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d7a2f40/0xd895711d66d9d14 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb47 expref: 11 pid: 9633 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1715330306.232727:0:17197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5228 00010000:00010000:1.0:1715330306.232728:0:9398:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d7a2f40/0xd895711d66d9d14 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb47 expref: 11 pid: 9633 timeout: 380 lvb_type: 1 00000100:00100000:2.0:1715330306.232753:0:17197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+7:3688:x1798653942505472:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1715330306.232759:0:9398:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134567800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9398:1798653942505920:192.168.204.49@tcp:104: 00002000:00080000:2.0:1715330306.232764:0:17197:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2506 count 1 00010000:00010000:2.0:1715330306.232774:0:17197:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011db67840/0xd895711d66d9ebf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330306.232778:0:9398:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4333780 going to sleep for 11 seconds 00010000:00010000:2.0:1715330306.232783:0:17197:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013457cd80/0xd895711d66d9477 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9aa expref: 11 pid: 17200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1715330306.232788:0:17197:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330306.232789:0:17197:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330306.232790:0:17197:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db67840/0xd895711d66d9ebf lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330306.232801:0:17197:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013457cd80/0xd895711d66d9477 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9aa expref: 11 pid: 17200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1715330306.232808:0:17197:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013457cd80/0xd895711d66d9477 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9aa expref: 11 pid: 17200 timeout: 380 lvb_type: 1 00000100:00100000:1.0:1715330306.232816:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5eca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942505792:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1715330306.232820:0:17197:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d608380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:17197:1798653942505984:192.168.204.49@tcp:104: 00000004:00080000:1.0:1715330306.232823:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 730 rpc_version 730 00000020:00100000:1.0:1715330306.232833:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1715330306.232836:0:17197:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091cb5480 going to sleep for 11 seconds 00000100:00100000:1.0:1715330306.232836:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880134565f80 x1798653942506112/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1715330306.232845:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134565f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942506112:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330306.232867:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330306.232875:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b43339c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330306.232887:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942506112 00000100:00100000:1.0:1715330306.232890:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942506112 00000100:00100000:1.0:1715330306.232905:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3032 00000100:00100000:1.0:1715330306.232908:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134565180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8587:x1798653942506112:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330306.233280:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f57a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942505536:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1715330306.233306:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330306.233320:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1715330306.233324:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942505600:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1715330306.233337:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330306.233353:0:17200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942505536 00000100:00100000:0.0:1715330306.233355:0:17200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942505536 00000100:00100000:0.0:1715330306.233370:0:17200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942505600 00000100:00100000:0.0:1715330306.233371:0:17200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942505600 00000100:00100000:0.0:1715330306.233383:0:17200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5229 00000100:00100000:0.0:1715330306.233387:0:17200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d777800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+9:3690:x1798653942505536:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1715330306.233397:0:17200:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2508 count 1 00010000:00010000:0.0:1715330306.233407:0:17200:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d7a1680/0xd895711d66d9ec6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330306.233417:0:17200:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011db67180/0xd895711d66d9c96 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb1d expref: 11 pid: 9633 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1715330306.233422:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330306.233423:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330306.233424:0:17200:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7a1680/0xd895711d66d9ec6 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330306.233439:0:17200:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011db67180/0xd895711d66d9c96 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb1d expref: 11 pid: 9633 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1715330306.233445:0:17200:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011db67180/0xd895711d66d9c96 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb1d expref: 11 pid: 9633 timeout: 380 lvb_type: 1 00000100:00100000:0.0:1715330306.233452:0:17200:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d777480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:17200:1798653942506176:192.168.204.49@tcp:104: 00000100:00100000:0.0:1715330306.233471:0:17200:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1715330306.233486:0:12304:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5230 00000100:00100000:0.0:1715330306.233489:0:12304:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d775880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+9:3690:x1798653942505600:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1715330306.233500:0:12304:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2507 count 1 00010000:00010000:0.0:1715330306.233509:0:12304:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d7a3a80/0xd895711d66d9ecd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330306.233521:0:12304:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f48d680/0xd895711d66d9bd9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbade expref: 11 pid: 17206 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1715330306.233526:0:12304:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330306.233527:0:12304:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330306.233528:0:12304:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7a3a80/0xd895711d66d9ecd lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330306.233543:0:12304:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f48d680/0xd895711d66d9bd9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbade expref: 11 pid: 17206 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1715330306.233549:0:12304:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f48d680/0xd895711d66d9bd9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbade expref: 11 pid: 17206 timeout: 380 lvb_type: 1 00000100:00100000:0.0:1715330306.233557:0:12304:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093981500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12304:1798653942506240:192.168.204.49@tcp:104: 00000100:00100000:0.0:1715330306.233573:0:12304:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47e240 going to sleep for 11 seconds 00000100:00100000:1.0:1715330306.233892:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134565180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:8587:x1798653942506112:12345-0@lo:1000:osp_up1-0.0 Request processed in 983us (1024us total) trans 4294968495 rc 0/0 00000100:00100000:1.0:1715330306.233899:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3032 00000100:00100000:0.0:1715330306.233977:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880134565f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942506112:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1715330306.233986:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 731 rpc_version 731 00000020:00100000:0.0:1715330306.233999:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1715330306.234003:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88009d647b80 x1798653942506368/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715330306.234012:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d647b80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942506368:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330306.234034:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330306.234042:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f47e600 going to sleep for 11 seconds 00000100:00100000:3.0:1715330306.234402:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942505344 00000100:00100000:3.0:1715330306.234407:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942505344 00000100:00100000:3.0:1715330306.234435:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1418 00000100:00100000:3.0:1715330306.234439:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d776d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+13:3691:x1798653942505344:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1715330306.234448:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330306.234464:0:9416:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66d9e80 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6088621d bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd895711d66d9e79 expref: 13 pid: 7139 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330306.234477:0:9416:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6088621d (ffff88009d5e7b00) 00010000:00010000:3.0:1715330306.234485:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715330306.234506:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d776d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+12:3691:x1798653942505344:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 68us (2555us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330306.234511:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1418 00000100:00100000:1.0:1715330306.237225:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942506368 00000100:00100000:1.0:1715330306.237237:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942506368 00000100:00100000:1.0:1715330306.237279:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3033 00000100:00100000:1.0:1715330306.237286:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:8587:x1798653942506368:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1715330306.237308:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1715330306.237324:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942506432:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1715330306.237381:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330306.237429:0:9399:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942506432 00000100:00100000:3.0:1715330306.237433:0:9399:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942506432 00000100:00100000:1.0:1715330306.237435:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:8587:x1798653942506368:12345-0@lo:1000:osp_up1-0.0 Request processed in 150us (3400us total) trans 4294968496 rc 0/0 00000100:00100000:1.0:1715330306.237442:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3033 00000100:00080000:2.0:1715330306.237452:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330276 00000100:00100000:3.0:1715330306.237465:0:9399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5231 00000100:00100000:3.0:1715330306.237468:0:9399:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942506432:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1715330306.237489:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d647b80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942506368:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1715330306.237501:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 732 rpc_version 732 00000020:00100000:1.0:1715330306.237524:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1715330306.237530:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880134564700 x1798653942506688/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1715330306.237547:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134564700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942506688:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330306.237570:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330306.237580:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4333000 going to sleep for 11 seconds 00000100:00100000:1.0:1715330306.237589:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942506688 00000100:00100000:1.0:1715330306.237592:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942506688 00000100:00100000:1.0:1715330306.237606:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3034 00000100:00100000:1.0:1715330306.237609:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:8587:x1798653942506688:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330306.237658:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:8587:x1798653942506688:12345-0@lo:1000:osp_up1-0.0 Request processed in 47us (87us total) trans 4294968497 rc 0/0 00000100:00100000:1.0:1715330306.237665:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3034 00000100:00100000:1.0:1715330306.237685:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880134564700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942506688:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1715330306.237691:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 733 rpc_version 733 00000020:00100000:1.0:1715330306.237700:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1715330306.237702:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880134565500 x1798653942506816/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1715330306.237712:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134565500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942506816:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330306.237749:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330306.237757:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4333000 going to sleep for 11 seconds 00000100:00100000:1.0:1715330306.237765:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942506816 00000100:00100000:1.0:1715330306.237767:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942506816 00000100:00100000:1.0:1715330306.237779:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3035 00000100:00100000:1.0:1715330306.237782:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134565880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:8587:x1798653942506816:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330306.237831:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134565880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:8587:x1798653942506816:12345-0@lo:1000:osp_up1-0.0 Request processed in 48us (101us total) trans 4294968498 rc 0/0 00000100:00100000:1.0:1715330306.237836:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3035 00000100:00100000:1.0:1715330306.237857:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880134565500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942506816:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1715330306.237861:0:8587:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006ef78c00 version 734 rpc_version 734 00000020:00100000:1.0:1715330306.237870:0:8587:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1715330306.237872:0:8587:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880134567b80 x1798653942506944/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1715330306.237881:0:8587:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134567b80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942506944:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330306.237898:0:8587:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330306.237905:0:8587:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4333000 going to sleep for 11 seconds 00000100:00100000:1.0:1715330306.237912:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942506944 00000100:00100000:1.0:1715330306.237914:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942506944 00000100:00100000:1.0:1715330306.237941:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3036 00000100:00100000:1.0:1715330306.237944:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134567100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:8587:x1798653942506944:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1715330306.237992:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134567100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:8587:x1798653942506944:12345-0@lo:1000:osp_up1-0.0 Request processed in 46us (93us total) trans 4294968499 rc 0/0 00000100:00100000:1.0:1715330306.237996:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3036 00000100:00100000:1.0:1715330306.238016:0:8587:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880134567b80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8587:1798653942506944:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1715330306.239019:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942506496:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1715330306.239056:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330306.239093:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1715330306.239098:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942506560:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1715330306.239114:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330306.239260:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d776a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942505344:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1715330306.239336:0:17199:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942506496 00000100:00100000:1.0:1715330306.239341:0:17199:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942506496 00000100:00100000:1.0:1715330306.239360:0:17199:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942506560 00000100:00100000:1.0:1715330306.239362:0:17199:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942506560 00000100:00100000:1.0:1715330306.239373:0:17199:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5232 00000100:00100000:1.0:1715330306.239377:0:17199:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+7:3690:x1798653942506496:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1715330306.239398:0:17199:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2506 count 1 00010000:00010000:1.0:1715330306.239418:0:17199:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093bfd8c0/0xd895711d66d9ed4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330306.239435:0:17199:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013457f180/0xd895711d66d93ba lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb96b expref: 10 pid: 17200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1715330306.239441:0:17199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330306.239443:0:17199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330306.239445:0:17199:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093bfd8c0/0xd895711d66d9ed4 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330306.239467:0:17199:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013457f180/0xd895711d66d93ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb96b expref: 10 pid: 17200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1715330306.239480:0:17199:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013457f180/0xd895711d66d93ba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb96b expref: 10 pid: 17200 timeout: 380 lvb_type: 1 00000100:00100000:1.0:1715330306.239490:0:17199:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:17199:1798653942507008:192.168.204.49@tcp:104: 00000100:00100000:1.0:1715330306.239527:0:17199:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4333000 going to sleep for 11 seconds 00000100:00100000:1.0:1715330306.239541:0:17217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5233 00000100:00100000:1.0:1715330306.239545:0:17217:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+7:3690:x1798653942506560:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1715330306.239555:0:17217:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2507 count 1 00010000:00010000:1.0:1715330306.239563:0:17217:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093bfe640/0xd895711d66d9edb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330306.239572:0:17217:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011db64240/0xd895711d66d9c18 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbaf3 expref: 10 pid: 9633 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1715330306.239577:0:17217:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330306.239578:0:17217:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330306.239579:0:17217:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093bfe640/0xd895711d66d9edb lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330306.239593:0:17217:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011db64240/0xd895711d66d9c18 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbaf3 expref: 10 pid: 9633 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1715330306.239599:0:17217:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011db64240/0xd895711d66d9c18 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbaf3 expref: 10 pid: 9633 timeout: 380 lvb_type: 1 00000100:00100000:1.0:1715330306.239611:0:17217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:17217:1798653942507072:192.168.204.49@tcp:104: 00000100:00100000:1.0:1715330306.239628:0:17217:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b4333900 going to sleep for 11 seconds 00002000:00080000:3.0:1715330306.242117:0:9399:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2505 count 1 00010000:00010000:3.0:1715330306.242143:0:9399:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f48cd80/0xd895711d66d9ee2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330306.242157:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00010000:00010000:3.0:1715330306.242159:0:9399:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013457ed00/0xd895711d66d9438 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb995 expref: 10 pid: 17200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1715330306.242166:0:9399:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330306.242168:0:9399:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330306.242170:0:9399:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f48cd80/0xd895711d66d9ee2 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330306.242206:0:9399:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013457ed00/0xd895711d66d9438 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb995 expref: 10 pid: 17200 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1715330306.242215:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00010000:00010000:3.0:1715330306.242216:0:9399:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013457ed00/0xd895711d66d9438 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb995 expref: 10 pid: 17200 timeout: 380 lvb_type: 1 00000100:00100000:3.0:1715330306.242228:0:9399:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba64a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9399:1798653942507136:192.168.204.49@tcp:104: 00000100:00100000:0.0:1715330306.242230:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330306.242246:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330306.242275:0:9399:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091f74780 going to sleep for 11 seconds 00000100:00100000:0.0:1715330306.242288:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330306.242310:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938071616 00000100:00100000:3.0:1715330306.242317:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938071616 00010000:00010000:3.0:1715330306.242349:0:9416:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7a2f40/0xd895711d66d9d14 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb47 expref: 12 pid: 9633 timeout: 380 lvb_type: 1 00000100:00100000:0.0:1715330306.242349:0:10673:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938071680 00000100:00100000:0.0:1715330306.242354:0:10673:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938071680 00010000:00010000:0.0:1715330306.242368:0:10673:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013457cd80/0xd895711d66d9477 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9aa expref: 13 pid: 17200 timeout: 380 lvb_type: 1 00000100:00100000:3.0:1715330306.242373:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938071552 00000100:00100000:3.0:1715330306.242375:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938071552 00000100:00100000:0.0:1715330306.242380:0:10673:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938071808 00000100:00100000:0.0:1715330306.242382:0:10673:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938071808 00010000:00010000:3.0:1715330306.242383:0:9416:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011db66400/0xd895711d66d933c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb941 expref: 14 pid: 17200 timeout: 380 lvb_type: 1 00010000:00010000:0.0:1715330306.242390:0:10673:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f48d680/0xd895711d66d9bd9 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbade expref: 15 pid: 17206 timeout: 380 lvb_type: 1 00000100:00100000:3.0:1715330306.242395:0:9416:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938071744 00000100:00100000:3.0:1715330306.242396:0:9416:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938071744 00000100:00100000:0.0:1715330306.242401:0:10673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1577 00010000:00010000:3.0:1715330306.242402:0:9416:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011db67180/0xd895711d66d9c96 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb1d expref: 16 pid: 9633 timeout: 380 lvb_type: 1 00000100:00100000:0.0:1715330306.242407:0:10673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ab788850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:72de1896-1df4-4b3a-930a-9116d2c66168+16:2012:x1798653938071616:12345-192.168.204.49@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1715330306.242411:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1578 00000100:00100000:3.0:1715330306.242415:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d635180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+16:2011:x1798653938071680:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1715330306.242415:0:10673:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330306.242418:0:10673:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d7a2f40/0xd895711d66d9d14 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb47 expref: 16 pid: 9633 timeout: 380 lvb_type: 1 00010000:00010000:3.0:1715330306.242421:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330306.242424:0:9416:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013457cd80/0xd895711d66d9477 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9aa expref: 16 pid: 17200 timeout: 380 lvb_type: 1 00010000:00010000:0.0:1715330306.242426:0:10673:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d7a2f40/0xd895711d66d9d14 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb47 expref: 16 pid: 9633 timeout: 380 lvb_type: 1 00010000:00010000:3.0:1715330306.242430:0:9416:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013457cd80/0xd895711d66d9477 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9aa expref: 16 pid: 17200 timeout: 380 lvb_type: 1 00010000:00010000:0.0:1715330306.242447:0:10673:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330306.242448:0:9416:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330306.242449:0:9416:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330306.242449:0:10673:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330306.242451:0:9416:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011db67840/0xd895711d66d9ebf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330306.242451:0:10673:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093bfdb00/0xd895711d66d9eb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330306.242458:0:9416:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db67840/0xd895711d66d9ebf lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330306.242458:0:10673:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093bfdb00/0xd895711d66d9eb8 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330306.242469:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715330306.242469:0:10673:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330306.242491:0:10673:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ab788850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:72de1896-1df4-4b3a-930a-9116d2c66168+16:2012:x1798653938071616:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 84us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330306.242492:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d635180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+16:2011:x1798653938071680:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 76us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330306.242497:0:10673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1577 00000100:00100000:3.0:1715330306.242500:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1578 00000100:00100000:3.0:1715330306.242513:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1579 00000100:00100000:3.0:1715330306.242516:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d776a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+14:2014:x1798653938071552:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1715330306.242522:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330306.242524:0:9416:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011db66400/0xd895711d66d933c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb941 expref: 14 pid: 17200 timeout: 380 lvb_type: 1 00010000:00010000:3.0:1715330306.242530:0:9416:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011db66400/0xd895711d66d933c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb941 expref: 14 pid: 17200 timeout: 380 lvb_type: 1 00010000:00010000:3.0:1715330306.242539:0:9416:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1715330306.242539:0:10673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1580 00010000:00010000:3.0:1715330306.242541:0:9416:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330306.242542:0:9416:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011db67a80/0xd895711d66d9eb1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330306.242542:0:10673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:72de1896-1df4-4b3a-930a-9116d2c66168+14:2014:x1798653938071808:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1715330306.242547:0:9416:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db67a80/0xd895711d66d9eb1 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330306.242548:0:10673:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330306.242551:0:10673:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f48d680/0xd895711d66d9bd9 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbade expref: 14 pid: 17206 timeout: 380 lvb_type: 1 00010000:00010000:3.0:1715330306.242555:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715330306.242557:0:10673:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f48d680/0xd895711d66d9bd9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbade expref: 14 pid: 17206 timeout: 380 lvb_type: 1 00010000:00010000:0.0:1715330306.242567:0:10673:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1715330306.242568:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d776a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+14:2014:x1798653938071552:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 51us (337us total) trans 0 rc 0/0 00010000:00010000:0.0:1715330306.242569:0:10673:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330306.242570:0:10673:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d7a3a80/0xd895711d66d9ecd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330306.242573:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1579 00010000:00010000:0.0:1715330306.242580:0:10673:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7a3a80/0xd895711d66d9ecd lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330306.242581:0:9416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1581 00000100:00100000:3.0:1715330306.242584:0:9416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+13:2014:x1798653938071744:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1715330306.242587:0:10673:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330306.242589:0:9416:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330306.242591:0:9416:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011db67180/0xd895711d66d9c96 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb1d expref: 13 pid: 9633 timeout: 380 lvb_type: 1 00000100:00100000:0.0:1715330306.242600:0:10673:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:72de1896-1df4-4b3a-930a-9116d2c66168+13:2014:x1798653938071808:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 56us (353us total) trans 0 rc 0/0 00010000:00010000:3.0:1715330306.242603:0:9416:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011db67180/0xd895711d66d9c96 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb1d expref: 13 pid: 9633 timeout: 380 lvb_type: 1 00000100:00100000:0.0:1715330306.242604:0:10673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1580 00010000:00010000:3.0:1715330306.242612:0:9416:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330306.242617:0:9416:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330306.242619:0:9416:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d7a1680/0xd895711d66d9ec6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330306.242624:0:9416:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7a1680/0xd895711d66d9ec6 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330306.242633:0:9416:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715330306.242639:0:12304:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f48d680/0xd895711d66d9bd9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbade expref: 12 pid: 17206 timeout: 380 lvb_type: 1 00000100:00100000:3.0:1715330306.242645:0:9416:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72de1896-1df4-4b3a-930a-9116d2c66168+11:2014:x1798653938071744:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 60us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330306.242649:0:12304:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093981500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12304:1798653942506240:192.168.204.49@tcp:104: 00000100:00100000:3.0:1715330306.242650:0:9416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1581 00010000:00010000:0.0:1715330306.242662:0:12304:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009d7a3a80/0xd895711d66d9ecd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00000100:00080000:3.0:1715330306.242665:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330276 00010000:00010000:0.0:1715330306.242669:0:12304:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009d7a3a80/0xd895711d66d9ecd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330306.242674:0:12304:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d7a3a80/0xd895711d66d9ecd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330306.242680:0:12304:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d7a3a80/0xd895711d66d9ecd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330306.242685:0:12304:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7a3a80/0xd895711d66d9ecd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330306.242696:0:12304:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d7a3a80/0xd895711d66d9ecd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330306.242701:0:12304:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a3a80 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330306.242704:0:12304:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d7a3a80/0xd895711d66d9ecd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330306.242709:0:12304:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d7a3a80/0xd895711d66d9ecd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330306.242719:0:12304:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d7a3a80/0xd895711d66d9ecd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330306.242723:0:12304:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d7a3a80/0xd895711d66d9ecd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330306.243036:0:12304:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d775880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+10:3690:x1798653942505600:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9545us (9697us total) trans 4294969893 rc 0/0 00000100:00100000:0.0:1715330306.243043:0:12304:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5230 00010000:00010000:0.0:1715330306.243068:0:17200:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011db67180/0xd895711d66d9c96 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb1d expref: 10 pid: 9633 timeout: 380 lvb_type: 1 00000100:00100000:0.0:1715330306.243075:0:17200:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d777480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:17200:1798653942506176:192.168.204.49@tcp:104: 00010000:00010000:0.0:1715330306.243085:0:17200:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009d7a1680/0xd895711d66d9ec6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330306.243093:0:17200:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009d7a1680/0xd895711d66d9ec6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330306.243098:0:17200:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d7a1680/0xd895711d66d9ec6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330306.243102:0:17200:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d7a1680/0xd895711d66d9ec6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330306.243106:0:17200:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7a1680/0xd895711d66d9ec6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330306.243111:0:17200:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d7a1680/0xd895711d66d9ec6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330306.243115:0:17200:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a1680 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330306.243117:0:17200:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d7a1680/0xd895711d66d9ec6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330306.243122:0:17200:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d7a1680/0xd895711d66d9ec6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330306.243129:0:17200:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d7a1680/0xd895711d66d9ec6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330306.243134:0:17200:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d7a1680/0xd895711d66d9ec6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330306.243255:0:17200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d777800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+10:3690:x1798653942505536:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9867us (9948us total) trans 4294969894 rc 0/0 00000100:00100000:0.0:1715330306.243260:0:17200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5229 00000004:00080000:0.0:1715330306.243346:0:3690:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012fa4e680/2, rc 0, transno 2597 00000100:00100000:0.0:1715330306.243351:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942505600:0@lo:6:osp-syn-0-1.0 00000004:00080000:0.0:1715330306.243358:0:3690:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012f57a300/2, rc 0, transno 2598 00000100:00100000:0.0:1715330306.243360:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f57a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942505536:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1715330306.243598:0:17197:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013457cd80/0xd895711d66d9477 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb9aa expref: 9 pid: 17200 timeout: 380 lvb_type: 1 00000100:00100000:2.0:1715330306.243608:0:17197:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d608380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:17197:1798653942505984:192.168.204.49@tcp:104: 00010000:00010000:2.0:1715330306.243619:0:17197:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88011db67840/0xd895711d66d9ebf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330306.243625:0:17197:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88011db67840/0xd895711d66d9ebf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330306.243629:0:17197:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011db67840/0xd895711d66d9ebf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330306.243634:0:17197:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011db67840/0xd895711d66d9ebf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330306.243639:0:17197:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88011db67840/0xd895711d66d9ebf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330306.243648:0:17197:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88011db67840/0xd895711d66d9ebf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330306.243653:0:17197:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db67840 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330306.243654:0:17197:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88011db67840/0xd895711d66d9ebf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330306.243659:0:17197:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88011db67840/0xd895711d66d9ebf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330306.243667:0:17197:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88011db67840/0xd895711d66d9ebf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330306.243672:0:17197:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011db67840/0xd895711d66d9ebf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330306.243816:0:17197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+10:3688:x1798653942505472:12345-0@lo:6:osp-syn-0-1.0 Request processed in 11062us (11323us total) trans 4294969895 rc 0/0 00000100:00100000:2.0:1715330306.243822:0:17197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5228 00000004:00080000:3.0:1715330306.243843:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012f578000/2, rc 0, transno 2599 00000100:00100000:3.0:1715330306.243847:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f578000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942505472:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1715330306.243847:0:9633:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011db66400/0xd895711d66d933c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb941 expref: 8 pid: 17200 timeout: 380 lvb_type: 1 00000100:00100000:2.0:1715330306.243855:0:9633:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d609880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9633:1798653942505856:192.168.204.49@tcp:104: 00010000:00010000:2.0:1715330306.243863:0:9633:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88011db67a80/0xd895711d66d9eb1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330306.243872:0:9633:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88011db67a80/0xd895711d66d9eb1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330306.243873:0:9398:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d7a2f40/0xd895711d66d9d14 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb47 expref: 7 pid: 9633 timeout: 380 lvb_type: 1 00010000:00010000:2.0:1715330306.243877:0:9633:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011db67a80/0xd895711d66d9eb1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330306.243882:0:9633:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011db67a80/0xd895711d66d9eb1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330306.243885:0:9398:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880134567800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9398:1798653942505920:192.168.204.49@tcp:104: 00010000:00010000:2.0:1715330306.243886:0:9633:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88011db67a80/0xd895711d66d9eb1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330306.243891:0:9633:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88011db67a80/0xd895711d66d9eb1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330306.243895:0:9633:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db67a80 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330306.243897:0:9633:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88011db67a80/0xd895711d66d9eb1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330306.243900:0:9398:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880093bfdb00/0xd895711d66d9eb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330306.243901:0:9633:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88011db67a80/0xd895711d66d9eb1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330306.243908:0:9633:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88011db67a80/0xd895711d66d9eb1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330306.243909:0:9398:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880093bfdb00/0xd895711d66d9eb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330306.243912:0:9633:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011db67a80/0xd895711d66d9eb1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330306.243913:0:9398:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093bfdb00/0xd895711d66d9eb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330306.243919:0:9398:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093bfdb00/0xd895711d66d9eb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330306.243923:0:9398:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093bfdb00/0xd895711d66d9eb8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330306.243927:0:9398:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093bfdb00/0xd895711d66d9eb8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330306.243932:0:9398:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfdb00 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330306.243933:0:9398:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093bfdb00/0xd895711d66d9eb8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330306.243937:0:9398:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093bfdb00/0xd895711d66d9eb8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330306.243946:0:9398:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093bfdb00/0xd895711d66d9eb8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330306.243951:0:9398:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093bfdb00/0xd895711d66d9eb8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330306.244026:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+11:3688:x1798653942505408:12345-0@lo:6:osp-syn-0-1.0 Request processed in 11467us (11593us total) trans 4294969896 rc 0/0 00000100:00100000:2.0:1715330306.244031:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5226 00000004:00080000:2.0:1715330306.244052:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012f57b100/2, rc 0, transno 2600 00000100:00100000:2.0:1715330306.244055:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f57b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942505408:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1715330306.244082:0:9398:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+10:3688:x1798653942505664:12345-0@lo:6:osp-syn-0-1.0 Request processed in 11411us (11618us total) trans 4294969897 rc 0/0 00000100:00100000:3.0:1715330306.244087:0:9398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5227 00000004:00080000:2.0:1715330306.244094:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012fa4ca80/2, rc 0, transno 2601 00000100:00100000:2.0:1715330306.244098:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942505664:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1715330306.246992:0:17217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:17217:1798653942507072:192.168.204.49@tcp:104: 00010000:00010000:3.0:1715330306.247014:0:17217:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880093bfe640/0xd895711d66d9edb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330306.247036:0:9399:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba64a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9399:1798653942507136:192.168.204.49@tcp:104: 00010000:00010000:3.0:1715330306.247044:0:9399:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012f48cd80/0xd895711d66d9ee2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330306.247068:0:17199:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:17199:1798653942507008:192.168.204.49@tcp:104: 00010000:00010000:3.0:1715330306.247077:0:17199:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880093bfd8c0/0xd895711d66d9ed4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330306.250822:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330306.250855:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330306.250901:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938071872 00000100:00100000:3.0:1715330306.250911:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938071872 00000100:00100000:0.0:1715330306.250938:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00010000:00010000:3.0:1715330306.250953:0:7120:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011db64240/0xd895711d66d9c18 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbaf3 expref: 11 pid: 9633 timeout: 380 lvb_type: 1 00000100:00100000:0.0:1715330306.250959:0:7121:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938071936 00000100:00100000:0.0:1715330306.250963:0:7121:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938071936 00000100:00100000:3.0:1715330306.250974:0:7120:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938072000 00010000:00010000:0.0:1715330306.250975:0:7121:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013457f180/0xd895711d66d93ba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb96b expref: 12 pid: 17200 timeout: 380 lvb_type: 1 00000100:00100000:3.0:1715330306.250977:0:7120:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938072000 00010000:00010000:3.0:1715330306.250984:0:7120:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013457ed00/0xd895711d66d9438 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb995 expref: 13 pid: 17200 timeout: 380 lvb_type: 1 00000100:00100000:0.0:1715330306.250994:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1582 00000100:00100000:0.0:1715330306.251000:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+13:2012:x1798653938071872:12345-192.168.204.49@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1715330306.251005:0:7120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1583 00000100:00100000:3.0:1715330306.251008:0:7120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093981500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72de1896-1df4-4b3a-930a-9116d2c66168+13:2012:x1798653938071936:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1715330306.251012:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330306.251015:0:7120:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330306.251015:0:7121:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011db64240/0xd895711d66d9c18 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbaf3 expref: 13 pid: 9633 timeout: 380 lvb_type: 1 00010000:00010000:3.0:1715330306.251018:0:7120:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013457f180/0xd895711d66d93ba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb96b expref: 13 pid: 17200 timeout: 380 lvb_type: 1 00010000:00010000:0.0:1715330306.251025:0:7121:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011db64240/0xd895711d66d9c18 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbaf3 expref: 13 pid: 9633 timeout: 380 lvb_type: 1 00010000:00010000:3.0:1715330306.251026:0:7120:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013457f180/0xd895711d66d93ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb96b expref: 13 pid: 17200 timeout: 380 lvb_type: 1 00010000:00010000:3.0:1715330306.251047:0:7120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013457f180/0xd895711d66d93ba lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb96b expref: 13 pid: 17200 timeout: 380 lvb_type: 1 00010000:00010000:0.0:1715330306.251047:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011db64240/0xd895711d66d9c18 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbaf3 expref: 13 pid: 9633 timeout: 380 lvb_type: 1 00010000:00010000:3.0:1715330306.251057:0:7120:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330306.251059:0:7120:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330306.251059:0:7121:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330306.251060:0:7121:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330306.251062:0:7120:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093bfd8c0/0xd895711d66d9ed4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330306.251062:0:7121:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093bfe640/0xd895711d66d9edb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330306.251069:0:7120:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093bfd8c0/0xd895711d66d9ed4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330306.251069:0:7121:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093bfe640/0xd895711d66d9edb lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330306.251087:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330306.251088:0:7120:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330306.251129:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+11:2012:x1798653938071872:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 129us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330306.251136:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1582 00000100:00100000:0.0:1715330306.251151:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1584 00000100:00100000:0.0:1715330306.251154:0:7121:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ab788450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+10:2014:x1798653938072000:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1715330306.251160:0:7121:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330306.251163:0:7121:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013457ed00/0xd895711d66d9438 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb995 expref: 10 pid: 17200 timeout: 380 lvb_type: 1 00010000:00010000:0.0:1715330306.251171:0:7121:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013457ed00/0xd895711d66d9438 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb995 expref: 10 pid: 17200 timeout: 380 lvb_type: 1 00000100:00100000:3.0:1715330306.251174:0:7120:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093981500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72de1896-1df4-4b3a-930a-9116d2c66168+10:2012:x1798653938071936:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 164us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330306.251180:0:7120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1583 00010000:00010000:0.0:1715330306.251181:0:7121:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013457ed00/0xd895711d66d9438 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfb995 expref: 10 pid: 17200 timeout: 380 lvb_type: 1 00010000:00010000:0.0:1715330306.251199:0:7121:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330306.251200:0:7121:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330306.251202:0:7121:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f48cd80/0xd895711d66d9ee2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00000100:00080000:3.0:1715330306.251203:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330276 00010000:00010000:0.0:1715330306.251206:0:7121:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f48cd80/0xd895711d66d9ee2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330306.251217:0:17199:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880093bfd8c0/0xd895711d66d9ed4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330306.251219:0:7121:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330306.251223:0:17199:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093bfd8c0/0xd895711d66d9ed4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330306.251231:0:17199:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093bfd8c0/0xd895711d66d9ed4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330306.251233:0:7121:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ab788450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72de1896-1df4-4b3a-930a-9116d2c66168+8:2014:x1798653938072000:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 78us (295us total) trans 0 rc 0/0 00010000:00010000:3.0:1715330306.251237:0:17199:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093bfd8c0/0xd895711d66d9ed4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330306.251239:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1584 00010000:00010000:3.0:1715330306.251242:0:17199:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093bfd8c0/0xd895711d66d9ed4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330306.251248:0:17199:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfd8c0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330306.251251:0:17199:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093bfd8c0/0xd895711d66d9ed4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330306.251257:0:17199:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093bfd8c0/0xd895711d66d9ed4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330306.251267:0:17199:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093bfd8c0/0xd895711d66d9ed4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330306.251271:0:17199:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093bfd8c0/0xd895711d66d9ed4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330306.251281:0:17217:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880093bfe640/0xd895711d66d9edb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330306.251286:0:17217:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093bfe640/0xd895711d66d9edb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330306.251291:0:17217:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093bfe640/0xd895711d66d9edb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330306.251295:0:17217:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093bfe640/0xd895711d66d9edb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330306.251300:0:17217:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093bfe640/0xd895711d66d9edb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330306.251308:0:17217:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfe640 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330306.251310:0:17217:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093bfe640/0xd895711d66d9edb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330306.251314:0:17217:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093bfe640/0xd895711d66d9edb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330306.251322:0:17217:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093bfe640/0xd895711d66d9edb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330306.251327:0:17217:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093bfe640/0xd895711d66d9edb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330306.251379:0:9399:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012f48cd80/0xd895711d66d9ee2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330306.251384:0:9399:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f48cd80/0xd895711d66d9ee2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330306.251390:0:9399:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f48cd80/0xd895711d66d9ee2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330306.251395:0:9399:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012f48cd80/0xd895711d66d9ee2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330306.251400:0:9399:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012f48cd80/0xd895711d66d9ee2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330306.251404:0:9399:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48cd80 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330306.251406:0:9399:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f48cd80/0xd895711d66d9ee2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330306.251410:0:9399:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f48cd80/0xd895711d66d9ee2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330306.251418:0:9399:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012f48cd80/0xd895711d66d9ee2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330306.251554:0:17217:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+9:3690:x1798653942506560:12345-0@lo:6:osp-syn-1-1.0 Request processed in 12008us (12439us total) trans 4294969894 rc 0/0 00000100:00100000:0.0:1715330306.251562:0:17217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5233 00000100:00100000:0.0:1715330306.251599:0:3690:0:(client.c:2956:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294969887 gen 2 00000004:00080000:0.0:1715330306.251603:0:3690:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d777100, transno 4294969887 00000100:00100000:0.0:1715330306.251613:0:3690:0:(client.c:3000:ptlrpc_free_committed()) @@@ stopping search req@ffff88009ba64000 x1798653942506560/t4294969894(4294969894) o6->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715330322 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 00000004:00080000:0.0:1715330306.251623:0:3690:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009ba64000/2, rc 0, transno 2598 00000100:00100000:0.0:1715330306.251627:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942506560:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1715330306.251726:0:17199:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+8:3690:x1798653942506496:12345-0@lo:6:osp-syn-1-1.0 Request processed in 12348us (12669us total) trans 4294969895 rc 0/0 00000100:00100000:0.0:1715330306.251755:0:17199:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5232 00000004:00080000:0.0:1715330306.251778:0:3690:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009ba67100/2, rc 0, transno 2599 00000100:00100000:0.0:1715330306.251781:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942506496:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1715330306.252181:0:9399:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f48cd80/0xd895711d66d9ee2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330306.252370:0:9399:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+8:3688:x1798653942506432:12345-0@lo:6:osp-syn-1-1.0 Request processed in 14900us (14989us total) trans 4294969896 rc 0/0 00000100:00100000:3.0:1715330306.252376:0:9399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5231 00000004:00080000:2.0:1715330306.252394:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009ba67b80/2, rc 0, transno 2600 00000100:00100000:2.0:1715330306.252398:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942506432:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1715330306.565092:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3688:1798653942507200:0@lo:400:kworker.0 00000100:00100000:2.0:1715330306.565150:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330306.565155:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3691:1798653942507392:0@lo:400:kworker.0 00000100:00100000:2.0:1715330306.565173:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b4c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942507456:0@lo:400:kworker.0 00000100:00100000:3.0:1715330306.565195:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330306.565212:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b4c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942507648:0@lo:400:kworker.0 00000100:00100000:2.0:1715330306.565215:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330306.565219:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3689:1798653942507264:0@lo:400:kworker.0 00000100:00100000:2.0:1715330306.565225:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b4c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942507712:0@lo:400:kworker.0 00000100:00100000:3.0:1715330306.565232:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330306.565247:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942507456 00000100:00100000:2.0:1715330306.565253:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942507456 00000100:00100000:2.0:1715330306.565278:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3037 00000100:00100000:0.0:1715330306.565280:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330306.565283:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d609880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+11:3688:x1798653942507456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330306.565292:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134567800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942507328:0@lo:400:kworker.0 00000100:00100000:0.0:1715330306.565295:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b4c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3689:1798653942507520:0@lo:400:kworker.0 00000100:00100000:0.0:1715330306.565313:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330306.565318:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d609880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+11:3688:x1798653942507456:12345-0@lo:400:kworker.0 Request processed in 35us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330306.565320:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330306.565323:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b4c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3689:1798653942507776:0@lo:400:kworker.0 00000100:00100000:2.0:1715330306.565324:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3037 00000100:00100000:1.0:1715330306.565332:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b4c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3690:1798653942507584:0@lo:400:kworker.0 00000100:00100000:2.0:1715330306.565334:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942507328 00000100:00100000:2.0:1715330306.565336:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942507328 00000100:00100000:0.0:1715330306.565337:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330306.565346:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3038 00000100:00100000:1.0:1715330306.565346:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330306.565349:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942507328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330306.565356:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b4c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3690:1798653942507840:0@lo:400:kworker.0 00000100:00100000:0.0:1715330306.565359:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942507392 00000100:00100000:0.0:1715330306.565363:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942507392 00000100:00100000:2.0:1715330306.565364:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942507328:12345-0@lo:400:kworker.0 Request processed in 14us (44us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330306.565368:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3038 00000100:00100000:1.0:1715330306.565370:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330306.565380:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942507264 00000100:00100000:0.0:1715330306.565380:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942507520 00000100:00100000:2.0:1715330306.565382:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942507264 00000100:00100000:0.0:1715330306.565382:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942507520 00000100:00100000:2.0:1715330306.565390:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942507776 00000100:00100000:1.0:1715330306.565391:0:3690:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983562 gen 2 00000100:00100000:2.0:1715330306.565392:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942507776 00000100:00100000:0.0:1715330306.565395:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942507584 00000004:00080000:1.0:1715330306.565396:0:3690:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983562 committed transno 4294983562 00000100:00100000:0.0:1715330306.565397:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942507584 00000100:00100000:2.0:1715330306.565399:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942507840 00000100:00100000:2.0:1715330306.565400:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942507840 00000020:00080000:1.0:1715330306.565401:0:3690:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff880091ffa900 refcount 2 committed 0 result 0 batchid 392 00000020:00080000:1.0:1715330306.565404:0:3690:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8800aa391f00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff880091ffab40 00000020:00080000:1.0:1715330306.565407:0:3690:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].393 00000100:00100000:2.0:1715330306.565408:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000020:00080000:1.0:1715330306.565409:0:3690:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88009b985200 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88012f5cba00 00000100:00100000:2.0:1715330306.565411:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3691:x1798653942507392:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1715330306.565411:0:3690:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].392 00000100:00100000:0.0:1715330306.565418:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1715330306.565423:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093981500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1798653942507264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330306.565428:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3691:x1798653942507392:12345-0@lo:400:kworker.0 Request processed in 16us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330306.565431:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880134567800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942507328:0@lo:400:kworker.0 00000100:00100000:2.0:1715330306.565432:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1715330306.565441:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1715330306.565443:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093980a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1798653942507520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330306.565448:0:7129:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942507200 00000100:00100000:1.0:1715330306.565451:0:7129:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942507200 00000100:00100000:0.0:1715330306.565452:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093981500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1798653942507264:12345-0@lo:400:kworker.0 Request processed in 29us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330306.565457:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093980a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1798653942507520:12345-0@lo:400:kworker.0 Request processed in 13us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330306.565457:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1715330306.565461:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1715330306.565467:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1715330306.565470:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1715330306.565471:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3689:x1798653942507776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330306.565481:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3688:x1798653942507200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330306.565491:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3689:x1798653942507776:12345-0@lo:400:kworker.0 Request processed in 19us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330306.565505:0:7129:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3688:x1798653942507200:12345-0@lo:400:kworker.0 Request processed in 31us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330306.565511:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1715330306.565705:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b4c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942507904:0@lo:400:kworker.0 00000100:00100000:3.0:1715330306.565723:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330306.565760:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3691:1798653942507392:0@lo:400:kworker.0 00000100:00100000:3.0:1715330306.565778:0:9399:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942507648 00000100:00100000:3.0:1715330306.565780:0:9399:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942507648 00000100:00100000:3.0:1715330306.565797:0:9399:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942507904 00000100:00100000:3.0:1715330306.565798:0:9399:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942507904 00000100:00100000:3.0:1715330306.565809:0:9399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1715330306.565812:0:9399:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+10:3691:x1798653942507648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330306.565837:0:9399:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+10:3691:x1798653942507648:12345-0@lo:400:kworker.0 Request processed in 24us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330306.565841:0:9399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1715330306.565849:0:9399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1715330306.565852:0:9399:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+8:3691:x1798653942507904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330306.565869:0:9399:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+8:3691:x1798653942507904:12345-0@lo:400:kworker.0 Request processed in 16us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330306.565873:0:9399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1715330306.566215:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1715330306.566220:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3690:x1798653942507584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330306.566222:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1715330306.566239:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1715330306.566243:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3690:x1798653942507840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330306.566247:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3690:x1798653942507584:12345-0@lo:400:kworker.0 Request processed in 27us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330306.566252:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1715330306.566272:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3690:x1798653942507840:12345-0@lo:400:kworker.0 Request processed in 28us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330306.566276:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330306.566277:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1715330306.566288:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b4c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942507968:0@lo:400:kworker.0 00000100:00100000:0.0:1715330306.566293:0:17199:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942507712 00000100:00100000:0.0:1715330306.566296:0:17199:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942507712 00000100:00100000:2.0:1715330306.566304:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330306.566316:0:17199:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942507968 00000100:00100000:0.0:1715330306.566318:0:17199:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942507968 00000100:00100000:2.0:1715330306.566326:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3688:1798653942507200:0@lo:400:kworker.0 00000100:00100000:0.0:1715330306.566334:0:17199:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1715330306.566337:0:17199:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d608380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942507712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330306.566342:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b4c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942507456:0@lo:400:kworker.0 00000100:00100000:2.0:1715330306.566357:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1715330306.566361:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d608a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942507968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330306.566363:0:17199:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d608380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942507712:12345-0@lo:400:kworker.0 Request processed in 25us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330306.566369:0:17199:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1715330306.566381:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d608a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942507968:12345-0@lo:400:kworker.0 Request processed in 19us (75us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330306.566385:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1715330306.566396:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3689:1798653942507264:0@lo:400:kworker.0 00000100:00100000:0.0:1715330306.566403:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b4c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3689:1798653942507520:0@lo:400:kworker.0 00000100:00100000:2.0:1715330306.566408:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b4c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942507712:0@lo:400:kworker.0 00000100:00100000:0.0:1715330306.566411:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b4c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3689:1798653942507776:0@lo:400:kworker.0 00000100:00100000:2.0:1715330306.566413:0:3688:0:(client.c:2956:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969893 gen 2 00000004:00080000:2.0:1715330306.566417:0:3688:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294969882 committed transno 4294969893 00000004:00080000:2.0:1715330306.566432:0:3688:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294969884 committed transno 4294969893 00000020:00080000:0.0:1715330306.566433:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 392 committed batchid 391 00000004:00080000:2.0:1715330306.566448:0:3688:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294969886 committed transno 4294969893 00000004:00080000:2.0:1715330306.566461:0:3688:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294969889 committed transno 4294969893 00000004:00080000:2.0:1715330306.566474:0:3688:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294969891 committed transno 4294969893 00000004:00080000:2.0:1715330306.566490:0:3688:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294969893 committed transno 4294969893 00000020:00080000:0.0:1715330306.566492:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 391 00000100:00100000:2.0:1715330306.566502:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b4c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942507968:0@lo:400:kworker.0 00000100:00100000:0.0:1715330306.566508:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b4c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3690:1798653942507584:0@lo:400:kworker.0 00000100:00100000:0.0:1715330306.566514:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b4c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3690:1798653942507840:0@lo:400:kworker.0 00000100:00080000:2.0:1715330306.566518:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330276 00000100:00080000:2.0:1715330306.566521:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330276 00000100:00080000:2.0:1715330306.566522:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330276 00000100:00080000:2.0:1715330306.566524:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330276 00000100:00100000:2.0:1715330306.566539:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b4c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942507648:0@lo:400:kworker.0 00000100:00100000:2.0:1715330306.566547:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b4c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942507904:0@lo:400:kworker.0 00000004:00080000:1.0:1715330306.595071:0:10801:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 281071337874ns, next at 282071335795ns, rc = 0 00000100:00100000:2.0:1715330306.595358:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1715330306.595379:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942508032:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1715330306.595437:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330306.597925:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942508032 00000100:00100000:3.0:1715330306.597936:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942508032 00000100:00100000:3.0:1715330306.598515:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1715330306.598523:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d608e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+8:3688:x1798653942508032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1715330306.598557:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 67509696 pending 0 free 3923537920 avail 3692015616 00000100:00100000:3.0:1715330306.599362:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d608e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+8:3688:x1798653942508032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 837us (3921us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330306.599369:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1715330306.599458:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942508032:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1715330306.611083:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b4c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942508096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1715330306.611147:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330306.611410:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942508096 00000100:00100000:3.0:1715330306.611417:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942508096 00000100:00100000:3.0:1715330306.611462:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1715330306.611468:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093980380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942508096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1715330306.611490:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 67509696 pending 0 free 3923537920 avail 3692015616 00000100:00100000:3.0:1715330306.612586:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093980380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942508096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1113us (1434us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330306.612594:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1715330306.612795:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b4c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942508096:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1715330307.186542:0:28268:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 60j: llog_reader reports corruptions ====== 04:38:26 (1715330306) 00010000:00010000:1.0:1715330307.202430:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1715330307.824241:0:28333:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000100:00100000:2.0:1715330308.019944:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b4c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942508160:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1715330308.020012:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330308.020243:0:7139:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942508160 00000100:00100000:0.0:1715330308.020251:0:7139:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942508160 00000100:00100000:0.0:1715330308.020296:0:7139:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3039 00000100:00100000:0.0:1715330308.020302:0:7139:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:3691:x1798653942508160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1715330308.020336:0:7139:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444052992 avail 1314590720 00000100:00100000:0.0:1715330308.020761:0:7139:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:3691:x1798653942508160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 430us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330308.020768:0:7139:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3039 00000100:00100000:3.0:1715330308.021909:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b4c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942508160:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1715330308.112222:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330308.112263:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330308.112284:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330308.112302:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330308.112335:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938072128 00000100:00100000:3.0:1715330308.112346:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938072128 00000100:00100000:1.0:1715330308.112354:0:7130:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938072064 00000100:00100000:1.0:1715330308.112359:0:7130:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938072064 00000100:00100000:3.0:1715330308.114609:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938072192 00000100:00100000:3.0:1715330308.114622:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938072192 00000100:00100000:3.0:1715330308.114652:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 276 00000100:00100000:3.0:1715330308.114660:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+9:2013:x1798653938072128:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:3.0:1715330308.114757:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+9:2013:x1798653938072128:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 96us (2491us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330308.114764:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 276 00000100:00100000:3.0:1715330308.114785:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 277 00000100:00100000:3.0:1715330308.114789:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938072192:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:3.0:1715330308.114811:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938072192:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 21us (2528us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330308.114816:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 277 00000100:00080000:3.0:1715330308.114957:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330278 00000100:00080000:3.0:1715330308.114961:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330278 00000100:00080000:3.0:1715330308.114964:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330278 00000100:00100000:1.0:1715330308.116753:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 337 00000100:00100000:1.0:1715330308.116761:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2014:x1798653938072064:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:1.0:1715330308.116824:0:7130:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2014:x1798653938072064:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 63us (4614us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330308.116831:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 337 00000100:00100000:0.0:1715330308.117874:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330308.117903:0:17197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938072256 00000100:00100000:0.0:1715330308.117910:0:17197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938072256 00000100:00100000:0.0:1715330308.117950:0:17197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938072320 00000100:00100000:0.0:1715330308.117953:0:17197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938072320 00000100:00100000:0.0:1715330308.117966:0:17197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 195 00000100:00100000:0.0:1715330308.117971:0:17197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:72de1896-1df4-4b3a-930a-9116d2c66168+7:2013:x1798653938072256:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:0.0:1715330308.118004:0:17197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:72de1896-1df4-4b3a-930a-9116d2c66168+7:2013:x1798653938072256:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 32us (5700us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330308.118010:0:17197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 195 00000100:00100000:0.0:1715330308.118021:0:17197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 196 00000100:00100000:0.0:1715330308.118024:0:17197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:72de1896-1df4-4b3a-930a-9116d2c66168+8:2014:x1798653938072320:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:0.0:1715330308.118038:0:17197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:72de1896-1df4-4b3a-930a-9116d2c66168+8:2014:x1798653938072320:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 13us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330308.118042:0:17197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 196 00000100:00080000:1.0:1715330308.118140:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330278 00000100:00080000:1.0:1715330308.118143:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330278 00010000:00010000:2.0:1715330308.207905:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330308.965706:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330308.966022:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938072384 00000100:00100000:3.0:1715330308.966032:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938072384 00000100:00100000:3.0:1715330308.966492:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23593 00000100:00100000:3.0:1715330308.966500:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+9:18735:x1798653938072384:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:3.0:1715330308.966521:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330308.966544:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d680/0xd895711d66d9ee9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbb4e expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330308.966605:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e400/0xd895711d66d9ef0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330308.966619:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e400/0xd895711d66d9ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330308.966631:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e400/0xd895711d66d9ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00000004:00200000:3.0:1715330308.966675:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 270336 00000004:00200000:3.0:1715330308.966679:0:9622:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1715330308.966695:0:9622:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e400/0xd895711d66d9ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330308.966718:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d680/0xd895711d66d9ee9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb4e expref: 11 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330308.966851:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e400/0xd895711d66d9ef0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb4e expref: 10 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330308.966859:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:3.0:1715330308.966862:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1715330308.966865:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f48e400, rc 0) 00000100:00100000:3.0:1715330308.966911:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+10:18735:x1798653938072384:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 412us (1217us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330308.966918:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23593 00000100:00100000:0.0:1715330308.971169:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330308.971291:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938072448 00000100:00100000:3.0:1715330308.971301:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938072448 00000100:00100000:3.0:1715330308.971349:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23594 00000100:00100000:3.0:1715330308.971357:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d777100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+10:18735:x1798653938072448:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:3.0:1715330308.971380:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330308.971405:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c000/0xd895711d66d9ef7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbb55 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330308.971472:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48fa80/0xd895711d66d9efe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330308.971486:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48fa80/0xd895711d66d9efe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330308.971497:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48fa80/0xd895711d66d9efe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330308.971514:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48eac0/0xd895711d66d9f05 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9d986a8e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330308.971520:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48eac0/0xd895711d66d9f05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9d986a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330308.971525:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48eac0/0xd895711d66d9f05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9d986a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330308.971579:0:9622:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48fa80/0xd895711d66d9efe lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330308.971584:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48fa80/0xd895711d66d9efe lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330308.971588:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48fa80/0xd895711d66d9efe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330308.971593:0:9622:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48fa80/0xd895711d66d9efe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330308.971600:0:9622:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48fa80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330308.971604:0:9622:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48fa80/0xd895711d66d9efe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330308.971610:0:9622:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48fa80/0xd895711d66d9efe lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330308.971621:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:3.0:1715330308.971624:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330308.971628:0:9622:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48fa80/0xd895711d66d9efe lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330308.971633:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48fa80/0xd895711d66d9efe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330308.971642:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48eac0/0xd895711d66d9f05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9d986a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330308.971646:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48eac0/0xd895711d66d9f05 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9d986a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330308.971650:0:9622:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48eac0/0xd895711d66d9f05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9d986a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330308.971653:0:9622:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48eac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330308.971656:0:9622:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48eac0/0xd895711d66d9f05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9d986a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330308.971661:0:9622:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48eac0/0xd895711d66d9f05 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9d986a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330308.971666:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9d986a8e (ffff880091ea7600) 00010000:00010000:3.0:1715330308.971668:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330308.971669:0:9622:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48eac0/0xd895711d66d9f05 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9d986a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330308.971674:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48eac0/0xd895711d66d9f05 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9d986a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330308.971701:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c000/0xd895711d66d9ef7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb55 expref: 11 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330308.971708:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c000/0xd895711d66d9ef7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb55 expref: 11 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330308.971716:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f48c000, rc 0) 00000100:00100000:3.0:1715330308.971787:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d777100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+10:18735:x1798653938072448:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 430us (626us total) trans 0 rc 301/301 00000100:00100000:3.0:1715330308.971794:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23594 00000100:00100000:1.0:1715330308.976231:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330308.977431:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938072576 00000100:00100000:0.0:1715330308.977443:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938072576 00000100:00100000:0.0:1715330308.977506:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23595 00000100:00100000:0.0:1715330308.977514:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+10:18735:x1798653938072576:12345-192.168.204.49@tcp:36:lfs.0 00010000:00010000:0.0:1715330308.977590:0:7135:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330308.977619:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e400/0xd895711d66d9ef0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb4e expref: 10 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330308.977634:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:0.0:1715330308.977638:0:7135:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715330308.977703:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0000/0xd895711d66d9f0c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330308.977714:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0000/0xd895711d66d9f0c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330308.977722:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0000/0xd895711d66d9f0c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330308.977752:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66d9f13 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9d986a8e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330308.977757:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66d9f13 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9d986a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330308.977762:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66d9f13 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9d986a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330308.978148:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3840/0xd895711d66d9f1a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330308.978154:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3840/0xd895711d66d9f1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330308.978161:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3840/0xd895711d66d9f1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00010000:0.0:1715330308.978173:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008d48e300 reply state ffff880093821000 transno 4294983563 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3840/0xd895711d66d9f1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330308.978179:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3840/0xd895711d66d9f1a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330308.978184:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d678a00) 00010000:00010000:0.0:1715330308.978186:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330308.978189:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1715330308.978192:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x152a:0x0]: returning size 4096 00010000:00010000:0.0:1715330308.978198:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0000/0xd895711d66d9f0c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330308.978203:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0000/0xd895711d66d9f0c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330308.978207:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0000/0xd895711d66d9f0c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330308.978213:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0000/0xd895711d66d9f0c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330308.978218:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a0000 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330308.978221:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0000/0xd895711d66d9f0c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330308.978227:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0000/0xd895711d66d9f0c lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330308.978233:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:0.0:1715330308.978234:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330308.978237:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0000/0xd895711d66d9f0c lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330308.978245:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0000/0xd895711d66d9f0c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00000004:00010000:0.0:1715330308.978254:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008d48e300 reply state ffff880093821000 transno 4294983563 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66d9f13 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9d986a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330308.978260:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66d9f13 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9d986a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:0.0:1715330308.978264:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9d986a8e (ffff88009d678600) 00010000:00010000:0.0:1715330308.978266:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330308.978267:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1715330308.978358:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+11:18735:x1798653938072576:12345-192.168.204.49@tcp:36:lfs.0 Request processed in 842us (2133us total) trans 4294983563 rc 0/0 00000100:00100000:0.0:1715330308.978366:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23595 00010000:00010000:1.0:1715330309.209124:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330309.476600:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1715330309.476623:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942508224:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1715330309.476684:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330309.478566:0:7139:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942508224 00000100:00100000:1.0:1715330309.478575:0:7139:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942508224 00000100:00100000:1.0:1715330309.478622:0:7139:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3040 00000100:00100000:1.0:1715330309.478629:0:7139:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d776a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:3689:x1798653942508224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1715330309.478659:0:7139:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445085184 avail 1315622912 00000100:00100000:1.0:1715330309.478710:0:7139:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d776a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:3689:x1798653942508224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (2026us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330309.478716:0:7139:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3040 00000100:00100000:0.0:1715330309.478794:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942508224:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1715330310.030192:0:28592:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00010000:00010000:1.0:1715330310.210953:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330310.307456:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d777480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942508288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1715330310.307528:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330310.307629:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942508288 00000100:00100000:0.0:1715330310.307638:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942508288 00000100:00100000:0.0:1715330310.307685:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1715330310.307693:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942508288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1715330310.307727:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 67476928 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1715330310.307780:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942508288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330310.307787:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:0.0:1715330310.307818:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330280 00000100:00100000:1.0:1715330310.308178:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d777480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942508288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1715330310.326674:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1715330310.326695:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b4c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942508352:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1715330310.326776:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330310.327698:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942508352 00000100:00100000:0.0:1715330310.327707:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942508352 00000100:00100000:0.0:1715330310.327785:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1715330310.327793:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+10:3691:x1798653942508352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1715330310.327820:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 67476928 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1715330310.327881:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+10:3691:x1798653942508352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (1105us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330310.327888:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1715330310.327941:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b4c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942508352:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1715330310.327958:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330280 00000020:00000080:1.0:1715330310.507598:0:28656:0:(class_obd.c:334:class_handle_ioctl()) obdclass: cmd=424066b1 len=0 uarg=00007fffe65cd100 00000004:00000080:1.0:1715330310.507613:0:28656:0:(mdt_handler.c:7835:mdt_iocontrol()) lustre-MDT0000: cmd=424066b1 len=576 karg=ffff88009d6b1400 uarg=0000000000000000 00000004:00000080:1.0:1715330310.507654:0:28656:0:(mdd_device.c:2268:mdd_iocontrol()) lustre-MDD0000: cmd=424066b1 len=576 karg=ffff88009d6b1400 00000040:00080000:1.0:1715330310.507870:0:28656:0:(llog_osd.c:233:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1715330310.508390:0:28656:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1715330310.508456:0:28656:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 80 off8272 00000004:00000080:1.0:1715330310.508641:0:28656:0:(mdd_device.c:1836:mdd_changelog_user_register()) lustre-MDD0000: registered changelog user 'cl1', mask 0x0 00000004:02000000:1.0:1715330310.508644:0:28656:0:(mdd_device.c:486:mdd_changelog_on()) lustre-MDD0000: changelog on 00010000:00010000:1.0:1715330311.213281:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1715330311.475771:0:28785:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000100:00100000:0.0:1715330311.591122:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1715330311.591142:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d776d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3690:1798653942508416:0@lo:400:kworker.0 00000100:00100000:0.0:1715330311.591207:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330311.591243:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1715330311.591249:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d777480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3689:1798653942508480:0@lo:400:kworker.0 00000100:00100000:0.0:1715330311.591271:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330311.591294:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942508480 00000100:00100000:0.0:1715330311.591300:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942508480 00000100:00100000:0.0:1715330311.591330:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1715330311.591336:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1798653942508480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330311.591376:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1798653942508480:12345-0@lo:400:kworker.0 Request processed in 39us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330311.591382:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1715330311.591418:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d777480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3689:1798653942508480:0@lo:400:kworker.0 00000100:00100000:0.0:1715330311.591443:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942508544:0@lo:400:kworker.0 00000100:00100000:0.0:1715330311.591463:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330311.591489:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3690:1798653942508608:0@lo:400:kworker.0 00000100:00100000:0.0:1715330311.591504:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330311.591516:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942508608 00000100:00100000:0.0:1715330311.591518:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942508608 00000100:00100000:0.0:1715330311.591533:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1715330311.591536:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3690:x1798653942508608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330311.591557:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3690:x1798653942508608:12345-0@lo:400:kworker.0 Request processed in 20us (52us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330311.591562:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1715330311.591577:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3690:1798653942508608:0@lo:400:kworker.0 00000100:00100000:0.0:1715330311.591596:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1715330311.591600:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942508672:0@lo:400:kworker.0 00000100:00100000:0.0:1715330311.591615:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330311.591637:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1715330311.591642:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091cca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3689:1798653942508736:0@lo:400:kworker.0 00000100:00100000:0.0:1715330311.591657:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330311.591668:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942508736 00000100:00100000:0.0:1715330311.591670:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942508736 00000100:00100000:0.0:1715330311.591689:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1715330311.591692:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1798653942508736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330311.591712:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1798653942508736:12345-0@lo:400:kworker.0 Request processed in 19us (54us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330311.591716:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00080000:0.0:1715330311.591727:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330281 00000100:00100000:0.0:1715330311.591766:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091cca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3689:1798653942508736:0@lo:400:kworker.0 00000100:00100000:0.0:1715330311.591787:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091cca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3689:1798653942508800:0@lo:400:kworker.0 00000100:00100000:0.0:1715330311.591805:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330311.591817:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942508800 00000100:00100000:0.0:1715330311.591820:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942508800 00000100:00100000:0.0:1715330311.591835:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1715330311.591838:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091cc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1798653942508800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330311.591859:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091cc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1798653942508800:12345-0@lo:400:kworker.0 Request processed in 20us (53us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330311.591864:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00080000:0.0:1715330311.591875:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330281 00000100:00100000:0.0:1715330311.591885:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091cca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3689:1798653942508800:0@lo:400:kworker.0 00000100:00100000:0.0:1715330311.591904:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091cca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942508864:0@lo:400:kworker.0 00000100:00100000:0.0:1715330311.591921:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330311.591941:0:9398:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942508864 00000100:00100000:0.0:1715330311.591943:0:9398:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942508864 00000100:00100000:0.0:1715330311.591960:0:9398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1715330311.591964:0:9398:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+10:3690:x1798653942508864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330311.591988:0:9398:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+10:3690:x1798653942508864:12345-0@lo:400:kworker.0 Request processed in 23us (66us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330311.591993:0:9398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1715330311.592011:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091cca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942508864:0@lo:400:kworker.0 00000100:00100000:0.0:1715330311.592029:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1715330311.592033:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091cca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942508928:0@lo:400:kworker.0 00000100:00100000:0.0:1715330311.592048:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330311.592060:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942508928 00000100:00100000:0.0:1715330311.592062:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942508928 00000100:00100000:0.0:1715330311.592073:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1715330311.592077:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942508928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330311.592111:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942508928:12345-0@lo:400:kworker.0 Request processed in 32us (62us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330311.592115:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1715330311.592130:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091cca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942508928:0@lo:400:kworker.0 00000100:00100000:0.0:1715330311.592146:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1715330311.592150:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091cca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3689:1798653942508992:0@lo:400:kworker.0 00000100:00100000:0.0:1715330311.592164:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330311.592175:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942508992 00000100:00100000:0.0:1715330311.592177:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942508992 00000100:00100000:0.0:1715330311.592190:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1715330311.592193:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3689:x1798653942508992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330311.592213:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3689:x1798653942508992:12345-0@lo:400:kworker.0 Request processed in 19us (48us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330311.592218:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00080000:0.0:1715330311.592225:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330281 00000100:00100000:0.0:1715330311.592237:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091cca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3689:1798653942508992:0@lo:400:kworker.0 00000100:00100000:0.0:1715330311.592255:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091cca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3689:1798653942509056:0@lo:400:kworker.0 00000100:00100000:0.0:1715330311.592269:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330311.592280:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942509056 00000100:00100000:0.0:1715330311.592282:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942509056 00000100:00100000:0.0:1715330311.592293:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1715330311.592296:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091cca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3689:x1798653942509056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330311.592315:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091cca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3689:x1798653942509056:12345-0@lo:400:kworker.0 Request processed in 18us (45us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330311.592323:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00080000:0.0:1715330311.592330:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330281 00000100:00100000:0.0:1715330311.592342:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091cca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3689:1798653942509056:0@lo:400:kworker.0 00000100:00100000:0.0:1715330311.592360:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091cca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942509120:0@lo:400:kworker.0 00000100:00100000:0.0:1715330311.592373:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330311.592384:0:9398:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942509120 00000100:00100000:0.0:1715330311.592386:0:9398:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942509120 00000100:00100000:0.0:1715330311.592398:0:9398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1715330311.592400:0:9398:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091ccb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+8:3690:x1798653942509120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330311.592419:0:9398:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091ccb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+8:3690:x1798653942509120:12345-0@lo:400:kworker.0 Request processed in 17us (45us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330311.592422:0:9398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00080000:0.0:1715330311.592429:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330281 00000100:00100000:0.0:1715330311.592440:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091cca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942509120:0@lo:400:kworker.0 00000100:00100000:0.0:1715330311.592458:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1715330311.592462:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091cca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942509184:0@lo:400:kworker.0 00000100:00100000:0.0:1715330311.592477:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330311.592488:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942509184 00000100:00100000:0.0:1715330311.592490:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942509184 00000100:00100000:0.0:1715330311.592502:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1715330311.592505:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942509184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330311.592529:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942509184:12345-0@lo:400:kworker.0 Request processed in 22us (51us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330311.592534:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00080000:0.0:1715330311.592542:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330281 00000100:00100000:0.0:1715330311.592555:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091cca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942509184:0@lo:400:kworker.0 00000100:00100000:1.0:1715330311.593179:0:7129:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942508416 00000100:00100000:1.0:1715330311.593184:0:7129:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942508416 00000100:00080000:0.0:1715330311.593202:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330281 00000100:00100000:1.0:1715330311.593217:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1715330311.593222:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3690:x1798653942508416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330311.593257:0:7129:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3690:x1798653942508416:12345-0@lo:400:kworker.0 Request processed in 34us (2049us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330311.593263:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1715330311.593264:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d776d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3690:1798653942508416:0@lo:400:kworker.0 00000100:00100000:1.0:1715330311.593296:0:7139:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942508544 00000100:00100000:1.0:1715330311.593299:0:7139:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942508544 00000100:00100000:1.0:1715330311.593316:0:7139:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942508672 00000100:00100000:1.0:1715330311.593318:0:7139:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942508672 00000100:00100000:1.0:1715330311.593331:0:7139:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3041 00000100:00100000:1.0:1715330311.593335:0:7139:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:3689:x1798653942508544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330311.593369:0:7139:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:3689:x1798653942508544:12345-0@lo:400:kworker.0 Request processed in 29us (1900us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330311.593374:0:7139:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3041 00000100:00100000:1.0:1715330311.593382:0:7139:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3042 00000100:00100000:0.0:1715330311.593383:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942508544:0@lo:400:kworker.0 00000100:00100000:1.0:1715330311.593386:0:7139:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d777480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:3690:x1798653942508672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330311.593409:0:7139:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d777480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:3690:x1798653942508672:12345-0@lo:400:kworker.0 Request processed in 23us (1793us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330311.593413:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942508672:0@lo:400:kworker.0 00000100:00100000:1.0:1715330311.593414:0:7139:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3042 00000004:00080000:2.0:1715330311.604401:0:10801:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 286080667411ns, next at 287080664640ns, rc = 0 00000100:00100000:2.0:1715330311.604443:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942509248:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1715330311.604510:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330311.606098:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942509248 00000100:00100000:0.0:1715330311.606108:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942509248 00000100:00100000:0.0:1715330311.606146:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1715330311.606154:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7ec1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+8:3688:x1798653942509248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1715330311.606184:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 67509696 pending 0 free 3923537920 avail 3692015616 00000100:00100000:0.0:1715330311.606236:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7ec1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+8:3688:x1798653942509248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (1726us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330311.606242:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1715330311.606346:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942509248:0@lo:13:osp-pre-1-1.0 00000004:00080000:0.0:1715330311.607175:0:8267:0:(osp_sync.c:1604:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 7 committed 00000004:00080000:0.0:1715330311.607603:0:8267:0:(osp_sync.c:1604:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 6 committed 00000020:00080000:0.0:1715330311.607610:0:8267:0:(update_trans.c:1351:distribute_txn_batchid_cb()) lustre-MDT0001: 392 batchid updated 00000001:00080000:0.0:1715330311.607624:0:8267:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968499 is committed 00000020:00080000:0.0:1715330311.607640:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 392 00000004:00080000:0.0:1715330311.607689:0:8285:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88008d667840 with version 753 00000020:00080000:0.0:1715330311.607696:0:8285:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 392 cancel update log [0x200000401:0x3:0x0].393: rc = 0 00000020:00080000:0.0:1715330311.607759:0:8285:0:(update_trans.c:1313:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 392 cancel update log [0x240000400:0x3:0x0].392: rc = 0 00000020:00080000:0.0:1715330311.607766:0:8285:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 392 00000100:00100000:3.0:1715330311.608952:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1715330311.608968:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b4c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942509312:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1715330311.609015:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330311.609047:0:9398:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942509312 00000100:00100000:3.0:1715330311.609052:0:9398:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942509312 00000004:00080000:1.0:1715330311.609256:0:8278:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff880071a5c300 version 753 rpc_version 753 00000020:00100000:1.0:1715330311.609281:0:8278:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1715330311.609287:0:8278:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88008d48d180 x1798653942509504/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1715330311.609302:0:8278:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48d180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942509504:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1715330311.609447:0:8278:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330311.609460:0:8278:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009396ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1715330311.609473:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942509504 00000100:00100000:1.0:1715330311.609476:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942509504 00000100:00100000:1.0:1715330311.609498:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3043 00000100:00100000:1.0:1715330311.609503:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:8278:x1798653942509504:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1715330311.609609:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:8278:x1798653942509504:12345-0@lo:1000:osp_up0-1.0 Request processed in 105us (280us total) trans 4294983564 rc 0/0 00000100:00100000:1.0:1715330311.609615:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3043 00000100:00100000:1.0:1715330311.609872:0:8278:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48d180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8278:1798653942509504:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1715330311.609935:0:9398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5234 00000100:00100000:3.0:1715330311.609940:0:9398:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+8:3688:x1798653942509312:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1715330311.609958:0:9398:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2508 count 1 00010000:00010000:3.0:1715330311.609982:0:9398:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f48d680/0xd895711d66d9f21 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330311.610002:0:9398:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011db66640/0xd895711d66d9cd5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb32 expref: 7 pid: 9633 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1715330311.610010:0:9398:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330311.610012:0:9398:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330311.610015:0:9398:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f48d680/0xd895711d66d9f21 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330311.610037:0:9398:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011db66640/0xd895711d66d9cd5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb32 expref: 7 pid: 9633 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1715330311.610054:0:9398:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011db66640/0xd895711d66d9cd5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb32 expref: 7 pid: 9633 timeout: 386 lvb_type: 1 00000100:00100000:3.0:1715330311.610064:0:9398:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b4c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9398:1798653942509568:192.168.204.49@tcp:104: 00000100:00100000:3.0:1715330311.610117:0:9398:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091f74300 going to sleep for 11 seconds 00000100:00100000:3.0:1715330311.610958:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1715330311.610970:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b4c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942509376:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1715330311.610997:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330311.611016:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942509376 00000100:00100000:3.0:1715330311.611020:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942509376 00000100:00100000:3.0:1715330311.611045:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5235 00000100:00100000:3.0:1715330311.611049:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+9:3691:x1798653942509376:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1715330311.611061:0:9633:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2509 count 1 00010000:00010000:3.0:1715330311.611073:0:9633:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f48df80/0xd895711d66d9f28 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330311.611097:0:9633:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f48c480/0xd895711d66d9c57 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb08 expref: 7 pid: 17206 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1715330311.611104:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330311.611106:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330311.611108:0:9633:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f48df80/0xd895711d66d9f28 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330311.611122:0:9633:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f48c480/0xd895711d66d9c57 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb08 expref: 7 pid: 17206 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1715330311.611134:0:9633:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f48c480/0xd895711d66d9c57 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb08 expref: 7 pid: 17206 timeout: 386 lvb_type: 1 00000100:00100000:3.0:1715330311.611142:0:9633:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b4c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9633:1798653942509632:192.168.204.49@tcp:104: 00000100:00100000:3.0:1715330311.611162:0:9633:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091f749c0 going to sleep for 11 seconds 00000001:00080000:0.0:1715330311.613597:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983564 is committed 00000001:00080000:0.0:1715330311.613618:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983563 is committed 00010000:00010000:3.0:1715330311.614141:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66d9f13 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9d986a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330311.614154:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66d9f13 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9d986a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330311.614161:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66d9f13 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9d986a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330311.614166:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a1d40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330311.614170:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66d9f13 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9d986a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330311.614176:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66d9f13 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9d986a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330311.614196:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9d986a8e (ffff88009d678600) 00010000:00010000:3.0:1715330311.614199:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330311.614202:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66d9f13 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9d986a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330311.614207:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66d9f13 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9d986a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330311.614227:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3840/0xd895711d66d9f1a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330311.614233:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3840/0xd895711d66d9f1a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330311.614238:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3840/0xd895711d66d9f1a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330311.614241:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a3840 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330311.614244:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3840/0xd895711d66d9f1a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330311.614248:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3840/0xd895711d66d9f1a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330311.614253:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d678a00) 00010000:00010000:3.0:1715330311.614255:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330311.614257:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3840/0xd895711d66d9f1a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330311.614261:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3840/0xd895711d66d9f1a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00000100:00100000:0.0:1715330311.615612:0:9398:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b4c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9398:1798653942509568:192.168.204.49@tcp:104: 00010000:00010000:0.0:1715330311.615641:0:9398:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012f48d680/0xd895711d66d9f21 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330311.618026:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330311.618131:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938072640 00000100:00100000:0.0:1715330311.618139:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938072640 00010000:00010000:0.0:1715330311.618180:0:10674:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011db66640/0xd895711d66d9cd5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb32 expref: 8 pid: 9633 timeout: 386 lvb_type: 1 00000100:00100000:0.0:1715330311.618206:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1585 00000100:00100000:0.0:1715330311.618214:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:72de1896-1df4-4b3a-930a-9116d2c66168+8:2012:x1798653938072640:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1715330311.618227:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330311.618231:0:10674:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011db66640/0xd895711d66d9cd5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb32 expref: 8 pid: 9633 timeout: 386 lvb_type: 1 00010000:00010000:0.0:1715330311.618242:0:10674:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011db66640/0xd895711d66d9cd5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb32 expref: 8 pid: 9633 timeout: 386 lvb_type: 1 00010000:00010000:0.0:1715330311.618269:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011db66640/0xd895711d66d9cd5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb32 expref: 8 pid: 9633 timeout: 386 lvb_type: 1 00010000:00010000:0.0:1715330311.618286:0:10674:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330311.618288:0:10674:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330311.618292:0:10674:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f48d680/0xd895711d66d9f21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330311.618301:0:10674:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f48d680/0xd895711d66d9f21 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330311.618326:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330311.618368:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:72de1896-1df4-4b3a-930a-9116d2c66168+7:2012:x1798653938072640:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 155us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330311.618375:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1585 00010000:00010000:0.0:1715330311.618400:0:9398:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012f48d680/0xd895711d66d9f21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330311.618407:0:9398:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f48d680/0xd895711d66d9f21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330311.618415:0:9398:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f48d680/0xd895711d66d9f21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330311.618422:0:9398:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012f48d680/0xd895711d66d9f21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330311.618429:0:9398:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012f48d680/0xd895711d66d9f21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330311.618434:0:9398:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48d680 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330311.618438:0:9398:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f48d680/0xd895711d66d9f21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330311.618446:0:9398:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f48d680/0xd895711d66d9f21 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330311.618463:0:9398:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012f48d680/0xd895711d66d9f21 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330311.618468:0:9398:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f48d680/0xd895711d66d9f21 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330311.618763:0:9398:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+10:3688:x1798653942509312:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8821us (9747us total) trans 4294969897 rc 0/0 00000100:00100000:0.0:1715330311.618770:0:9398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5234 00000100:00080000:1.0:1715330311.618941:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330281 00000100:00100000:0.0:1715330311.619380:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330311.619394:0:10673:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938072704 00000100:00100000:0.0:1715330311.619398:0:10673:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938072704 00010000:00010000:0.0:1715330311.619410:0:10673:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f48c480/0xd895711d66d9c57 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb08 expref: 7 pid: 17206 timeout: 386 lvb_type: 1 00000100:00100000:0.0:1715330311.619425:0:10673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1586 00000100:00100000:0.0:1715330311.619429:0:10673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091cca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:72de1896-1df4-4b3a-930a-9116d2c66168+7:2011:x1798653938072704:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1715330311.619436:0:10673:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330311.619440:0:10673:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f48c480/0xd895711d66d9c57 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb08 expref: 7 pid: 17206 timeout: 386 lvb_type: 1 00010000:00010000:0.0:1715330311.619448:0:10673:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f48c480/0xd895711d66d9c57 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb08 expref: 7 pid: 17206 timeout: 386 lvb_type: 1 00010000:00010000:0.0:1715330311.619460:0:10673:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330311.619462:0:10673:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330311.619464:0:10673:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f48df80/0xd895711d66d9f28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330311.619470:0:10673:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f48df80/0xd895711d66d9f28 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330311.619479:0:10673:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330311.619496:0:10673:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091cca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:72de1896-1df4-4b3a-930a-9116d2c66168+7:2011:x1798653938072704:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 66us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330311.619501:0:10673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1586 00010000:00010000:0.0:1715330311.619535:0:9633:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f48c480/0xd895711d66d9c57 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb08 expref: 6 pid: 17206 timeout: 386 lvb_type: 1 00000100:00100000:0.0:1715330311.619544:0:9633:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b4c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9633:1798653942509632:192.168.204.49@tcp:104: 00010000:00010000:0.0:1715330311.619560:0:9633:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012f48df80/0xd895711d66d9f28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330311.619567:0:9633:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012f48df80/0xd895711d66d9f28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330311.619573:0:9633:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f48df80/0xd895711d66d9f28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330311.619579:0:9633:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f48df80/0xd895711d66d9f28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330311.619585:0:9633:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012f48df80/0xd895711d66d9f28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330311.619591:0:9633:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012f48df80/0xd895711d66d9f28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330311.619596:0:9633:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48df80 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330311.619599:0:9633:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f48df80/0xd895711d66d9f28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330311.619604:0:9633:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f48df80/0xd895711d66d9f28 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330311.619612:0:9633:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012f48df80/0xd895711d66d9f28 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330311.619618:0:9633:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f48df80/0xd895711d66d9f28 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330311.619766:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+10:3691:x1798653942509376:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8716us (8768us total) trans 4294969898 rc 0/0 00000100:00100000:0.0:1715330311.619773:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5235 00000004:00080000:0.0:1715330311.619804:0:3691:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009b4c3100/2, rc 0, transno 2602 00000100:00100000:0.0:1715330311.619809:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b4c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942509376:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1715330311.619857:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1715330311.619869:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942509696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1715330311.619899:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330311.619934:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942509696 00000100:00100000:0.0:1715330311.619938:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942509696 00000100:00100000:0.0:1715330311.619963:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1715330311.619967:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942509696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1715330311.619984:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 67509696 pending 0 free 3923537920 avail 3692015616 00000100:00100000:0.0:1715330311.620007:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942509696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330311.620011:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1715330311.620124:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942509696:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1715330311.620180:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009b4c3800/2, rc 0, transno 2601 00000100:00100000:0.0:1715330311.620183:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b4c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942509312:0@lo:6:osp-syn-1-1.0 00000001:00080000:3.0:1715330311.623708:0:10666:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4294969898 is committed 00000020:00000080:3.0:1715330312.005133:0:28850:0:(class_obd.c:334:class_handle_ioctl()) obdclass: cmd=424066b1 len=0 uarg=00007ffec0181500 00000004:00000080:3.0:1715330312.005155:0:28850:0:(mdt_handler.c:7835:mdt_iocontrol()) lustre-MDT0001: cmd=424066b1 len=576 karg=ffff88009ba70800 uarg=0000000000000000 00000004:00000080:3.0:1715330312.005200:0:28850:0:(mdd_device.c:2268:mdd_iocontrol()) lustre-MDD0001: cmd=424066b1 len=576 karg=ffff88009ba70800 00000040:00080000:3.0:1715330312.007591:0:28850:0:(llog_osd.c:233:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1715330312.007799:0:28850:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1715330312.007889:0:28850:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 80 off8272 00000004:00000080:3.0:1715330312.007907:0:28850:0:(mdd_device.c:1836:mdd_changelog_user_register()) lustre-MDD0001: registered changelog user 'cl1', mask 0x0 00000004:02000000:3.0:1715330312.007911:0:28850:0:(mdd_device.c:486:mdd_changelog_on()) lustre-MDD0001: changelog on 00010000:00010000:2.0:1715330312.215485:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1715330312.244364:0:9395:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0000: transno 4294969897 is committed 00000100:00100000:0.0:1715330312.774806:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330312.775667:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938072768 00000100:00100000:2.0:1715330312.775677:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938072768 00000100:00080000:1.0:1715330312.775761:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330282 00000100:00100000:2.0:1715330312.775773:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23596 00000100:00100000:2.0:1715330312.775781:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+9:18875:x1798653938072768:12345-192.168.204.49@tcp:46:lfs.0 00000004:00000080:2.0:1715330312.775825:0:11283:0:(mdt_handler.c:7835:mdt_iocontrol()) lustre-MDT0000: cmd=424066b3 len=12 karg=ffff880072de57c0 uarg=0000000000000000 00000004:00000080:2.0:1715330312.775874:0:11283:0:(mdd_device.c:2268:mdd_iocontrol()) lustre-MDD0000: cmd=424066b3 len=12 karg=ffff880072de57c0 00000004:00000080:2.0:1715330312.775879:0:11283:0:(mdd_device.c:2138:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=1, endrec=0 00000040:00080000:2.0:1715330312.775916:0:11283:0:(llog.c:735:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1715330312.775920:0:11283:0:(llog_cat.c:796:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:2.0:1715330312.775937:0:11283:0:(mdd_device.c:2110:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl1 endrec = 0 00000040:00080000:2.0:1715330312.775988:0:11283:0:(llog.c:792:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 2 00000040:00080000:2.0:1715330312.775995:0:11283:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:2.0:1715330312.775999:0:11283:0:(mdd_device.c:2187:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl1 entries up to 18446744073709551615 00000040:00080000:2.0:1715330312.776966:0:11283:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:2.0:1715330312.777073:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+9:18875:x1798653938072768:12345-192.168.204.49@tcp:46:lfs.0 Request processed in 1282us (2269us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330312.777082:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23596 00000100:00100000:0.0:1715330312.798827:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330312.798910:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938072832 00000100:00100000:3.0:1715330312.798920:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938072832 00000100:00100000:3.0:1715330312.798986:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23597 00000100:00100000:3.0:1715330312.798993:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091cc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+6:18877:x1798653938072832:12345-192.168.204.49@tcp:46:lfs.0 00000004:00000080:3.0:1715330312.799035:0:11283:0:(mdt_handler.c:7835:mdt_iocontrol()) lustre-MDT0001: cmd=424066b3 len=12 karg=ffff880072de59a0 uarg=0000000000000000 00000004:00000080:3.0:1715330312.799084:0:11283:0:(mdd_device.c:2268:mdd_iocontrol()) lustre-MDD0001: cmd=424066b3 len=12 karg=ffff880072de59a0 00000004:00000080:3.0:1715330312.799091:0:11283:0:(mdd_device.c:2138:mdd_changelog_clear()) lustre-MDD0001: Purge request: id=1, endrec=0 00000040:00080000:3.0:1715330312.799125:0:11283:0:(llog.c:735:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1715330312.799129:0:11283:0:(llog_cat.c:796:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:3.0:1715330312.799147:0:11283:0:(mdd_device.c:2110:mdd_changelog_clear_cb()) lustre-MDD0001: update changelog user cl1 endrec = 0 00000040:00080000:3.0:1715330312.799190:0:11283:0:(llog.c:792:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1715330312.799198:0:11283:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:3.0:1715330312.799202:0:11283:0:(mdd_device.c:2187:mdd_changelog_clear()) lustre-MDD0001: purge changelog user cl1 entries up to 18446744073709551615 00000040:00080000:3.0:1715330312.799549:0:11283:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:3.0:1715330312.799624:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091cc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+6:18877:x1798653938072832:12345-192.168.204.49@tcp:46:lfs.0 Request processed in 631us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330312.799631:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23597 00000100:00080000:0.0:1715330312.799692:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330282 00000100:00100000:0.0:1715330312.814631:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330312.817459:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938072896 00000100:00100000:2.0:1715330312.817475:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938072896 00000100:00100000:2.0:1715330312.817542:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23598 00000100:00100000:2.0:1715330312.817550:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+9:18878:x1798653938072896:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:2.0:1715330312.817570:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330312.817593:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db661c0/0xd895711d66d9f2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbb5c expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330312.817654:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d9f36 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330312.817667:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d9f36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330312.817680:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d9f36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00200000:2.0:1715330312.817726:0:7133:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 270336 00000004:00200000:2.0:1715330312.817743:0:7133:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1715330312.817762:0:7133:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d9f36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330312.817781:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db661c0/0xd895711d66d9f2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb5c expref: 11 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330312.817799:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d9f36 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb5c expref: 10 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330312.817806:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:2.0:1715330312.817809:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1715330312.817811:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db66640, rc 0) 00000100:00100000:2.0:1715330312.817885:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+10:18878:x1798653938072896:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 335us (3264us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330312.817891:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23598 00000100:00100000:1.0:1715330312.828238:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330312.828528:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938072960 00000100:00100000:2.0:1715330312.828537:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938072960 00000100:00100000:2.0:1715330312.828778:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23599 00000100:00100000:2.0:1715330312.828786:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+10:18878:x1798653938072960:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:2.0:1715330312.828806:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330312.828828:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d9f3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbb63 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330312.828889:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d9f44 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.828903:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d9f44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.828914:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d9f44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.828926:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d9f4b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9d986a8e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.828935:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d9f4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9d986a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.828939:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d9f4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9d986a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.829006:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d9f52 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.829013:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d9f52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x152a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.829018:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d9f52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x152a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00200000:2.0:1715330312.829051:0:11283:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x152a:0x0]: returning size 4096 00000004:00200000:2.0:1715330312.829054:0:11283:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1715330312.829082:0:11283:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d9f52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x152a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.829094:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d9f44 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.829099:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d9f44 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.829104:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d9f44 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.829108:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d9f44 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.829114:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db67a80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330312.829118:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d9f44 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.829125:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d9f44 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.829135:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:2.0:1715330312.829138:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330312.829142:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d9f44 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.829146:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66d9f44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.829156:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d9f4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9d986a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.829160:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d9f4b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9d986a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.829164:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d9f4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9d986a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.829168:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66400 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330312.829170:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d9f4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9d986a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.829175:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d9f4b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9d986a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.829180:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9d986a8e (ffff88009d618600) 00010000:00010000:2.0:1715330312.829181:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330312.829183:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d9f4b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9d986a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.829186:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66d9f4b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9d986a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.829210:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66d9f3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb63 expref: 12 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330312.829221:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d9f52 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x152a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb63 expref: 11 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330312.829227:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330312.829229:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1715330312.829231:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db67840, rc 0) 00000100:00100000:2.0:1715330312.829282:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+11:18878:x1798653938072960:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 497us (1054us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330312.829290:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23599 00000100:00100000:1.0:1715330312.837232:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330312.837353:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938073088 00000100:00100000:3.0:1715330312.837364:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938073088 00000100:00100000:3.0:1715330312.837420:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23600 00000100:00100000:3.0:1715330312.837428:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+11:18878:x1798653938073088:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:3.0:1715330312.837450:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330312.837472:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48df80/0xd895711d66d9f59 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbb6a expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330312.837585:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c480/0xd895711d66d9f60 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.837599:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c480/0xd895711d66d9f60 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.837611:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c480/0xd895711d66d9f60 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.837628:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d680/0xd895711d66d9f67 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca986ad0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.837633:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d680/0xd895711d66d9f67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.837638:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d680/0xd895711d66d9f67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:3.0:1715330312.838008:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9ce:0x0], index 0: 0 00000040:00080000:3.0:1715330312.838143:0:7133:0:(llog_osd.c:233:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1715330312.838261:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1715330312.838326:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 184 off8376 00000004:00080000:3.0:1715330312.838332:0:7133:0:(mdd_dir.c:894:mdd_changelog_is_space_safe()) lustre-MDD0000: estimated changelog size is 21MB, space limit is 344MB 00010000:00010000:3.0:1715330312.838399:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e1c0/0xd895711d66d9f6e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x152b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.838406:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e1c0/0xd895711d66d9f6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x152b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.838411:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e1c0/0xd895711d66d9f6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x152b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330312.838448:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 176 off8552 00000001:00080000:3.0:1715330312.838452:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983565 00010000:00010000:3.0:1715330312.838474:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c480/0xd895711d66d9f60 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.838480:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c480/0xd895711d66d9f60 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.838489:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c480/0xd895711d66d9f60 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.838494:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c480/0xd895711d66d9f60 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.838499:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48c480 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330312.838501:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c480/0xd895711d66d9f60 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.838507:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c480/0xd895711d66d9f60 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.838516:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330312.838519:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330312.838523:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c480/0xd895711d66d9f60 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.838527:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c480/0xd895711d66d9f60 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330312.838537:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008d48d500 reply state ffff8800938e6000 transno 4294983566 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d680/0xd895711d66d9f67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.838543:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d680/0xd895711d66d9f67 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.838547:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca986ad0 (ffff880093b42700) 00010000:00010000:3.0:1715330312.838549:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330312.838551:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330312.838572:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48df80/0xd895711d66d9f59 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb6a expref: 15 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330312.838588:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e1c0/0xd895711d66d9f6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x152b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb6a expref: 14 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330312.838595:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152b:0x0].0x0 (ffff880093b42e00) 00010000:00010000:3.0:1715330312.838597:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330312.838599:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f48e1c0, rc 0) 00000100:00100000:3.0:1715330312.838667:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+15:18878:x1798653938073088:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 1239us (1446us total) trans 4294983566 rc 0/0 00000100:00100000:3.0:1715330312.838675:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23600 00000020:00080000:3.0:1715330312.838681:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330312.843905:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330312.843943:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938073216 00000100:00100000:0.0:1715330312.843952:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938073216 00000100:00100000:0.0:1715330312.844000:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5107 00000100:00100000:0.0:1715330312.844009:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+15:18878:x1798653938073216:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:0.0:1715330312.844289:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].3, 168 off8720 00000001:00080000:0.0:1715330312.844295:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983567 00000100:00100000:0.0:1715330312.844376:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:18878:x1798653938073216:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 368us (484us total) trans 4294983568 rc 0/0 00000100:00100000:0.0:1715330312.844383:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5107 00000020:00080000:0.0:1715330312.844388:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330312.851827:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330312.851902:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938073344 00000100:00100000:3.0:1715330312.851912:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938073344 00000100:00100000:3.0:1715330312.851958:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23601 00000100:00100000:3.0:1715330312.851964:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+17:18878:x1798653938073344:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:3.0:1715330312.851988:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330312.852008:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c6c0/0xd895711d66d9f7c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbb71 expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330312.852123:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d200/0xd895711d66d9f83 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.852136:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d200/0xd895711d66d9f83 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.852148:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d200/0xd895711d66d9f83 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.852160:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f180/0xd895711d66d9f8a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca986ad1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.852166:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f180/0xd895711d66d9f8a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.852171:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f180/0xd895711d66d9f8a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:3.0:1715330312.852441:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9ce:0x0], index 1: 0 00000040:00080000:3.0:1715330312.852511:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].4, 184 off8904 00010000:00010000:3.0:1715330312.852566:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e640/0xd895711d66d9f91 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x152c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.852573:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e640/0xd895711d66d9f91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x152c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.852579:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e640/0xd895711d66d9f91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x152c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330312.852616:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].5, 176 off9080 00000001:00080000:3.0:1715330312.852620:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983569 00010000:00010000:3.0:1715330312.852643:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d200/0xd895711d66d9f83 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.852649:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d200/0xd895711d66d9f83 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.852655:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d200/0xd895711d66d9f83 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.852660:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d200/0xd895711d66d9f83 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.852665:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48d200 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330312.852667:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d200/0xd895711d66d9f83 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.852674:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d200/0xd895711d66d9f83 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.852683:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330312.852685:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330312.852689:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d200/0xd895711d66d9f83 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.852693:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d200/0xd895711d66d9f83 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330312.852704:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008b0c0e00 reply state ffff8800938e5000 transno 4294983570 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f180/0xd895711d66d9f8a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.852711:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f180/0xd895711d66d9f8a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.852716:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca986ad1 (ffff880093b42200) 00010000:00010000:3.0:1715330312.852718:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330312.852720:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330312.852764:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c6c0/0xd895711d66d9f7c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb71 expref: 21 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330312.852775:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e640/0xd895711d66d9f91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x152c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb71 expref: 20 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330312.852782:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152c:0x0].0x0 (ffff880093b42300) 00010000:00010000:3.0:1715330312.852784:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330312.852785:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f48e640, rc 0) 00000100:00100000:3.0:1715330312.852833:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+21:18878:x1798653938073344:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 868us (1013us total) trans 4294983570 rc 0/0 00000100:00100000:3.0:1715330312.852842:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23601 00000020:00080000:3.0:1715330312.852847:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1715330312.863011:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330312.863198:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938073472 00000100:00100000:0.0:1715330312.863208:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938073472 00000100:00100000:0.0:1715330312.863258:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5108 00000100:00100000:0.0:1715330312.863265:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+21:18878:x1798653938073472:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:0.0:1715330312.863515:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].6, 168 off9248 00000001:00080000:0.0:1715330312.863521:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983571 00000100:00100000:0.0:1715330312.863605:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+23:18878:x1798653938073472:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 340us (603us total) trans 4294983572 rc 0/0 00000100:00100000:0.0:1715330312.863614:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5108 00000020:00080000:0.0:1715330312.863619:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330312.869315:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330312.871444:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938073600 00000100:00100000:2.0:1715330312.871456:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938073600 00000100:00100000:2.0:1715330312.871969:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23602 00000100:00100000:2.0:1715330312.871978:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+23:18878:x1798653938073600:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:2.0:1715330312.872001:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330312.872023:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d9f9f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbb78 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330312.872151:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d9fa6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.872168:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d9fa6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.872179:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d9fa6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.872195:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9fad lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca986ad2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.872200:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9fad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.872205:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9fad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00080000:2.0:1715330312.873384:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9cf:0x0], index 0: 0 00000040:00080000:2.0:1715330312.873471:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].7, 184 off9432 00010000:00010000:2.0:1715330312.873533:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d9fb4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x152d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.873541:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d9fb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x152d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.873547:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d9fb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x152d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:2.0:1715330312.873582:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].8, 176 off9608 00000001:00080000:2.0:1715330312.873586:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983573 00010000:00010000:2.0:1715330312.873608:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d9fa6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.873613:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d9fa6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.873618:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d9fa6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.873623:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d9fa6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.873631:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64b40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330312.873634:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d9fa6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.873640:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d9fa6 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.873648:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330312.873650:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330312.873654:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d9fa6 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.873658:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66d9fa6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:2.0:1715330312.873667:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008b0c1500 reply state ffff88009382b000 transno 4294983574 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9fad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.873674:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9fad lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.873679:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca986ad2 (ffff88009d618900) 00010000:00010000:2.0:1715330312.873681:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330312.873683:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1715330312.873704:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66d9f9f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb78 expref: 27 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330312.873714:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d9fb4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x152d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb78 expref: 26 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330312.873719:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152d:0x0].0x0 (ffff88009d618d00) 00010000:00010000:2.0:1715330312.873722:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330312.873723:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db64000, rc 0) 00000100:00100000:2.0:1715330312.873808:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+27:18878:x1798653938073600:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 1830us (4503us total) trans 4294983574 rc 0/0 00000100:00100000:2.0:1715330312.873816:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23602 00000020:00080000:2.0:1715330312.873822:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330312.881828:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330312.883539:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938073728 00000100:00100000:1.0:1715330312.883551:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938073728 00000100:00100000:1.0:1715330312.883610:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5109 00000100:00100000:1.0:1715330312.883616:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d776d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+27:18878:x1798653938073728:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:1.0:1715330312.883899:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].9, 168 off9776 00000001:00080000:1.0:1715330312.883905:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983575 00000100:00100000:1.0:1715330312.883993:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d776d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+29:18878:x1798653938073728:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 375us (2176us total) trans 4294983576 rc 0/0 00000100:00100000:1.0:1715330312.884000:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5109 00000020:00080000:1.0:1715330312.884005:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1715330312.890698:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330312.893135:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938073856 00000100:00100000:2.0:1715330312.893150:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938073856 00000100:00100000:2.0:1715330312.893231:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23603 00000100:00100000:2.0:1715330312.893240:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+29:18878:x1798653938073856:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:2.0:1715330312.893272:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330312.893296:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d9fc2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbb7f expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330312.893407:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db646c0/0xd895711d66d9fc9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.893422:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db646c0/0xd895711d66d9fc9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.893432:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db646c0/0xd895711d66d9fc9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.893444:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d9fd0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca986ad3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.893449:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d9fd0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.893455:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d9fd0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00080000:2.0:1715330312.893785:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9cf:0x0], index 1: 0 00000040:00080000:2.0:1715330312.893865:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].10, 184 off9960 00010000:00010000:2.0:1715330312.893933:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9fd7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x152e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.893940:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9fd7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x152e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.893946:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9fd7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x152e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:2.0:1715330312.893992:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].11, 176 off10136 00000001:00080000:2.0:1715330312.893996:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983577 00010000:00010000:2.0:1715330312.894023:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db646c0/0xd895711d66d9fc9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.894029:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db646c0/0xd895711d66d9fc9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.894035:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db646c0/0xd895711d66d9fc9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.894041:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db646c0/0xd895711d66d9fc9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.894046:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db646c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330312.894049:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db646c0/0xd895711d66d9fc9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.894056:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db646c0/0xd895711d66d9fc9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.894080:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330312.894084:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330312.894088:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db646c0/0xd895711d66d9fc9 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.894093:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db646c0/0xd895711d66d9fc9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:2.0:1715330312.894129:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008d48f100 reply state ffff88009382e000 transno 4294983578 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d9fd0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.894137:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d9fd0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.894142:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca986ad3 (ffff88009d618100) 00010000:00010000:2.0:1715330312.894144:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330312.894147:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1715330312.894170:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66d9fc2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb7f expref: 33 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330312.894420:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9fd7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x152e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb7f expref: 32 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330312.894428:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152e:0x0].0x0 (ffff88009d618c00) 00010000:00010000:2.0:1715330312.894430:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330312.894433:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db66ac0, rc 0) 00000100:00100000:2.0:1715330312.894556:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+33:18878:x1798653938073856:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 1315us (3869us total) trans 4294983578 rc 0/0 00000100:00100000:2.0:1715330312.894565:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23603 00000020:00080000:2.0:1715330312.894572:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330312.899629:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330312.899672:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938073984 00000100:00100000:0.0:1715330312.899682:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938073984 00000100:00100000:0.0:1715330312.899748:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5110 00000100:00100000:0.0:1715330312.899757:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fbeec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+33:18878:x1798653938073984:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:0.0:1715330312.900044:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].12, 168 off10304 00000001:00080000:0.0:1715330312.900051:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983579 00000100:00100000:0.0:1715330312.900157:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fbeec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+35:18878:x1798653938073984:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 400us (540us total) trans 4294983580 rc 0/0 00000100:00100000:0.0:1715330312.900166:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5110 00000020:00080000:0.0:1715330312.900172:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330312.908716:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330312.909701:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938074112 00000100:00100000:2.0:1715330312.909712:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938074112 00000100:00100000:2.0:1715330312.909797:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23604 00000100:00100000:2.0:1715330312.909805:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d776d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+35:18878:x1798653938074112:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:2.0:1715330312.909832:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330312.909853:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d9fe5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbb86 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330312.909954:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d9fec lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.909967:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d9fec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.909977:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d9fec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.909988:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d9ff3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca986ad4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.909993:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d9ff3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.909997:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d9ff3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00080000:2.0:1715330312.910284:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d0:0x0], index 0: 0 00000040:00080000:2.0:1715330312.910361:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].13, 184 off10488 00010000:00010000:2.0:1715330312.910422:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d9ffa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x152f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.910430:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d9ffa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x152f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.910435:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d9ffa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x152f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:2.0:1715330312.910476:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].14, 176 off10664 00000001:00080000:2.0:1715330312.910480:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983581 00010000:00010000:2.0:1715330312.910505:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d9fec lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.910511:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d9fec lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.910516:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d9fec lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.910521:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d9fec lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.910527:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db65d40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330312.910530:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d9fec lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.910536:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d9fec lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.910546:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330312.910549:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330312.910553:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d9fec lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.910558:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66d9fec lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:2.0:1715330312.911355:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008d776d80 reply state ffff88009382d000 transno 4294983582 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d9ff3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.911367:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d9ff3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.911373:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca986ad4 (ffff88009d618e00) 00010000:00010000:2.0:1715330312.911375:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330312.911378:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1715330312.911407:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66d9fe5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb86 expref: 39 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330312.911422:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d9ffa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x152f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb86 expref: 38 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330312.911427:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152f:0x0].0x0 (ffff88009d618f00) 00010000:00010000:2.0:1715330312.911429:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330312.911431:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db65200, rc 0) 00000100:00100000:2.0:1715330312.912526:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d776d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+39:18878:x1798653938074112:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 2716us (3816us total) trans 4294983582 rc 0/0 00000100:00100000:2.0:1715330312.912536:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23604 00000020:00080000:2.0:1715330312.912544:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1715330312.922771:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330312.924206:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938074240 00000100:00100000:2.0:1715330312.924221:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938074240 00000100:00100000:2.0:1715330312.924286:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5111 00000100:00100000:2.0:1715330312.924293:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+39:18878:x1798653938074240:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:2.0:1715330312.924530:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].15, 168 off10832 00000001:00080000:2.0:1715330312.924535:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983583 00000100:00100000:2.0:1715330312.924639:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+41:18878:x1798653938074240:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 345us (1923us total) trans 4294983584 rc 0/0 00000100:00100000:2.0:1715330312.924646:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5111 00000020:00080000:2.0:1715330312.924651:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330312.928115:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330312.928481:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938074368 00000100:00100000:2.0:1715330312.928491:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938074368 00000100:00100000:2.0:1715330312.928550:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23605 00000100:00100000:2.0:1715330312.928556:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+41:18878:x1798653938074368:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:2.0:1715330312.928583:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330312.928606:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66da008 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbb8d expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330312.928710:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66da00f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.928723:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66da00f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.928770:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66da00f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.928785:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66da016 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca986ad5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.928790:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66da016 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.928795:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66da016 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00080000:2.0:1715330312.931386:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d0:0x0], index 1: 0 00000040:00080000:2.0:1715330312.931528:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].16, 184 off11016 00010000:00010000:2.0:1715330312.931639:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66da01d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1530:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.931656:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66da01d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1530:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.931667:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66da01d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1530:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:2.0:1715330312.931757:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].17, 176 off11192 00000001:00080000:2.0:1715330312.931886:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983585 00010000:00010000:2.0:1715330312.931924:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66da00f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.931931:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66da00f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.931936:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66da00f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.931941:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66da00f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.931947:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66f40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330312.931950:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66da00f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.931956:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66da00f lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.931968:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330312.931971:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330312.931975:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66da00f lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.931980:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66da00f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:2.0:1715330312.931996:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012b55f100 reply state ffff8800939e6000 transno 4294983586 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66da016 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.932003:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66da016 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.932009:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca986ad5 (ffff88009d618700) 00010000:00010000:2.0:1715330312.932011:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330312.932014:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1715330312.932053:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66da008 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb8d expref: 45 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330312.932076:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66da01d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1530:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb8d expref: 44 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330312.932082:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1530:0x0].0x0 (ffff88009d618200) 00010000:00010000:2.0:1715330312.932084:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330312.932086:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db64fc0, rc 0) 00000100:00100000:2.0:1715330312.932163:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+45:18878:x1798653938074368:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 3604us (4059us total) trans 4294983586 rc 0/0 00000100:00100000:2.0:1715330312.932172:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23605 00000020:00080000:2.0:1715330312.932179:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330312.937051:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330312.937189:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938074496 00000100:00100000:2.0:1715330312.937198:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938074496 00000100:00100000:2.0:1715330312.938050:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5112 00000100:00100000:2.0:1715330312.938058:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+45:18878:x1798653938074496:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:2.0:1715330312.938323:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].18, 168 off11360 00000001:00080000:2.0:1715330312.938329:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983587 00000100:00100000:2.0:1715330312.938447:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+47:18878:x1798653938074496:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 388us (1406us total) trans 4294983588 rc 0/0 00000100:00100000:2.0:1715330312.938454:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5112 00000020:00080000:2.0:1715330312.938460:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330312.944140:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330312.944475:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938074624 00000100:00100000:2.0:1715330312.944487:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938074624 00000100:00100000:2.0:1715330312.944541:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23606 00000100:00100000:2.0:1715330312.944548:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+47:18878:x1798653938074624:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:2.0:1715330312.944577:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330312.944601:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66da02b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbb94 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330312.944707:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66da032 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.944719:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66da032 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.944757:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66da032 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.944771:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66da039 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca986ad6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.944776:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66da039 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.944781:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66da039 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00080000:2.0:1715330312.946492:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d1:0x0], index 0: 0 00000040:00080000:2.0:1715330312.946572:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].19, 184 off11544 00010000:00010000:2.0:1715330312.946655:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66da040 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1531:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.946668:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66da040 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1531:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.946677:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66da040 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1531:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:2.0:1715330312.946727:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].20, 176 off11720 00000001:00080000:2.0:1715330312.946750:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983589 00010000:00010000:2.0:1715330312.946784:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66da032 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.946789:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66da032 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.946794:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66da032 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.946799:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66da032 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.946804:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db65440 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330312.946808:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66da032 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.946814:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66da032 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.946825:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330312.946827:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330312.946832:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66da032 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.946836:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66da032 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:2.0:1715330312.946874:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880091cc9c00 reply state ffff88011db73000 transno 4294983590 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66da039 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.946881:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66da039 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330312.946887:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca986ad6 (ffff88009d618000) 00010000:00010000:2.0:1715330312.946888:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330312.946891:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1715330312.946924:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66da02b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb94 expref: 51 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330312.946936:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66da040 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1531:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb94 expref: 50 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330312.946942:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1531:0x0].0x0 (ffff88009d618300) 00010000:00010000:2.0:1715330312.946944:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330312.946946:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db66f40, rc 0) 00000100:00100000:2.0:1715330312.948038:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+51:18878:x1798653938074624:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 3485us (3904us total) trans 4294983590 rc 0/0 00000100:00100000:2.0:1715330312.948048:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23606 00000020:00080000:2.0:1715330312.948129:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1715330312.953411:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330312.953514:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938074752 00000100:00100000:2.0:1715330312.953525:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938074752 00000100:00100000:2.0:1715330312.953593:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5113 00000100:00100000:2.0:1715330312.953601:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+51:18878:x1798653938074752:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:2.0:1715330312.953898:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].21, 168 off11888 00000001:00080000:2.0:1715330312.953905:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983591 00000100:00100000:2.0:1715330312.953999:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+53:18878:x1798653938074752:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 398us (602us total) trans 4294983592 rc 0/0 00000100:00100000:2.0:1715330312.954007:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5113 00000020:00080000:2.0:1715330312.954013:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330312.963701:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330312.963909:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938074880 00000100:00100000:2.0:1715330312.963921:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938074880 00000100:00100000:3.0:1715330312.965308:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23607 00000100:00100000:3.0:1715330312.965319:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+53:18878:x1798653938074880:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:3.0:1715330312.965350:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330312.965376:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c6c0/0xd895711d66da04e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbb9b expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330312.965488:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d200/0xd895711d66da055 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.965502:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d200/0xd895711d66da055 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.965513:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d200/0xd895711d66da055 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.965526:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48df80/0xd895711d66da05c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca986ad7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.965531:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48df80/0xd895711d66da05c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.965535:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48df80/0xd895711d66da05c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:3.0:1715330312.965972:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d1:0x0], index 1: 0 00000040:00080000:3.0:1715330312.966051:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].22, 184 off12072 00010000:00010000:3.0:1715330312.966128:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c480/0xd895711d66da063 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1532:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.966138:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c480/0xd895711d66da063 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1532:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.966145:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c480/0xd895711d66da063 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1532:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330312.966191:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].23, 176 off12248 00000001:00080000:3.0:1715330312.966195:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983593 00010000:00010000:3.0:1715330312.966223:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d200/0xd895711d66da055 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.966229:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d200/0xd895711d66da055 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.966234:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d200/0xd895711d66da055 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.966239:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d200/0xd895711d66da055 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.966244:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48d200 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330312.966247:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d200/0xd895711d66da055 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.966253:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d200/0xd895711d66da055 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.966263:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330312.966266:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330312.966270:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d200/0xd895711d66da055 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.966275:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d200/0xd895711d66da055 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330312.966303:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880091d57b80 reply state ffff8800938e7000 transno 4294983594 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48df80/0xd895711d66da05c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.966311:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48df80/0xd895711d66da05c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.966316:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca986ad7 (ffff880093b42d00) 00010000:00010000:3.0:1715330312.966318:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330312.966320:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330312.966345:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c6c0/0xd895711d66da04e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb9b expref: 57 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330312.966356:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c480/0xd895711d66da063 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1532:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb9b expref: 56 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330312.966362:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1532:0x0].0x0 (ffff880093b42000) 00010000:00010000:3.0:1715330312.966363:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330312.966365:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f48c480, rc 0) 00000100:00100000:3.0:1715330312.967928:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+57:18878:x1798653938074880:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 2601us (4230us total) trans 4294983594 rc 0/0 00000100:00100000:3.0:1715330312.967939:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23607 00000020:00080000:3.0:1715330312.967948:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1715330312.971611:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330312.971683:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938075008 00000100:00100000:0.0:1715330312.971693:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938075008 00000100:00100000:0.0:1715330312.971779:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5114 00000100:00100000:0.0:1715330312.971787:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+57:18878:x1798653938075008:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:0.0:1715330312.972154:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].24, 168 off12416 00000001:00080000:0.0:1715330312.972162:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983595 00000100:00100000:0.0:1715330312.972271:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+59:18878:x1798653938075008:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 482us (669us total) trans 4294983596 rc 0/0 00000100:00100000:0.0:1715330312.972279:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5114 00000020:00080000:0.0:1715330312.972284:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1715330312.985243:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330312.985346:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938075136 00000100:00100000:3.0:1715330312.985356:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938075136 00000100:00100000:3.0:1715330312.985418:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23608 00000100:00100000:3.0:1715330312.985426:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+59:18878:x1798653938075136:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:3.0:1715330312.985453:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330312.985474:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c240/0xd895711d66da071 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbba2 expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330312.985593:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e880/0xd895711d66da078 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.985608:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e880/0xd895711d66da078 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.985622:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e880/0xd895711d66da078 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.985636:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f3c0/0xd895711d66da07f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca986ad8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.985642:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f3c0/0xd895711d66da07f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.985647:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f3c0/0xd895711d66da07f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:3.0:1715330312.986022:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d2:0x0], index 0: 0 00000040:00080000:3.0:1715330312.986129:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].25, 184 off12600 00010000:00010000:3.0:1715330312.986201:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48dd40/0xd895711d66da086 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1533:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.986208:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48dd40/0xd895711d66da086 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1533:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.986214:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48dd40/0xd895711d66da086 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1533:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330312.986262:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].26, 176 off12776 00000001:00080000:3.0:1715330312.986266:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983597 00010000:00010000:3.0:1715330312.986293:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e880/0xd895711d66da078 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.986303:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e880/0xd895711d66da078 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.986309:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e880/0xd895711d66da078 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.986315:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e880/0xd895711d66da078 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.986321:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48e880 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330312.986325:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e880/0xd895711d66da078 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.986332:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e880/0xd895711d66da078 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.986344:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330312.986347:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330312.986351:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e880/0xd895711d66da078 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.986356:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e880/0xd895711d66da078 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330312.986377:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008d48f480 reply state ffff8800938e1000 transno 4294983598 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f3c0/0xd895711d66da07f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.986385:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f3c0/0xd895711d66da07f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330312.986390:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca986ad8 (ffff880093b42500) 00010000:00010000:3.0:1715330312.986393:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330312.986396:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330312.986419:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c240/0xd895711d66da071 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbba2 expref: 63 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330312.986431:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48dd40/0xd895711d66da086 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1533:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbba2 expref: 62 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330312.986437:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1533:0x0].0x0 (ffff880093b42c00) 00010000:00010000:3.0:1715330312.986439:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330312.986441:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f48dd40, rc 0) 00000100:00100000:3.0:1715330312.986504:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+63:18878:x1798653938075136:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 1078us (1272us total) trans 4294983598 rc 0/0 00000100:00100000:3.0:1715330312.986512:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23608 00000020:00080000:3.0:1715330312.986518:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330312.987191:0:9630:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d56d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9630:1798653942509760:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1715330312.987245:0:9630:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330312.987275:0:9630:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008d667900 going to sleep for 11 seconds 00000100:00100000:2.0:1715330312.987331:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942509760 00000100:00100000:2.0:1715330312.987340:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942509760 00000100:00100000:2.0:1715330312.987390:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5236 00000100:00100000:2.0:1715330312.987396:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9630:x1798653942509760:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1715330312.987436:0:9633:0:(ofd_dev.c:1660:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2530 00000100:00100000:2.0:1715330312.988654:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9630:x1798653942509760:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1258us (1408us total) trans 4294969898 rc 0/0 00000100:00100000:2.0:1715330312.988662:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5236 00000100:00080000:2.0:1715330312.988698:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330282 00000100:00100000:0.0:1715330312.989135:0:9630:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d56d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9630:1798653942509760:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1715330312.989148:0:9630:0:(osp_precreate.c:724:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x9d2:0x0]-[0x280000401:0xa01:0x0] 00000100:00100000:0.0:1715330312.995437:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330312.995554:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938075264 00000100:00100000:2.0:1715330312.995563:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938075264 00000100:00100000:0.0:1715330312.996767:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5115 00000100:00100000:0.0:1715330312.996776:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+63:18878:x1798653938075264:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:0.0:1715330312.997031:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].27, 168 off12944 00000001:00080000:0.0:1715330312.997037:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983599 00000100:00100000:0.0:1715330312.998091:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+65:18878:x1798653938075264:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 1313us (2661us total) trans 4294983600 rc 0/0 00000100:00100000:0.0:1715330312.998102:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5115 00000020:00080000:0.0:1715330312.998109:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1715330313.002390:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330313.002510:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938075392 00000100:00100000:2.0:1715330313.002519:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938075392 00000100:00100000:2.0:1715330313.002564:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23609 00000100:00100000:2.0:1715330313.002571:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+65:18878:x1798653938075392:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:2.0:1715330313.002595:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330313.002617:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66da094 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbba9 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.002724:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66da09b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.002772:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66da09b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.002784:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66da09b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.002796:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66da0a2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca986ad9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.002803:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66da0a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.002808:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66da0a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000100:00100000:1.0:1715330313.004217:0:10805:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10805:1798653942509824:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1715330313.004281:0:10805:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330313.004314:0:10805:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009396cd80 going to sleep for 11 seconds 00000004:00080000:2.0:1715330313.004445:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d2:0x0], index 1: 0 00000040:00080000:2.0:1715330313.004540:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].28, 184 off13128 00010000:00010000:2.0:1715330313.004621:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db646c0/0xd895711d66da0a9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1534:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.004633:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db646c0/0xd895711d66da0a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1534:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.004642:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db646c0/0xd895711d66da0a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1534:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:2.0:1715330313.004692:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].29, 176 off13304 00000001:00080000:2.0:1715330313.004696:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983601 00010000:00010000:2.0:1715330313.004724:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66da09b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.004746:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66da09b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.004751:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66da09b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.004756:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66da09b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.004762:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db65d40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330313.004766:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66da09b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.004772:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66da09b lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.004783:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330313.004786:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330313.004791:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66da09b lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.004795:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66da09b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:2.0:1715330313.004830:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009b4c3b80 reply state ffff88012fbd8000 transno 4294983602 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66da0a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.004839:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66da0a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.004845:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca986ad9 (ffff88009d618a00) 00010000:00010000:2.0:1715330313.004847:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330313.004850:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1715330313.004882:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66da094 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbba9 expref: 69 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.004896:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db646c0/0xd895711d66da0a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1534:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbba9 expref: 68 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.004902:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1534:0x0].0x0 (ffff88009d618600) 00010000:00010000:2.0:1715330313.004904:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330313.004906:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db646c0, rc 0) 00000100:00100000:2.0:1715330313.004966:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+69:18878:x1798653938075392:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 2394us (2586us total) trans 4294983602 rc 0/0 00000100:00100000:2.0:1715330313.004977:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23609 00000020:00080000:2.0:1715330313.004985:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.005267:0:9398:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942509824 00000100:00100000:0.0:1715330313.005275:0:9398:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942509824 00000100:00100000:0.0:1715330313.005336:0:9398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5237 00000100:00100000:0.0:1715330313.005342:0:9398:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:10805:x1798653942509824:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1715330313.005384:0:9398:0:(ofd_dev.c:1660:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2530 00000100:00100000:0.0:1715330313.007654:0:9398:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:10805:x1798653942509824:12345-0@lo:5:osp-pre-1-0.0 Request processed in 2307us (3368us total) trans 4294969899 rc 0/0 00000100:00100000:0.0:1715330313.007665:0:9398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5237 00000100:00100000:1.0:1715330313.007700:0:10805:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10805:1798653942509824:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1715330313.007721:0:10805:0:(osp_precreate.c:724:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x9d2:0x0]-[0x2c0000401:0xa01:0x0] 00000100:00080000:2.0:1715330313.008978:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330283 00000100:00100000:1.0:1715330313.011037:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330313.011189:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938075520 00000100:00100000:0.0:1715330313.011197:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938075520 00000100:00100000:0.0:1715330313.011246:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5116 00000100:00100000:0.0:1715330313.011252:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fbee850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+69:18878:x1798653938075520:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:0.0:1715330313.011459:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].30, 168 off13472 00000001:00080000:0.0:1715330313.011464:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983603 00000100:00100000:0.0:1715330313.011540:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fbee850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+71:18878:x1798653938075520:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 286us (510us total) trans 4294983604 rc 0/0 00000100:00100000:0.0:1715330313.011546:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5116 00000020:00080000:0.0:1715330313.011550:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.019666:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330313.019792:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938075648 00000100:00100000:2.0:1715330313.019803:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938075648 00000100:00100000:2.0:1715330313.021865:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23610 00000100:00100000:2.0:1715330313.021875:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+71:18878:x1798653938075648:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:2.0:1715330313.021898:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330313.021915:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66da0b7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbbb0 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.022001:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66da0be lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.022404:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66da0be lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.022416:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66da0be lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.022428:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66da0c5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989ad1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.022433:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66da0c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.022438:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66da0c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00080000:2.0:1715330313.022673:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d3:0x0], index 0: 0 00000040:00080000:2.0:1715330313.022754:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].31, 184 off13656 00010000:00010000:2.0:1715330313.022808:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66da0cc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1535:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.022814:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66da0cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1535:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.022820:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66da0cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1535:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:2.0:1715330313.022862:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].32, 176 off13832 00000001:00080000:2.0:1715330313.022866:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983605 00010000:00010000:2.0:1715330313.022890:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66da0be lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.022894:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66da0be lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.022899:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66da0be lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.022904:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66da0be lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.022908:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64b40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330313.022912:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66da0be lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.022917:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66da0be lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.022925:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330313.022928:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330313.022931:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66da0be lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.022935:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66da0be lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:2.0:1715330313.022971:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880091d54380 reply state ffff88012fbdc000 transno 4294983606 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66da0c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.022978:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66da0c5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.022982:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ad1 (ffff88009b9a4600) 00010000:00010000:2.0:1715330313.022984:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330313.022986:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1715330313.023005:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66da0b7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbbb0 expref: 75 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.023016:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66da0cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1535:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbbb0 expref: 74 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.023021:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1535:0x0].0x0 (ffff88009b9a4a00) 00010000:00010000:2.0:1715330313.023023:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330313.023025:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db66400, rc 0) 00000100:00100000:2.0:1715330313.023096:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+75:18878:x1798653938075648:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 1223us (3441us total) trans 4294983606 rc 0/0 00000100:00100000:2.0:1715330313.023102:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23610 00000020:00080000:2.0:1715330313.023107:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1715330313.027004:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1715330313.027023:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b4c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942509888:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1715330313.027087:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330313.027241:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942509888 00000100:00100000:2.0:1715330313.027248:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942509888 00000100:00100000:2.0:1715330313.027867:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3044 00000100:00100000:2.0:1715330313.027874:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:3689:x1798653942509888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1715330313.027908:0:7138:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443995648 avail 1314533376 00000100:00100000:2.0:1715330313.028278:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:3689:x1798653942509888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 404us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330313.028285:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3044 00000100:00100000:0.0:1715330313.028356:0:3689:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983564 gen 2 00000004:00080000:0.0:1715330313.028362:0:3689:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294983564 committed transno 4294983564 00000100:00100000:0.0:1715330313.028397:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b4c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942509888:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1715330313.029210:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330313.029282:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938075776 00000100:00100000:2.0:1715330313.029287:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938075776 00000100:00100000:2.0:1715330313.029855:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5117 00000100:00100000:2.0:1715330313.029861:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+75:18878:x1798653938075776:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:2.0:1715330313.030170:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].33, 168 off14000 00000001:00080000:2.0:1715330313.030176:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983607 00000100:00100000:2.0:1715330313.030602:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+77:18878:x1798653938075776:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 740us (1393us total) trans 4294983608 rc 0/0 00000100:00100000:2.0:1715330313.030609:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5117 00000020:00080000:2.0:1715330313.030613:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.035155:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330313.035283:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938075904 00000100:00100000:2.0:1715330313.035293:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938075904 00000100:00100000:2.0:1715330313.035344:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23611 00000100:00100000:2.0:1715330313.035351:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+77:18878:x1798653938075904:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:2.0:1715330313.035373:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330313.035391:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66da0da lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbbb7 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.035483:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db661c0/0xd895711d66da0e1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.035495:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db661c0/0xd895711d66da0e1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.035504:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db661c0/0xd895711d66da0e1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.035516:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66da0e8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989bd1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.035521:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66da0e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.035525:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66da0e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00080000:2.0:1715330313.035789:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d3:0x0], index 1: 0 00000040:00080000:2.0:1715330313.035850:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].34, 184 off14184 00010000:00010000:2.0:1715330313.035898:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66da0ef lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1536:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.035904:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66da0ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1536:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.035909:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66da0ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1536:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:2.0:1715330313.035949:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].35, 176 off14360 00000001:00080000:2.0:1715330313.035952:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983609 00010000:00010000:2.0:1715330313.035975:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db661c0/0xd895711d66da0e1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.035980:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db661c0/0xd895711d66da0e1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.035984:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db661c0/0xd895711d66da0e1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.035989:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db661c0/0xd895711d66da0e1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.035994:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db661c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330313.035998:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db661c0/0xd895711d66da0e1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.036003:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db661c0/0xd895711d66da0e1 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.036011:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330313.036014:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330313.036018:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db661c0/0xd895711d66da0e1 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.036022:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db661c0/0xd895711d66da0e1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:2.0:1715330313.036049:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880091d54700 reply state ffff88008b18b000 transno 4294983610 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66da0e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.036056:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66da0e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.036069:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989bd1 (ffff88008b122a00) 00010000:00010000:2.0:1715330313.036072:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330313.036074:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1715330313.036091:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66da0da lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbbb7 expref: 81 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.036101:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66da0ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1536:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbbb7 expref: 80 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.036107:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1536:0x0].0x0 (ffff88008b122200) 00010000:00010000:2.0:1715330313.036109:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330313.036110:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db64b40, rc 0) 00000100:00100000:2.0:1715330313.036163:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+81:18878:x1798653938075904:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 811us (1016us total) trans 4294983610 rc 0/0 00000100:00100000:2.0:1715330313.036172:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23611 00000020:00080000:2.0:1715330313.036176:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.040024:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330313.040519:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938076032 00000100:00100000:2.0:1715330313.040528:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938076032 00000100:00100000:2.0:1715330313.040569:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5118 00000100:00100000:2.0:1715330313.040576:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+81:18878:x1798653938076032:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:2.0:1715330313.040788:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].36, 168 off14528 00000001:00080000:2.0:1715330313.040794:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983611 00000100:00100000:2.0:1715330313.040879:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+83:18878:x1798653938076032:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 302us (861us total) trans 4294983612 rc 0/0 00000100:00100000:2.0:1715330313.040885:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5118 00000020:00080000:2.0:1715330313.040890:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1715330313.043595:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330313.043721:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938076160 00000100:00100000:2.0:1715330313.043867:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938076160 00000100:00100000:2.0:1715330313.043913:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23612 00000100:00100000:2.0:1715330313.043920:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+83:18878:x1798653938076160:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:2.0:1715330313.043938:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330313.043953:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66da0fd lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbbbe expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.044083:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66da104 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.044094:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66da104 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.044103:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66da104 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.044116:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66da10b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989cd1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.044121:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66da10b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.044126:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66da10b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00080000:2.0:1715330313.044348:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d4:0x0], index 0: 0 00000040:00080000:2.0:1715330313.044418:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].37, 184 off14712 00010000:00010000:2.0:1715330313.044464:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66da112 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1537:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.044469:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66da112 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1537:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.044472:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66da112 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1537:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:2.0:1715330313.044500:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].38, 176 off14888 00000001:00080000:2.0:1715330313.044502:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983613 00010000:00010000:2.0:1715330313.044883:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66da104 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.044889:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66da104 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.044894:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66da104 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.044898:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66da104 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.044906:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db65d40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330313.044908:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66da104 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.044914:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66da104 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.044922:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330313.044924:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330313.044928:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66da104 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.044933:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66da104 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:2.0:1715330313.044944:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009b4c0e00 reply state ffff880091fdc000 transno 4294983614 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66da10b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.044950:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66da10b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.044954:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989cd1 (ffff88008b122c00) 00010000:00010000:2.0:1715330313.044956:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330313.044958:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1715330313.044977:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66da0fd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbbbe expref: 87 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.044988:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66da112 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1537:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbbbe expref: 86 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.044993:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1537:0x0].0x0 (ffff88008b122500) 00010000:00010000:2.0:1715330313.044996:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330313.044998:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db65440, rc 0) 00000100:00100000:2.0:1715330313.045134:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+87:18878:x1798653938076160:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 1213us (1544us total) trans 4294983614 rc 0/0 00000100:00100000:2.0:1715330313.045141:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23612 00000020:00080000:2.0:1715330313.045145:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1715330313.048781:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330313.048850:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938076288 00000100:00100000:0.0:1715330313.048940:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938076288 00000100:00100000:0.0:1715330313.048978:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5119 00000100:00100000:0.0:1715330313.048984:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+87:18878:x1798653938076288:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:0.0:1715330313.049194:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].39, 168 off15056 00000001:00080000:0.0:1715330313.049199:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983615 00000100:00100000:0.0:1715330313.049289:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+89:18878:x1798653938076288:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 304us (513us total) trans 4294983616 rc 0/0 00000100:00100000:0.0:1715330313.049295:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5119 00000020:00080000:0.0:1715330313.049299:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.052108:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330313.052930:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938076416 00000100:00100000:2.0:1715330313.052939:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938076416 00000100:00100000:2.0:1715330313.052988:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23613 00000100:00100000:2.0:1715330313.052994:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+89:18878:x1798653938076416:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:2.0:1715330313.053013:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330313.053029:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66da120 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbbc5 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.053124:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66da127 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.053135:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66da127 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.053144:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66da127 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.053154:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66da12e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989dd1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.053160:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66da12e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.053164:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66da12e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00080000:2.0:1715330313.053396:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d4:0x0], index 1: 0 00000040:00080000:2.0:1715330313.053535:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].40, 184 off15240 00010000:00010000:2.0:1715330313.053588:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db661c0/0xd895711d66da135 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1538:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.053594:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db661c0/0xd895711d66da135 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1538:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.053600:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db661c0/0xd895711d66da135 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1538:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:2.0:1715330313.053637:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].41, 176 off15416 00000001:00080000:2.0:1715330313.053641:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983617 00010000:00010000:2.0:1715330313.053663:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66da127 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.053668:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66da127 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.053672:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66da127 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.053676:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66da127 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.053680:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db65d40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330313.053683:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66da127 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.053688:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66da127 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.053696:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330313.053698:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330313.053702:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66da127 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.053706:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66da127 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:2.0:1715330313.054465:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880091d57100 reply state ffff880091fda000 transno 4294983618 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66da12e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.054475:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66da12e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.054479:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989dd1 (ffff88008b122e00) 00010000:00010000:2.0:1715330313.054482:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330313.054484:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1715330313.054506:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66da120 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbbc5 expref: 93 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.054615:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db661c0/0xd895711d66da135 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1538:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbbc5 expref: 92 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.054621:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1538:0x0].0x0 (ffff88008b122600) 00010000:00010000:2.0:1715330313.054625:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330313.054627:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db661c0, rc 0) 00000100:00100000:2.0:1715330313.054723:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+93:18878:x1798653938076416:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 1728us (2621us total) trans 4294983618 rc 0/0 00000100:00100000:2.0:1715330313.054745:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23613 00000020:00080000:2.0:1715330313.054750:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1715330313.058234:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330313.058386:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938076544 00000100:00100000:2.0:1715330313.058394:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938076544 00000100:00100000:2.0:1715330313.058436:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5120 00000100:00100000:2.0:1715330313.058442:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+93:18878:x1798653938076544:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:2.0:1715330313.058627:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].42, 168 off15584 00000001:00080000:2.0:1715330313.058631:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983619 00000100:00100000:2.0:1715330313.058706:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+95:18878:x1798653938076544:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 264us (479us total) trans 4294983620 rc 0/0 00000100:00100000:2.0:1715330313.058713:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5120 00000020:00080000:2.0:1715330313.058716:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.062698:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330313.062761:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938076672 00000100:00100000:2.0:1715330313.062769:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938076672 00000100:00100000:2.0:1715330313.062812:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23614 00000100:00100000:2.0:1715330313.062818:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+95:18878:x1798653938076672:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:2.0:1715330313.062837:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330313.062853:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66da143 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbbcc expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.062945:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66da14a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.062955:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66da14a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.062963:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66da14a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.062973:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66da151 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989ed1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.062978:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66da151 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.062986:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66da151 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00080000:2.0:1715330313.063217:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d5:0x0], index 0: 0 00000040:00080000:3.0:1715330313.064789:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].43, 184 off15768 00010000:00010000:3.0:1715330313.064868:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c240/0xd895711d66da158 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1539:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.064880:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c240/0xd895711d66da158 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1539:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.064888:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c240/0xd895711d66da158 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1539:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:3.0:1715330313.064942:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].44, 176 off15944 00000001:00080000:3.0:1715330313.064946:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983621 00010000:00010000:3.0:1715330313.064976:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66da14a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.064983:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66da14a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.064987:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66da14a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.064992:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66da14a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.064997:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db65d40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330313.065000:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66da14a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.065005:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66da14a lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.065014:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330313.065016:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330313.065020:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66da14a lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.065024:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65d40/0xd895711d66da14a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:3.0:1715330313.065049:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880091d55180 reply state ffff880093888000 transno 4294983622 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66da151 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.065057:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66da151 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.065074:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ed1 (ffff88008b122700) 00010000:00010000:3.0:1715330313.065076:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330313.065079:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330313.065104:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64480/0xd895711d66da143 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbbcc expref: 99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.065116:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c240/0xd895711d66da158 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1539:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbbcc expref: 98 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.065121:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1539:0x0].0x0 (ffff880093b42100) 00010000:00010000:3.0:1715330313.065123:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330313.065125:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f48c240, rc 0) 00000100:00100000:3.0:1715330313.065179:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+99:18878:x1798653938076672:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 2361us (2486us total) trans 4294983622 rc 0/0 00000100:00100000:3.0:1715330313.065186:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23614 00000020:00080000:3.0:1715330313.065191:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.069097:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330313.069195:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938076800 00000100:00100000:2.0:1715330313.069203:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938076800 00000100:00100000:2.0:1715330313.069242:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5121 00000100:00100000:2.0:1715330313.069247:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+99:18878:x1798653938076800:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:2.0:1715330313.069466:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].45, 168 off16112 00000001:00080000:2.0:1715330313.069472:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983623 00000100:00100000:2.0:1715330313.069650:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+101:18878:x1798653938076800:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 401us (559us total) trans 4294983624 rc 0/0 00000100:00100000:2.0:1715330313.069660:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5121 00000020:00080000:2.0:1715330313.069664:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1715330313.073398:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.073471:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938076928 00000100:00100000:3.0:1715330313.073479:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938076928 00000100:00100000:3.0:1715330313.074117:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23615 00000100:00100000:3.0:1715330313.074125:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+101:18878:x1798653938076928:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:3.0:1715330313.074144:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330313.074162:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e880/0xd895711d66da166 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbbd3 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.074251:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cfc0/0xd895711d66da16d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.074262:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cfc0/0xd895711d66da16d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.074271:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cfc0/0xd895711d66da16d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.074285:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c6c0/0xd895711d66da174 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989fd1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.074290:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c6c0/0xd895711d66da174 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.074295:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c6c0/0xd895711d66da174 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00080000:3.0:1715330313.074520:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d5:0x0], index 1: 0 00000040:00080000:3.0:1715330313.074588:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].46, 184 off16296 00010000:00010000:3.0:1715330313.074642:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d200/0xd895711d66da17b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x153a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.074648:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d200/0xd895711d66da17b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.074654:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d200/0xd895711d66da17b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:3.0:1715330313.074778:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].48, 176 off16560 00000001:00080000:3.0:1715330313.074784:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983625 00010000:00010000:3.0:1715330313.074811:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cfc0/0xd895711d66da16d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.074817:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cfc0/0xd895711d66da16d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.074821:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cfc0/0xd895711d66da16d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.074826:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cfc0/0xd895711d66da16d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.074835:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48cfc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330313.074838:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cfc0/0xd895711d66da16d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.074844:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cfc0/0xd895711d66da16d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.074852:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330313.074855:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330313.074858:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cfc0/0xd895711d66da16d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.074862:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cfc0/0xd895711d66da16d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:3.0:1715330313.074887:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012fa84a80 reply state ffff8800938e0000 transno 4294983626 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c6c0/0xd895711d66da174 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.074894:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c6c0/0xd895711d66da174 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.074900:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989fd1 (ffff880093b42600) 00010000:00010000:3.0:1715330313.074902:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330313.074904:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330313.074923:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e880/0xd895711d66da166 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbbd3 expref: 105 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.074933:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d200/0xd895711d66da17b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x153a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbbd3 expref: 104 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.074938:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153a:0x0].0x0 (ffff880093b42a00) 00010000:00010000:3.0:1715330313.074941:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330313.074943:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f48d200, rc 0) 00000100:00100000:3.0:1715330313.078234:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+105:18878:x1798653938076928:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 4099us (4833us total) trans 4294983626 rc 0/0 00000100:00100000:3.0:1715330313.078246:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23615 00000020:00080000:3.0:1715330313.078253:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.084021:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.084195:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938077056 00000100:00100000:3.0:1715330313.084204:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938077056 00000100:00100000:3.0:1715330313.084241:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5122 00000100:00100000:3.0:1715330313.084247:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fbee450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+105:18878:x1798653938077056:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330313.084454:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].49, 168 off16728 00000001:00080000:3.0:1715330313.084460:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983627 00000100:00100000:3.0:1715330313.084542:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fbee450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+107:18878:x1798653938077056:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 295us (527us total) trans 4294983628 rc 0/0 00000100:00100000:3.0:1715330313.084549:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5122 00000020:00080000:3.0:1715330313.084553:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.088148:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.088259:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938077184 00000100:00100000:3.0:1715330313.088269:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938077184 00000100:00100000:3.0:1715330313.088318:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23616 00000100:00100000:3.0:1715330313.088326:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+107:18878:x1798653938077184:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:3.0:1715330313.088355:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330313.088378:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e400/0xd895711d66da189 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbbda expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.088488:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c000/0xd895711d66da190 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.088502:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c000/0xd895711d66da190 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.088513:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c000/0xd895711d66da190 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.088527:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48eac0/0xd895711d66da197 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a0d1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.088532:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48eac0/0xd895711d66da197 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.088537:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48eac0/0xd895711d66da197 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00080000:3.0:1715330313.088853:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d6:0x0], index 0: 0 00000040:00080000:3.0:1715330313.089561:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].50, 184 off16912 00010000:00010000:3.0:1715330313.089633:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48fa80/0xd895711d66da19e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x153b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.089641:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48fa80/0xd895711d66da19e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.089648:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48fa80/0xd895711d66da19e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:3.0:1715330313.089688:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].51, 176 off17088 00000001:00080000:3.0:1715330313.089693:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983629 00010000:00010000:3.0:1715330313.089715:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c000/0xd895711d66da190 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.089721:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c000/0xd895711d66da190 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.089726:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c000/0xd895711d66da190 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.089809:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c000/0xd895711d66da190 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.089815:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48c000 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330313.089818:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c000/0xd895711d66da190 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.089824:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c000/0xd895711d66da190 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.089835:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330313.089837:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330313.089841:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c000/0xd895711d66da190 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.089846:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c000/0xd895711d66da190 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:3.0:1715330313.089913:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880091d56680 reply state ffff8800938e4000 transno 4294983630 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48eac0/0xd895711d66da197 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.089922:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48eac0/0xd895711d66da197 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.089927:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a0d1 (ffff880093b42800) 00010000:00010000:3.0:1715330313.089929:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330313.089932:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330313.089958:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e400/0xd895711d66da189 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbbda expref: 111 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.089969:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48fa80/0xd895711d66da19e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x153b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbbda expref: 110 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.089980:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153b:0x0].0x0 (ffff880093b42900) 00010000:00010000:3.0:1715330313.089982:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330313.089983:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f48fa80, rc 0) 00000100:00100000:3.0:1715330313.091238:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+111:18878:x1798653938077184:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 2903us (3093us total) trans 4294983630 rc 0/0 00000100:00100000:3.0:1715330313.091249:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23616 00000020:00080000:3.0:1715330313.091258:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1715330313.096179:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330313.096425:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938077312 00000100:00100000:0.0:1715330313.096435:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938077312 00000100:00100000:0.0:1715330313.096651:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5123 00000100:00100000:0.0:1715330313.096659:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+111:18878:x1798653938077312:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:0.0:1715330313.097284:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].52, 168 off17256 00000001:00080000:0.0:1715330313.097290:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983631 00000100:00100000:0.0:1715330313.099355:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+113:18878:x1798653938077312:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 2685us (3177us total) trans 4294983632 rc 0/0 00000100:00100000:0.0:1715330313.099369:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5123 00000020:00080000:0.0:1715330313.099377:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.105668:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.106097:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938077440 00000100:00100000:3.0:1715330313.106107:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938077440 00000100:00100000:3.0:1715330313.106165:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23617 00000100:00100000:3.0:1715330313.106173:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+113:18878:x1798653938077440:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:3.0:1715330313.106200:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330313.106221:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66da1ac lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbbe1 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.106326:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48ef40/0xd895711d66da1b3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.106339:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48ef40/0xd895711d66da1b3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.106349:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48ef40/0xd895711d66da1b3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.106361:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cb40/0xd895711d66da1ba lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a1d1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.106366:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cb40/0xd895711d66da1ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.106372:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cb40/0xd895711d66da1ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00080000:3.0:1715330313.106640:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d6:0x0], index 1: 0 00000040:00080000:3.0:1715330313.106703:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].53, 184 off17440 00010000:00010000:3.0:1715330313.106777:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48fcc0/0xd895711d66da1c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x153c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.106784:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48fcc0/0xd895711d66da1c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.106789:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48fcc0/0xd895711d66da1c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:3.0:1715330313.106825:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].54, 176 off17616 00000001:00080000:3.0:1715330313.106829:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983633 00010000:00010000:3.0:1715330313.106850:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48ef40/0xd895711d66da1b3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.107223:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48ef40/0xd895711d66da1b3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.107228:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48ef40/0xd895711d66da1b3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.107233:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48ef40/0xd895711d66da1b3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.107238:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48ef40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330313.107241:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48ef40/0xd895711d66da1b3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.107247:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48ef40/0xd895711d66da1b3 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.107259:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330313.107262:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330313.107266:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48ef40/0xd895711d66da1b3 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.107270:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48ef40/0xd895711d66da1b3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:3.0:1715330313.107297:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880091d56300 reply state ffff88009c61c000 transno 4294983634 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cb40/0xd895711d66da1ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.107304:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cb40/0xd895711d66da1ba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.107309:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a1d1 (ffff880093b42b00) 00010000:00010000:3.0:1715330313.107311:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330313.107313:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330313.107335:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66da1ac lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbbe1 expref: 117 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.107346:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48fcc0/0xd895711d66da1c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x153c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbbe1 expref: 116 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.107352:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153c:0x0].0x0 (ffff880093b42f00) 00010000:00010000:3.0:1715330313.107354:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330313.107356:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f48fcc0, rc 0) 00000100:00100000:3.0:1715330313.108172:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+117:18878:x1798653938077440:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 1997us (2512us total) trans 4294983634 rc 0/0 00000100:00100000:3.0:1715330313.108181:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23617 00000020:00080000:3.0:1715330313.108188:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.110835:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330313.110892:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938077568 00000100:00100000:2.0:1715330313.110902:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938077568 00000100:00100000:2.0:1715330313.110958:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5124 00000100:00100000:2.0:1715330313.110966:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+117:18878:x1798653938077568:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:2.0:1715330313.111230:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].55, 168 off17784 00000001:00080000:2.0:1715330313.111237:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983635 00000100:00100000:2.0:1715330313.111337:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+119:18878:x1798653938077568:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 370us (512us total) trans 4294983636 rc 0/0 00000100:00100000:2.0:1715330313.111344:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5124 00000020:00080000:2.0:1715330313.111349:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.114541:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.114904:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938077696 00000100:00100000:3.0:1715330313.114914:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938077696 00000100:00100000:3.0:1715330313.114969:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23618 00000100:00100000:3.0:1715330313.114977:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+119:18878:x1798653938077696:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:3.0:1715330313.115001:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330313.115022:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48ed00/0xd895711d66da1cf lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbbe8 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.115137:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f840/0xd895711d66da1d6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.115150:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f840/0xd895711d66da1d6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.115161:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f840/0xd895711d66da1d6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.115173:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d8c0/0xd895711d66da1dd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a2d1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.115179:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d8c0/0xd895711d66da1dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.115184:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d8c0/0xd895711d66da1dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00080000:3.0:1715330313.115469:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d7:0x0], index 0: 0 00000040:00080000:3.0:1715330313.115544:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].56, 184 off17968 00010000:00010000:3.0:1715330313.115605:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f600/0xd895711d66da1e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x153d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.115612:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f600/0xd895711d66da1e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.115621:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f600/0xd895711d66da1e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:3.0:1715330313.115662:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].57, 176 off18144 00000001:00080000:3.0:1715330313.115666:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983637 00010000:00010000:3.0:1715330313.115691:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f840/0xd895711d66da1d6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.115697:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f840/0xd895711d66da1d6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.115703:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f840/0xd895711d66da1d6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.115708:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f840/0xd895711d66da1d6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.115713:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48f840 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330313.115716:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f840/0xd895711d66da1d6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.115722:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f840/0xd895711d66da1d6 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.115768:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330313.115771:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330313.115775:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f840/0xd895711d66da1d6 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.115781:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f840/0xd895711d66da1d6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:3.0:1715330313.115808:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880091d55880 reply state ffff88012b0a5000 transno 4294983638 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d8c0/0xd895711d66da1dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.115817:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d8c0/0xd895711d66da1dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.115822:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a2d1 (ffff88009ef25900) 00010000:00010000:3.0:1715330313.115824:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330313.115826:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330313.115847:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48ed00/0xd895711d66da1cf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbbe8 expref: 123 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.115858:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f600/0xd895711d66da1e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x153d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbbe8 expref: 122 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.115864:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153d:0x0].0x0 (ffff88009ef25300) 00010000:00010000:3.0:1715330313.115868:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330313.115869:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f48f600, rc 0) 00000100:00100000:3.0:1715330313.115927:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+123:18878:x1798653938077696:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 951us (1397us total) trans 4294983638 rc 0/0 00000100:00100000:3.0:1715330313.115934:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23618 00000020:00080000:3.0:1715330313.115939:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.121683:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.121784:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938077888 00000100:00100000:3.0:1715330313.121794:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938077888 00000100:00100000:3.0:1715330313.121876:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5125 00000100:00100000:3.0:1715330313.121884:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+123:18878:x1798653938077888:12345-192.168.204.49@tcp:35:createmany.0 00000100:00100000:0.0:1715330313.122077:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330313.122110:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330313.122139:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330313.122158:0:9398:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938078016 00000100:00100000:0.0:1715330313.122161:0:9398:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938078016 00000100:00100000:1.0:1715330313.122224:0:7130:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938077760 00000100:00100000:1.0:1715330313.122228:0:7130:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938077760 00000100:00100000:0.0:1715330313.122515:0:9398:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938077952 00000100:00100000:0.0:1715330313.122518:0:9398:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938077952 00000100:00100000:0.0:1715330313.122617:0:9398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 201 00000100:00100000:1.0:1715330313.122621:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 339 00000100:00100000:0.0:1715330313.122622:0:9398:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72de1896-1df4-4b3a-930a-9116d2c66168+6:2012:x1798653938078016:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:1.0:1715330313.122625:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2012:x1798653938077760:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:1.0:1715330313.122674:0:7130:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2012:x1798653938077760:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 48us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330313.122674:0:9398:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72de1896-1df4-4b3a-930a-9116d2c66168+6:2012:x1798653938078016:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 50us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330313.122680:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 339 00000100:00100000:0.0:1715330313.122680:0:9398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 201 00000100:00100000:0.0:1715330313.122694:0:9398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 202 00000100:00100000:0.0:1715330313.122697:0:9398:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72de1896-1df4-4b3a-930a-9116d2c66168+7:2012:x1798653938077952:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:0.0:1715330313.122714:0:9398:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72de1896-1df4-4b3a-930a-9116d2c66168+7:2012:x1798653938077952:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 16us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330313.122718:0:9398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 202 00000100:00080000:2.0:1715330313.122792:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330283 00000100:00080000:2.0:1715330313.122797:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330283 00000100:00080000:2.0:1715330313.122799:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330283 00000040:00080000:3.0:1715330313.123413:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].58, 168 off18312 00000001:00080000:3.0:1715330313.123419:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983639 00000100:00100000:3.0:1715330313.123493:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+125:18878:x1798653938077888:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 1609us (1820us total) trans 4294983640 rc 0/0 00000100:00100000:3.0:1715330313.123504:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5125 00000020:00080000:3.0:1715330313.123509:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.127513:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330313.127648:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938078144 00000100:00100000:2.0:1715330313.127658:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938078144 00000100:00100000:2.0:1715330313.127721:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23619 00000100:00100000:2.0:1715330313.127839:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+125:18878:x1798653938078144:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:2.0:1715330313.127867:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330313.127889:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66da1f2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbbef expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.128104:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66da1f9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.128117:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66da1f9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.128126:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66da1f9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.128141:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66da200 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a3d1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.128146:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66da200 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.128151:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66da200 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:2.0:1715330313.128470:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d7:0x0], index 1: 0 00000040:00080000:2.0:1715330313.128548:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].59, 184 off18496 00010000:00010000:2.0:1715330313.128608:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66da207 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x153e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.128614:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66da207 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.128620:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66da207 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:2.0:1715330313.128664:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].60, 176 off18672 00000001:00080000:2.0:1715330313.128668:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983641 00010000:00010000:2.0:1715330313.128693:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66da1f9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.128698:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66da1f9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.128703:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66da1f9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.128707:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66da1f9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.128713:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f1440 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330313.128716:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66da1f9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.128722:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66da1f9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.128750:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330313.128753:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330313.128758:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66da1f9 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.128763:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66da1f9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:2.0:1715330313.128812:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880091d54000 reply state ffff880093889000 transno 4294983642 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66da200 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.128821:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66da200 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.128826:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a3d1 (ffff88008b122300) 00010000:00010000:2.0:1715330313.128828:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330313.128830:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1715330313.128855:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66da1f2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbbef expref: 129 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.128866:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66da207 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x153e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbbef expref: 128 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.128872:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153e:0x0].0x0 (ffff88008b122900) 00010000:00010000:2.0:1715330313.128874:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330313.128876:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f1680, rc 0) 00000100:00100000:2.0:1715330313.129109:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+129:18878:x1798653938078144:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 1379us (1606us total) trans 4294983642 rc 0/0 00000100:00100000:2.0:1715330313.129118:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23619 00000020:00080000:2.0:1715330313.129123:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.132893:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.133588:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938078272 00000100:00100000:3.0:1715330313.133597:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938078272 00000100:00100000:3.0:1715330313.133660:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5126 00000100:00100000:3.0:1715330313.133668:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+129:18878:x1798653938078272:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330313.134017:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].61, 168 off18840 00000001:00080000:3.0:1715330313.134024:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983643 00000100:00100000:3.0:1715330313.134130:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+131:18878:x1798653938078272:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 462us (1249us total) trans 4294983644 rc 0/0 00000100:00100000:3.0:1715330313.134137:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5126 00000020:00080000:3.0:1715330313.134142:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.136961:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.137067:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938078400 00000100:00100000:3.0:1715330313.137077:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938078400 00000100:00100000:3.0:1715330313.137652:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23620 00000100:00100000:3.0:1715330313.137660:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+131:18878:x1798653938078400:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:3.0:1715330313.137685:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330313.137705:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c900/0xd895711d66da215 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbbf6 expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.137840:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d440/0xd895711d66da21c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.137853:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d440/0xd895711d66da21c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.137863:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d440/0xd895711d66da21c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.137880:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48db00/0xd895711d66da223 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989ad2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.137885:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48db00/0xd895711d66da223 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.137889:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48db00/0xd895711d66da223 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:3.0:1715330313.138184:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d8:0x0], index 0: 0 00000040:00080000:3.0:1715330313.138262:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].62, 184 off19024 00010000:00010000:3.0:1715330313.138325:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48ed00/0xd895711d66da22a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x153f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.138332:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48ed00/0xd895711d66da22a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.138338:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48ed00/0xd895711d66da22a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330313.138380:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].63, 176 off19200 00000001:00080000:3.0:1715330313.138385:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983645 00010000:00010000:3.0:1715330313.138411:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d440/0xd895711d66da21c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.138416:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d440/0xd895711d66da21c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.138421:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d440/0xd895711d66da21c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.138427:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d440/0xd895711d66da21c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.138437:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48d440 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330313.138440:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d440/0xd895711d66da21c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.138447:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d440/0xd895711d66da21c lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.138458:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330313.138461:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330313.138465:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d440/0xd895711d66da21c lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.138470:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d440/0xd895711d66da21c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330313.138481:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093b58000 reply state ffff88009d665000 transno 4294983646 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48db00/0xd895711d66da223 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.138488:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48db00/0xd895711d66da223 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.138493:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ad2 (ffff88009ef25b00) 00010000:00010000:3.0:1715330313.138495:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330313.138497:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330313.138519:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c900/0xd895711d66da215 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbbf6 expref: 135 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.138530:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48ed00/0xd895711d66da22a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x153f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbbf6 expref: 134 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.138536:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153f:0x0].0x0 (ffff88009ef25200) 00010000:00010000:3.0:1715330313.138539:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330313.138541:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f48ed00, rc 0) 00000100:00100000:3.0:1715330313.138614:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+135:18878:x1798653938078400:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 954us (1663us total) trans 4294983646 rc 0/0 00000100:00100000:3.0:1715330313.138621:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23620 00000020:00080000:3.0:1715330313.138626:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.141832:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.141996:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938078528 00000100:00100000:3.0:1715330313.142006:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938078528 00000100:00100000:3.0:1715330313.142196:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5127 00000100:00100000:3.0:1715330313.142204:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+135:18878:x1798653938078528:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330313.142450:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].64, 168 off19368 00000001:00080000:3.0:1715330313.142456:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983647 00000100:00100000:3.0:1715330313.142884:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+137:18878:x1798653938078528:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 680us (1061us total) trans 4294983648 rc 0/0 00000100:00100000:3.0:1715330313.142892:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5127 00000020:00080000:3.0:1715330313.142898:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1715330313.146010:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330313.146069:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938078656 00000100:00100000:0.0:1715330313.146080:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938078656 00000100:00100000:0.0:1715330313.146142:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23621 00000100:00100000:0.0:1715330313.146149:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+137:18878:x1798653938078656:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:0.0:1715330313.146173:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330313.146196:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3840/0xd895711d66da238 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbbfd expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330313.146300:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66da23f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.146318:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66da23f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.146329:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66da23f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.146347:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0000/0xd895711d66da246 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989bd2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.146352:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0000/0xd895711d66da246 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.146358:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0000/0xd895711d66da246 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00080000:0.0:1715330313.146657:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d8:0x0], index 1: 0 00000040:00080000:0.0:1715330313.146772:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].65, 184 off19552 00010000:00010000:0.0:1715330313.146836:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1680/0xd895711d66da24d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1540:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.146844:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1680/0xd895711d66da24d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1540:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.146850:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1680/0xd895711d66da24d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1540:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:0.0:1715330313.146894:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].66, 176 off19728 00000001:00080000:0.0:1715330313.146899:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983649 00010000:00010000:0.0:1715330313.146924:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66da23f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.146930:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66da23f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.146939:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66da23f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.146944:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66da23f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.146949:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a1d40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330313.146952:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66da23f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.146958:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66da23f lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.146967:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:0.0:1715330313.146970:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330313.146974:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66da23f lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.146979:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66da23f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:0.0:1715330313.147007:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008d48c380 reply state ffff880093827000 transno 4294983650 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0000/0xd895711d66da246 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.147016:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0000/0xd895711d66da246 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.147022:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989bd2 (ffff88012ca48100) 00010000:00010000:0.0:1715330313.147024:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330313.147026:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1715330313.147048:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3840/0xd895711d66da238 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbbfd expref: 141 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330313.147078:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1680/0xd895711d66da24d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1540:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbbfd expref: 140 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330313.147085:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1540:0x0].0x0 (ffff88012ca48000) 00010000:00010000:0.0:1715330313.147087:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715330313.147089:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a1680, rc 0) 00000100:00100000:0.0:1715330313.147558:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+141:18878:x1798653938078656:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 1002us (1153us total) trans 4294983650 rc 0/0 00000100:00100000:0.0:1715330313.147567:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23621 00000020:00080000:0.0:1715330313.147573:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.149993:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.150273:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938078784 00000100:00100000:3.0:1715330313.150285:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938078784 00000100:00100000:3.0:1715330313.150347:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5128 00000100:00100000:3.0:1715330313.150356:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fbee050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+141:18878:x1798653938078784:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330313.150611:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].67, 168 off19896 00000001:00080000:3.0:1715330313.150617:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983651 00000100:00100000:3.0:1715330313.150705:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fbee050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+143:18878:x1798653938078784:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 349us (723us total) trans 4294983652 rc 0/0 00000100:00100000:3.0:1715330313.151879:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5128 00000020:00080000:3.0:1715330313.151888:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1715330313.154840:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330313.154871:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938078912 00000100:00100000:0.0:1715330313.154880:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938078912 00000100:00100000:0.0:1715330313.154941:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23622 00000100:00100000:0.0:1715330313.154948:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+143:18878:x1798653938078912:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:0.0:1715330313.154973:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330313.154993:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3a80/0xd895711d66da25b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbc04 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330313.155104:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66da262 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.155117:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66da262 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.155127:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66da262 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.155143:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0fc0/0xd895711d66da269 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989cd2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.155149:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0fc0/0xd895711d66da269 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.155154:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0fc0/0xd895711d66da269 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00080000:0.0:1715330313.155780:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d9:0x0], index 0: 0 00000040:00080000:0.0:1715330313.155860:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].68, 184 off20080 00010000:00010000:0.0:1715330313.155926:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2ac0/0xd895711d66da270 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.155933:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2ac0/0xd895711d66da270 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1541:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.155939:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2ac0/0xd895711d66da270 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1541:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:0.0:1715330313.155982:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].69, 176 off20256 00000001:00080000:0.0:1715330313.155986:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983653 00010000:00010000:0.0:1715330313.156012:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66da262 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.156019:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66da262 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.156024:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66da262 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.156030:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66da262 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.156039:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a2f40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330313.156042:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66da262 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.156049:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66da262 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.156072:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:0.0:1715330313.156075:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330313.156079:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66da262 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.156084:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66da262 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:0.0:1715330313.156098:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012fa87b80 reply state ffff880093820000 transno 4294983654 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0fc0/0xd895711d66da269 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.156106:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0fc0/0xd895711d66da269 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.156111:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989cd2 (ffff88012ca48a00) 00010000:00010000:0.0:1715330313.156114:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330313.156116:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1715330313.156139:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3a80/0xd895711d66da25b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc04 expref: 147 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330313.156153:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2ac0/0xd895711d66da270 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1541:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc04 expref: 146 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330313.156159:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff88012ca48200) 00010000:00010000:0.0:1715330313.156162:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715330313.156164:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a2ac0, rc 0) 00000100:00100000:0.0:1715330313.156232:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+147:18878:x1798653938078912:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 1284us (1403us total) trans 4294983654 rc 0/0 00000100:00100000:0.0:1715330313.156239:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23622 00000020:00080000:0.0:1715330313.156244:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1715330313.159837:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.159970:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938079040 00000100:00100000:3.0:1715330313.159987:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938079040 00000100:00100000:3.0:1715330313.160041:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5129 00000100:00100000:3.0:1715330313.160049:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+147:18878:x1798653938079040:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330313.160300:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].70, 168 off20424 00000001:00080000:3.0:1715330313.160306:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983655 00000100:00100000:3.0:1715330313.160401:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+149:18878:x1798653938079040:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 352us (574us total) trans 4294983656 rc 0/0 00000100:00100000:3.0:1715330313.160408:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5129 00000020:00080000:3.0:1715330313.160413:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.163945:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330313.164238:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938079168 00000100:00100000:2.0:1715330313.164248:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938079168 00000100:00100000:2.0:1715330313.164305:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23623 00000100:00100000:2.0:1715330313.164313:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+149:18878:x1798653938079168:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:2.0:1715330313.164337:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330313.164359:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66da27e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbc0b expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.164467:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66da285 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.164480:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66da285 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.164491:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66da285 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.164503:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66da28c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989dd2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.164508:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66da28c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.164513:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66da28c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00080000:2.0:1715330313.164829:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d9:0x0], index 1: 0 00000040:00080000:2.0:1715330313.164974:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].71, 184 off20608 00010000:00010000:2.0:1715330313.165038:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66da293 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1542:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.165045:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66da293 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1542:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.165051:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66da293 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1542:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:2.0:1715330313.165108:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].72, 176 off20784 00000001:00080000:2.0:1715330313.165112:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983657 00010000:00010000:2.0:1715330313.165139:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66da285 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.165148:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66da285 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.165153:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66da285 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.165158:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66da285 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.165163:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f1440 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330313.165166:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66da285 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.165171:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66da285 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.165181:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330313.165183:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330313.165186:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66da285 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.165190:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66da285 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:2.0:1715330313.165207:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093b58700 reply state ffff88009388a000 transno 4294983658 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66da28c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.165214:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66da28c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.165218:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989dd2 (ffff88008b122400) 00010000:00010000:2.0:1715330313.165220:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330313.165223:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1715330313.165245:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66da27e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc0b expref: 153 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.165256:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66da293 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1542:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc0b expref: 152 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.165261:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1542:0x0].0x0 (ffff88008b122d00) 00010000:00010000:2.0:1715330313.165263:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330313.165265:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f2880, rc 0) 00000100:00100000:2.0:1715330313.165342:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+153:18878:x1798653938079168:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 1029us (1408us total) trans 4294983658 rc 0/0 00000100:00100000:2.0:1715330313.165349:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23623 00000020:00080000:2.0:1715330313.165354:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.169846:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330313.169972:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938079296 00000100:00100000:2.0:1715330313.169983:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938079296 00000100:00100000:2.0:1715330313.170042:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5130 00000100:00100000:2.0:1715330313.170050:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+153:18878:x1798653938079296:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:2.0:1715330313.170302:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].73, 168 off20952 00000001:00080000:2.0:1715330313.170308:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983659 00000100:00100000:2.0:1715330313.170393:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+155:18878:x1798653938079296:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 343us (559us total) trans 4294983660 rc 0/0 00000100:00100000:2.0:1715330313.170399:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5130 00000020:00080000:2.0:1715330313.170404:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1715330313.175336:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.175419:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938079424 00000100:00100000:3.0:1715330313.175428:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938079424 00000100:00100000:3.0:1715330313.175476:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23624 00000100:00100000:3.0:1715330313.175483:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134567800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+155:18878:x1798653938079424:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:3.0:1715330313.175507:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330313.175527:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f840/0xd895711d66da2a1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbc12 expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.175631:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66da2a8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.175644:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66da2a8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.175653:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66da2a8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.175664:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48ef40/0xd895711d66da2af lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989ed2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.175669:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48ef40/0xd895711d66da2af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.175674:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48ef40/0xd895711d66da2af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:3.0:1715330313.175990:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9da:0x0], index 0: 0 00000040:00080000:3.0:1715330313.176069:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].74, 184 off21136 00010000:00010000:3.0:1715330313.176126:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e400/0xd895711d66da2b6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1543:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.176133:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e400/0xd895711d66da2b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1543:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.176138:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e400/0xd895711d66da2b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1543:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330313.176171:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].75, 176 off21312 00000001:00080000:3.0:1715330313.176175:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983661 00010000:00010000:3.0:1715330313.176196:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66da2a8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.176201:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66da2a8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.176206:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66da2a8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.176210:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66da2a8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.176215:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48cd80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330313.176218:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66da2a8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.176223:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66da2a8 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.176233:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330313.176235:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330313.176238:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66da2a8 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.176243:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66da2a8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330313.176256:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880134567800 reply state ffff8800938e8000 transno 4294983662 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48ef40/0xd895711d66da2af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.176263:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48ef40/0xd895711d66da2af lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.176267:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ed2 (ffff88009ef25f00) 00010000:00010000:3.0:1715330313.176268:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330313.176270:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330313.176287:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f840/0xd895711d66da2a1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc12 expref: 159 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.176295:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e400/0xd895711d66da2b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1543:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc12 expref: 158 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.176301:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1543:0x0].0x0 (ffff88009ef25e00) 00010000:00010000:3.0:1715330313.176302:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330313.176304:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f48e400, rc 0) 00000100:00100000:3.0:1715330313.176357:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134567800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+159:18878:x1798653938079424:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 874us (1032us total) trans 4294983662 rc 0/0 00000100:00100000:3.0:1715330313.176363:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23624 00000020:00080000:3.0:1715330313.176368:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.179220:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.179324:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938079552 00000100:00100000:3.0:1715330313.179333:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938079552 00000100:00100000:3.0:1715330313.180352:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5131 00000100:00100000:3.0:1715330313.180359:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+159:18878:x1798653938079552:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330313.180610:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].76, 168 off21480 00000001:00080000:3.0:1715330313.180616:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983663 00000100:00100000:3.0:1715330313.180710:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+161:18878:x1798653938079552:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 350us (1499us total) trans 4294983664 rc 0/0 00000100:00100000:3.0:1715330313.180717:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5131 00000020:00080000:3.0:1715330313.180722:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.183263:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330313.183353:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938079680 00000100:00100000:2.0:1715330313.183363:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938079680 00000100:00100000:2.0:1715330313.183411:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23625 00000100:00100000:2.0:1715330313.183418:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+161:18878:x1798653938079680:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:2.0:1715330313.183442:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330313.183463:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66da2c4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbc19 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.183567:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66da2cb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.183580:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66da2cb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.183589:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66da2cb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.183600:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66da2d2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989fd2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.183605:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66da2d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.183610:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66da2d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00080000:2.0:1715330313.183912:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9da:0x0], index 1: 0 00000040:00080000:2.0:1715330313.183988:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].77, 184 off21664 00010000:00010000:2.0:1715330313.184045:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66da2d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1544:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.184051:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66da2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1544:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.184057:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66da2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1544:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:2.0:1715330313.184110:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].78, 176 off21840 00000001:00080000:2.0:1715330313.184115:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983665 00010000:00010000:2.0:1715330313.184142:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66da2cb lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.184147:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66da2cb lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.184153:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66da2cb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.184159:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66da2cb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.184165:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f1440 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330313.184169:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66da2cb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.184175:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66da2cb lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.184185:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330313.184187:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330313.184191:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66da2cb lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.184195:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66da2cb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:2.0:1715330313.184210:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093b59180 reply state ffff88009388b000 transno 4294983666 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66da2d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.184217:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66da2d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.184222:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989fd2 (ffff88012bfb5e00) 00010000:00010000:2.0:1715330313.184225:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330313.184227:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1715330313.184246:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66da2c4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc19 expref: 165 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.184257:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66da2d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1544:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc19 expref: 164 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.184262:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1544:0x0].0x0 (ffff88012bfb5a00) 00010000:00010000:2.0:1715330313.184264:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330313.184266:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f2400, rc 0) 00000100:00100000:2.0:1715330313.184324:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+165:18878:x1798653938079680:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 904us (1068us total) trans 4294983666 rc 0/0 00000100:00100000:2.0:1715330313.184329:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23625 00000020:00080000:2.0:1715330313.184334:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1715330313.187767:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.188947:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938079808 00000100:00100000:3.0:1715330313.188957:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938079808 00000100:00100000:3.0:1715330313.189615:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5132 00000100:00100000:3.0:1715330313.189624:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+165:18878:x1798653938079808:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330313.190600:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].79, 168 off22008 00000001:00080000:3.0:1715330313.190606:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983667 00000100:00100000:3.0:1715330313.191267:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+167:18878:x1798653938079808:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 1640us (3535us total) trans 4294983668 rc 0/0 00000100:00100000:3.0:1715330313.191276:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5132 00000020:00080000:3.0:1715330313.191282:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.194032:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.194629:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938079936 00000100:00100000:3.0:1715330313.194638:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938079936 00000100:00100000:3.0:1715330313.194701:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23626 00000100:00100000:3.0:1715330313.194709:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+167:18878:x1798653938079936:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:3.0:1715330313.194926:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330313.194947:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f840/0xd895711d66da2e7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbc20 expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.195051:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66da2ee lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.195075:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66da2ee lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.195086:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66da2ee lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.195098:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c000/0xd895711d66da2f5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a0d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.195103:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c000/0xd895711d66da2f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.195108:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c000/0xd895711d66da2f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:3.0:1715330313.195382:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9db:0x0], index 0: 0 00000040:00080000:3.0:1715330313.195459:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].80, 184 off22192 00010000:00010000:3.0:1715330313.195520:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e880/0xd895711d66da2fc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1545:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.195527:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e880/0xd895711d66da2fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1545:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.195533:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e880/0xd895711d66da2fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1545:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330313.195574:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].81, 176 off22368 00000001:00080000:3.0:1715330313.195578:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983669 00010000:00010000:3.0:1715330313.195604:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66da2ee lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.195613:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66da2ee lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.195618:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66da2ee lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.195623:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66da2ee lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.195628:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48cd80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330313.195631:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66da2ee lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.195638:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66da2ee lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.195648:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330313.195651:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330313.195655:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66da2ee lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.195659:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66da2ee lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330313.195671:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093b59500 reply state ffff8800938e9000 transno 4294983670 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c000/0xd895711d66da2f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.195679:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c000/0xd895711d66da2f5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.195684:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a0d2 (ffff88009ef25a00) 00010000:00010000:3.0:1715330313.195686:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330313.195688:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330313.195706:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f840/0xd895711d66da2e7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc20 expref: 171 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.195716:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e880/0xd895711d66da2fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1545:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc20 expref: 170 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.195722:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1545:0x0].0x0 (ffff88009ef25400) 00010000:00010000:3.0:1715330313.195724:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330313.195726:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f48e880, rc 0) 00000100:00100000:3.0:1715330313.195808:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+171:18878:x1798653938079936:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 1099us (1785us total) trans 4294983670 rc 0/0 00000100:00100000:3.0:1715330313.195815:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23626 00000020:00080000:3.0:1715330313.195820:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.201043:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.201174:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938080064 00000100:00100000:3.0:1715330313.201184:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938080064 00000100:00100000:3.0:1715330313.201235:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5133 00000100:00100000:3.0:1715330313.201241:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+171:18878:x1798653938080064:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330313.201447:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].82, 168 off22536 00000001:00080000:3.0:1715330313.201450:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983671 00000100:00100000:3.0:1715330313.201522:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+173:18878:x1798653938080064:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 281us (490us total) trans 4294983672 rc 0/0 00000100:00100000:3.0:1715330313.201528:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5133 00000020:00080000:3.0:1715330313.201532:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1715330313.205975:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.206070:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938080192 00000100:00100000:3.0:1715330313.206081:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938080192 00000100:00100000:3.0:1715330313.206145:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23627 00000100:00100000:3.0:1715330313.206153:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+173:18878:x1798653938080192:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:3.0:1715330313.206182:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330313.206203:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f840/0xd895711d66da30a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbc27 expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.206309:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66da311 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.206323:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66da311 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.206335:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66da311 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.206351:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cfc0/0xd895711d66da318 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a1d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.206356:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cfc0/0xd895711d66da318 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.206361:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cfc0/0xd895711d66da318 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:3.0:1715330313.206662:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9db:0x0], index 1: 0 00000040:00080000:3.0:1715330313.206787:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].83, 184 off22720 00010000:00010000:3.0:1715330313.206849:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c900/0xd895711d66da31f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.206854:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c900/0xd895711d66da31f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1546:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.206858:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c900/0xd895711d66da31f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1546:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330313.206891:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].84, 176 off22896 00000001:00080000:3.0:1715330313.206894:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983673 00010000:00010000:3.0:1715330313.206914:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66da311 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.206918:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66da311 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.206922:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66da311 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.206925:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66da311 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.206929:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48cd80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330313.206931:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66da311 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.206935:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66da311 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.206942:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330313.206944:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330313.206946:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66da311 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.206949:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66da311 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330313.206957:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800877eea00 reply state ffff8800938ea000 transno 4294983674 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cfc0/0xd895711d66da318 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.206961:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cfc0/0xd895711d66da318 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.206964:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a1d2 (ffff88009ef25d00) 00010000:00010000:3.0:1715330313.206966:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330313.206968:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330313.206984:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f840/0xd895711d66da30a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc27 expref: 177 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.206992:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c900/0xd895711d66da31f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1546:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc27 expref: 176 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.206996:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff88009ef25500) 00010000:00010000:3.0:1715330313.206997:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330313.206999:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f48c900, rc 0) 00000100:00100000:3.0:1715330313.207050:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+177:18878:x1798653938080192:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 898us (1087us total) trans 4294983674 rc 0/0 00000100:00100000:3.0:1715330313.207056:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23627 00000020:00080000:3.0:1715330313.207069:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.211916:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.212016:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938080320 00000100:00100000:3.0:1715330313.212026:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938080320 00000100:00100000:3.0:1715330313.212232:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5134 00000100:00100000:3.0:1715330313.212240:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fbedc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+177:18878:x1798653938080320:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330313.212476:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].85, 168 off23064 00000001:00080000:3.0:1715330313.212482:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983675 00000100:00100000:3.0:1715330313.212576:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fbedc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+179:18878:x1798653938080320:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 336us (671us total) trans 4294983676 rc 0/0 00000100:00100000:3.0:1715330313.212583:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5134 00000020:00080000:3.0:1715330313.212588:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.215834:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.215921:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938080448 00000100:00100000:3.0:1715330313.215931:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938080448 00000100:00100000:3.0:1715330313.215988:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23628 00000100:00100000:3.0:1715330313.215997:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+179:18878:x1798653938080448:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:3.0:1715330313.216020:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330313.216043:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f840/0xd895711d66da32d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbc2e expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.216159:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66da334 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.216173:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66da334 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.216184:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66da334 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.216196:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d440/0xd895711d66da33b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a2d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.216202:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d440/0xd895711d66da33b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.216207:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d440/0xd895711d66da33b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:3.0:1715330313.216527:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9dc:0x0], index 0: 0 00000040:00080000:3.0:1715330313.216610:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].86, 184 off23248 00010000:00010000:3.0:1715330313.216682:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b6ac0/0xd895711d66da342 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1547:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.216689:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b6ac0/0xd895711d66da342 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1547:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.216695:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b6ac0/0xd895711d66da342 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1547:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330313.216766:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].87, 176 off23424 00000001:00080000:3.0:1715330313.216772:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983677 00010000:00010000:3.0:1715330313.216800:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66da334 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.216806:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66da334 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.216811:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66da334 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.216817:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66da334 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.216823:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48cd80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330313.216826:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66da334 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.216833:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66da334 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.216844:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330313.216847:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330313.216851:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66da334 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.216857:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cd80/0xd895711d66da334 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330313.216868:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093b59c00 reply state ffff8800938eb000 transno 4294983678 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d440/0xd895711d66da33b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.216875:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d440/0xd895711d66da33b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.216881:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a2d2 (ffff88009ef25600) 00010000:00010000:3.0:1715330313.216883:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330313.216886:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330313.216908:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f840/0xd895711d66da32d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc2e expref: 183 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.216921:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b6ac0/0xd895711d66da342 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1547:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc2e expref: 182 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.216927:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1547:0x0].0x0 (ffff88009ef25100) 00010000:00010000:3.0:1715330313.216929:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330313.216931:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a91b6ac0, rc 0) 00000100:00100000:3.0:1715330313.216982:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+183:18878:x1798653938080448:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 985us (1161us total) trans 4294983678 rc 0/0 00000100:00100000:3.0:1715330313.216989:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23628 00000020:00080000:3.0:1715330313.216994:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1715330313.217123:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330313.220961:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330313.221055:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938080576 00000100:00100000:2.0:1715330313.221074:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938080576 00000100:00100000:2.0:1715330313.221130:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5135 00000100:00100000:2.0:1715330313.221137:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+183:18878:x1798653938080576:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:2.0:1715330313.221389:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].88, 168 off23592 00000001:00080000:2.0:1715330313.221394:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983679 00000100:00100000:2.0:1715330313.221506:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+185:18878:x1798653938080576:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 367us (556us total) trans 4294983680 rc 0/0 00000100:00100000:2.0:1715330313.221513:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5135 00000020:00080000:2.0:1715330313.221518:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1715330313.227074:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.227225:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938080704 00000100:00100000:3.0:1715330313.227235:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938080704 00000100:00100000:3.0:1715330313.227309:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23629 00000100:00100000:3.0:1715330313.227316:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+185:18878:x1798653938080704:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:3.0:1715330313.227341:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330313.227362:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7a80/0xd895711d66da350 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbc35 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.227473:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7cc0/0xd895711d66da357 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.227487:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7cc0/0xd895711d66da357 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.227499:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7cc0/0xd895711d66da357 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.227512:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7600/0xd895711d66da35e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a3d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.227517:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7600/0xd895711d66da35e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.227522:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7600/0xd895711d66da35e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00080000:3.0:1715330313.227855:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9dc:0x0], index 1: 0 00000040:00080000:3.0:1715330313.227935:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].89, 184 off23776 00010000:00010000:3.0:1715330313.227998:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b4d80/0xd895711d66da365 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1548:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.228005:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b4d80/0xd895711d66da365 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1548:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.228011:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b4d80/0xd895711d66da365 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1548:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:3.0:1715330313.228052:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].90, 176 off23952 00000001:00080000:3.0:1715330313.228071:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983681 00010000:00010000:3.0:1715330313.228098:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7cc0/0xd895711d66da357 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.228104:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7cc0/0xd895711d66da357 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.228110:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7cc0/0xd895711d66da357 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.228115:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7cc0/0xd895711d66da357 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.228125:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a91b7cc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330313.228128:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7cc0/0xd895711d66da357 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.228134:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7cc0/0xd895711d66da357 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.228143:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330313.228146:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330313.228150:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7cc0/0xd895711d66da357 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.228154:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7cc0/0xd895711d66da357 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:3.0:1715330313.228183:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012fa84700 reply state ffff8800938ec000 transno 4294983682 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7600/0xd895711d66da35e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.228191:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7600/0xd895711d66da35e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.228196:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a3d2 (ffff88009bbf0800) 00010000:00010000:3.0:1715330313.228198:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330313.228201:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330313.228222:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7a80/0xd895711d66da350 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc35 expref: 189 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.228233:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b4d80/0xd895711d66da365 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1548:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc35 expref: 188 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.228239:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1548:0x0].0x0 (ffff88009bbf0e00) 00010000:00010000:3.0:1715330313.228242:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330313.228244:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a91b4d80, rc 0) 00000100:00100000:3.0:1715330313.228306:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+189:18878:x1798653938080704:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 989us (1252us total) trans 4294983682 rc 0/0 00000100:00100000:3.0:1715330313.228312:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23629 00000020:00080000:3.0:1715330313.228318:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.232548:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.232645:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938080832 00000100:00100000:3.0:1715330313.232655:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938080832 00000100:00100000:3.0:1715330313.232712:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5136 00000100:00100000:3.0:1715330313.232721:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+189:18878:x1798653938080832:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330313.233001:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].91, 168 off24120 00000001:00080000:3.0:1715330313.233008:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983683 00000100:00100000:3.0:1715330313.233106:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+191:18878:x1798653938080832:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 385us (571us total) trans 4294983684 rc 0/0 00000100:00100000:3.0:1715330313.233114:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5136 00000020:00080000:3.0:1715330313.233119:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1715330313.238891:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.238992:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938080960 00000100:00100000:3.0:1715330313.239003:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938080960 00000100:00100000:3.0:1715330313.239070:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23630 00000100:00100000:3.0:1715330313.239078:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+191:18878:x1798653938080960:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:3.0:1715330313.239103:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330313.239124:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b5680/0xd895711d66da373 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbc3c expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.239226:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b4b40/0xd895711d66da37a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.239239:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b4b40/0xd895711d66da37a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.239251:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b4b40/0xd895711d66da37a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.239262:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b6d00/0xd895711d66da381 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989ad3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.239267:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b6d00/0xd895711d66da381 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.239272:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b6d00/0xd895711d66da381 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00080000:3.0:1715330313.239555:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9dd:0x0], index 0: 0 00000040:00080000:3.0:1715330313.239630:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].92, 184 off24304 00010000:00010000:3.0:1715330313.239686:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7180/0xd895711d66da388 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1549:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.239693:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7180/0xd895711d66da388 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1549:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.239698:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7180/0xd895711d66da388 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1549:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:3.0:1715330313.239767:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].93, 176 off24480 00000001:00080000:3.0:1715330313.239772:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983685 00010000:00010000:3.0:1715330313.239797:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b4b40/0xd895711d66da37a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.239802:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b4b40/0xd895711d66da37a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.239807:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b4b40/0xd895711d66da37a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.239815:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b4b40/0xd895711d66da37a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.239820:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a91b4b40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330313.239823:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b4b40/0xd895711d66da37a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.239830:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b4b40/0xd895711d66da37a lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.239840:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330313.239842:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330313.239847:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b4b40/0xd895711d66da37a lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.239851:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b4b40/0xd895711d66da37a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:3.0:1715330313.239873:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007d628700 reply state ffff8800938ed000 transno 4294983686 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b6d00/0xd895711d66da381 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.239882:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b6d00/0xd895711d66da381 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.239887:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ad3 (ffff88009bbf0300) 00010000:00010000:3.0:1715330313.239889:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330313.239891:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330313.239910:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b5680/0xd895711d66da373 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc3c expref: 195 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.239921:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7180/0xd895711d66da388 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1549:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc3c expref: 194 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.239932:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1549:0x0].0x0 (ffff88009bbf0500) 00010000:00010000:3.0:1715330313.239934:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330313.239935:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a91b7180, rc 0) 00000100:00100000:3.0:1715330313.239980:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+195:18878:x1798653938080960:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 902us (1255us total) trans 4294983686 rc 0/0 00000100:00100000:3.0:1715330313.239985:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23630 00000020:00080000:3.0:1715330313.239990:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.244128:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330313.244217:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938081088 00000100:00100000:2.0:1715330313.244226:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938081088 00000100:00100000:2.0:1715330313.244282:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5137 00000100:00100000:2.0:1715330313.244289:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+195:18878:x1798653938081088:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:2.0:1715330313.244607:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].95, 168 off24744 00000001:00080000:2.0:1715330313.244614:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983687 00000100:00100000:2.0:1715330313.244719:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+197:18878:x1798653938081088:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 428us (601us total) trans 4294983688 rc 0/0 00000100:00100000:2.0:1715330313.244727:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5137 00000020:00080000:2.0:1715330313.244755:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.251703:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.252205:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938081216 00000100:00100000:3.0:1715330313.252215:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938081216 00000100:00100000:3.0:1715330313.252463:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23631 00000100:00100000:3.0:1715330313.252471:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+197:18878:x1798653938081216:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:3.0:1715330313.252494:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330313.252515:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b73c0/0xd895711d66da396 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbc43 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.252616:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b46c0/0xd895711d66da39d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.252629:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b46c0/0xd895711d66da39d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.252639:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b46c0/0xd895711d66da39d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.252653:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b5680/0xd895711d66da3a4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989bd3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.252659:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b5680/0xd895711d66da3a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.252667:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b5680/0xd895711d66da3a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00080000:3.0:1715330313.252966:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9dd:0x0], index 1: 0 00000040:00080000:3.0:1715330313.253040:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].96, 184 off24928 00010000:00010000:3.0:1715330313.253104:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b4b40/0xd895711d66da3ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x154a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.253111:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b4b40/0xd895711d66da3ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.253116:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b4b40/0xd895711d66da3ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:3.0:1715330313.253150:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].97, 176 off25104 00000001:00080000:3.0:1715330313.253154:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983689 00010000:00010000:3.0:1715330313.253175:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b46c0/0xd895711d66da39d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.253180:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b46c0/0xd895711d66da39d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.253184:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b46c0/0xd895711d66da39d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.253189:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b46c0/0xd895711d66da39d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.253193:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a91b46c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330313.253197:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b46c0/0xd895711d66da39d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.253202:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b46c0/0xd895711d66da39d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.253212:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330313.253215:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330313.253219:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b46c0/0xd895711d66da39d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.253223:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b46c0/0xd895711d66da39d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:3.0:1715330313.253252:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093b5a680 reply state ffff8800938ee000 transno 4294983690 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b5680/0xd895711d66da3a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.253260:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b5680/0xd895711d66da3a4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.253265:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989bd3 (ffff88009bbf0200) 00010000:00010000:3.0:1715330313.253267:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330313.253270:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330313.253289:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b73c0/0xd895711d66da396 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc43 expref: 201 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.253302:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b4b40/0xd895711d66da3ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x154a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc43 expref: 200 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.253407:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154a:0x0].0x0 (ffff88009bbf0600) 00010000:00010000:3.0:1715330313.253409:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330313.253411:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a91b4b40, rc 0) 00000100:00100000:3.0:1715330313.254081:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+201:18878:x1798653938081216:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 1608us (2388us total) trans 4294983690 rc 0/0 00000100:00100000:3.0:1715330313.254089:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23631 00000020:00080000:3.0:1715330313.254095:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.258410:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.258527:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938081344 00000100:00100000:3.0:1715330313.258537:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938081344 00000100:00100000:3.0:1715330313.259339:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5138 00000100:00100000:3.0:1715330313.259346:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+201:18878:x1798653938081344:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330313.259561:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].98, 168 off25272 00000001:00080000:3.0:1715330313.259566:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983691 00000100:00100000:3.0:1715330313.259645:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+203:18878:x1798653938081344:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 299us (1247us total) trans 4294983692 rc 0/0 00000100:00100000:3.0:1715330313.260197:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5138 00000020:00080000:3.0:1715330313.260205:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.266693:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.266997:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938081472 00000100:00100000:3.0:1715330313.267007:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938081472 00000100:00100000:3.0:1715330313.267073:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23632 00000100:00100000:3.0:1715330313.267081:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+203:18878:x1798653938081472:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:3.0:1715330313.267109:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330313.267132:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7a80/0xd895711d66da3b9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbc4a expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.267240:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7cc0/0xd895711d66da3c0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.267255:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7cc0/0xd895711d66da3c0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.267336:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7cc0/0xd895711d66da3c0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.267354:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b73c0/0xd895711d66da3c7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989cd3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.267360:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b73c0/0xd895711d66da3c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.267366:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b73c0/0xd895711d66da3c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00080000:3.0:1715330313.267660:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9de:0x0], index 0: 0 00000040:00080000:3.0:1715330313.267770:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].99, 184 off25456 00010000:00010000:3.0:1715330313.267836:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b46c0/0xd895711d66da3ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x154b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.267843:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b46c0/0xd895711d66da3ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.267849:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b46c0/0xd895711d66da3ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:3.0:1715330313.267893:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].100, 176 off25632 00000001:00080000:3.0:1715330313.267897:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983693 00010000:00010000:3.0:1715330313.267923:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7cc0/0xd895711d66da3c0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.267929:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7cc0/0xd895711d66da3c0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.267934:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7cc0/0xd895711d66da3c0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.267940:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7cc0/0xd895711d66da3c0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.267945:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a91b7cc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330313.267949:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7cc0/0xd895711d66da3c0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.267955:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7cc0/0xd895711d66da3c0 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.267967:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330313.267969:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330313.267973:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7cc0/0xd895711d66da3c0 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.267978:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7cc0/0xd895711d66da3c0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:3.0:1715330313.268006:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093b5ad80 reply state ffff8800938ef000 transno 4294983694 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b73c0/0xd895711d66da3c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.268014:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b73c0/0xd895711d66da3c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.268019:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989cd3 (ffff88009bbf0700) 00010000:00010000:3.0:1715330313.268020:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330313.268023:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330313.268046:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7a80/0xd895711d66da3b9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc4a expref: 207 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.268068:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b46c0/0xd895711d66da3ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x154b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc4a expref: 206 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.268074:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154b:0x0].0x0 (ffff88009bbf0a00) 00010000:00010000:3.0:1715330313.268076:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330313.268078:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a91b46c0, rc 0) 00000100:00100000:3.0:1715330313.269237:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+207:18878:x1798653938081472:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 2151us (2551us total) trans 4294983694 rc 0/0 00000100:00100000:3.0:1715330313.269246:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23632 00000020:00080000:3.0:1715330313.269253:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.274480:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.274594:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938081600 00000100:00100000:3.0:1715330313.274602:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938081600 00000100:00100000:3.0:1715330313.274652:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5139 00000100:00100000:3.0:1715330313.274659:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+207:18878:x1798653938081600:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330313.274906:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].101, 168 off25800 00000001:00080000:3.0:1715330313.274910:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983695 00000100:00100000:3.0:1715330313.274998:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+209:18878:x1798653938081600:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 338us (529us total) trans 4294983696 rc 0/0 00000100:00100000:3.0:1715330313.275004:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5139 00000020:00080000:3.0:1715330313.275011:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.277936:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.278288:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938081728 00000100:00100000:3.0:1715330313.278297:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938081728 00000100:00100000:3.0:1715330313.278363:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23633 00000100:00100000:3.0:1715330313.278369:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+209:18878:x1798653938081728:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:3.0:1715330313.278392:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330313.278412:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7a80/0xd895711d66da3dc lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbc51 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.278526:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7cc0/0xd895711d66da3e3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.278540:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7cc0/0xd895711d66da3e3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.278550:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7cc0/0xd895711d66da3e3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.278562:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cfa80/0xd895711d66da3ea lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989dd3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.278568:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cfa80/0xd895711d66da3ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.278573:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cfa80/0xd895711d66da3ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00080000:3.0:1715330313.278895:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9de:0x0], index 1: 0 00000040:00080000:3.0:1715330313.278972:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].102, 184 off25984 00010000:00010000:3.0:1715330313.279038:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cef40/0xd895711d66da3f1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x154c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.279045:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cef40/0xd895711d66da3f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.279052:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cef40/0xd895711d66da3f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:3.0:1715330313.279110:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].103, 176 off26160 00000001:00080000:3.0:1715330313.279114:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983697 00010000:00010000:3.0:1715330313.279143:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7cc0/0xd895711d66da3e3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.279150:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7cc0/0xd895711d66da3e3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.279155:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7cc0/0xd895711d66da3e3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.279161:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7cc0/0xd895711d66da3e3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.279166:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a91b7cc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330313.279170:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7cc0/0xd895711d66da3e3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.279177:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7cc0/0xd895711d66da3e3 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.279189:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330313.279191:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330313.279195:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7cc0/0xd895711d66da3e3 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.279200:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7cc0/0xd895711d66da3e3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:3.0:1715330313.279210:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093b5b480 reply state ffff88009aea8000 transno 4294983698 ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cfa80/0xd895711d66da3ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.279218:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cfa80/0xd895711d66da3ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.279223:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989dd3 (ffff88009bbf0b00) 00010000:00010000:3.0:1715330313.279225:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330313.279227:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330313.279248:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7a80/0xd895711d66da3dc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc51 expref: 213 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.279260:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cef40/0xd895711d66da3f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x154c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc51 expref: 212 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.279266:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154c:0x0].0x0 (ffff88009bbf0d00) 00010000:00010000:3.0:1715330313.279268:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330313.279270:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800939cef40, rc 0) 00000100:00100000:3.0:1715330313.280164:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+213:18878:x1798653938081728:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 1791us (2237us total) trans 4294983698 rc 0/0 00000100:00100000:3.0:1715330313.280171:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23633 00000020:00080000:3.0:1715330313.280177:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.283194:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330313.283300:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938081856 00000100:00100000:2.0:1715330313.283310:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938081856 00000100:00100000:2.0:1715330313.283377:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5140 00000100:00100000:2.0:1715330313.283385:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fbed850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+213:18878:x1798653938081856:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:2.0:1715330313.283633:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].104, 168 off26328 00000001:00080000:2.0:1715330313.283639:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983699 00000100:00100000:2.0:1715330313.283781:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fbed850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+215:18878:x1798653938081856:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 395us (595us total) trans 4294983700 rc 0/0 00000100:00100000:2.0:1715330313.283788:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5140 00000020:00080000:2.0:1715330313.283794:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.290686:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.291163:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938081984 00000100:00100000:3.0:1715330313.291172:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938081984 00000100:00100000:3.0:1715330313.291244:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23634 00000100:00100000:3.0:1715330313.291251:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+215:18878:x1798653938081984:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:3.0:1715330313.291277:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330313.291301:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce640/0xd895711d66da3ff lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbc58 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.291411:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ced00/0xd895711d66da406 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.291426:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ced00/0xd895711d66da406 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.291437:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ced00/0xd895711d66da406 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.291449:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc480/0xd895711d66da40d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989ed3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.291454:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc480/0xd895711d66da40d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.291459:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc480/0xd895711d66da40d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00080000:3.0:1715330313.291857:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9df:0x0], index 0: 0 00000040:00080000:3.0:1715330313.291936:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].105, 184 off26512 00010000:00010000:3.0:1715330313.292004:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cdf80/0xd895711d66da414 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x154d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.292016:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cdf80/0xd895711d66da414 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.292028:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cdf80/0xd895711d66da414 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:3.0:1715330313.292076:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].106, 176 off26688 00000001:00080000:3.0:1715330313.292080:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983701 00010000:00010000:3.0:1715330313.292105:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ced00/0xd895711d66da406 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.292110:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ced00/0xd895711d66da406 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.292114:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ced00/0xd895711d66da406 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.292119:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ced00/0xd895711d66da406 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.292123:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800939ced00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330313.292127:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ced00/0xd895711d66da406 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.292132:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ced00/0xd895711d66da406 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.292141:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330313.292143:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330313.292146:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ced00/0xd895711d66da406 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.292150:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ced00/0xd895711d66da406 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:3.0:1715330313.292180:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093b5b800 reply state ffff88009aea9000 transno 4294983702 ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc480/0xd895711d66da40d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.292189:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc480/0xd895711d66da40d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.292194:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ed3 (ffff88009bbf0c00) 00010000:00010000:3.0:1715330313.292196:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330313.292199:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330313.292227:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce640/0xd895711d66da3ff lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc58 expref: 219 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.292240:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cdf80/0xd895711d66da414 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x154d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc58 expref: 218 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.292246:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154d:0x0].0x0 (ffff88009bbf0f00) 00010000:00010000:3.0:1715330313.292248:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330313.292250:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800939cdf80, rc 0) 00000100:00100000:3.0:1715330313.292580:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+219:18878:x1798653938081984:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 1328us (1906us total) trans 4294983702 rc 0/0 00000100:00100000:3.0:1715330313.292591:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23634 00000020:00080000:3.0:1715330313.292596:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.296466:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.296600:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938082112 00000100:00100000:3.0:1715330313.296610:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938082112 00000100:00100000:2.0:1715330313.296860:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5141 00000100:00100000:2.0:1715330313.296869:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+219:18878:x1798653938082112:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:2.0:1715330313.297153:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].107, 168 off26856 00000001:00080000:2.0:1715330313.297159:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983703 00000100:00100000:2.0:1715330313.297263:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+221:18878:x1798653938082112:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 393us (808us total) trans 4294983704 rc 0/0 00000100:00100000:2.0:1715330313.297271:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5141 00000020:00080000:2.0:1715330313.297276:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.302445:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.303906:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938082240 00000100:00100000:3.0:1715330313.303919:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938082240 00000100:00100000:3.0:1715330313.303981:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23635 00000100:00100000:3.0:1715330313.303990:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+221:18878:x1798653938082240:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:3.0:1715330313.304018:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330313.304042:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc240/0xd895711d66da422 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbc5f expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.304164:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce400/0xd895711d66da429 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.304177:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce400/0xd895711d66da429 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.304189:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce400/0xd895711d66da429 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.304202:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce1c0/0xd895711d66da430 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989fd3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.304207:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce1c0/0xd895711d66da430 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.304213:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce1c0/0xd895711d66da430 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00080000:3.0:1715330313.304537:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9df:0x0], index 1: 0 00000040:00080000:3.0:1715330313.304618:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].108, 184 off27040 00010000:00010000:3.0:1715330313.304683:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cf600/0xd895711d66da437 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x154e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.304690:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cf600/0xd895711d66da437 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.304695:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cf600/0xd895711d66da437 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:3.0:1715330313.304770:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].109, 176 off27216 00000001:00080000:3.0:1715330313.304775:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983705 00010000:00010000:3.0:1715330313.304804:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce400/0xd895711d66da429 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.304812:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce400/0xd895711d66da429 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.304817:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce400/0xd895711d66da429 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.304822:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce400/0xd895711d66da429 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.304827:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800939ce400 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330313.304830:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce400/0xd895711d66da429 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.304836:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce400/0xd895711d66da429 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.304847:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330313.304849:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330313.304853:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce400/0xd895711d66da429 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.304858:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce400/0xd895711d66da429 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:3.0:1715330313.304887:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093b59f80 reply state ffff88009aeaa000 transno 4294983706 ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce1c0/0xd895711d66da430 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.304894:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce1c0/0xd895711d66da430 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.304898:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989fd3 (ffff8800ad835f00) 00010000:00010000:3.0:1715330313.304900:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330313.304903:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330313.304926:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc240/0xd895711d66da422 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc5f expref: 225 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.304939:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cf600/0xd895711d66da437 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x154e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc5f expref: 224 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.304945:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154e:0x0].0x0 (ffff8800ad835d00) 00010000:00010000:3.0:1715330313.304946:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330313.304948:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800939cf600, rc 0) 00000100:00100000:3.0:1715330313.305008:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+225:18878:x1798653938082240:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 1019us (2577us total) trans 4294983706 rc 0/0 00000100:00100000:3.0:1715330313.305015:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23635 00000020:00080000:3.0:1715330313.305022:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.308493:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.308628:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938082368 00000100:00100000:3.0:1715330313.308637:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938082368 00000100:00100000:3.0:1715330313.309506:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5142 00000100:00100000:3.0:1715330313.309514:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+225:18878:x1798653938082368:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330313.309771:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].110, 168 off27384 00000001:00080000:3.0:1715330313.309777:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983707 00000100:00100000:3.0:1715330313.309876:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+227:18878:x1798653938082368:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 361us (1392us total) trans 4294983708 rc 0/0 00000100:00100000:3.0:1715330313.309883:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5142 00000020:00080000:3.0:1715330313.309888:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1715330313.315820:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330313.315900:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938082496 00000100:00100000:0.0:1715330313.315909:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938082496 00000100:00100000:0.0:1715330313.315970:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23636 00000100:00100000:0.0:1715330313.315978:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+227:18878:x1798653938082496:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:0.0:1715330313.316001:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330313.316023:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3a80/0xd895711d66da445 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbc66 expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330313.316131:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66da44c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330313.316146:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66da44c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330313.316156:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66da44c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330313.316168:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3840/0xd895711d66da453 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a0d3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330313.316173:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3840/0xd895711d66da453 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330313.316178:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3840/0xd895711d66da453 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:0.0:1715330313.316458:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e0:0x0], index 0: 0 00000040:00080000:0.0:1715330313.316538:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].111, 184 off27568 00010000:00010000:0.0:1715330313.316604:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a21c0/0xd895711d66da45a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x154f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330313.316611:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a21c0/0xd895711d66da45a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330313.316617:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a21c0/0xd895711d66da45a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:0.0:1715330313.316660:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].112, 176 off27744 00000001:00080000:0.0:1715330313.316664:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983709 00010000:00010000:0.0:1715330313.316691:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66da44c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330313.316696:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66da44c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330313.316701:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66da44c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330313.316706:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66da44c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330313.316711:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a2f40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330313.316715:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66da44c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330313.316721:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66da44c lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330313.316843:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:0.0:1715330313.316846:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330313.316851:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66da44c lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330313.316857:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66da44c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:0.0:1715330313.322142:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009b4c3480 reply state ffff880093823000 transno 4294983710 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3840/0xd895711d66da453 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330313.322169:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3840/0xd895711d66da453 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330313.322178:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a0d3 (ffff88012ca48b00) 00010000:00010000:0.0:1715330313.322180:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330313.322185:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1715330313.322242:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3a80/0xd895711d66da445 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc66 expref: 231 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330313.322262:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a21c0/0xd895711d66da45a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x154f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc66 expref: 230 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330313.322268:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154f:0x0].0x0 (ffff88012ca48e00) 00010000:00010000:0.0:1715330313.322270:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715330313.322272:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a21c0, rc 0) 00000100:00100000:0.0:1715330313.322363:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+231:18878:x1798653938082496:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 6386us (6557us total) trans 4294983710 rc 0/0 00000100:00100000:0.0:1715330313.322371:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23636 00000020:00080000:0.0:1715330313.322378:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.326326:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330313.326440:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938082624 00000100:00100000:2.0:1715330313.326451:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938082624 00000100:00100000:2.0:1715330313.326557:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5143 00000100:00100000:2.0:1715330313.326564:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+231:18878:x1798653938082624:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:2.0:1715330313.326940:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].113, 168 off27912 00000001:00080000:2.0:1715330313.326946:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983711 00000100:00100000:2.0:1715330313.329192:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+233:18878:x1798653938082624:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 2617us (2868us total) trans 4294983712 rc 0/0 00000100:00100000:2.0:1715330313.329207:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5143 00000020:00080000:2.0:1715330313.329215:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.336045:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330313.336147:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938082752 00000100:00100000:2.0:1715330313.336157:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938082752 00000100:00100000:2.0:1715330313.336276:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23637 00000100:00100000:2.0:1715330313.336284:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+233:18878:x1798653938082752:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:2.0:1715330313.336308:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330313.336329:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0480/0xd895711d66da468 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbc6d expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.336445:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66da46f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.336460:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66da46f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.336472:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66da46f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.336486:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66da476 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a1d3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.336492:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66da476 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.336498:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66da476 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:2.0:1715330313.336838:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e0:0x0], index 1: 0 00000040:00080000:2.0:1715330313.336918:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].114, 184 off28096 00010000:00010000:2.0:1715330313.336980:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66da47d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1550:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.336987:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66da47d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1550:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.336993:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66da47d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1550:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:2.0:1715330313.337036:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].115, 176 off28272 00000001:00080000:2.0:1715330313.337040:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983713 00010000:00010000:2.0:1715330313.337079:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66da46f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.337085:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66da46f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.337091:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66da46f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.337096:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66da46f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.337101:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f2ac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330313.337103:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66da46f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.337109:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66da46f lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.337121:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330313.337123:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330313.337127:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66da46f lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.337131:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66da46f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:2.0:1715330313.337148:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093b5b100 reply state ffff88009388c000 transno 4294983714 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66da476 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.337154:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66da476 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.337159:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a1d3 (ffff88012bfb5100) 00010000:00010000:2.0:1715330313.337160:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330313.337162:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1715330313.337185:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0480/0xd895711d66da468 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc6d expref: 237 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.337196:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66da47d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1550:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc6d expref: 236 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.337201:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1550:0x0].0x0 (ffff88012bfb5900) 00010000:00010000:2.0:1715330313.337203:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330313.337205:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f21c0, rc 0) 00000100:00100000:2.0:1715330313.340535:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+237:18878:x1798653938082752:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 4238us (4489us total) trans 4294983714 rc 0/0 00000100:00100000:2.0:1715330313.340548:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23637 00000020:00080000:2.0:1715330313.340557:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.365552:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330313.365683:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938082880 00000100:00100000:2.0:1715330313.365693:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938082880 00000100:00100000:3.0:1715330313.365920:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5144 00000100:00100000:3.0:1715330313.365928:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+237:18878:x1798653938082880:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330313.366163:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].116, 168 off28440 00000001:00080000:3.0:1715330313.366168:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983715 00000100:00100000:3.0:1715330313.366264:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+239:18878:x1798653938082880:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 335us (719us total) trans 4294983716 rc 0/0 00000100:00100000:3.0:1715330313.366271:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5144 00000020:00080000:3.0:1715330313.366275:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.371461:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330313.371577:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938083008 00000100:00100000:2.0:1715330313.371587:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938083008 00000100:00100000:2.0:1715330313.371650:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23638 00000100:00100000:2.0:1715330313.371658:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+239:18878:x1798653938083008:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:2.0:1715330313.371685:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330313.371708:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0480/0xd895711d66da48b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbc74 expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.371843:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66da492 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.373006:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66da492 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.373021:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66da492 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.373036:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66da499 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a2d3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.373043:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66da499 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.373049:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66da499 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:2.0:1715330313.373362:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e1:0x0], index 0: 0 00000040:00080000:2.0:1715330313.373443:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].117, 184 off28624 00010000:00010000:2.0:1715330313.373511:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66da4a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1551:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.373518:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66da4a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1551:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.373525:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66da4a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1551:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:2.0:1715330313.373641:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].118, 176 off28800 00000001:00080000:2.0:1715330313.373647:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983717 00010000:00010000:2.0:1715330313.373678:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66da492 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.373684:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66da492 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.373689:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66da492 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.373695:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66da492 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.373700:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f2ac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330313.373704:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66da492 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.373711:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66da492 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.373722:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330313.373725:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330313.373764:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66da492 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.373770:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66da492 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:2.0:1715330313.373793:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093b58e00 reply state ffff88009388d000 transno 4294983718 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66da499 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.373801:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66da499 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.373807:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a2d3 (ffff88012bfb5400) 00010000:00010000:2.0:1715330313.373809:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330313.373811:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1715330313.373838:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0480/0xd895711d66da48b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc74 expref: 243 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.373851:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66da4a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1551:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc74 expref: 242 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.373858:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1551:0x0].0x0 (ffff88012bfb5200) 00010000:00010000:2.0:1715330313.373860:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330313.373862:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad9f1440, rc 0) 00000100:00100000:2.0:1715330313.373942:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+243:18878:x1798653938083008:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 2283us (2491us total) trans 4294983718 rc 0/0 00000100:00100000:2.0:1715330313.373950:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23638 00000020:00080000:2.0:1715330313.373956:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1715330313.380828:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.381489:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938083136 00000100:00100000:3.0:1715330313.381500:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938083136 00000100:00100000:3.0:1715330313.381555:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5145 00000100:00100000:3.0:1715330313.381563:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+243:18878:x1798653938083136:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330313.381863:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].119, 168 off28968 00000001:00080000:3.0:1715330313.381869:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983719 00000100:00100000:3.0:1715330313.381971:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+245:18878:x1798653938083136:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 408us (1155us total) trans 4294983720 rc 0/0 00000100:00100000:3.0:1715330313.381979:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5145 00000020:00080000:3.0:1715330313.381984:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.392354:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330313.392421:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938083264 00000100:00100000:2.0:1715330313.392431:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938083264 00000100:00100000:2.0:1715330313.392495:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23639 00000100:00100000:2.0:1715330313.392503:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+245:18878:x1798653938083264:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:2.0:1715330313.392530:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330313.392552:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0480/0xd895711d66da4ae lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbc7b expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.392662:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66da4b5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.392677:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66da4b5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.392688:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66da4b5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.392715:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738000/0xd895711d66da4bc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a3d3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.392720:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738000/0xd895711d66da4bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.392725:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738000/0xd895711d66da4bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:2.0:1715330313.394919:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e1:0x0], index 1: 0 00000040:00080000:2.0:1715330313.395008:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].120, 184 off29152 00010000:00010000:2.0:1715330313.395107:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738240/0xd895711d66da4c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1552:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.395121:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738240/0xd895711d66da4c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1552:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.395130:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738240/0xd895711d66da4c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1552:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:2.0:1715330313.395180:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].121, 176 off29328 00000001:00080000:2.0:1715330313.395184:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983721 00010000:00010000:2.0:1715330313.395216:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66da4b5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.395222:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66da4b5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.395231:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66da4b5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.395237:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66da4b5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.395242:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f2ac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330313.395245:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66da4b5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.395252:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66da4b5 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.395263:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330313.395266:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330313.395270:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66da4b5 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.395275:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2ac0/0xd895711d66da4b5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:2.0:1715330313.395311:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093b59880 reply state ffff88009388e000 transno 4294983722 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738000/0xd895711d66da4bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.395320:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738000/0xd895711d66da4bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.395325:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a3d3 (ffff88012bfb5500) 00010000:00010000:2.0:1715330313.395327:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330313.395330:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1715330313.395365:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0480/0xd895711d66da4ae lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc7b expref: 249 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.395381:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738240/0xd895711d66da4c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1552:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc7b expref: 248 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.395387:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1552:0x0].0x0 (ffff88012bfb5700) 00010000:00010000:2.0:1715330313.395389:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330313.395391:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d738240, rc 0) 00000100:00100000:2.0:1715330313.395475:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+249:18878:x1798653938083264:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 2971us (3130us total) trans 4294983722 rc 0/0 00000100:00100000:2.0:1715330313.395483:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23639 00000020:00080000:2.0:1715330313.395490:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.403879:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330313.404206:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938083392 00000100:00100000:2.0:1715330313.404218:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938083392 00000100:00100000:2.0:1715330313.404279:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5146 00000100:00100000:2.0:1715330313.404286:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fbed450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+249:18878:x1798653938083392:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:2.0:1715330313.404553:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].122, 168 off29496 00000001:00080000:2.0:1715330313.404558:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983723 00000100:00100000:2.0:1715330313.404655:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fbed450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+251:18878:x1798653938083392:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 368us (788us total) trans 4294983724 rc 0/0 00000100:00100000:2.0:1715330313.404662:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5146 00000020:00080000:2.0:1715330313.404667:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.420239:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330313.420567:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938083520 00000100:00100000:2.0:1715330313.420578:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938083520 00000100:00100000:2.0:1715330313.420645:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23640 00000100:00100000:2.0:1715330313.420652:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+251:18878:x1798653938083520:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:2.0:1715330313.420680:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330313.420704:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738480/0xd895711d66da4d1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbc82 expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.420838:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7386c0/0xd895711d66da4d8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.420854:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7386c0/0xd895711d66da4d8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.420866:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7386c0/0xd895711d66da4d8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.420881:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738900/0xd895711d66da4df lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989ad4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.420887:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738900/0xd895711d66da4df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.420892:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738900/0xd895711d66da4df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:2.0:1715330313.421222:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e2:0x0], index 0: 0 00000040:00080000:2.0:1715330313.421291:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].123, 184 off29680 00010000:00010000:2.0:1715330313.421348:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738b40/0xd895711d66da4e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1553:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.421355:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738b40/0xd895711d66da4e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1553:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.421360:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738b40/0xd895711d66da4e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1553:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:2.0:1715330313.421395:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].124, 176 off29856 00000001:00080000:2.0:1715330313.421399:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983725 00010000:00010000:2.0:1715330313.421420:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7386c0/0xd895711d66da4d8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.421426:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7386c0/0xd895711d66da4d8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.421431:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7386c0/0xd895711d66da4d8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.421435:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7386c0/0xd895711d66da4d8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.421440:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d7386c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330313.421443:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7386c0/0xd895711d66da4d8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.421448:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7386c0/0xd895711d66da4d8 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.421456:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330313.421459:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330313.421462:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7386c0/0xd895711d66da4d8 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.421466:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7386c0/0xd895711d66da4d8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:2.0:1715330313.421481:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093b58380 reply state ffff88009388f000 transno 4294983726 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738900/0xd895711d66da4df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.421488:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738900/0xd895711d66da4df lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.421492:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ad4 (ffff88008b374e00) 00010000:00010000:2.0:1715330313.421495:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330313.421497:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1715330313.421514:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738480/0xd895711d66da4d1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc82 expref: 255 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.421524:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738b40/0xd895711d66da4e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1553:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc82 expref: 254 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.421530:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1553:0x0].0x0 (ffff88008b374d00) 00010000:00010000:2.0:1715330313.421532:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330313.421534:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d738b40, rc 0) 00000100:00100000:2.0:1715330313.422279:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+255:18878:x1798653938083520:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 1625us (2051us total) trans 4294983726 rc 0/0 00000100:00100000:2.0:1715330313.422288:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23640 00000020:00080000:2.0:1715330313.422294:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.427926:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.428026:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938083648 00000100:00100000:3.0:1715330313.428036:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938083648 00000100:00100000:3.0:1715330313.428102:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5147 00000100:00100000:3.0:1715330313.428110:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+255:18878:x1798653938083648:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330313.428366:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].125, 168 off30024 00000001:00080000:3.0:1715330313.428372:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983727 00000100:00100000:3.0:1715330313.430126:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+257:18878:x1798653938083648:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 2010us (2209us total) trans 4294983728 rc 0/0 00000100:00100000:3.0:1715330313.430137:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5147 00000020:00080000:3.0:1715330313.430144:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.434196:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330313.434441:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938083776 00000100:00100000:2.0:1715330313.434450:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938083776 00000100:00100000:2.0:1715330313.434511:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23641 00000100:00100000:2.0:1715330313.434518:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+257:18878:x1798653938083776:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:2.0:1715330313.434544:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330313.434567:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738d80/0xd895711d66da4f4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbc89 expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.434694:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738fc0/0xd895711d66da4fb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.434709:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738fc0/0xd895711d66da4fb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.434723:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738fc0/0xd895711d66da4fb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.434772:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739200/0xd895711d66da502 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989bd4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.434778:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739200/0xd895711d66da502 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.434783:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739200/0xd895711d66da502 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:2.0:1715330313.435094:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e2:0x0], index 1: 0 00000040:00080000:2.0:1715330313.435184:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].126, 184 off30208 00010000:00010000:2.0:1715330313.435252:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739440/0xd895711d66da509 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1554:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.435258:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739440/0xd895711d66da509 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1554:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.435264:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739440/0xd895711d66da509 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1554:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:2.0:1715330313.435303:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].127, 176 off30384 00000001:00080000:2.0:1715330313.435306:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983729 00010000:00010000:2.0:1715330313.435331:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738fc0/0xd895711d66da4fb lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.435336:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738fc0/0xd895711d66da4fb lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.435342:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738fc0/0xd895711d66da4fb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.435348:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738fc0/0xd895711d66da4fb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.435357:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d738fc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330313.435361:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738fc0/0xd895711d66da4fb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.435367:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738fc0/0xd895711d66da4fb lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.435379:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330313.435382:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330313.435387:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738fc0/0xd895711d66da4fb lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.435392:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738fc0/0xd895711d66da4fb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:2.0:1715330313.435416:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093b5a300 reply state ffff8800938d0000 transno 4294983730 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739200/0xd895711d66da502 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.435423:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739200/0xd895711d66da502 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.435427:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989bd4 (ffff88008b374a00) 00010000:00010000:2.0:1715330313.435429:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330313.435431:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1715330313.435452:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738d80/0xd895711d66da4f4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc89 expref: 261 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.435462:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739440/0xd895711d66da509 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1554:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc89 expref: 260 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.435468:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1554:0x0].0x0 (ffff88008b374700) 00010000:00010000:2.0:1715330313.435470:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330313.435472:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d739440, rc 0) 00000100:00100000:2.0:1715330313.436983:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+261:18878:x1798653938083776:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 2456us (2792us total) trans 4294983730 rc 0/0 00000100:00100000:2.0:1715330313.436993:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23641 00000020:00080000:2.0:1715330313.437001:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.443537:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.443967:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938083904 00000100:00100000:3.0:1715330313.443977:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938083904 00000100:00100000:3.0:1715330313.444026:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5148 00000100:00100000:3.0:1715330313.444034:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+261:18878:x1798653938083904:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330313.444276:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].128, 168 off30552 00000001:00080000:3.0:1715330313.444281:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983731 00000100:00100000:3.0:1715330313.446428:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+263:18878:x1798653938083904:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 2382us (3695us total) trans 4294983732 rc 0/0 00000100:00100000:3.0:1715330313.446445:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5148 00000020:00080000:3.0:1715330313.446453:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.456624:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330313.456698:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938084032 00000100:00100000:2.0:1715330313.456707:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938084032 00000100:00100000:2.0:1715330313.456924:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23642 00000100:00100000:2.0:1715330313.456932:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+263:18878:x1798653938084032:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:2.0:1715330313.456960:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330313.456982:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739680/0xd895711d66da517 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbc90 expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.457099:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7398c0/0xd895711d66da51e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.457113:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7398c0/0xd895711d66da51e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.457125:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7398c0/0xd895711d66da51e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.457138:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739b00/0xd895711d66da525 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989cd4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.457143:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739b00/0xd895711d66da525 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.457148:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739b00/0xd895711d66da525 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:2.0:1715330313.457457:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e3:0x0], index 0: 0 00000040:00080000:2.0:1715330313.457549:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].129, 184 off30736 00010000:00010000:2.0:1715330313.457617:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739d40/0xd895711d66da52c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1555:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.457625:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739d40/0xd895711d66da52c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1555:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.457631:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739d40/0xd895711d66da52c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1555:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:2.0:1715330313.457678:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].130, 176 off30912 00000001:00080000:2.0:1715330313.457682:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983733 00010000:00010000:2.0:1715330313.457713:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7398c0/0xd895711d66da51e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.457720:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7398c0/0xd895711d66da51e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.457724:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7398c0/0xd895711d66da51e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.457757:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7398c0/0xd895711d66da51e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.457763:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d7398c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330313.457767:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7398c0/0xd895711d66da51e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.457773:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7398c0/0xd895711d66da51e lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.457784:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330313.457787:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330313.457792:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7398c0/0xd895711d66da51e lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.457797:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7398c0/0xd895711d66da51e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:2.0:1715330313.457835:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093b58a80 reply state ffff8800938d1000 transno 4294983734 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739b00/0xd895711d66da525 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.457843:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739b00/0xd895711d66da525 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.457848:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989cd4 (ffff88008b374900) 00010000:00010000:2.0:1715330313.457849:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330313.457852:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1715330313.457875:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739680/0xd895711d66da517 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc90 expref: 267 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.457888:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739d40/0xd895711d66da52c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1555:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc90 expref: 266 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.457894:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1555:0x0].0x0 (ffff88008b374100) 00010000:00010000:2.0:1715330313.457895:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330313.457897:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d739d40, rc 0) 00000100:00100000:2.0:1715330313.457972:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+267:18878:x1798653938084032:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 1040us (1358us total) trans 4294983734 rc 0/0 00000100:00100000:2.0:1715330313.457978:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23642 00000020:00080000:2.0:1715330313.457984:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.465037:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.465258:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938084160 00000100:00100000:3.0:1715330313.465267:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938084160 00000100:00100000:3.0:1715330313.465325:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5149 00000100:00100000:3.0:1715330313.465333:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+267:18878:x1798653938084160:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330313.465579:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].131, 168 off31080 00000001:00080000:3.0:1715330313.465585:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983735 00000100:00100000:3.0:1715330313.467653:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+269:18878:x1798653938084160:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 2311us (2618us total) trans 4294983736 rc 0/0 00000100:00100000:3.0:1715330313.467666:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5149 00000020:00080000:3.0:1715330313.467674:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.472452:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.472616:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938084288 00000100:00100000:3.0:1715330313.472627:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938084288 00000100:00100000:3.0:1715330313.472686:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23643 00000100:00100000:3.0:1715330313.472693:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+269:18878:x1798653938084288:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:3.0:1715330313.472719:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330313.472773:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce880/0xd895711d66da53a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbc97 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.472889:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cfcc0/0xd895711d66da541 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.472906:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cfcc0/0xd895711d66da541 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.472917:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cfcc0/0xd895711d66da541 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.472929:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ccfc0/0xd895711d66da548 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989dd4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.472934:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ccfc0/0xd895711d66da548 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.472940:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ccfc0/0xd895711d66da548 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00080000:3.0:1715330313.473275:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e3:0x0], index 1: 0 00000040:00080000:3.0:1715330313.473359:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].132, 184 off31264 00010000:00010000:3.0:1715330313.473423:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cd8c0/0xd895711d66da54f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1556:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.473430:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cd8c0/0xd895711d66da54f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1556:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.473436:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cd8c0/0xd895711d66da54f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1556:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:3.0:1715330313.473480:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].133, 176 off31440 00000001:00080000:3.0:1715330313.473485:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983737 00010000:00010000:3.0:1715330313.473514:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cfcc0/0xd895711d66da541 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.473520:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cfcc0/0xd895711d66da541 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.473529:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cfcc0/0xd895711d66da541 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.473534:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cfcc0/0xd895711d66da541 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.473540:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800939cfcc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330313.473543:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cfcc0/0xd895711d66da541 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.473550:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cfcc0/0xd895711d66da541 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.473560:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330313.473564:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330313.473568:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cfcc0/0xd895711d66da541 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.473573:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cfcc0/0xd895711d66da541 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:3.0:1715330313.473599:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093a8c380 reply state ffff88009aeab000 transno 4294983738 ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ccfc0/0xd895711d66da548 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.473607:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ccfc0/0xd895711d66da548 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.473612:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989dd4 (ffff8800ab6b5500) 00010000:00010000:3.0:1715330313.473614:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330313.473617:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330313.473641:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce880/0xd895711d66da53a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc97 expref: 273 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.473657:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cd8c0/0xd895711d66da54f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1556:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc97 expref: 272 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.473663:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1556:0x0].0x0 (ffff8800ab6b5000) 00010000:00010000:3.0:1715330313.473664:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330313.473666:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800939cd8c0, rc 0) 00000100:00100000:3.0:1715330313.473724:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+273:18878:x1798653938084288:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 1031us (1284us total) trans 4294983738 rc 0/0 00000100:00100000:3.0:1715330313.473755:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23643 00000020:00080000:3.0:1715330313.473759:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.478684:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.479289:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938084416 00000100:00100000:3.0:1715330313.479299:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938084416 00000100:00100000:3.0:1715330313.479410:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5150 00000100:00100000:3.0:1715330313.479418:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+273:18878:x1798653938084416:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330313.479687:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].134, 168 off31608 00000001:00080000:3.0:1715330313.479692:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983739 00000100:00100000:3.0:1715330313.481508:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+275:18878:x1798653938084416:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 2084us (2833us total) trans 4294983740 rc 0/0 00000100:00100000:3.0:1715330313.481520:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5150 00000020:00080000:3.0:1715330313.481528:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.488258:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330313.489457:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938084544 00000100:00100000:2.0:1715330313.489471:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938084544 00000100:00100000:2.0:1715330313.489545:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23644 00000100:00100000:2.0:1715330313.489553:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+275:18878:x1798653938084544:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:2.0:1715330313.489581:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330313.489604:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739f80/0xd895711d66da55d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbc9e expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.489712:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73a1c0/0xd895711d66da564 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.489726:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73a1c0/0xd895711d66da564 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.489760:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73a1c0/0xd895711d66da564 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.489774:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73a400/0xd895711d66da56b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989ed4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.489779:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73a400/0xd895711d66da56b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.489783:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73a400/0xd895711d66da56b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:2.0:1715330313.490095:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e4:0x0], index 0: 0 00000040:00080000:2.0:1715330313.490175:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].135, 184 off31792 00010000:00010000:2.0:1715330313.490235:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73a640/0xd895711d66da572 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1557:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.490242:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73a640/0xd895711d66da572 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1557:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.490247:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73a640/0xd895711d66da572 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1557:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:2.0:1715330313.490286:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].136, 176 off31968 00000001:00080000:2.0:1715330313.490291:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983741 00010000:00010000:2.0:1715330313.490317:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73a1c0/0xd895711d66da564 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.490323:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73a1c0/0xd895711d66da564 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.490328:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73a1c0/0xd895711d66da564 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.490333:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73a1c0/0xd895711d66da564 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.490338:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d73a1c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330313.490341:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73a1c0/0xd895711d66da564 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.490347:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73a1c0/0xd895711d66da564 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.490358:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330313.490360:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330313.490364:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73a1c0/0xd895711d66da564 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.490369:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73a1c0/0xd895711d66da564 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:2.0:1715330313.490385:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093a8ca80 reply state ffff8800938d2000 transno 4294983742 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73a400/0xd895711d66da56b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.490397:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73a400/0xd895711d66da56b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.490402:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ed4 (ffff88008b374000) 00010000:00010000:2.0:1715330313.490404:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330313.490406:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1715330313.490427:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739f80/0xd895711d66da55d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc9e expref: 279 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.490442:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73a640/0xd895711d66da572 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1557:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc9e expref: 278 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.490447:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1557:0x0].0x0 (ffff88008b374c00) 00010000:00010000:2.0:1715330313.490449:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330313.490450:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d73a640, rc 0) 00000100:00100000:2.0:1715330313.490517:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+279:18878:x1798653938084544:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 964us (2271us total) trans 4294983742 rc 0/0 00000100:00100000:2.0:1715330313.490524:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23644 00000020:00080000:2.0:1715330313.490529:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.495584:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.496265:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938084672 00000100:00100000:3.0:1715330313.496276:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938084672 00000100:00100000:3.0:1715330313.496337:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5151 00000100:00100000:3.0:1715330313.496344:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+279:18878:x1798653938084672:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330313.496619:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].137, 168 off32136 00000001:00080000:3.0:1715330313.496626:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983743 00000100:00100000:3.0:1715330313.496753:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+281:18878:x1798653938084672:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 407us (1180us total) trans 4294983744 rc 0/0 00000100:00100000:3.0:1715330313.496760:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5151 00000020:00080000:3.0:1715330313.496766:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.499492:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.499605:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938084800 00000100:00100000:3.0:1715330313.499616:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938084800 00000100:00100000:3.0:1715330313.499679:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23645 00000100:00100000:3.0:1715330313.499687:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+281:18878:x1798653938084800:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:3.0:1715330313.499713:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330313.499771:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cd200/0xd895711d66da580 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbca5 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.501198:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cd440/0xd895711d66da587 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.501216:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cd440/0xd895711d66da587 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.501233:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cd440/0xd895711d66da587 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.501248:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc6c0/0xd895711d66da58e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989fd4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.501253:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc6c0/0xd895711d66da58e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.501258:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc6c0/0xd895711d66da58e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00080000:3.0:1715330313.501537:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e4:0x0], index 1: 0 00000040:00080000:3.0:1715330313.501609:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].138, 184 off32320 00010000:00010000:3.0:1715330313.501673:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc900/0xd895711d66da595 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1558:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.501679:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc900/0xd895711d66da595 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1558:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.501684:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc900/0xd895711d66da595 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1558:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:3.0:1715330313.501720:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].139, 176 off32496 00000001:00080000:3.0:1715330313.501725:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983745 00010000:00010000:3.0:1715330313.501786:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cd440/0xd895711d66da587 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.501792:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cd440/0xd895711d66da587 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.501797:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cd440/0xd895711d66da587 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.501802:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cd440/0xd895711d66da587 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.501807:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800939cd440 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330313.501811:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cd440/0xd895711d66da587 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.501817:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cd440/0xd895711d66da587 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.501827:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330313.501829:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330313.501834:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cd440/0xd895711d66da587 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.501841:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cd440/0xd895711d66da587 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:3.0:1715330313.501853:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093a8d180 reply state ffff88009aeac000 transno 4294983746 ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc6c0/0xd895711d66da58e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.501861:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc6c0/0xd895711d66da58e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.501866:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989fd4 (ffff8800ab6b5400) 00010000:00010000:3.0:1715330313.501868:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330313.501871:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330313.501903:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cd200/0xd895711d66da580 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbca5 expref: 285 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.501920:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc900/0xd895711d66da595 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1558:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbca5 expref: 284 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.501926:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1558:0x0].0x0 (ffff8800ab6b5b00) 00010000:00010000:3.0:1715330313.501928:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330313.501931:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800939cc900, rc 0) 00000100:00100000:3.0:1715330313.502002:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+285:18878:x1798653938084800:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 2315us (2520us total) trans 4294983746 rc 0/0 00000100:00100000:3.0:1715330313.502010:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23645 00000020:00080000:3.0:1715330313.502016:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.507523:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330313.507690:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938084928 00000100:00100000:2.0:1715330313.507699:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938084928 00000100:00100000:2.0:1715330313.507780:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5152 00000100:00100000:2.0:1715330313.507788:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fbed050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+285:18878:x1798653938084928:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:2.0:1715330313.508035:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].140, 168 off32664 00000001:00080000:2.0:1715330313.508041:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983747 00000100:00100000:2.0:1715330313.508157:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fbed050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+287:18878:x1798653938084928:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 369us (646us total) trans 4294983748 rc 0/0 00000100:00100000:2.0:1715330313.508164:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5152 00000020:00080000:2.0:1715330313.508170:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1715330313.516665:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.516787:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938085056 00000100:00100000:3.0:1715330313.516800:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938085056 00000100:00100000:3.0:1715330313.516870:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23646 00000100:00100000:3.0:1715330313.516878:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+287:18878:x1798653938085056:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:3.0:1715330313.516908:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330313.516934:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ccd80/0xd895711d66da5a3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbcac expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.517045:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da5aa lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.517069:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da5aa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.517080:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da5aa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.517093:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cd680/0xd895711d66da5b1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a0d4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.517099:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cd680/0xd895711d66da5b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.517103:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cd680/0xd895711d66da5b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00080000:3.0:1715330313.517400:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e5:0x0], index 0: 0 00000040:00080000:3.0:1715330313.517557:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].142, 184 off32952 00010000:00010000:3.0:1715330313.522314:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cdb00/0xd895711d66da5b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1559:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.522336:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cdb00/0xd895711d66da5b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1559:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.522348:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cdb00/0xd895711d66da5b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1559:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:3.0:1715330313.522451:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].143, 176 off33128 00000001:00080000:3.0:1715330313.522458:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983749 00010000:00010000:3.0:1715330313.522500:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da5aa lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.522506:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da5aa lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.522511:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da5aa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.522516:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da5aa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.522522:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800939cc000 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330313.522526:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da5aa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.522533:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da5aa lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.522545:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330313.522548:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330313.522552:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da5aa lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.522557:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da5aa lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:3.0:1715330313.522597:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012fa84e00 reply state ffff88009aead000 transno 4294983750 ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cd680/0xd895711d66da5b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.522605:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cd680/0xd895711d66da5b1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.522611:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a0d4 (ffff8800ab6b5f00) 00010000:00010000:3.0:1715330313.522613:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330313.522616:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330313.522655:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ccd80/0xd895711d66da5a3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbcac expref: 291 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.522669:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cdb00/0xd895711d66da5b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1559:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbcac expref: 290 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.522675:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1559:0x0].0x0 (ffff8800ab6b5200) 00010000:00010000:3.0:1715330313.522677:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330313.522678:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800939cdb00, rc 0) 00000100:00100000:3.0:1715330313.522777:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+291:18878:x1798653938085056:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 5898us (6123us total) trans 4294983750 rc 0/0 00000100:00100000:3.0:1715330313.522786:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23646 00000020:00080000:3.0:1715330313.522793:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.528961:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.529040:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938085184 00000100:00100000:3.0:1715330313.529050:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938085184 00000100:00100000:3.0:1715330313.529139:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5153 00000100:00100000:3.0:1715330313.529148:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+291:18878:x1798653938085184:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330313.529400:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].144, 168 off33296 00000001:00080000:3.0:1715330313.529407:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983751 00000100:00100000:3.0:1715330313.529518:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+293:18878:x1798653938085184:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 370us (568us total) trans 4294983752 rc 0/0 00000100:00100000:3.0:1715330313.529526:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5153 00000020:00080000:3.0:1715330313.529531:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1715330313.535041:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.535203:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938085312 00000100:00100000:3.0:1715330313.535215:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938085312 00000100:00100000:3.0:1715330313.535306:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23647 00000100:00100000:3.0:1715330313.535314:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+293:18878:x1798653938085312:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:3.0:1715330313.535340:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330313.535366:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ceac0/0xd895711d66da5c6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbcb3 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.535617:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cdd40/0xd895711d66da5cd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.535633:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cdd40/0xd895711d66da5cd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.535646:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cdd40/0xd895711d66da5cd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.535659:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cf3c0/0xd895711d66da5d4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a1d4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.535665:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cf3c0/0xd895711d66da5d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.535669:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cf3c0/0xd895711d66da5d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00080000:3.0:1715330313.537126:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e5:0x0], index 1: 0 00000040:00080000:3.0:1715330313.537216:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].145, 184 off33480 00010000:00010000:3.0:1715330313.537296:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cf180/0xd895711d66da5db lrc: 3/1,0 mode: --/PR res: [0x200000402:0x155a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.537307:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cf180/0xd895711d66da5db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.537316:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cf180/0xd895711d66da5db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:3.0:1715330313.537372:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].146, 176 off33656 00000001:00080000:3.0:1715330313.537377:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983753 00010000:00010000:3.0:1715330313.537407:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cdd40/0xd895711d66da5cd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.537411:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cdd40/0xd895711d66da5cd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.537415:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cdd40/0xd895711d66da5cd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.537419:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cdd40/0xd895711d66da5cd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.537423:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800939cdd40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330313.537426:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cdd40/0xd895711d66da5cd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.537430:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cdd40/0xd895711d66da5cd lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.537438:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330313.537440:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330313.537444:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cdd40/0xd895711d66da5cd lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.537447:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cdd40/0xd895711d66da5cd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:3.0:1715330313.537627:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007d629c00 reply state ffff88009aeae000 transno 4294983754 ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cf3c0/0xd895711d66da5d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.537634:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cf3c0/0xd895711d66da5d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.537637:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a1d4 (ffff8800ab6b5300) 00010000:00010000:3.0:1715330313.537639:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330313.537641:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330313.537670:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ceac0/0xd895711d66da5c6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbcb3 expref: 297 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.537681:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cf180/0xd895711d66da5db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x155a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbcb3 expref: 296 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.537686:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155a:0x0].0x0 (ffff8800ab6b5100) 00010000:00010000:3.0:1715330313.537688:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330313.537690:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800939cf180, rc 0) 00000100:00100000:3.0:1715330313.537776:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+297:18878:x1798653938085312:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 2460us (2745us total) trans 4294983754 rc 0/0 00000100:00100000:3.0:1715330313.537787:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23647 00000020:00080000:3.0:1715330313.537794:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.546030:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.548765:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938085440 00000100:00100000:3.0:1715330313.548781:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938085440 00000100:00100000:3.0:1715330313.548859:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5154 00000100:00100000:3.0:1715330313.548868:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+297:18878:x1798653938085440:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330313.549150:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].147, 168 off33824 00000001:00080000:3.0:1715330313.549156:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983755 00000100:00100000:3.0:1715330313.549279:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+299:18878:x1798653938085440:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 409us (3263us total) trans 4294983756 rc 0/0 00000100:00100000:3.0:1715330313.549286:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5154 00000020:00080000:3.0:1715330313.549291:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.557825:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.557957:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938085568 00000100:00100000:3.0:1715330313.557967:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938085568 00000100:00100000:2.0:1715330313.558402:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23648 00000100:00100000:2.0:1715330313.558410:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+299:18878:x1798653938085568:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:2.0:1715330313.558437:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330313.558460:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73a880/0xd895711d66da5e9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbcba expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.558581:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73aac0/0xd895711d66da5f0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.558594:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73aac0/0xd895711d66da5f0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.558604:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73aac0/0xd895711d66da5f0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.558616:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73ad00/0xd895711d66da5f7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a2d4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.558621:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73ad00/0xd895711d66da5f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.558625:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73ad00/0xd895711d66da5f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:2.0:1715330313.558961:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e6:0x0], index 0: 0 00000040:00080000:2.0:1715330313.559039:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].148, 184 off34008 00010000:00010000:2.0:1715330313.559113:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73af40/0xd895711d66da5fe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x155b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.559120:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73af40/0xd895711d66da5fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.559126:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73af40/0xd895711d66da5fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:2.0:1715330313.559163:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].149, 176 off34184 00000001:00080000:2.0:1715330313.559167:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983757 00010000:00010000:2.0:1715330313.559192:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73aac0/0xd895711d66da5f0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.559198:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73aac0/0xd895711d66da5f0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.559203:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73aac0/0xd895711d66da5f0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.559208:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73aac0/0xd895711d66da5f0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.559213:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d73aac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330313.559216:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73aac0/0xd895711d66da5f0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.559222:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73aac0/0xd895711d66da5f0 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.559231:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330313.559234:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330313.559237:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73aac0/0xd895711d66da5f0 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.559242:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73aac0/0xd895711d66da5f0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:2.0:1715330313.559767:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093a8dc00 reply state ffff8800938d3000 transno 4294983758 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73ad00/0xd895711d66da5f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.559776:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73ad00/0xd895711d66da5f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.559783:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a2d4 (ffff88008b374600) 00010000:00010000:2.0:1715330313.559785:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330313.559788:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1715330313.559816:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73a880/0xd895711d66da5e9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbcba expref: 303 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.559828:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73af40/0xd895711d66da5fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x155b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbcba expref: 302 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.559834:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155b:0x0].0x0 (ffff88008b374400) 00010000:00010000:2.0:1715330313.559836:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330313.559838:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d73af40, rc 0) 00000100:00100000:2.0:1715330313.560093:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+303:18878:x1798653938085568:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 1682us (2279us total) trans 4294983758 rc 0/0 00000100:00100000:2.0:1715330313.560101:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23648 00000020:00080000:2.0:1715330313.560107:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.568496:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330313.569215:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938085696 00000100:00100000:2.0:1715330313.569226:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938085696 00000100:00100000:2.0:1715330313.569284:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5155 00000100:00100000:2.0:1715330313.569293:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+303:18878:x1798653938085696:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:2.0:1715330313.569525:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].150, 168 off34352 00000001:00080000:2.0:1715330313.569530:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983759 00000100:00100000:2.0:1715330313.569654:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+305:18878:x1798653938085696:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 360us (1167us total) trans 4294983760 rc 0/0 00000100:00100000:2.0:1715330313.569661:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5155 00000020:00080000:2.0:1715330313.569666:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.574139:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330313.574246:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938085824 00000100:00100000:2.0:1715330313.574258:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938085824 00000100:00100000:2.0:1715330313.574321:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23649 00000100:00100000:2.0:1715330313.574330:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+305:18878:x1798653938085824:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:2.0:1715330313.574358:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330313.574379:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b180/0xd895711d66da60c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbcc1 expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.574494:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da613 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.574508:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da613 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.574520:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da613 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.574533:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b600/0xd895711d66da61a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a3d4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.574538:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b600/0xd895711d66da61a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.574542:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b600/0xd895711d66da61a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:2.0:1715330313.574971:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e6:0x0], index 1: 0 00000040:00080000:2.0:1715330313.575069:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].151, 184 off34536 00010000:00010000:2.0:1715330313.575140:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b840/0xd895711d66da621 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x155c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.575147:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b840/0xd895711d66da621 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.575155:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b840/0xd895711d66da621 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:2.0:1715330313.575201:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].152, 176 off34712 00000001:00080000:2.0:1715330313.575206:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983761 00010000:00010000:2.0:1715330313.575236:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da613 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.575241:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da613 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.575246:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da613 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.575251:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da613 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.575256:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d73b3c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330313.575259:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da613 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.575265:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da613 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.575275:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330313.575278:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330313.575281:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da613 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.575286:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da613 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:2.0:1715330313.575298:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093a8e300 reply state ffff8800938d4000 transno 4294983762 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b600/0xd895711d66da61a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.575305:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b600/0xd895711d66da61a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.575311:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a3d4 (ffff88008b374b00) 00010000:00010000:2.0:1715330313.575312:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330313.575315:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1715330313.575336:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b180/0xd895711d66da60c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbcc1 expref: 309 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.575347:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b840/0xd895711d66da621 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x155c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbcc1 expref: 308 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.575352:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155c:0x0].0x0 (ffff88009ef57100) 00010000:00010000:2.0:1715330313.575354:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330313.575356:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d73b840, rc 0) 00000100:00100000:2.0:1715330313.575425:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+309:18878:x1798653938085824:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 1096us (1298us total) trans 4294983762 rc 0/0 00000100:00100000:2.0:1715330313.575433:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23649 00000020:00080000:2.0:1715330313.575438:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.579243:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.579329:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938085952 00000100:00100000:3.0:1715330313.579339:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938085952 00000100:00100000:3.0:1715330313.579400:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5156 00000100:00100000:3.0:1715330313.579409:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+309:18878:x1798653938085952:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330313.579631:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].153, 168 off34880 00000001:00080000:3.0:1715330313.579635:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983763 00000100:00100000:3.0:1715330313.579826:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+311:18878:x1798653938085952:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 418us (594us total) trans 4294983764 rc 0/0 00000100:00100000:3.0:1715330313.579834:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5156 00000020:00080000:3.0:1715330313.579839:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.586033:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330313.586146:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938086080 00000100:00100000:2.0:1715330313.586155:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938086080 00000100:00100000:2.0:1715330313.586214:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23650 00000100:00100000:2.0:1715330313.586222:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+311:18878:x1798653938086080:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:2.0:1715330313.586248:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330313.586271:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b180/0xd895711d66da62f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbcc8 expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.586384:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da636 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.586398:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da636 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.586410:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da636 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.586423:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73ba80/0xd895711d66da63d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989ad5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.586429:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73ba80/0xd895711d66da63d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.586434:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73ba80/0xd895711d66da63d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:2.0:1715330313.587335:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e7:0x0], index 0: 0 00000040:00080000:2.0:1715330313.587441:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].154, 184 off35064 00010000:00010000:2.0:1715330313.588130:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73bcc0/0xd895711d66da644 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x155d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.588142:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73bcc0/0xd895711d66da644 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.588152:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73bcc0/0xd895711d66da644 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:2.0:1715330313.588215:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].155, 176 off35240 00000001:00080000:2.0:1715330313.588220:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983765 00010000:00010000:2.0:1715330313.588254:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da636 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.588260:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da636 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.588266:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da636 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.588275:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da636 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.588281:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d73b3c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330313.588284:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da636 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.588290:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da636 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.588302:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330313.588305:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330313.588308:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da636 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.588313:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da636 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:2.0:1715330313.588350:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093a8ea00 reply state ffff8800938d5000 transno 4294983766 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73ba80/0xd895711d66da63d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.588359:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73ba80/0xd895711d66da63d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.588363:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ad5 (ffff88009ef57f00) 00010000:00010000:2.0:1715330313.588366:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330313.588369:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1715330313.588401:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b180/0xd895711d66da62f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbcc8 expref: 315 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.588414:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73bcc0/0xd895711d66da644 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x155d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbcc8 expref: 314 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.588425:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155d:0x0].0x0 (ffff88009ef57a00) 00010000:00010000:2.0:1715330313.588428:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330313.588430:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d73bcc0, rc 0) 00000100:00100000:2.0:1715330313.589693:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+315:18878:x1798653938086080:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 3463us (3880us total) trans 4294983766 rc 0/0 00000100:00100000:2.0:1715330313.589705:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23650 00000020:00080000:2.0:1715330313.589713:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.593396:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.593484:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938086208 00000100:00100000:3.0:1715330313.593495:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938086208 00000100:00100000:3.0:1715330313.593698:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5157 00000100:00100000:3.0:1715330313.593707:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+315:18878:x1798653938086208:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330313.594427:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].156, 168 off35408 00000001:00080000:3.0:1715330313.594433:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983767 00000100:00100000:3.0:1715330313.594631:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+317:18878:x1798653938086208:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 923us (1245us total) trans 4294983768 rc 0/0 00000100:00100000:3.0:1715330313.594639:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5157 00000020:00080000:3.0:1715330313.594645:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.597342:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330313.597411:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938086336 00000100:00100000:2.0:1715330313.597423:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938086336 00000100:00100000:2.0:1715330313.597492:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23651 00000100:00100000:2.0:1715330313.597500:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+317:18878:x1798653938086336:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:2.0:1715330313.597526:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330313.597551:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b180/0xd895711d66da652 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbccf expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.597655:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da659 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.597668:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da659 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.597678:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da659 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.597688:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73a880/0xd895711d66da660 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989bd5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.597691:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73a880/0xd895711d66da660 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.597698:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73a880/0xd895711d66da660 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:2.0:1715330313.598075:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e7:0x0], index 1: 0 00000040:00080000:2.0:1715330313.598160:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].157, 184 off35592 00010000:00010000:2.0:1715330313.598225:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73aac0/0xd895711d66da667 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x155e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.598233:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73aac0/0xd895711d66da667 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.598238:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73aac0/0xd895711d66da667 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:2.0:1715330313.598280:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].158, 176 off35768 00000001:00080000:2.0:1715330313.598284:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983769 00010000:00010000:2.0:1715330313.598313:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da659 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.598319:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da659 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.598325:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da659 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.598331:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da659 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.598337:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d73b3c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330313.598340:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da659 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.598345:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da659 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.598357:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330313.598360:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330313.598364:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da659 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.598369:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da659 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:2.0:1715330313.598396:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093a8f100 reply state ffff8800938d6000 transno 4294983770 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73a880/0xd895711d66da660 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.598405:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73a880/0xd895711d66da660 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.598409:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989bd5 (ffff88009ef57200) 00010000:00010000:2.0:1715330313.598411:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330313.598413:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1715330313.598434:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b180/0xd895711d66da652 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbccf expref: 321 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.598446:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73aac0/0xd895711d66da667 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x155e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbccf expref: 320 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.598452:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155e:0x0].0x0 (ffff88009ef57400) 00010000:00010000:2.0:1715330313.598454:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330313.598456:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d73aac0, rc 0) 00000100:00100000:2.0:1715330313.598519:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+321:18878:x1798653938086336:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 1019us (1191us total) trans 4294983770 rc 0/0 00000100:00100000:2.0:1715330313.598526:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23651 00000020:00080000:2.0:1715330313.598532:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.601895:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.602173:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938086464 00000100:00100000:3.0:1715330313.602183:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938086464 00000100:00100000:3.0:1715330313.602363:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5158 00000100:00100000:3.0:1715330313.602371:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fbecc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+321:18878:x1798653938086464:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330313.602623:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].159, 168 off35936 00000001:00080000:3.0:1715330313.602629:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983771 00000100:00100000:3.0:1715330313.604120:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fbecc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+323:18878:x1798653938086464:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 1746us (2234us total) trans 4294983772 rc 0/0 00000100:00100000:3.0:1715330313.604129:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5158 00000020:00080000:3.0:1715330313.604136:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.611155:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330313.611222:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938086592 00000100:00100000:2.0:1715330313.611233:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938086592 00000100:00100000:2.0:1715330313.611633:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23652 00000100:00100000:2.0:1715330313.611641:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+323:18878:x1798653938086592:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:2.0:1715330313.611669:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330313.611693:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b180/0xd895711d66da675 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbcd6 expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.611849:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da67c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.611864:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da67c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.611874:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da67c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.611886:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739f80/0xd895711d66da683 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989cd5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.611891:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739f80/0xd895711d66da683 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.611896:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739f80/0xd895711d66da683 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:2.0:1715330313.613169:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e8:0x0], index 0: 0 00000040:00080000:2.0:1715330313.613263:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].160, 184 off36120 00010000:00010000:2.0:1715330313.613347:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73a1c0/0xd895711d66da68a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x155f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.613358:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73a1c0/0xd895711d66da68a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.613372:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73a1c0/0xd895711d66da68a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:2.0:1715330313.613422:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].161, 176 off36296 00000001:00080000:2.0:1715330313.613426:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983773 00010000:00010000:2.0:1715330313.613455:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da67c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.613460:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da67c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.613466:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da67c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.613471:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da67c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.613477:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d73b3c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330313.613481:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da67c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.613487:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da67c lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.613499:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330313.613502:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330313.613506:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da67c lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.613512:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da67c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:2.0:1715330313.613545:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093a8f480 reply state ffff8800938d7000 transno 4294983774 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739f80/0xd895711d66da683 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.613554:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739f80/0xd895711d66da683 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.613559:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989cd5 (ffff88009ef57900) 00010000:00010000:2.0:1715330313.613561:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330313.613565:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1715330313.613598:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b180/0xd895711d66da675 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbcd6 expref: 327 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.613611:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73a1c0/0xd895711d66da68a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x155f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbcd6 expref: 326 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.613617:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155f:0x0].0x0 (ffff88009bbb0300) 00010000:00010000:2.0:1715330313.613620:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330313.613622:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d73a1c0, rc 0) 00000100:00100000:2.0:1715330313.613703:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+327:18878:x1798653938086592:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 2062us (2557us total) trans 4294983774 rc 0/0 00000100:00100000:2.0:1715330313.613712:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23652 00000020:00080000:2.0:1715330313.613719:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.619811:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.619902:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938086720 00000100:00100000:3.0:1715330313.619911:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938086720 00000100:00100000:3.0:1715330313.619964:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5159 00000100:00100000:3.0:1715330313.619972:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+327:18878:x1798653938086720:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330313.620258:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].162, 168 off36464 00000001:00080000:3.0:1715330313.620264:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983775 00000100:00100000:3.0:1715330313.622139:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+329:18878:x1798653938086720:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 2157us (2328us total) trans 4294983776 rc 0/0 00000100:00100000:3.0:1715330313.622150:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5159 00000020:00080000:3.0:1715330313.622158:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.624900:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330313.624985:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938086848 00000100:00100000:2.0:1715330313.624996:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938086848 00000100:00100000:2.0:1715330313.625105:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23653 00000100:00100000:2.0:1715330313.625115:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+329:18878:x1798653938086848:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:2.0:1715330313.625147:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330313.625171:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739680/0xd895711d66da698 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbcdd expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.625299:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7398c0/0xd895711d66da69f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.625314:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7398c0/0xd895711d66da69f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.625326:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7398c0/0xd895711d66da69f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.625341:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738d80/0xd895711d66da6a6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989dd5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.625346:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738d80/0xd895711d66da6a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.625350:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738d80/0xd895711d66da6a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:2.0:1715330313.625657:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e8:0x0], index 1: 0 00000040:00080000:2.0:1715330313.625783:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].163, 184 off36648 00010000:00010000:2.0:1715330313.625851:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738fc0/0xd895711d66da6ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1560:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.625858:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738fc0/0xd895711d66da6ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1560:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.625864:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738fc0/0xd895711d66da6ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1560:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:2.0:1715330313.625903:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].164, 176 off36824 00000001:00080000:2.0:1715330313.625908:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983777 00010000:00010000:2.0:1715330313.625936:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7398c0/0xd895711d66da69f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.625942:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7398c0/0xd895711d66da69f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.625952:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7398c0/0xd895711d66da69f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.625958:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7398c0/0xd895711d66da69f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.625963:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d7398c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330313.625966:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7398c0/0xd895711d66da69f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.625973:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7398c0/0xd895711d66da69f lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.625983:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330313.625986:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330313.625990:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7398c0/0xd895711d66da69f lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.625994:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7398c0/0xd895711d66da69f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:2.0:1715330313.626015:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093a8fb80 reply state ffff880073bd8000 transno 4294983778 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738d80/0xd895711d66da6a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.626022:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738d80/0xd895711d66da6a6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.626028:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989dd5 (ffff88009bbb0600) 00010000:00010000:2.0:1715330313.626030:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330313.626032:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1715330313.626065:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739680/0xd895711d66da698 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbcdd expref: 333 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.626083:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738fc0/0xd895711d66da6ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1560:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbcdd expref: 332 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.626089:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1560:0x0].0x0 (ffff88009bbb0100) 00010000:00010000:2.0:1715330313.626091:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330313.626093:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d738fc0, rc 0) 00000100:00100000:2.0:1715330313.627755:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+333:18878:x1798653938086848:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 2633us (2857us total) trans 4294983778 rc 0/0 00000100:00100000:2.0:1715330313.627766:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23653 00000020:00080000:2.0:1715330313.627774:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.631159:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.631902:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938086976 00000100:00100000:3.0:1715330313.631912:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938086976 00000100:00100000:3.0:1715330313.631964:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5160 00000100:00100000:3.0:1715330313.631970:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+333:18878:x1798653938086976:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330313.632311:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].165, 168 off36992 00000001:00080000:3.0:1715330313.632318:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983779 00000100:00100000:3.0:1715330313.632419:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+335:18878:x1798653938086976:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 447us (1271us total) trans 4294983780 rc 0/0 00000100:00100000:3.0:1715330313.632427:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5160 00000020:00080000:3.0:1715330313.632432:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.636728:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330313.636890:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938087104 00000100:00100000:2.0:1715330313.636900:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938087104 00000100:00100000:2.0:1715330313.636964:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23654 00000100:00100000:2.0:1715330313.636972:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+335:18878:x1798653938087104:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:2.0:1715330313.637000:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330313.637021:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738480/0xd895711d66da6bb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbce4 expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.637145:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7386c0/0xd895711d66da6c2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.637161:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7386c0/0xd895711d66da6c2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.637172:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7386c0/0xd895711d66da6c2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.637189:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739680/0xd895711d66da6c9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989ed5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.637194:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739680/0xd895711d66da6c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.637199:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739680/0xd895711d66da6c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:2.0:1715330313.637504:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e9:0x0], index 0: 0 00000040:00080000:2.0:1715330313.637586:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].166, 184 off37176 00010000:00010000:2.0:1715330313.637646:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7398c0/0xd895711d66da6d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1561:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.637652:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7398c0/0xd895711d66da6d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1561:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.637658:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7398c0/0xd895711d66da6d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1561:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:2.0:1715330313.637692:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].167, 176 off37352 00000001:00080000:2.0:1715330313.637696:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983781 00010000:00010000:2.0:1715330313.637716:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7386c0/0xd895711d66da6c2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.637722:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7386c0/0xd895711d66da6c2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.637726:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7386c0/0xd895711d66da6c2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.637763:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7386c0/0xd895711d66da6c2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.637767:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d7386c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330313.637770:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7386c0/0xd895711d66da6c2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.637777:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7386c0/0xd895711d66da6c2 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.637787:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330313.637790:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330313.637793:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7386c0/0xd895711d66da6c2 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.637798:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7386c0/0xd895711d66da6c2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:2.0:1715330313.637815:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093a8d880 reply state ffff880073bd9000 transno 4294983782 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739680/0xd895711d66da6c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.637822:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739680/0xd895711d66da6c9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.637827:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ed5 (ffff88009bbb0700) 00010000:00010000:2.0:1715330313.637829:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330313.637830:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1715330313.637852:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738480/0xd895711d66da6bb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbce4 expref: 339 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.637862:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7398c0/0xd895711d66da6d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1561:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbce4 expref: 338 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.637867:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1561:0x0].0x0 (ffff88009bbb0d00) 00010000:00010000:2.0:1715330313.637869:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330313.637870:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d7398c0, rc 0) 00000100:00100000:2.0:1715330313.637923:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+339:18878:x1798653938087104:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 953us (1209us total) trans 4294983782 rc 0/0 00000100:00100000:2.0:1715330313.637933:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23654 00000020:00080000:2.0:1715330313.637937:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.640851:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330313.640976:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938087232 00000100:00100000:2.0:1715330313.640986:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938087232 00000100:00100000:2.0:1715330313.641107:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5161 00000100:00100000:2.0:1715330313.641114:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+339:18878:x1798653938087232:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:2.0:1715330313.641342:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].168, 168 off37520 00000001:00080000:2.0:1715330313.641347:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983783 00000100:00100000:2.0:1715330313.641594:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+341:18878:x1798653938087232:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 479us (753us total) trans 4294983784 rc 0/0 00000100:00100000:2.0:1715330313.641602:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5161 00000020:00080000:2.0:1715330313.641606:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.645838:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.646681:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938087360 00000100:00100000:3.0:1715330313.646690:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938087360 00000100:00100000:3.0:1715330313.646757:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23655 00000100:00100000:3.0:1715330313.646764:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+341:18878:x1798653938087360:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:3.0:1715330313.646788:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330313.646809:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cf840/0xd895711d66da6de lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbceb expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.646917:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ccb40/0xd895711d66da6e5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.646930:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ccb40/0xd895711d66da6e5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.646941:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ccb40/0xd895711d66da6e5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.646955:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ceac0/0xd895711d66da6ec lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989fd5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.646960:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ceac0/0xd895711d66da6ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.646965:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ceac0/0xd895711d66da6ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00080000:3.0:1715330313.647306:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e9:0x0], index 1: 0 00000040:00080000:3.0:1715330313.647390:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].169, 184 off37704 00010000:00010000:3.0:1715330313.647456:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cdd40/0xd895711d66da6f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1562:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.647463:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cdd40/0xd895711d66da6f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1562:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.647468:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cdd40/0xd895711d66da6f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1562:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:3.0:1715330313.647509:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].170, 176 off37880 00000001:00080000:3.0:1715330313.647513:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983785 00010000:00010000:3.0:1715330313.647540:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ccb40/0xd895711d66da6e5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.647549:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ccb40/0xd895711d66da6e5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.647554:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ccb40/0xd895711d66da6e5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.647560:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ccb40/0xd895711d66da6e5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.647565:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800939ccb40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330313.647568:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ccb40/0xd895711d66da6e5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.647575:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ccb40/0xd895711d66da6e5 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.647586:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330313.647588:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330313.647593:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ccb40/0xd895711d66da6e5 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.647597:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ccb40/0xd895711d66da6e5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:3.0:1715330313.647632:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093a8e680 reply state ffff88009aeaf000 transno 4294983786 ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ceac0/0xd895711d66da6ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.647640:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ceac0/0xd895711d66da6ec lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.647645:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989fd5 (ffff8800b2570000) 00010000:00010000:3.0:1715330313.647647:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330313.647650:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330313.647673:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cf840/0xd895711d66da6de lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbceb expref: 345 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.647684:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cdd40/0xd895711d66da6f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1562:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbceb expref: 344 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.647690:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1562:0x0].0x0 (ffff8800ab6b5e00) 00010000:00010000:3.0:1715330313.647692:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330313.647694:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800939cdd40, rc 0) 00000100:00100000:3.0:1715330313.647767:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+345:18878:x1798653938087360:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 1003us (1941us total) trans 4294983786 rc 0/0 00000100:00100000:3.0:1715330313.647774:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23655 00000020:00080000:3.0:1715330313.647779:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.650879:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330313.651045:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938087488 00000100:00100000:2.0:1715330313.651062:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938087488 00000100:00100000:2.0:1715330313.651117:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5162 00000100:00100000:2.0:1715330313.651124:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+345:18878:x1798653938087488:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:2.0:1715330313.651370:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].171, 168 off38048 00000001:00080000:2.0:1715330313.651375:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983787 00000100:00100000:2.0:1715330313.651472:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+347:18878:x1798653938087488:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 347us (603us total) trans 4294983788 rc 0/0 00000100:00100000:2.0:1715330313.651480:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5162 00000020:00080000:2.0:1715330313.651485:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.655026:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330313.655125:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938087616 00000100:00100000:2.0:1715330313.655135:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938087616 00000100:00100000:2.0:1715330313.655187:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23656 00000100:00100000:2.0:1715330313.655193:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+347:18878:x1798653938087616:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:2.0:1715330313.655221:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330313.655243:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738480/0xd895711d66da701 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbcf2 expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.655343:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7386c0/0xd895711d66da708 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.655356:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7386c0/0xd895711d66da708 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.655367:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7386c0/0xd895711d66da708 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.655380:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b180/0xd895711d66da70f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a0d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.655387:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b180/0xd895711d66da70f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.655391:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b180/0xd895711d66da70f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:2.0:1715330313.655690:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9ea:0x0], index 0: 0 00000040:00080000:2.0:1715330313.655808:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].172, 184 off38232 00010000:00010000:2.0:1715330313.655885:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da716 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1563:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.655891:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da716 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1563:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.655897:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da716 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1563:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:2.0:1715330313.655937:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].173, 176 off38408 00000001:00080000:2.0:1715330313.655942:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983789 00010000:00010000:2.0:1715330313.655965:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7386c0/0xd895711d66da708 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.655971:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7386c0/0xd895711d66da708 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.655976:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7386c0/0xd895711d66da708 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.655982:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7386c0/0xd895711d66da708 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.655988:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d7386c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330313.655991:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7386c0/0xd895711d66da708 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.655998:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7386c0/0xd895711d66da708 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.656009:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330313.656012:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330313.656016:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7386c0/0xd895711d66da708 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.656021:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7386c0/0xd895711d66da708 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:2.0:1715330313.656033:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093a8c000 reply state ffff880073bda000 transno 4294983790 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b180/0xd895711d66da70f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.656041:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b180/0xd895711d66da70f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330313.656045:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a0d5 (ffff880093a11f00) 00010000:00010000:2.0:1715330313.656048:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330313.656057:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1715330313.656078:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738480/0xd895711d66da701 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbcf2 expref: 351 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.656090:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da716 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1563:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbcf2 expref: 350 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.656096:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1563:0x0].0x0 (ffff880093a11d00) 00010000:00010000:2.0:1715330313.656097:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330313.656099:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d73b3c0, rc 0) 00000100:00100000:2.0:1715330313.656153:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+351:18878:x1798653938087616:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 960us (1139us total) trans 4294983790 rc 0/0 00000100:00100000:2.0:1715330313.656160:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23656 00000020:00080000:2.0:1715330313.656165:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.661397:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.661499:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938087744 00000100:00100000:3.0:1715330313.661508:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938087744 00000100:00100000:3.0:1715330313.661560:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5163 00000100:00100000:3.0:1715330313.661568:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+351:18878:x1798653938087744:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330313.661852:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].174, 168 off38576 00000001:00080000:3.0:1715330313.661859:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983791 00000100:00100000:3.0:1715330313.661969:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+353:18878:x1798653938087744:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 400us (583us total) trans 4294983792 rc 0/0 00000100:00100000:3.0:1715330313.661976:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5163 00000020:00080000:3.0:1715330313.661982:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.665523:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.665617:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938087872 00000100:00100000:3.0:1715330313.665626:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938087872 00000100:00100000:3.0:1715330313.666117:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23657 00000100:00100000:3.0:1715330313.666125:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+353:18878:x1798653938087872:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:3.0:1715330313.666155:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330313.666177:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ccd80/0xd895711d66da724 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbcf9 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.666306:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da72b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.666320:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da72b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.666332:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da72b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.666345:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cd200/0xd895711d66da732 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a1d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.666350:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cd200/0xd895711d66da732 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.666355:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cd200/0xd895711d66da732 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00080000:3.0:1715330313.666651:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9ea:0x0], index 1: 0 00000040:00080000:3.0:1715330313.666759:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].175, 184 off38760 00010000:00010000:3.0:1715330313.666823:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cd440/0xd895711d66da739 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1564:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.666830:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cd440/0xd895711d66da739 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1564:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.666835:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cd440/0xd895711d66da739 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1564:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:3.0:1715330313.666880:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].176, 176 off38936 00000001:00080000:3.0:1715330313.666886:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983793 00010000:00010000:3.0:1715330313.666913:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da72b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.666919:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da72b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.666925:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da72b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.666929:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da72b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.666935:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800939cc000 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330313.666939:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da72b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.666946:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da72b lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.666956:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330313.666960:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330313.666965:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da72b lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.666970:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da72b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:3.0:1715330313.666981:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093a8ce00 reply state ffff88008d560000 transno 4294983794 ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cd200/0xd895711d66da732 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.666988:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cd200/0xd895711d66da732 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330313.666994:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a1d5 (ffff880092dfde00) 00010000:00010000:3.0:1715330313.666996:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330313.666999:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330313.667021:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ccd80/0xd895711d66da724 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbcf9 expref: 357 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.667032:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cd440/0xd895711d66da739 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1564:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbcf9 expref: 356 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.667038:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1564:0x0].0x0 (ffff880092dfdb00) 00010000:00010000:3.0:1715330313.667039:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330313.667041:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800939cd440, rc 0) 00000100:00100000:3.0:1715330313.667114:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+357:18878:x1798653938087872:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 989us (1601us total) trans 4294983794 rc 0/0 00000100:00100000:3.0:1715330313.667121:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23657 00000020:00080000:3.0:1715330313.667126:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.671071:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330313.671224:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938088000 00000100:00100000:2.0:1715330313.671234:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938088000 00000100:00100000:2.0:1715330313.671292:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5164 00000100:00100000:2.0:1715330313.671301:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fbec850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+357:18878:x1798653938088000:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:2.0:1715330313.671524:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].177, 168 off39104 00000001:00080000:2.0:1715330313.671528:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983795 00000100:00100000:2.0:1715330313.671620:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fbec850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+359:18878:x1798653938088000:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 320us (570us total) trans 4294983796 rc 0/0 00000100:00100000:2.0:1715330313.671627:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5164 00000020:00080000:2.0:1715330313.671632:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.680351:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.680540:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938088128 00000100:00100000:3.0:1715330313.680552:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938088128 00000100:00100000:3.0:1715330313.680604:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23658 00000100:00100000:3.0:1715330313.680611:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+359:18878:x1798653938088128:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:3.0:1715330313.680637:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330313.680659:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce880/0xd895711d66da747 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbd00 expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.680787:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cfcc0/0xd895711d66da74e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.680801:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cfcc0/0xd895711d66da74e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.680813:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cfcc0/0xd895711d66da74e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.680826:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc240/0xd895711d66da755 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a2d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.680831:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc240/0xd895711d66da755 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.680836:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc240/0xd895711d66da755 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:3.0:1715330313.681142:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9eb:0x0], index 0: 0 00000040:00080000:3.0:1715330313.681215:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].178, 184 off39288 00010000:00010000:3.0:1715330313.681272:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce400/0xd895711d66da75c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1565:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.681278:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce400/0xd895711d66da75c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1565:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.681283:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce400/0xd895711d66da75c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1565:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330313.681317:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].179, 176 off39464 00000001:00080000:3.0:1715330313.681321:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983797 00010000:00010000:3.0:1715330313.681340:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cfcc0/0xd895711d66da74e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.681345:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cfcc0/0xd895711d66da74e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.681350:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cfcc0/0xd895711d66da74e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.681355:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cfcc0/0xd895711d66da74e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.681363:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800939cfcc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330313.681366:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cfcc0/0xd895711d66da74e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.681372:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cfcc0/0xd895711d66da74e lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.681380:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330313.681383:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330313.681386:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cfcc0/0xd895711d66da74e lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.681390:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cfcc0/0xd895711d66da74e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330313.681417:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093a8f800 reply state ffff88008d561000 transno 4294983798 ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc240/0xd895711d66da755 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.681424:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc240/0xd895711d66da755 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.681428:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a2d5 (ffff880092dfd500) 00010000:00010000:3.0:1715330313.681430:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330313.681432:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330313.681449:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce880/0xd895711d66da747 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd00 expref: 363 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.681459:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce400/0xd895711d66da75c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1565:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd00 expref: 362 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.681464:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1565:0x0].0x0 (ffff880092dfdc00) 00010000:00010000:3.0:1715330313.681466:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330313.681468:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800939ce400, rc 0) 00000100:00100000:3.0:1715330313.681521:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+363:18878:x1798653938088128:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 910us (1183us total) trans 4294983798 rc 0/0 00000100:00100000:3.0:1715330313.681527:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23658 00000020:00080000:3.0:1715330313.681532:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.684478:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.684590:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938088256 00000100:00100000:3.0:1715330313.684599:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938088256 00000100:00100000:3.0:1715330313.684762:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5165 00000100:00100000:3.0:1715330313.684769:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+363:18878:x1798653938088256:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330313.685005:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].180, 168 off39632 00000001:00080000:3.0:1715330313.685010:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983799 00000100:00100000:3.0:1715330313.685310:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+365:18878:x1798653938088256:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 539us (841us total) trans 4294983800 rc 0/0 00000100:00100000:3.0:1715330313.685317:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5165 00000020:00080000:3.0:1715330313.685321:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.689170:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330313.689282:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938088384 00000100:00100000:1.0:1715330313.689292:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938088384 00000100:00100000:1.0:1715330313.689353:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23659 00000100:00100000:1.0:1715330313.689361:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ad93a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+365:18878:x1798653938088384:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:1.0:1715330313.689388:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330313.689410:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66da76a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbd07 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330313.689530:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66da771 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.689543:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66da771 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.689554:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66da771 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.689567:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66da778 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a3d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.689572:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66da778 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.689577:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66da778 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00080000:1.0:1715330313.689921:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9eb:0x0], index 1: 0 00000040:00080000:1.0:1715330313.690002:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].181, 184 off39816 00010000:00010000:1.0:1715330313.690078:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66da77f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1566:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.690085:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66da77f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1566:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.690091:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66da77f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1566:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:1.0:1715330313.690135:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].182, 176 off39992 00000001:00080000:1.0:1715330313.690140:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983801 00010000:00010000:1.0:1715330313.690166:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66da771 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.690172:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66da771 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.690178:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66da771 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.690188:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66da771 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.690194:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfcd80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330313.690197:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66da771 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.690204:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66da771 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.690216:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:1.0:1715330313.690218:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330313.690223:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66da771 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.690228:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66da771 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:1.0:1715330313.690244:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800ad93a850 reply state ffff88009aef6000 transno 4294983802 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66da778 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.690252:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66da778 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.690256:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a3d5 (ffff88008b0d2a00) 00010000:00010000:1.0:1715330313.690258:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330313.690261:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1715330313.690281:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66da76a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd07 expref: 369 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330313.690292:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66da77f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1566:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd07 expref: 368 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330313.690303:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1566:0x0].0x0 (ffff88008b0d2c00) 00010000:00010000:1.0:1715330313.690304:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715330313.690306:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfc240, rc 0) 00000100:00100000:1.0:1715330313.690354:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ad93a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+369:18878:x1798653938088384:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 994us (1197us total) trans 4294983802 rc 0/0 00000100:00100000:1.0:1715330313.690360:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23659 00000020:00080000:1.0:1715330313.690365:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.699096:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.699187:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938088512 00000100:00100000:3.0:1715330313.699197:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938088512 00000100:00100000:0.0:1715330313.700632:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5166 00000100:00100000:0.0:1715330313.700640:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+369:18878:x1798653938088512:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:1.0:1715330313.702109:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].183, 168 off40160 00000001:00080000:1.0:1715330313.702117:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983803 00000100:00100000:1.0:1715330313.702546:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+371:18878:x1798653938088512:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 1902us (3458us total) trans 4294983804 rc 0/0 00000100:00100000:1.0:1715330313.702557:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5166 00000020:00080000:1.0:1715330313.702564:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.706061:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.706186:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938088640 00000100:00100000:3.0:1715330313.706195:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938088640 00000100:00100000:3.0:1715330313.706251:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23660 00000100:00100000:3.0:1715330313.706258:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+371:18878:x1798653938088640:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:3.0:1715330313.706283:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330313.706304:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce640/0xd895711d66da78d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbd0e expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.706408:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ced00/0xd895711d66da794 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.706424:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ced00/0xd895711d66da794 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.706435:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ced00/0xd895711d66da794 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.706448:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce880/0xd895711d66da79b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989ad6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.706453:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce880/0xd895711d66da79b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.706457:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce880/0xd895711d66da79b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:3.0:1715330313.706767:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9ec:0x0], index 0: 0 00000040:00080000:3.0:1715330313.706846:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].184, 184 off40344 00010000:00010000:3.0:1715330313.706902:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cfcc0/0xd895711d66da7a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1567:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.706908:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cfcc0/0xd895711d66da7a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1567:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.706914:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cfcc0/0xd895711d66da7a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1567:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330313.706947:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].185, 176 off40520 00000001:00080000:3.0:1715330313.706950:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983805 00010000:00010000:3.0:1715330313.706971:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ced00/0xd895711d66da794 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.706976:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ced00/0xd895711d66da794 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.706984:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ced00/0xd895711d66da794 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.706990:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ced00/0xd895711d66da794 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.706994:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800939ced00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330313.706997:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ced00/0xd895711d66da794 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.707002:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ced00/0xd895711d66da794 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.707011:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330313.707013:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330313.707016:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ced00/0xd895711d66da794 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.707020:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ced00/0xd895711d66da794 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330313.707047:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093a8ed80 reply state ffff88008d562000 transno 4294983806 ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce880/0xd895711d66da79b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.707061:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce880/0xd895711d66da79b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.707066:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ad6 (ffff880092dfd300) 00010000:00010000:3.0:1715330313.707068:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330313.707070:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330313.707088:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce640/0xd895711d66da78d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd0e expref: 375 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.707102:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cfcc0/0xd895711d66da7a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1567:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd0e expref: 374 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.707108:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1567:0x0].0x0 (ffff880092dfd000) 00010000:00010000:3.0:1715330313.707111:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330313.707112:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800939cfcc0, rc 0) 00000100:00100000:3.0:1715330313.707162:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+375:18878:x1798653938088640:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 904us (1122us total) trans 4294983806 rc 0/0 00000100:00100000:3.0:1715330313.707168:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23660 00000020:00080000:3.0:1715330313.707173:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.711706:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330313.711837:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938088768 00000100:00100000:1.0:1715330313.711847:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938088768 00000100:00100000:1.0:1715330313.711903:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5167 00000100:00100000:1.0:1715330313.711910:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+375:18878:x1798653938088768:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:1.0:1715330313.712174:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].186, 168 off40688 00000001:00080000:1.0:1715330313.712179:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983807 00000100:00100000:1.0:1715330313.712271:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+377:18878:x1798653938088768:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 360us (577us total) trans 4294983808 rc 0/0 00000100:00100000:1.0:1715330313.712278:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5167 00000020:00080000:1.0:1715330313.712282:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.714666:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330313.714770:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938088896 00000100:00100000:1.0:1715330313.714778:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938088896 00000100:00100000:1.0:1715330313.714829:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23661 00000100:00100000:1.0:1715330313.714838:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+377:18878:x1798653938088896:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:1.0:1715330313.714860:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330313.714881:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66da7b0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbd15 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330313.714973:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66da7b7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.714986:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66da7b7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.714996:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66da7b7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.715007:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66da7be lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989bd6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.715012:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66da7be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.715016:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66da7be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00080000:1.0:1715330313.715285:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9ec:0x0], index 1: 0 00000040:00080000:1.0:1715330313.715354:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].187, 184 off40872 00010000:00010000:1.0:1715330313.715403:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66da7c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1568:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.715409:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66da7c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1568:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.715414:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66da7c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1568:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:1.0:1715330313.715512:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].189, 176 off41136 00000001:00080000:1.0:1715330313.715516:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983809 00010000:00010000:1.0:1715330313.715540:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66da7b7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.715545:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66da7b7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.715550:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66da7b7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.715556:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66da7b7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.715561:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfc6c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330313.715565:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66da7b7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.715571:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66da7b7 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.715581:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:1.0:1715330313.715584:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330313.715588:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66da7b7 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.715599:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66da7b7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:1.0:1715330313.715611:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093a8c380 reply state ffff88009aef1000 transno 4294983810 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66da7be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.715619:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66da7be lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.715625:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989bd6 (ffff88008b0d2600) 00010000:00010000:1.0:1715330313.715627:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330313.715629:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1715330313.715648:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66da7b0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd15 expref: 381 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330313.715661:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66da7c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1568:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd15 expref: 380 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330313.715667:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1568:0x0].0x0 (ffff88008b0d2700) 00010000:00010000:1.0:1715330313.715669:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715330313.715671:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfdd40, rc 0) 00000100:00100000:1.0:1715330313.715716:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+381:18878:x1798653938088896:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 878us (1058us total) trans 4294983810 rc 0/0 00000100:00100000:1.0:1715330313.715722:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23661 00000020:00080000:1.0:1715330313.715726:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.718580:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.718666:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938089024 00000100:00100000:3.0:1715330313.718676:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938089024 00000100:00100000:3.0:1715330313.718756:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5168 00000100:00100000:3.0:1715330313.718765:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+381:18878:x1798653938089024:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330313.719018:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].190, 168 off41304 00000001:00080000:3.0:1715330313.719025:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983811 00000100:00100000:3.0:1715330313.719130:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+383:18878:x1798653938089024:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 365us (559us total) trans 4294983812 rc 0/0 00000100:00100000:3.0:1715330313.719137:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5168 00000020:00080000:3.0:1715330313.719142:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.722042:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.722967:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938089152 00000100:00100000:3.0:1715330313.722977:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938089152 00000100:00100000:3.0:1715330313.723033:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23662 00000100:00100000:3.0:1715330313.723040:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+383:18878:x1798653938089152:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:3.0:1715330313.723186:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330313.723212:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ccd80/0xd895711d66da7d3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbd1c expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.723314:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da7da lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.723326:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da7da lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.723336:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da7da lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.723346:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cf840/0xd895711d66da7e1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989cd6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.723351:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cf840/0xd895711d66da7e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.723355:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cf840/0xd895711d66da7e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:3.0:1715330313.723610:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9ed:0x0], index 0: 0 00000040:00080000:3.0:1715330313.723677:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].191, 184 off41488 00010000:00010000:3.0:1715330313.723758:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ccb40/0xd895711d66da7e8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1569:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.723764:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ccb40/0xd895711d66da7e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1569:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.723770:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ccb40/0xd895711d66da7e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1569:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330313.723815:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].192, 176 off41664 00000001:00080000:3.0:1715330313.723819:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983813 00010000:00010000:3.0:1715330313.723846:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da7da lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.723852:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da7da lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.724007:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da7da lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.724013:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da7da lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.724019:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800939cc000 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330313.724022:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da7da lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.724029:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da7da lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.724040:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330313.724043:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330313.724047:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da7da lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.724064:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da7da lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330313.724075:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093a8d180 reply state ffff88008d563000 transno 4294983814 ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cf840/0xd895711d66da7e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.724083:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cf840/0xd895711d66da7e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.724088:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989cd6 (ffff880092dfd200) 00010000:00010000:3.0:1715330313.724090:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330313.724093:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330313.724114:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ccd80/0xd895711d66da7d3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd1c expref: 387 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.724126:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ccb40/0xd895711d66da7e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1569:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd1c expref: 386 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.724131:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1569:0x0].0x0 (ffff880092dfd400) 00010000:00010000:3.0:1715330313.724133:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330313.724135:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800939ccb40, rc 0) 00000100:00100000:3.0:1715330313.724201:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+387:18878:x1798653938089152:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 1160us (2168us total) trans 4294983814 rc 0/0 00000100:00100000:3.0:1715330313.724208:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23662 00000020:00080000:3.0:1715330313.724213:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.728154:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330313.728227:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938089280 00000100:00100000:1.0:1715330313.728237:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938089280 00000100:00100000:1.0:1715330313.728290:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5169 00000100:00100000:1.0:1715330313.728298:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+387:18878:x1798653938089280:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:1.0:1715330313.728539:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].193, 168 off41832 00000001:00080000:1.0:1715330313.728545:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983815 00000100:00100000:1.0:1715330313.728647:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+389:18878:x1798653938089280:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 348us (504us total) trans 4294983816 rc 0/0 00000100:00100000:1.0:1715330313.728655:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5169 00000020:00080000:1.0:1715330313.728659:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.732117:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.732331:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938089408 00000100:00100000:3.0:1715330313.732341:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938089408 00000100:00100000:3.0:1715330313.732402:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23663 00000100:00100000:3.0:1715330313.732410:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+389:18878:x1798653938089408:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:3.0:1715330313.732435:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330313.732460:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ccd80/0xd895711d66da7f6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbd23 expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.732574:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da7fd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.732589:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da7fd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.732602:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da7fd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.732620:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce640/0xd895711d66da804 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989dd6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.732624:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce640/0xd895711d66da804 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.732629:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce640/0xd895711d66da804 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:3.0:1715330313.732991:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9ed:0x0], index 1: 0 00000040:00080000:3.0:1715330313.733088:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].194, 184 off42016 00010000:00010000:3.0:1715330313.733149:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ced00/0xd895711d66da80b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x156a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.733156:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ced00/0xd895711d66da80b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.733161:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ced00/0xd895711d66da80b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330313.733206:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].195, 176 off42192 00000001:00080000:3.0:1715330313.733210:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983817 00010000:00010000:3.0:1715330313.733625:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da7fd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.733632:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da7fd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.733637:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da7fd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.733643:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da7fd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.733653:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800939cc000 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330313.733656:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da7fd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.733662:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da7fd lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.733673:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330313.733676:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330313.733681:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da7fd lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.733686:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da7fd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330313.733715:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093a8e300 reply state ffff88008d564000 transno 4294983818 ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce640/0xd895711d66da804 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.733723:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce640/0xd895711d66da804 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.733728:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989dd6 (ffff880092dfd800) 00010000:00010000:3.0:1715330313.733749:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330313.733752:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330313.733775:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ccd80/0xd895711d66da7f6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd23 expref: 393 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.733788:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ced00/0xd895711d66da80b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x156a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd23 expref: 392 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.733794:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156a:0x0].0x0 (ffff880092dfd100) 00010000:00010000:3.0:1715330313.733797:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330313.733799:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800939ced00, rc 0) 00000100:00100000:3.0:1715330313.733989:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+393:18878:x1798653938089408:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 1577us (1881us total) trans 4294983818 rc 0/0 00000100:00100000:3.0:1715330313.733996:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23663 00000020:00080000:3.0:1715330313.734001:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.739578:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330313.739705:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938089536 00000100:00100000:1.0:1715330313.739716:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938089536 00000100:00100000:1.0:1715330313.740005:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5170 00000100:00100000:1.0:1715330313.740014:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fbec450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+393:18878:x1798653938089536:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:1.0:1715330313.740281:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].196, 168 off42360 00000001:00080000:1.0:1715330313.740287:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983819 00000100:00100000:1.0:1715330313.741338:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fbec450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+395:18878:x1798653938089536:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 1321us (1768us total) trans 4294983820 rc 0/0 00000100:00100000:1.0:1715330313.741346:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5170 00000020:00080000:1.0:1715330313.741352:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.745913:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.745986:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938089664 00000100:00100000:3.0:1715330313.745996:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938089664 00000100:00100000:3.0:1715330313.746068:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23664 00000100:00100000:3.0:1715330313.746076:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+395:18878:x1798653938089664:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:3.0:1715330313.746101:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330313.746123:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ccd80/0xd895711d66da819 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbd2a expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.746227:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da820 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.746242:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da820 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.746253:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da820 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.746266:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7a80/0xd895711d66da827 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989ed6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.746271:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7a80/0xd895711d66da827 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.746277:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7a80/0xd895711d66da827 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:3.0:1715330313.746573:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9ee:0x0], index 0: 0 00000040:00080000:3.0:1715330313.746659:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].197, 184 off42544 00010000:00010000:3.0:1715330313.746763:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7cc0/0xd895711d66da82e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x156b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.746771:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7cc0/0xd895711d66da82e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.746777:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7cc0/0xd895711d66da82e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330313.746826:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].198, 176 off42720 00000001:00080000:3.0:1715330313.746831:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983821 00010000:00010000:3.0:1715330313.746858:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da820 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.746864:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da820 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.746870:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da820 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.746876:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da820 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.746881:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800939cc000 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330313.746885:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da820 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.746892:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da820 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.746903:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330313.746906:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330313.746911:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da820 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.746916:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc000/0xd895711d66da820 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330313.746937:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093a8ea00 reply state ffff88008d565000 transno 4294983822 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7a80/0xd895711d66da827 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.746945:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7a80/0xd895711d66da827 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.746955:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ed6 (ffff880092dfd900) 00010000:00010000:3.0:1715330313.746958:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330313.746960:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330313.746994:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ccd80/0xd895711d66da819 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd2a expref: 399 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.747007:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7cc0/0xd895711d66da82e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x156b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd2a expref: 398 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.747013:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156b:0x0].0x0 (ffff880092dfdd00) 00010000:00010000:3.0:1715330313.747015:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330313.747017:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a91b7cc0, rc 0) 00000100:00100000:3.0:1715330313.747091:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+399:18878:x1798653938089664:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 1015us (1189us total) trans 4294983822 rc 0/0 00000100:00100000:3.0:1715330313.747098:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23664 00000020:00080000:3.0:1715330313.747104:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.753774:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330313.754325:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938089792 00000100:00100000:1.0:1715330313.754337:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938089792 00000100:00100000:1.0:1715330313.755457:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5171 00000100:00100000:1.0:1715330313.755467:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+399:18878:x1798653938089792:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:1.0:1715330313.755781:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].199, 168 off42888 00000001:00080000:1.0:1715330313.755787:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983823 00000100:00100000:1.0:1715330313.756897:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+401:18878:x1798653938089792:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 1425us (3126us total) trans 4294983824 rc 0/0 00000100:00100000:1.0:1715330313.756908:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5171 00000020:00080000:1.0:1715330313.756915:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.766312:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.767504:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938089920 00000100:00100000:3.0:1715330313.767514:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938089920 00000100:00100000:3.0:1715330313.767586:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23665 00000100:00100000:3.0:1715330313.767598:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+401:18878:x1798653938089920:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:3.0:1715330313.768318:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330313.768345:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087727a80/0xd895711d66da83c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbd31 expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.768451:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087724b40/0xd895711d66da843 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.768464:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087724b40/0xd895711d66da843 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.768475:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087724b40/0xd895711d66da843 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.768486:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800877261c0/0xd895711d66da84a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989fd6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.768490:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800877261c0/0xd895711d66da84a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.768495:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800877261c0/0xd895711d66da84a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:3.0:1715330313.768808:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9ee:0x0], index 1: 0 00000040:00080000:3.0:1715330313.768893:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].200, 184 off43072 00010000:00010000:3.0:1715330313.768956:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880087725440/0xd895711d66da851 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x156c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.768962:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087725440/0xd895711d66da851 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.768968:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087725440/0xd895711d66da851 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330313.769018:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].201, 176 off43248 00000001:00080000:3.0:1715330313.769023:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983825 00010000:00010000:3.0:1715330313.769061:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087724b40/0xd895711d66da843 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.769068:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087724b40/0xd895711d66da843 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.769073:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880087724b40/0xd895711d66da843 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.769079:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880087724b40/0xd895711d66da843 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.769085:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087724b40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330313.769088:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087724b40/0xd895711d66da843 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.769094:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087724b40/0xd895711d66da843 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.769106:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330313.769109:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330313.769113:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880087724b40/0xd895711d66da843 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.769118:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087724b40/0xd895711d66da843 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330313.769148:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093a8f480 reply state ffff88008d566000 transno 4294983826 ns: mdt-lustre-MDT0000_UUID lock: ffff8800877261c0/0xd895711d66da84a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.769157:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800877261c0/0xd895711d66da84a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.769163:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989fd6 (ffff88008d699700) 00010000:00010000:3.0:1715330313.769165:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330313.769168:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330313.769189:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087727a80/0xd895711d66da83c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd31 expref: 405 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.769203:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880087725440/0xd895711d66da851 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x156c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd31 expref: 404 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.769209:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156c:0x0].0x0 (ffff88008d699c00) 00010000:00010000:3.0:1715330313.769211:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330313.769213:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880087725440, rc 0) 00000100:00100000:3.0:1715330313.769287:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+405:18878:x1798653938089920:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 1688us (2987us total) trans 4294983826 rc 0/0 00000100:00100000:3.0:1715330313.769295:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23665 00000020:00080000:3.0:1715330313.769301:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.773868:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330313.774223:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938090048 00000100:00100000:2.0:1715330313.774233:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938090048 00000100:00100000:2.0:1715330313.774289:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5172 00000100:00100000:2.0:1715330313.774296:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+405:18878:x1798653938090048:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:2.0:1715330313.774535:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].202, 168 off43416 00000001:00080000:2.0:1715330313.774541:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983827 00000100:00100000:2.0:1715330313.774644:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+407:18878:x1798653938090048:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 347us (786us total) trans 4294983828 rc 0/0 00000100:00100000:2.0:1715330313.774651:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5172 00000020:00080000:2.0:1715330313.774656:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.778876:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.779058:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938090176 00000100:00100000:3.0:1715330313.779068:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938090176 00000100:00100000:3.0:1715330313.779126:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23666 00000100:00100000:3.0:1715330313.779133:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+407:18878:x1798653938090176:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:3.0:1715330313.779156:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330313.779178:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087725680/0xd895711d66da85f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbd38 expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.779276:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087727600/0xd895711d66da866 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.779288:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087727600/0xd895711d66da866 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.779299:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087727600/0xd895711d66da866 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.779310:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087726ac0/0xd895711d66da86d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a0d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.779315:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087726ac0/0xd895711d66da86d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.779319:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087726ac0/0xd895711d66da86d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:3.0:1715330313.779589:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9ef:0x0], index 0: 0 00000040:00080000:3.0:1715330313.779660:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].203, 184 off43600 00010000:00010000:3.0:1715330313.779714:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880087727840/0xd895711d66da874 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x156d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.779720:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087727840/0xd895711d66da874 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.779725:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087727840/0xd895711d66da874 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330313.779802:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].204, 176 off43776 00000001:00080000:3.0:1715330313.779805:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983829 00010000:00010000:3.0:1715330313.779827:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087727600/0xd895711d66da866 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.779833:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087727600/0xd895711d66da866 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.779838:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880087727600/0xd895711d66da866 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.779846:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880087727600/0xd895711d66da866 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.779851:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087727600 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330313.779854:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087727600/0xd895711d66da866 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.779859:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087727600/0xd895711d66da866 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.779867:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330313.779870:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330313.779873:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880087727600/0xd895711d66da866 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.779877:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087727600/0xd895711d66da866 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330313.779895:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093a8d880 reply state ffff88008d567000 transno 4294983830 ns: mdt-lustre-MDT0000_UUID lock: ffff880087726ac0/0xd895711d66da86d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.779902:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087726ac0/0xd895711d66da86d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.779906:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a0d6 (ffff88008d699e00) 00010000:00010000:3.0:1715330313.779911:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330313.779914:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330313.779932:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087725680/0xd895711d66da85f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd38 expref: 411 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.779943:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880087727840/0xd895711d66da874 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x156d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd38 expref: 410 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.779952:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156d:0x0].0x0 (ffff88008d699f00) 00010000:00010000:3.0:1715330313.779954:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330313.779956:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880087727840, rc 0) 00000100:00100000:3.0:1715330313.780633:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+411:18878:x1798653938090176:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 1497us (1772us total) trans 4294983830 rc 0/0 00000100:00100000:3.0:1715330313.780641:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23666 00000020:00080000:3.0:1715330313.780646:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.784294:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.784419:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938090304 00000100:00100000:3.0:1715330313.784429:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938090304 00000100:00100000:3.0:1715330313.784546:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5173 00000100:00100000:3.0:1715330313.784554:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+411:18878:x1798653938090304:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330313.784958:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].205, 168 off43944 00000001:00080000:3.0:1715330313.784964:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983831 00000100:00100000:3.0:1715330313.785888:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+413:18878:x1798653938090304:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 1331us (1600us total) trans 4294983832 rc 0/0 00000100:00100000:3.0:1715330313.785897:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5173 00000020:00080000:3.0:1715330313.785902:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.789082:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.789785:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938090432 00000100:00100000:3.0:1715330313.789797:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938090432 00000100:00100000:3.0:1715330313.790608:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23667 00000100:00100000:3.0:1715330313.790616:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+413:18878:x1798653938090432:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:3.0:1715330313.790644:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330313.790667:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087724900/0xd895711d66da882 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbd3f expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.790817:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800877273c0/0xd895711d66da889 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.790833:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800877273c0/0xd895711d66da889 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.790844:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800877273c0/0xd895711d66da889 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.790858:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087725200/0xd895711d66da890 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a1d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.790864:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087725200/0xd895711d66da890 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.790869:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087725200/0xd895711d66da890 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:3.0:1715330313.791214:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9ef:0x0], index 1: 0 00000040:00080000:3.0:1715330313.791299:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].206, 184 off44128 00010000:00010000:3.0:1715330313.791366:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880087727180/0xd895711d66da897 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x156e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.791372:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087727180/0xd895711d66da897 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.791379:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087727180/0xd895711d66da897 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330313.791418:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].207, 176 off44304 00000001:00080000:3.0:1715330313.791422:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983833 00010000:00010000:3.0:1715330313.791450:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800877273c0/0xd895711d66da889 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.791455:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800877273c0/0xd895711d66da889 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.791463:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800877273c0/0xd895711d66da889 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.791468:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800877273c0/0xd895711d66da889 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.791474:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800877273c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330313.791477:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800877273c0/0xd895711d66da889 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.791484:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800877273c0/0xd895711d66da889 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.791495:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330313.791498:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330313.791503:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800877273c0/0xd895711d66da889 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.791507:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800877273c0/0xd895711d66da889 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330313.791520:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093a8c000 reply state ffff88009d660000 transno 4294983834 ns: mdt-lustre-MDT0000_UUID lock: ffff880087725200/0xd895711d66da890 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.791528:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087725200/0xd895711d66da890 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.791532:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a1d6 (ffff88008d699400) 00010000:00010000:3.0:1715330313.791534:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330313.791536:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330313.791556:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087724900/0xd895711d66da882 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd3f expref: 417 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.791570:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880087727180/0xd895711d66da897 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x156e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd3f expref: 416 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.791576:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156e:0x0].0x0 (ffff88008d699500) 00010000:00010000:3.0:1715330313.791577:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330313.791579:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880087727180, rc 0) 00000100:00100000:3.0:1715330313.791644:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+417:18878:x1798653938090432:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 1028us (2576us total) trans 4294983834 rc 0/0 00000100:00100000:3.0:1715330313.791650:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23667 00000020:00080000:3.0:1715330313.791655:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.796715:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.797176:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938090560 00000100:00100000:3.0:1715330313.797186:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938090560 00000100:00100000:3.0:1715330313.797975:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5174 00000100:00100000:3.0:1715330313.797983:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+417:18878:x1798653938090560:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330313.798223:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].208, 168 off44472 00000001:00080000:3.0:1715330313.798228:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983835 00000100:00100000:3.0:1715330313.800144:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+419:18878:x1798653938090560:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 2152us (3431us total) trans 4294983836 rc 0/0 00000100:00100000:3.0:1715330313.800157:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5174 00000020:00080000:3.0:1715330313.800165:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.803501:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330313.803629:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938090688 00000100:00100000:1.0:1715330313.803639:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938090688 00000100:00100000:1.0:1715330313.803697:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23668 00000100:00100000:1.0:1715330313.803705:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+419:18878:x1798653938090688:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:1.0:1715330313.803768:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330313.803791:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66da8a5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbd46 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330313.803894:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66da8ac lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.803907:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66da8ac lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.803917:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66da8ac lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.803928:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66da8b3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a2d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.803934:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66da8b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.803939:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66da8b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00080000:1.0:1715330313.804225:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f0:0x0], index 0: 0 00000040:00080000:1.0:1715330313.804299:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].209, 184 off44656 00010000:00010000:1.0:1715330313.804360:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66da8ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x156f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.804367:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66da8ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.804372:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66da8ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:1.0:1715330313.804410:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].210, 176 off44832 00000001:00080000:1.0:1715330313.804414:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983837 00010000:00010000:1.0:1715330313.804436:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66da8ac lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.804445:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66da8ac lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.804450:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66da8ac lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.804455:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66da8ac lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.804460:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfd680 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330313.804463:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66da8ac lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.804469:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66da8ac lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.804479:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:1.0:1715330313.804481:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330313.804485:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66da8ac lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.804489:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66da8ac lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:1.0:1715330313.804505:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093a8f800 reply state ffff88009aef4000 transno 4294983838 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66da8b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.804512:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66da8b3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.804517:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a2d6 (ffff88008b0d2900) 00010000:00010000:1.0:1715330313.804519:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330313.804521:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1715330313.804540:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66da8a5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd46 expref: 423 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330313.804552:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66da8ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x156f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd46 expref: 422 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330313.804557:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156f:0x0].0x0 (ffff88008b0d2e00) 00010000:00010000:1.0:1715330313.804559:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715330313.804561:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfdf80, rc 0) 00000100:00100000:1.0:1715330313.804614:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+423:18878:x1798653938090688:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 909us (1123us total) trans 4294983838 rc 0/0 00000100:00100000:1.0:1715330313.804620:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23668 00000020:00080000:1.0:1715330313.804624:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.807855:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.808005:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938090816 00000100:00100000:3.0:1715330313.808015:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938090816 00000100:00100000:3.0:1715330313.808069:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5175 00000100:00100000:3.0:1715330313.808077:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+423:18878:x1798653938090816:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330313.808301:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].211, 168 off45000 00000001:00080000:3.0:1715330313.808307:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983839 00000100:00100000:3.0:1715330313.808385:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+425:18878:x1798653938090816:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 308us (543us total) trans 4294983840 rc 0/0 00000100:00100000:3.0:1715330313.808392:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5175 00000020:00080000:3.0:1715330313.808396:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.811668:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.814180:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938090944 00000100:00100000:3.0:1715330313.814195:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938090944 00000100:00100000:3.0:1715330313.814266:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23669 00000100:00100000:3.0:1715330313.814274:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+425:18878:x1798653938090944:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:3.0:1715330313.814304:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330313.814326:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800877258c0/0xd895711d66da8c8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbd4d expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.814433:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087724000/0xd895711d66da8cf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.814447:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087724000/0xd895711d66da8cf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.814457:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087724000/0xd895711d66da8cf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.814470:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087724fc0/0xd895711d66da8d6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a3d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.814475:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087724fc0/0xd895711d66da8d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.814480:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087724fc0/0xd895711d66da8d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:3.0:1715330313.814998:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f0:0x0], index 1: 0 00000040:00080000:3.0:1715330313.815166:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].212, 184 off45184 00010000:00010000:3.0:1715330313.815235:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800877246c0/0xd895711d66da8dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1570:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.815242:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800877246c0/0xd895711d66da8dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1570:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.815248:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800877246c0/0xd895711d66da8dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1570:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330313.815292:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].213, 176 off45360 00000001:00080000:3.0:1715330313.815297:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983841 00010000:00010000:3.0:1715330313.815327:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087724000/0xd895711d66da8cf lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.815333:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087724000/0xd895711d66da8cf lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.815338:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880087724000/0xd895711d66da8cf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.815343:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880087724000/0xd895711d66da8cf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.815349:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087724000 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330313.815353:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087724000/0xd895711d66da8cf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.815359:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087724000/0xd895711d66da8cf lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.815370:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330313.815374:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330313.815378:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880087724000/0xd895711d66da8cf lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.815386:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087724000/0xd895711d66da8cf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330313.815396:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093a8df80 reply state ffff88009d661000 transno 4294983842 ns: mdt-lustre-MDT0000_UUID lock: ffff880087724fc0/0xd895711d66da8d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.815404:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087724fc0/0xd895711d66da8d6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.815409:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a3d6 (ffff88008d699200) 00010000:00010000:3.0:1715330313.815411:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330313.815413:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330313.815434:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800877258c0/0xd895711d66da8c8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd4d expref: 429 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.815446:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800877246c0/0xd895711d66da8dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1570:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd4d expref: 428 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.815452:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1570:0x0].0x0 (ffff88008d699800) 00010000:00010000:3.0:1715330313.815454:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330313.815456:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800877246c0, rc 0) 00000100:00100000:3.0:1715330313.815523:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+429:18878:x1798653938090944:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 1249us (3863us total) trans 4294983842 rc 0/0 00000100:00100000:3.0:1715330313.815530:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23669 00000020:00080000:3.0:1715330313.815535:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1715330313.818875:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330313.823141:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938091072 00000100:00100000:2.0:1715330313.823157:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938091072 00000100:00100000:2.0:1715330313.823234:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5176 00000100:00100000:2.0:1715330313.823242:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fbec050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+429:18878:x1798653938091072:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:2.0:1715330313.823504:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].214, 168 off45528 00000001:00080000:2.0:1715330313.823510:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983843 00000100:00100000:2.0:1715330313.823628:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fbec050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+431:18878:x1798653938091072:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 385us (4762us total) trans 4294983844 rc 0/0 00000100:00100000:2.0:1715330313.823635:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5176 00000020:00080000:2.0:1715330313.823640:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1715330313.831882:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330313.831970:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938091200 00000100:00100000:0.0:1715330313.831981:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938091200 00000100:00100000:0.0:1715330313.832038:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23670 00000100:00100000:0.0:1715330313.832045:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d62b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+431:18878:x1798653938091200:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:0.0:1715330313.832097:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330313.832116:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66da8eb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbd54 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330313.832216:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3600/0xd895711d66da8f2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.832230:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3600/0xd895711d66da8f2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.832240:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3600/0xd895711d66da8f2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.832252:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2d00/0xd895711d66da8f9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989ad7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.832257:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2d00/0xd895711d66da8f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.832261:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2d00/0xd895711d66da8f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00080000:0.0:1715330313.832549:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f1:0x0], index 0: 0 00000040:00080000:0.0:1715330313.832629:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].215, 184 off45712 00010000:00010000:0.0:1715330313.832693:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66da900 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1571:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.832700:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66da900 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1571:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.832705:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66da900 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1571:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:0.0:1715330313.832922:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].216, 176 off45888 00000001:00080000:0.0:1715330313.832926:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983845 00010000:00010000:0.0:1715330313.832954:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3600/0xd895711d66da8f2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.832960:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3600/0xd895711d66da8f2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.832965:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3600/0xd895711d66da8f2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.832970:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3600/0xd895711d66da8f2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.832974:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a3600 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330313.832977:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3600/0xd895711d66da8f2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.832983:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3600/0xd895711d66da8f2 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.832994:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:0.0:1715330313.832997:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330313.833000:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3600/0xd895711d66da8f2 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.833005:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3600/0xd895711d66da8f2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:0.0:1715330313.833576:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007d62b800 reply state ffff880093825000 transno 4294983846 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2d00/0xd895711d66da8f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.833586:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2d00/0xd895711d66da8f9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.833591:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ad7 (ffff88012ca48900) 00010000:00010000:0.0:1715330313.833593:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330313.833595:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1715330313.833616:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66da8eb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd54 expref: 435 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330313.833628:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66da900 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1571:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd54 expref: 434 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330313.833633:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1571:0x0].0x0 (ffff88012ca48400) 00010000:00010000:0.0:1715330313.833635:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715330313.833636:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a06c0, rc 0) 00000100:00100000:0.0:1715330313.833786:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d62b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+435:18878:x1798653938091200:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 1683us (1857us total) trans 4294983846 rc 0/0 00000100:00100000:0.0:1715330313.833795:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23670 00000020:00080000:0.0:1715330313.833800:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.838105:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.838198:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938091328 00000100:00100000:3.0:1715330313.838209:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938091328 00000100:00100000:3.0:1715330313.839117:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5177 00000100:00100000:3.0:1715330313.839125:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+435:18878:x1798653938091328:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330313.839367:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].217, 168 off46056 00000001:00080000:3.0:1715330313.839373:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983847 00000100:00100000:3.0:1715330313.840496:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+437:18878:x1798653938091328:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 1369us (2401us total) trans 4294983848 rc 0/0 00000100:00100000:3.0:1715330313.840505:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5177 00000020:00080000:3.0:1715330313.840512:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1715330313.843486:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330313.843649:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938091456 00000100:00100000:0.0:1715330313.843659:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938091456 00000100:00100000:0.0:1715330313.843709:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23671 00000100:00100000:0.0:1715330313.843715:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+437:18878:x1798653938091456:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:1.0:1715330313.843940:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330313.843963:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66da90e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbd5b expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330313.844068:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd8c0/0xd895711d66da915 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.844082:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd8c0/0xd895711d66da915 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.844093:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd8c0/0xd895711d66da915 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.844105:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66da91c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989bd7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.844111:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66da91c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.844117:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66da91c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00080000:1.0:1715330313.844418:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f1:0x0], index 1: 0 00000040:00080000:1.0:1715330313.844495:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].218, 184 off46240 00010000:00010000:1.0:1715330313.844553:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66da923 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1572:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.844560:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66da923 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1572:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.844566:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66da923 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1572:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:1.0:1715330313.844604:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].219, 176 off46416 00000001:00080000:1.0:1715330313.844608:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983849 00010000:00010000:1.0:1715330313.844633:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd8c0/0xd895711d66da915 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.844639:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd8c0/0xd895711d66da915 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.844644:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd8c0/0xd895711d66da915 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.844648:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd8c0/0xd895711d66da915 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.844653:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfd8c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330313.844656:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd8c0/0xd895711d66da915 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.844663:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd8c0/0xd895711d66da915 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.844673:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:1.0:1715330313.844676:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330313.844679:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd8c0/0xd895711d66da915 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.844685:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd8c0/0xd895711d66da915 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:1.0:1715330313.844699:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009b4c0a80 reply state ffff88009aef5000 transno 4294983850 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66da91c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.844706:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66da91c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.844710:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989bd7 (ffff88008b0d2d00) 00010000:00010000:1.0:1715330313.844712:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330313.844714:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1715330313.844747:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66da90e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd5b expref: 441 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330313.844760:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66da923 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1572:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd5b expref: 440 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330313.844766:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1572:0x0].0x0 (ffff88008b0d2800) 00010000:00010000:1.0:1715330313.844767:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715330313.844769:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfdb00, rc 0) 00000100:00100000:1.0:1715330313.845902:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+441:18878:x1798653938091456:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 2179us (2418us total) trans 4294983850 rc 0/0 00000100:00100000:1.0:1715330313.845913:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23671 00000020:00080000:1.0:1715330313.845920:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1715330313.850401:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.850481:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938091584 00000100:00100000:3.0:1715330313.850490:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938091584 00000100:00100000:3.0:1715330313.850595:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5178 00000100:00100000:3.0:1715330313.850601:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+441:18878:x1798653938091584:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330313.850993:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].220, 168 off46584 00000001:00080000:3.0:1715330313.850998:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983851 00000100:00100000:3.0:1715330313.851404:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+443:18878:x1798653938091584:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 802us (1012us total) trans 4294983852 rc 0/0 00000100:00100000:3.0:1715330313.851411:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5178 00000020:00080000:3.0:1715330313.851415:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1715330313.854256:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330313.854337:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938091712 00000100:00100000:1.0:1715330313.854346:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938091712 00000100:00100000:1.0:1715330313.854414:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23672 00000100:00100000:1.0:1715330313.854421:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+443:18878:x1798653938091712:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:1.0:1715330313.854443:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330313.854462:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66da931 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbd62 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330313.854556:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66da938 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.854570:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66da938 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.854581:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66da938 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.854593:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66da93f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989cd7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.854598:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66da93f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.854604:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66da93f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00080000:1.0:1715330313.854887:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f2:0x0], index 0: 0 00000040:00080000:1.0:1715330313.854958:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].221, 184 off46768 00010000:00010000:1.0:1715330313.855009:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfed00/0xd895711d66da946 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1573:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.855014:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfed00/0xd895711d66da946 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1573:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.855021:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfed00/0xd895711d66da946 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1573:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000100:00100000:0.0:1715330313.855134:0:9630:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093a8ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9630:1798653942509952:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1715330313.855177:0:9630:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330313.855199:0:9630:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008d667d80 going to sleep for 11 seconds 00000100:00100000:2.0:1715330313.855281:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942509952 00000100:00100000:2.0:1715330313.855284:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942509952 00000100:00100000:2.0:1715330313.855306:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5238 00000100:00100000:2.0:1715330313.855310:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9630:x1798653942509952:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1715330313.855339:0:9633:0:(ofd_dev.c:1660:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2562 00000040:00080000:1.0:1715330313.856149:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].222, 176 off46944 00000001:00080000:1.0:1715330313.856156:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983853 00010000:00010000:1.0:1715330313.856193:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66da938 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.856200:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66da938 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.856206:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66da938 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.856212:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66da938 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.856217:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bffcc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330313.856220:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66da938 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.856226:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66da938 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.856238:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:1.0:1715330313.856240:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330313.856244:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66da938 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.856249:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66da938 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:1.0:1715330313.856263:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012fa84000 reply state ffff88009aef7000 transno 4294983854 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66da93f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.856270:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66da93f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.856275:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989cd7 (ffff88008b0d2200) 00010000:00010000:1.0:1715330313.856277:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330313.856279:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1715330313.856306:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66da931 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd62 expref: 447 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330313.856316:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfed00/0xd895711d66da946 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1573:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd62 expref: 446 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330313.856321:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1573:0x0].0x0 (ffff88008b0d2400) 00010000:00010000:1.0:1715330313.856323:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715330313.856325:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfed00, rc 0) 00000100:00100000:1.0:1715330313.856367:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+447:18878:x1798653938091712:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 1947us (2122us total) trans 4294983854 rc 0/0 00000100:00100000:1.0:1715330313.856375:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23672 00000020:00080000:1.0:1715330313.856380:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1715330313.859043:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:9630:x1798653942509952:12345-0@lo:5:osp-pre-0-0.0 Request processed in 3722us (3855us total) trans 4294969899 rc 0/0 00000100:00100000:2.0:1715330313.859066:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5238 00000100:00100000:0.0:1715330313.859197:0:9630:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093a8ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9630:1798653942509952:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1715330313.859211:0:9630:0:(osp_precreate.c:724:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x9f2:0x0]-[0x280000401:0xa21:0x0] 00000100:00100000:2.0:1715330313.860514:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.861193:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938091840 00000100:00100000:3.0:1715330313.861203:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938091840 00000100:00100000:3.0:1715330313.861247:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5179 00000100:00100000:3.0:1715330313.861253:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+447:18878:x1798653938091840:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330313.861475:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].223, 168 off47112 00000001:00080000:3.0:1715330313.861481:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983855 00000100:00100000:3.0:1715330313.862511:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+449:18878:x1798653938091840:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 1253us (1999us total) trans 4294983856 rc 0/0 00000100:00100000:3.0:1715330313.862520:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5179 00000020:00080000:3.0:1715330313.862526:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1715330313.866120:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330313.866198:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938091968 00000100:00100000:0.0:1715330313.866208:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938091968 00000100:00100000:0.0:1715330313.866268:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23673 00000100:00100000:0.0:1715330313.866276:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+449:18878:x1798653938091968:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:0.0:1715330313.866302:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330313.866323:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0480/0xd895711d66da954 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbd69 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330313.866426:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66da95b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.866440:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66da95b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.866451:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66da95b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.866466:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3180/0xd895711d66da962 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989dd7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.866470:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3180/0xd895711d66da962 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.866474:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3180/0xd895711d66da962 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00080000:0.0:1715330313.866797:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f2:0x0], index 1: 0 00000040:00080000:0.0:1715330313.866878:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].224, 184 off47296 00010000:00010000:0.0:1715330313.866944:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0d80/0xd895711d66da969 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1574:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.866950:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0d80/0xd895711d66da969 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1574:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.866956:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0d80/0xd895711d66da969 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1574:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:0.0:1715330313.867000:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].225, 176 off47472 00000001:00080000:0.0:1715330313.867004:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983857 00010000:00010000:0.0:1715330313.867031:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66da95b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.867036:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66da95b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.867041:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66da95b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.867056:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66da95b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.867062:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a2880 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330313.867065:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66da95b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.867071:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66da95b lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.867081:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:0.0:1715330313.867084:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330313.867088:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66da95b lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.867093:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66da95b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:0.0:1715330313.867111:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007d628380 reply state ffff880093826000 transno 4294983858 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3180/0xd895711d66da962 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.867118:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3180/0xd895711d66da962 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.867124:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989dd7 (ffff88012ca48f00) 00010000:00010000:0.0:1715330313.867126:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330313.867128:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1715330313.867148:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0480/0xd895711d66da954 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd69 expref: 453 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330313.867161:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0d80/0xd895711d66da969 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1574:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd69 expref: 452 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330313.867167:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1574:0x0].0x0 (ffff88012ca48c00) 00010000:00010000:0.0:1715330313.867169:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715330313.867171:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a0d80, rc 0) 00000100:00100000:0.0:1715330313.867219:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+453:18878:x1798653938091968:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 943us (1109us total) trans 4294983858 rc 0/0 00000100:00100000:0.0:1715330313.867225:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23673 00000020:00080000:0.0:1715330313.867230:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1715330313.869013:0:10805:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d62bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10805:1798653942510016:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1715330313.869082:0:10805:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330313.869118:0:10805:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009396c780 going to sleep for 11 seconds 00000100:00100000:2.0:1715330313.869181:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942510016 00000100:00100000:2.0:1715330313.869189:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942510016 00000100:00100000:2.0:1715330313.869226:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5239 00000100:00100000:2.0:1715330313.869232:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d62a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:10805:x1798653942510016:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1715330313.869277:0:9633:0:(ofd_dev.c:1660:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2562 00000100:00100000:2.0:1715330313.871851:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d62a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:10805:x1798653942510016:12345-0@lo:5:osp-pre-1-0.0 Request processed in 2614us (2764us total) trans 4294969900 rc 0/0 00000100:00100000:2.0:1715330313.871862:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5239 00000100:00100000:1.0:1715330313.871917:0:10805:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d62bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10805:1798653942510016:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1715330313.871943:0:10805:0:(osp_precreate.c:724:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x9f2:0x0]-[0x2c0000401:0xa21:0x0] 00000100:00100000:2.0:1715330313.872809:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.872856:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938092096 00000100:00100000:3.0:1715330313.872863:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938092096 00000100:00100000:3.0:1715330313.872906:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5180 00000100:00100000:3.0:1715330313.872911:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+453:18878:x1798653938092096:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330313.873137:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].226, 168 off47640 00000001:00080000:3.0:1715330313.873143:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983859 00000100:00100000:3.0:1715330313.873421:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+455:18878:x1798653938092096:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 508us (614us total) trans 4294983860 rc 0/0 00000100:00100000:3.0:1715330313.873428:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5180 00000020:00080000:3.0:1715330313.873433:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.877535:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.877638:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938092224 00000100:00100000:3.0:1715330313.877647:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938092224 00000100:00100000:3.0:1715330313.877722:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23674 00000100:00100000:3.0:1715330313.877766:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+455:18878:x1798653938092224:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:3.0:1715330313.877790:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330313.877810:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087727cc0/0xd895711d66da977 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbd70 expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.877917:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087724240/0xd895711d66da97e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.877931:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087724240/0xd895711d66da97e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.877941:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087724240/0xd895711d66da97e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.877953:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087724480/0xd895711d66da985 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989ed7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.877962:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087724480/0xd895711d66da985 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.877967:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087724480/0xd895711d66da985 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:3.0:1715330313.878237:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f3:0x0], index 0: 0 00000040:00080000:3.0:1715330313.878308:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].227, 184 off47824 00010000:00010000:3.0:1715330313.878361:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880087725f80/0xd895711d66da98c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1575:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.878367:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087725f80/0xd895711d66da98c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1575:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.878372:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087725f80/0xd895711d66da98c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1575:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330313.878405:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].228, 176 off48000 00000001:00080000:3.0:1715330313.878408:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983861 00010000:00010000:3.0:1715330313.878428:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087724240/0xd895711d66da97e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.878433:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087724240/0xd895711d66da97e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.878437:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880087724240/0xd895711d66da97e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.878442:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880087724240/0xd895711d66da97e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.878446:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087724240 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330313.878449:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087724240/0xd895711d66da97e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.878455:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087724240/0xd895711d66da97e lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.878465:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330313.878467:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330313.878470:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880087724240/0xd895711d66da97e lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.878475:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087724240/0xd895711d66da97e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330313.878486:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093a8f100 reply state ffff88009d663000 transno 4294983862 ns: mdt-lustre-MDT0000_UUID lock: ffff880087724480/0xd895711d66da985 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.878492:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087724480/0xd895711d66da985 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.878497:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ed7 (ffff88008d699900) 00010000:00010000:3.0:1715330313.878499:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330313.878500:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330313.878516:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087727cc0/0xd895711d66da977 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd70 expref: 459 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.878525:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880087725f80/0xd895711d66da98c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1575:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd70 expref: 458 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.878530:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1575:0x0].0x0 (ffff88008d699d00) 00010000:00010000:3.0:1715330313.878532:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330313.878534:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880087725f80, rc 0) 00000100:00100000:3.0:1715330313.878577:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+459:18878:x1798653938092224:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 849us (1054us total) trans 4294983862 rc 0/0 00000100:00100000:3.0:1715330313.878586:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23674 00000020:00080000:3.0:1715330313.878591:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1715330313.882865:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.883555:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938092352 00000100:00100000:3.0:1715330313.883565:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938092352 00000100:00100000:3.0:1715330313.883637:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5181 00000100:00100000:3.0:1715330313.883643:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+459:18878:x1798653938092352:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330313.883985:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].229, 168 off48168 00000001:00080000:3.0:1715330313.883990:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983863 00000100:00100000:3.0:1715330313.884098:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+461:18878:x1798653938092352:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 455us (1245us total) trans 4294983864 rc 0/0 00000100:00100000:3.0:1715330313.884105:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5181 00000020:00080000:3.0:1715330313.884110:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1715330313.887001:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330313.887083:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938092480 00000100:00100000:0.0:1715330313.887092:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938092480 00000100:00100000:0.0:1715330313.887142:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23675 00000100:00100000:0.0:1715330313.887148:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+461:18878:x1798653938092480:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:0.0:1715330313.887171:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330313.887192:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a18c0/0xd895711d66da99a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbd77 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330313.887296:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a33c0/0xd895711d66da9a1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.887308:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a33c0/0xd895711d66da9a1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.887318:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a33c0/0xd895711d66da9a1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.887328:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1b00/0xd895711d66da9a8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989fd7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.887333:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1b00/0xd895711d66da9a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.887337:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1b00/0xd895711d66da9a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00080000:0.0:1715330313.887626:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f3:0x0], index 1: 0 00000040:00080000:0.0:1715330313.887697:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].230, 184 off48352 00010000:00010000:0.0:1715330313.887801:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66da9af lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1576:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.887806:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66da9af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1576:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.887811:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66da9af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1576:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:0.0:1715330313.887846:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].231, 176 off48528 00000001:00080000:0.0:1715330313.887850:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983865 00010000:00010000:0.0:1715330313.887871:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a33c0/0xd895711d66da9a1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.887880:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a33c0/0xd895711d66da9a1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.887885:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a33c0/0xd895711d66da9a1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.887890:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a33c0/0xd895711d66da9a1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.887894:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a33c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330313.887897:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a33c0/0xd895711d66da9a1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.887902:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a33c0/0xd895711d66da9a1 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.887910:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:0.0:1715330313.887913:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330313.887916:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a33c0/0xd895711d66da9a1 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.887920:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a33c0/0xd895711d66da9a1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:0.0:1715330313.887942:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009b4c0380 reply state ffff880093822000 transno 4294983866 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1b00/0xd895711d66da9a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.887948:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1b00/0xd895711d66da9a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330313.887953:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989fd7 (ffff88012ca48600) 00010000:00010000:0.0:1715330313.887955:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330313.887957:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1715330313.887974:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a18c0/0xd895711d66da99a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd77 expref: 465 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330313.887985:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66da9af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1576:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd77 expref: 464 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330313.887990:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1576:0x0].0x0 (ffff88012ca48d00) 00010000:00010000:0.0:1715330313.887992:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715330313.887994:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a1440, rc 0) 00000100:00100000:0.0:1715330313.888038:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+465:18878:x1798653938092480:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 889us (1047us total) trans 4294983866 rc 0/0 00000100:00100000:0.0:1715330313.888043:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23675 00000020:00080000:0.0:1715330313.888055:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.891310:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.891917:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938092608 00000100:00100000:3.0:1715330313.891927:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938092608 00000100:00100000:3.0:1715330313.892541:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5182 00000100:00100000:3.0:1715330313.892549:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007acb3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+465:18878:x1798653938092608:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330313.892835:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].232, 168 off48696 00000001:00080000:3.0:1715330313.892840:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983867 00000100:00100000:3.0:1715330313.892933:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007acb3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+467:18878:x1798653938092608:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 384us (1633us total) trans 4294983868 rc 0/0 00000100:00100000:3.0:1715330313.892940:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5182 00000020:00080000:3.0:1715330313.892945:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1715330313.898317:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.898391:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938092736 00000100:00100000:3.0:1715330313.898401:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938092736 00000100:00100000:3.0:1715330313.898508:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23676 00000100:00100000:3.0:1715330313.898515:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d62aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+467:18878:x1798653938092736:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:3.0:1715330313.898540:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330313.898560:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087726f40/0xd895711d66da9bd lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbd7e expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.898662:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087726d00/0xd895711d66da9c4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.898675:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087726d00/0xd895711d66da9c4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.898686:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087726d00/0xd895711d66da9c4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.898701:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087727cc0/0xd895711d66da9cb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a0d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.898706:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087727cc0/0xd895711d66da9cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.898711:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087727cc0/0xd895711d66da9cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:3.0:1715330313.899251:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f4:0x0], index 0: 0 00000040:00080000:3.0:1715330313.899323:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].233, 184 off48880 00010000:00010000:3.0:1715330313.899382:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880087724240/0xd895711d66da9d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1577:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.899389:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087724240/0xd895711d66da9d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1577:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.899395:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087724240/0xd895711d66da9d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1577:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330313.899433:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].234, 176 off49056 00000001:00080000:3.0:1715330313.899437:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983869 00010000:00010000:3.0:1715330313.899463:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087726d00/0xd895711d66da9c4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.899468:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087726d00/0xd895711d66da9c4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.899474:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880087726d00/0xd895711d66da9c4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.899479:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880087726d00/0xd895711d66da9c4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.899484:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087726d00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330313.899487:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087726d00/0xd895711d66da9c4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.899493:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087726d00/0xd895711d66da9c4 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.899503:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330313.899505:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330313.899509:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880087726d00/0xd895711d66da9c4 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.899514:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087726d00/0xd895711d66da9c4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330313.899863:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007d62aa00 reply state ffff88009d664000 transno 4294983870 ns: mdt-lustre-MDT0000_UUID lock: ffff880087727cc0/0xd895711d66da9cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.899872:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087727cc0/0xd895711d66da9cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.899876:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a0d7 (ffff88008d699b00) 00010000:00010000:3.0:1715330313.899879:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330313.899881:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330313.899899:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087726f40/0xd895711d66da9bd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd7e expref: 471 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.899910:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880087724240/0xd895711d66da9d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1577:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd7e expref: 470 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.899915:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1577:0x0].0x0 (ffff88008d699600) 00010000:00010000:3.0:1715330313.899917:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330313.899919:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880087724240, rc 0) 00000100:00100000:3.0:1715330313.900548:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d62aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+471:18878:x1798653938092736:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 2031us (2241us total) trans 4294983870 rc 0/0 00000100:00100000:3.0:1715330313.900556:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23676 00000020:00080000:3.0:1715330313.900562:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1715330313.903876:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330313.903975:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938092864 00000100:00100000:2.0:1715330313.903986:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938092864 00000100:00100000:2.0:1715330313.904037:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5183 00000100:00100000:2.0:1715330313.904053:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+471:18878:x1798653938092864:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:2.0:1715330313.904425:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].236, 168 off49320 00000001:00080000:2.0:1715330313.904432:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983871 00000100:00100000:2.0:1715330313.904538:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+473:18878:x1798653938092864:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 493us (671us total) trans 4294983872 rc 0/0 00000100:00100000:2.0:1715330313.904545:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5183 00000020:00080000:2.0:1715330313.904550:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1715330313.908383:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.908627:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938092992 00000100:00100000:3.0:1715330313.908638:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938092992 00000100:00100000:3.0:1715330313.908699:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23677 00000100:00100000:3.0:1715330313.908706:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+473:18878:x1798653938092992:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:3.0:1715330313.908757:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330313.908780:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800877258c0/0xd895711d66da9e0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbd85 expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.908881:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087724000/0xd895711d66da9e7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.908895:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087724000/0xd895711d66da9e7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.908908:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087724000/0xd895711d66da9e7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.908921:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087724900/0xd895711d66da9ee lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a1d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.908926:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087724900/0xd895711d66da9ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.908930:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087724900/0xd895711d66da9ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:3.0:1715330313.909235:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f4:0x0], index 1: 0 00000040:00080000:3.0:1715330313.909323:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].237, 184 off49504 00010000:00010000:3.0:1715330313.909381:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800877273c0/0xd895711d66da9f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1578:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.909387:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800877273c0/0xd895711d66da9f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1578:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.909392:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800877273c0/0xd895711d66da9f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1578:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330313.909426:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].238, 176 off49680 00000001:00080000:3.0:1715330313.909430:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983873 00010000:00010000:3.0:1715330313.909451:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087724000/0xd895711d66da9e7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.909457:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087724000/0xd895711d66da9e7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.909461:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880087724000/0xd895711d66da9e7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.909470:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880087724000/0xd895711d66da9e7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.909475:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087724000 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330313.909478:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087724000/0xd895711d66da9e7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.909483:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087724000/0xd895711d66da9e7 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.909492:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330313.909494:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330313.909497:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880087724000/0xd895711d66da9e7 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.909501:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087724000/0xd895711d66da9e7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330313.909525:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007d628700 reply state ffff88009d666000 transno 4294983874 ns: mdt-lustre-MDT0000_UUID lock: ffff880087724900/0xd895711d66da9ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.909532:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087724900/0xd895711d66da9ee lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.909537:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a1d7 (ffff88008d699100) 00010000:00010000:3.0:1715330313.909539:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330313.909541:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330313.909559:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800877258c0/0xd895711d66da9e0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd85 expref: 477 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.909571:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800877273c0/0xd895711d66da9f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1578:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd85 expref: 476 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.909580:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1578:0x0].0x0 (ffff88008d699a00) 00010000:00010000:3.0:1715330313.909582:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330313.909584:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800877273c0, rc 0) 00000100:00100000:3.0:1715330313.909646:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+477:18878:x1798653938092992:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 939us (1273us total) trans 4294983874 rc 0/0 00000100:00100000:3.0:1715330313.909653:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23677 00000020:00080000:3.0:1715330313.909657:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1715330313.912042:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.912145:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938093120 00000100:00100000:3.0:1715330313.912159:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938093120 00000100:00100000:3.0:1715330313.912238:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5184 00000100:00100000:3.0:1715330313.912246:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+477:18878:x1798653938093120:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330313.912475:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].239, 168 off49848 00000001:00080000:3.0:1715330313.912480:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983875 00000100:00100000:3.0:1715330313.912558:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+479:18878:x1798653938093120:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 311us (524us total) trans 4294983876 rc 0/0 00000100:00100000:3.0:1715330313.912565:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5184 00000020:00080000:3.0:1715330313.912569:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.915236:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.915429:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938093248 00000100:00100000:3.0:1715330313.915437:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938093248 00000100:00100000:3.0:1715330313.915480:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23678 00000100:00100000:3.0:1715330313.915487:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+479:18878:x1798653938093248:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:3.0:1715330313.915515:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330313.915539:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087725680/0xd895711d66daa03 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbd8c expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.915637:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087727600/0xd895711d66daa0a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.915650:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087727600/0xd895711d66daa0a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.915660:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087727600/0xd895711d66daa0a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.915671:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087727a80/0xd895711d66daa11 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a2d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.915675:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087727a80/0xd895711d66daa11 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.915679:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087727a80/0xd895711d66daa11 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:3.0:1715330313.916186:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f5:0x0], index 0: 0 00000040:00080000:3.0:1715330313.916259:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].240, 184 off50032 00010000:00010000:3.0:1715330313.916319:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880087724b40/0xd895711d66daa18 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1579:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.916325:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087724b40/0xd895711d66daa18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1579:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.916330:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087724b40/0xd895711d66daa18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1579:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330313.916364:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].241, 176 off50208 00000001:00080000:3.0:1715330313.916368:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983877 00010000:00010000:3.0:1715330313.916388:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087727600/0xd895711d66daa0a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.916393:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087727600/0xd895711d66daa0a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.916402:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880087727600/0xd895711d66daa0a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.916407:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880087727600/0xd895711d66daa0a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.916412:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087727600 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330313.916415:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087727600/0xd895711d66daa0a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.916420:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087727600/0xd895711d66daa0a lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.916430:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330313.916432:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330313.916436:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880087727600/0xd895711d66daa0a lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.916440:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087727600/0xd895711d66daa0a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330313.916450:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093a8fb80 reply state ffff88009d667000 transno 4294983878 ns: mdt-lustre-MDT0000_UUID lock: ffff880087727a80/0xd895711d66daa11 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.916456:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087727a80/0xd895711d66daa11 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.916461:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a2d7 (ffff8800b4184000) 00010000:00010000:3.0:1715330313.916463:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330313.916465:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330313.916484:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087725680/0xd895711d66daa03 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd8c expref: 483 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.916499:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880087724b40/0xd895711d66daa18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1579:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd8c expref: 482 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.916504:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1579:0x0].0x0 (ffff8800b4184800) 00010000:00010000:3.0:1715330313.916506:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330313.916508:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880087724b40, rc 0) 00000100:00100000:3.0:1715330313.916575:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+483:18878:x1798653938093248:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 1088us (1347us total) trans 4294983878 rc 0/0 00000100:00100000:3.0:1715330313.916581:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23678 00000020:00080000:3.0:1715330313.916586:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1715330313.919336:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.919444:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938093376 00000100:00100000:3.0:1715330313.919452:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938093376 00000100:00100000:3.0:1715330313.919489:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5185 00000100:00100000:3.0:1715330313.919495:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d62b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+483:18878:x1798653938093376:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330313.919697:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].242, 168 off50376 00000001:00080000:3.0:1715330313.919701:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983879 00000100:00100000:3.0:1715330313.920371:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d62b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+485:18878:x1798653938093376:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 875us (1042us total) trans 4294983880 rc 0/0 00000100:00100000:3.0:1715330313.920378:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5185 00000020:00080000:3.0:1715330313.920383:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1715330313.924669:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.925272:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938093504 00000100:00100000:3.0:1715330313.925283:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938093504 00000100:00100000:3.0:1715330313.925396:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23679 00000100:00100000:3.0:1715330313.925402:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d62ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+485:18878:x1798653938093504:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:3.0:1715330313.925430:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330313.925454:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087725680/0xd895711d66daa26 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbd93 expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.925553:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087727600/0xd895711d66daa2d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.925564:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087727600/0xd895711d66daa2d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.925574:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087727600/0xd895711d66daa2d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.925586:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800877258c0/0xd895711d66daa34 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a3d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.925591:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800877258c0/0xd895711d66daa34 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.925595:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800877258c0/0xd895711d66daa34 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:3.0:1715330313.926151:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f5:0x0], index 1: 0 00000040:00080000:3.0:1715330313.926223:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].243, 184 off50560 00010000:00010000:3.0:1715330313.926283:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880087724000/0xd895711d66daa3b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x157a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.926290:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087724000/0xd895711d66daa3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.926295:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087724000/0xd895711d66daa3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330313.926335:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].244, 176 off50736 00000001:00080000:3.0:1715330313.926339:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983881 00010000:00010000:3.0:1715330313.926363:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087727600/0xd895711d66daa2d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.926369:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087727600/0xd895711d66daa2d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.926374:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880087727600/0xd895711d66daa2d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.926379:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880087727600/0xd895711d66daa2d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.926384:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087727600 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330313.926387:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087727600/0xd895711d66daa2d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.926392:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087727600/0xd895711d66daa2d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.926401:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330313.926403:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330313.926407:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880087727600/0xd895711d66daa2d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.926411:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087727600/0xd895711d66daa2d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330313.926422:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007d62ad80 reply state ffff880093828000 transno 4294983882 ns: mdt-lustre-MDT0000_UUID lock: ffff8800877258c0/0xd895711d66daa34 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.926429:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800877258c0/0xd895711d66daa34 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.926434:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a3d7 (ffff8800b4184d00) 00010000:00010000:3.0:1715330313.926435:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330313.926438:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330313.926457:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087725680/0xd895711d66daa26 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd93 expref: 489 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.926467:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880087724000/0xd895711d66daa3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x157a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd93 expref: 488 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.926473:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157a:0x0].0x0 (ffff8800b4184b00) 00010000:00010000:3.0:1715330313.926475:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330313.926476:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880087724000, rc 0) 00000100:00100000:3.0:1715330313.926542:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d62ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+489:18878:x1798653938093504:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 1140us (1885us total) trans 4294983882 rc 0/0 00000100:00100000:3.0:1715330313.926549:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23679 00000020:00080000:3.0:1715330313.926554:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.929821:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.929921:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938093632 00000100:00100000:3.0:1715330313.929931:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938093632 00000100:00100000:3.0:1715330313.930457:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5186 00000100:00100000:3.0:1715330313.930465:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+489:18878:x1798653938093632:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330313.930718:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].245, 168 off50904 00000001:00080000:3.0:1715330313.930723:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983883 00000100:00100000:3.0:1715330313.930842:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+491:18878:x1798653938093632:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 376us (1032us total) trans 4294983884 rc 0/0 00000100:00100000:3.0:1715330313.930849:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5186 00000020:00080000:3.0:1715330313.930854:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1715330313.934094:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.934232:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938093760 00000100:00100000:3.0:1715330313.934242:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938093760 00000100:00100000:3.0:1715330313.934862:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23680 00000100:00100000:3.0:1715330313.934870:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d62b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+491:18878:x1798653938093760:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:3.0:1715330313.934899:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330313.934920:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087726f40/0xd895711d66daa49 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbd9a expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.935027:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087726d00/0xd895711d66daa50 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.935041:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087726d00/0xd895711d66daa50 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.935087:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087726d00/0xd895711d66daa50 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.935100:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087725680/0xd895711d66daa57 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989ad8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.935106:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087725680/0xd895711d66daa57 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.935111:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087725680/0xd895711d66daa57 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:3.0:1715330313.935399:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f6:0x0], index 0: 0 00000040:00080000:3.0:1715330313.935480:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].246, 184 off51088 00010000:00010000:3.0:1715330313.935548:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880087727600/0xd895711d66daa5e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x157b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.935555:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087727600/0xd895711d66daa5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.935560:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087727600/0xd895711d66daa5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330313.935604:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].247, 176 off51264 00000001:00080000:3.0:1715330313.935610:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983885 00010000:00010000:3.0:1715330313.935636:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087726d00/0xd895711d66daa50 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.935641:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087726d00/0xd895711d66daa50 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.935646:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880087726d00/0xd895711d66daa50 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.935651:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880087726d00/0xd895711d66daa50 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.935657:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087726d00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330313.935660:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087726d00/0xd895711d66daa50 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.935667:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087726d00/0xd895711d66daa50 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.935679:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330313.935682:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330313.935686:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880087726d00/0xd895711d66daa50 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.935692:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087726d00/0xd895711d66daa50 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330313.935703:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007d62b100 reply state ffff880093829000 transno 4294983886 ns: mdt-lustre-MDT0000_UUID lock: ffff880087725680/0xd895711d66daa57 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.935709:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087725680/0xd895711d66daa57 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330313.935714:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ad8 (ffff88009d5faa00) 00010000:00010000:3.0:1715330313.935717:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330313.935719:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330313.935764:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087726f40/0xd895711d66daa49 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd9a expref: 495 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.935776:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880087727600/0xd895711d66daa5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x157b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd9a expref: 494 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330313.935782:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157b:0x0].0x0 (ffff88009d5fa200) 00010000:00010000:3.0:1715330313.935784:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330313.935785:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880087727600, rc 0) 00000100:00100000:3.0:1715330313.935862:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d62b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+495:18878:x1798653938093760:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 985us (1770us total) trans 4294983886 rc 0/0 00000100:00100000:3.0:1715330313.935868:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23680 00000020:00080000:3.0:1715330313.935873:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330313.940579:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330313.940771:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938093888 00000100:00100000:2.0:1715330313.940781:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938093888 00000100:00100000:2.0:1715330313.940888:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5187 00000100:00100000:2.0:1715330313.940895:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+495:18878:x1798653938093888:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:2.0:1715330313.941159:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].248, 168 off51432 00000001:00080000:2.0:1715330313.941165:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983887 00000100:00100000:2.0:1715330313.941253:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+497:18878:x1798653938093888:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 358us (684us total) trans 4294983888 rc 0/0 00000100:00100000:2.0:1715330313.941259:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5187 00000020:00080000:2.0:1715330313.941265:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1715330313.944305:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330313.944464:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938094016 00000100:00100000:0.0:1715330313.944473:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938094016 00000100:00100000:0.0:1715330313.944776:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23681 00000100:00100000:0.0:1715330313.944785:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+497:18878:x1798653938094016:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:0.0:1715330313.944813:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330313.944834:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2400/0xd895711d66daa6c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbda1 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330313.945213:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66daa73 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.945229:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66daa73 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.945240:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66daa73 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.945253:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66daa7a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989bd8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.945259:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66daa7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.945264:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66daa7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00080000:1.0:1715330313.945619:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f6:0x0], index 1: 0 00000040:00080000:1.0:1715330313.945706:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].249, 184 off51616 00010000:00010000:1.0:1715330313.945791:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66daa81 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x157c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.945799:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66daa81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.945805:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66daa81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:1.0:1715330313.945842:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].250, 176 off51792 00000001:00080000:1.0:1715330313.945845:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983889 00010000:00010000:1.0:1715330313.945869:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66daa73 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.945874:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66daa73 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.945878:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66daa73 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.945883:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66daa73 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.945888:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfe1c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330313.945891:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66daa73 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.945897:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66daa73 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.945907:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:1.0:1715330313.945910:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330313.945913:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66daa73 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.945917:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66daa73 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:1.0:1715330313.945948:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007d629880 reply state ffff8800939ec000 transno 4294983890 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66daa7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.945955:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66daa7a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.945960:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989bd8 (ffff88008b0d2300) 00010000:00010000:1.0:1715330313.945962:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330313.945964:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1715330313.945989:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2400/0xd895711d66daa6c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbda1 expref: 501 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330313.946003:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66daa81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x157c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbda1 expref: 500 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330313.946009:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157c:0x0].0x0 (ffff88008b0d2f00) 00010000:00010000:1.0:1715330313.946010:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715330313.946012:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bff3c0, rc 0) 00000100:00100000:1.0:1715330313.946154:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+501:18878:x1798653938094016:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 1368us (1857us total) trans 4294983890 rc 0/0 00000100:00100000:1.0:1715330313.946162:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23681 00000020:00080000:1.0:1715330313.946167:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1715330313.949528:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.949648:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938094144 00000100:00100000:3.0:1715330313.949656:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938094144 00000100:00100000:3.0:1715330313.949753:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5188 00000100:00100000:3.0:1715330313.949761:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007acb3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+501:18878:x1798653938094144:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330313.949989:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].251, 168 off51960 00000001:00080000:3.0:1715330313.949993:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983891 00000100:00100000:3.0:1715330313.950122:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007acb3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+503:18878:x1798653938094144:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 361us (604us total) trans 4294983892 rc 0/0 00000100:00100000:3.0:1715330313.950129:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5188 00000020:00080000:3.0:1715330313.950134:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1715330313.952482:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330313.952575:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938094272 00000100:00100000:1.0:1715330313.952585:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938094272 00000100:00100000:1.0:1715330313.952641:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23682 00000100:00100000:1.0:1715330313.952649:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+503:18878:x1798653938094272:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:1.0:1715330313.952672:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330313.952692:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66daa8f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbda8 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330313.952824:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66daa96 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.952842:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66daa96 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.952851:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66daa96 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.952864:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66daa9d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989cd8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.952869:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66daa9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.952874:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66daa9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00080000:1.0:1715330313.953182:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f7:0x0], index 0: 0 00000040:00080000:1.0:1715330313.953265:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].252, 184 off52144 00010000:00010000:1.0:1715330313.953334:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66daaa4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x157d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.953341:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66daaa4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.953347:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66daaa4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:1.0:1715330313.953394:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].253, 176 off52320 00000001:00080000:1.0:1715330313.953398:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983893 00010000:00010000:1.0:1715330313.953424:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66daa96 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.953429:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66daa96 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.953437:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66daa96 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.953442:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66daa96 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.953447:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfd440 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330313.953450:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66daa96 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.953455:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66daa96 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.953465:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:1.0:1715330313.953468:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330313.953472:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66daa96 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.953476:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66daa96 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:1.0:1715330313.953506:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012fa87100 reply state ffff8800939e8000 transno 4294983894 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66daa9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.953515:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66daa9d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.953521:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989cd8 (ffff88008b0d2100) 00010000:00010000:1.0:1715330313.953523:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330313.953526:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1715330313.953546:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66daa8f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbda8 expref: 507 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330313.953563:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66daaa4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x157d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbda8 expref: 506 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330313.953569:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157d:0x0].0x0 (ffff88008b0d2000) 00010000:00010000:1.0:1715330313.953570:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715330313.953572:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfe1c0, rc 0) 00000100:00100000:1.0:1715330313.953640:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+507:18878:x1798653938094272:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 991us (1167us total) trans 4294983894 rc 0/0 00000100:00100000:1.0:1715330313.953648:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23682 00000020:00080000:1.0:1715330313.953653:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1715330313.957176:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.957244:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938094400 00000100:00100000:3.0:1715330313.957255:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938094400 00000100:00100000:3.0:1715330313.957319:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5189 00000100:00100000:3.0:1715330313.957328:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+507:18878:x1798653938094400:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330313.957591:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].254, 168 off52488 00000001:00080000:3.0:1715330313.957598:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983895 00000100:00100000:3.0:1715330313.957807:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+509:18878:x1798653938094400:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 479us (640us total) trans 4294983896 rc 0/0 00000100:00100000:3.0:1715330313.957814:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5189 00000020:00080000:3.0:1715330313.957818:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1715330313.962559:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330313.962648:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938094528 00000100:00100000:1.0:1715330313.962658:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938094528 00000100:00100000:1.0:1715330313.962724:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23683 00000100:00100000:1.0:1715330313.962788:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+509:18878:x1798653938094528:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:1.0:1715330313.962813:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330313.962833:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66daab2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbdaf expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330313.962946:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66daab9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.962959:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66daab9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.962972:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66daab9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.962987:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66daac0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989dd8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.962992:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66daac0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.962998:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66daac0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00080000:1.0:1715330313.963330:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f7:0x0], index 1: 0 00000040:00080000:1.0:1715330313.963408:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].255, 184 off52672 00010000:00010000:1.0:1715330313.963470:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd8c0/0xd895711d66daac7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x157e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.963477:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd8c0/0xd895711d66daac7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.963483:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd8c0/0xd895711d66daac7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:1.0:1715330313.963522:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].256, 176 off52848 00000001:00080000:1.0:1715330313.963526:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983897 00010000:00010000:1.0:1715330313.963550:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66daab9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.963556:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66daab9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.963561:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66daab9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.963567:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66daab9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.963577:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bffcc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330313.963580:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66daab9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.963587:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66daab9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.963597:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:1.0:1715330313.963600:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330313.963603:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66daab9 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.963608:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66daab9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:1.0:1715330313.967072:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012fa87480 reply state ffff8800939ef000 transno 4294983898 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66daac0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.967101:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66daac0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330313.967114:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989dd8 (ffff88008b0d2b00) 00010000:00010000:1.0:1715330313.967118:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330313.967123:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1715330313.967186:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66daab2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbdaf expref: 513 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330313.967209:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd8c0/0xd895711d66daac7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x157e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbdaf expref: 512 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330313.967215:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157e:0x0].0x0 (ffff88009d774900) 00010000:00010000:1.0:1715330313.967218:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715330313.967220:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfd8c0, rc 0) 00000100:00100000:1.0:1715330313.967295:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+513:18878:x1798653938094528:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 4563us (4752us total) trans 4294983898 rc 0/0 00000100:00100000:1.0:1715330313.967305:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23683 00000020:00080000:1.0:1715330313.967313:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1715330313.973925:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330313.974064:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938094656 00000100:00100000:3.0:1715330313.974074:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938094656 00000100:00100000:3.0:1715330313.975033:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5190 00000100:00100000:3.0:1715330313.975042:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+513:18878:x1798653938094656:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330313.975341:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].257, 168 off53016 00000001:00080000:3.0:1715330313.975347:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983899 00000100:00100000:3.0:1715330313.976921:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+515:18878:x1798653938094656:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 1871us (2998us total) trans 4294983900 rc 0/0 00000100:00100000:3.0:1715330313.976934:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5190 00000020:00080000:3.0:1715330313.976942:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1715330313.987314:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330313.990838:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938094784 00000100:00100000:2.0:1715330313.990855:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938094784 00000100:00100000:2.0:1715330313.990943:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23684 00000100:00100000:2.0:1715330313.990953:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+515:18878:x1798653938094784:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:2.0:1715330313.990982:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330313.991007:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738480/0xd895711d66daad5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbdb6 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.991134:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7386c0/0xd895711d66daadc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.991147:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7386c0/0xd895711d66daadc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.991158:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7386c0/0xd895711d66daadc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.991191:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594000/0xd895711d66daae3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989ed8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.991195:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594000/0xd895711d66daae3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.991200:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594000/0xd895711d66daae3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00080000:2.0:1715330313.991543:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f8:0x0], index 0: 0 00000040:00080000:2.0:1715330313.991633:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].258, 184 off53200 00010000:00010000:2.0:1715330313.991705:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594240/0xd895711d66daaea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x157f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.991712:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594240/0xd895711d66daaea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.991718:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594240/0xd895711d66daaea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:2.0:1715330313.991886:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].259, 176 off53376 00000001:00080000:2.0:1715330313.991892:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983901 00010000:00010000:2.0:1715330313.991918:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7386c0/0xd895711d66daadc lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.991924:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7386c0/0xd895711d66daadc lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.991930:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7386c0/0xd895711d66daadc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.991936:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7386c0/0xd895711d66daadc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.991941:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d7386c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330313.991945:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7386c0/0xd895711d66daadc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.991956:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7386c0/0xd895711d66daadc lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.991970:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330313.991973:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330313.991978:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7386c0/0xd895711d66daadc lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.991983:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7386c0/0xd895711d66daadc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:2.0:1715330313.992009:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007d629c00 reply state ffff880073bdb000 transno 4294983902 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594000/0xd895711d66daae3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.993987:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594000/0xd895711d66daae3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330313.993997:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ed8 (ffff880093a11200) 00010000:00010000:2.0:1715330313.993999:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330313.994010:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1715330313.994093:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738480/0xd895711d66daad5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbdb6 expref: 519 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.994117:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594240/0xd895711d66daaea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x157f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbdb6 expref: 518 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330313.994124:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157f:0x0].0x0 (ffff880093a11500) 00010000:00010000:2.0:1715330313.994126:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330313.994128:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d594240, rc 0) 00000100:00100000:2.0:1715330313.994233:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+519:18878:x1798653938094784:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 3280us (6929us total) trans 4294983902 rc 0/0 00000100:00100000:2.0:1715330313.994244:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23684 00000020:00080000:2.0:1715330313.994250:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1715330314.009911:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.009991:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938094912 00000100:00100000:3.0:1715330314.010001:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938094912 00000100:00080000:2.0:1715330314.010031:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330284 00000100:00100000:3.0:1715330314.010070:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5191 00000100:00100000:3.0:1715330314.010079:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+519:18878:x1798653938094912:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330314.010352:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].260, 168 off53544 00000001:00080000:3.0:1715330314.010357:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983903 00000100:00100000:3.0:1715330314.010457:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+521:18878:x1798653938094912:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 379us (558us total) trans 4294983904 rc 0/0 00000100:00100000:3.0:1715330314.010465:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5191 00000020:00080000:3.0:1715330314.010469:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1715330314.017431:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.017786:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938095040 00000100:00100000:3.0:1715330314.017797:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938095040 00000100:00100000:2.0:1715330314.019542:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23685 00000100:00100000:2.0:1715330314.019555:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d62b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+521:18878:x1798653938095040:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:2.0:1715330314.019585:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330314.019612:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594480/0xd895711d66daaf8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbdbd expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330314.019725:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5946c0/0xd895711d66daaff lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.019755:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5946c0/0xd895711d66daaff lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.019766:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5946c0/0xd895711d66daaff lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.019778:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594900/0xd895711d66dab06 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989fd8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.019783:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594900/0xd895711d66dab06 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.019788:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594900/0xd895711d66dab06 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00080000:2.0:1715330314.020109:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f8:0x0], index 1: 0 00000040:00080000:2.0:1715330314.020193:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].261, 184 off53728 00010000:00010000:2.0:1715330314.020260:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594b40/0xd895711d66dab0d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1580:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.020266:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594b40/0xd895711d66dab0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1580:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.020272:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594b40/0xd895711d66dab0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1580:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:2.0:1715330314.020315:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].262, 176 off53904 00000001:00080000:2.0:1715330314.020319:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983905 00010000:00010000:2.0:1715330314.020348:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5946c0/0xd895711d66daaff lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.020355:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5946c0/0xd895711d66daaff lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.020361:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5946c0/0xd895711d66daaff lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.020366:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5946c0/0xd895711d66daaff lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.020372:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d5946c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.020375:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5946c0/0xd895711d66daaff lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.020381:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5946c0/0xd895711d66daaff lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.020392:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330314.020395:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330314.020399:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5946c0/0xd895711d66daaff lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.020405:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5946c0/0xd895711d66daaff lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:2.0:1715330314.020438:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007d62b480 reply state ffff880073bdc000 transno 4294983906 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594900/0xd895711d66dab06 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.020446:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594900/0xd895711d66dab06 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.020452:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989fd8 (ffff880093a11900) 00010000:00010000:2.0:1715330314.020454:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330314.020457:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1715330314.020481:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594480/0xd895711d66daaf8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbdbd expref: 525 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330314.020493:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594b40/0xd895711d66dab0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1580:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbdbd expref: 524 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330314.020499:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1580:0x0].0x0 (ffff880093a11b00) 00010000:00010000:2.0:1715330314.020501:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330314.020503:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d594b40, rc 0) 00000100:00100000:2.0:1715330314.020573:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d62b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+525:18878:x1798653938095040:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 1021us (3154us total) trans 4294983906 rc 0/0 00000100:00100000:2.0:1715330314.020580:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23685 00000020:00080000:2.0:1715330314.020586:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1715330314.026333:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330314.026402:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938095168 00000100:00100000:0.0:1715330314.026412:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938095168 00000100:00100000:0.0:1715330314.026527:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5192 00000100:00100000:0.0:1715330314.026536:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+525:18878:x1798653938095168:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:0.0:1715330314.026820:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].263, 168 off54072 00000001:00080000:0.0:1715330314.026826:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983907 00000100:00100000:0.0:1715330314.026932:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+527:18878:x1798653938095168:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 397us (610us total) trans 4294983908 rc 0/0 00000100:00100000:0.0:1715330314.026939:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5192 00000020:00080000:0.0:1715330314.026944:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1715330314.030947:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.031608:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938095296 00000100:00100000:3.0:1715330314.031621:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938095296 00000100:00100000:3.0:1715330314.031709:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23686 00000100:00100000:3.0:1715330314.031719:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+527:18878:x1798653938095296:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:3.0:1715330314.031792:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330314.031821:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087726f40/0xd895711d66dab1b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbdc4 expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330314.031940:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087726d00/0xd895711d66dab22 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.031954:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087726d00/0xd895711d66dab22 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.031965:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087726d00/0xd895711d66dab22 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.031978:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7840/0xd895711d66dab29 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a0d8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.031983:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7840/0xd895711d66dab29 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.031987:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7840/0xd895711d66dab29 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:3.0:1715330314.032274:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f9:0x0], index 0: 0 00000040:00080000:3.0:1715330314.032358:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].264, 184 off54256 00010000:00010000:3.0:1715330314.032423:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b73c0/0xd895711d66dab30 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1581:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.032433:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b73c0/0xd895711d66dab30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1581:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.032440:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b73c0/0xd895711d66dab30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1581:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330314.032485:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].265, 176 off54432 00000001:00080000:3.0:1715330314.032489:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983909 00010000:00010000:3.0:1715330314.032518:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087726d00/0xd895711d66dab22 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.032524:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087726d00/0xd895711d66dab22 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.032529:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880087726d00/0xd895711d66dab22 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.032534:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880087726d00/0xd895711d66dab22 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.032538:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087726d00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.032541:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087726d00/0xd895711d66dab22 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.032547:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087726d00/0xd895711d66dab22 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.032558:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330314.032561:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330314.032564:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880087726d00/0xd895711d66dab22 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.032569:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087726d00/0xd895711d66dab22 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330314.035359:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012fa84380 reply state ffff88009382a000 transno 4294983910 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7840/0xd895711d66dab29 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.035387:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7840/0xd895711d66dab29 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.035395:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a0d8 (ffff88009d5fa600) 00010000:00010000:3.0:1715330314.035398:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330314.035403:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330314.035457:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087726f40/0xd895711d66dab1b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbdc4 expref: 531 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330314.035478:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b73c0/0xd895711d66dab30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1581:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbdc4 expref: 530 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330314.035484:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1581:0x0].0x0 (ffff88009d5fa400) 00010000:00010000:3.0:1715330314.035485:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330314.035488:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7b73c0, rc 0) 00000100:00100000:3.0:1715330314.035561:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+531:18878:x1798653938095296:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 3843us (4626us total) trans 4294983910 rc 0/0 00000100:00100000:3.0:1715330314.035570:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23686 00000020:00080000:3.0:1715330314.035577:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330314.039304:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.040632:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938095424 00000100:00100000:3.0:1715330314.040644:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938095424 00000100:00100000:3.0:1715330314.040697:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5193 00000100:00100000:3.0:1715330314.040705:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+531:18878:x1798653938095424:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330314.040971:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].266, 168 off54600 00000001:00080000:3.0:1715330314.040977:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983911 00000100:00100000:3.0:1715330314.041086:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+533:18878:x1798653938095424:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 380us (1793us total) trans 4294983912 rc 0/0 00000100:00100000:3.0:1715330314.041093:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5193 00000020:00080000:3.0:1715330314.041098:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1715330314.044532:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330314.044617:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938095552 00000100:00100000:0.0:1715330314.044628:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938095552 00000100:00100000:0.0:1715330314.044686:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23687 00000100:00100000:0.0:1715330314.044694:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+533:18878:x1798653938095552:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:0.0:1715330314.044722:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330314.045186:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66dab3e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbdcb expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.045306:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66dab45 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.045321:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66dab45 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.045332:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66dab45 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.045345:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66dab4c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a1d8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.045351:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66dab4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.045356:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66dab4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:1.0:1715330314.045674:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f9:0x0], index 1: 0 00000040:00080000:1.0:1715330314.045835:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].267, 184 off54784 00010000:00010000:1.0:1715330314.046080:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66dab53 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1582:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.046088:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66dab53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1582:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.046094:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66dab53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1582:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:1.0:1715330314.046142:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].268, 176 off54960 00000001:00080000:1.0:1715330314.046147:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983913 00010000:00010000:1.0:1715330314.046180:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66dab45 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.046185:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66dab45 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.046190:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66dab45 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.046195:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66dab45 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.046200:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfd680 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330314.046204:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66dab45 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.046210:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66dab45 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.046220:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:1.0:1715330314.046222:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330314.046226:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66dab45 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.046230:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66dab45 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:1.0:1715330314.046301:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009b4c3b80 reply state ffff8800939ed000 transno 4294983914 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66dab4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.046310:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66dab4c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.046316:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a1d8 (ffff88012ca4dc00) 00010000:00010000:1.0:1715330314.046318:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330314.046321:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1715330314.046344:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66dab3e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbdcb expref: 537 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.046357:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66dab53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1582:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbdcb expref: 536 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.046362:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1582:0x0].0x0 (ffff88012ca4d900) 00010000:00010000:1.0:1715330314.046364:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715330314.046365:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bffcc0, rc 0) 00000100:00100000:1.0:1715330314.046573:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+537:18878:x1798653938095552:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 1879us (2055us total) trans 4294983914 rc 0/0 00000100:00100000:1.0:1715330314.046580:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23687 00000020:00080000:1.0:1715330314.046587:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1715330314.050624:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330314.050791:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938095680 00000100:00100000:0.0:1715330314.050802:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938095680 00000100:00100000:0.0:1715330314.050860:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5194 00000100:00100000:0.0:1715330314.050868:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007acb3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+537:18878:x1798653938095680:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:0.0:1715330314.051146:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].269, 168 off55128 00000001:00080000:0.0:1715330314.051152:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983915 00000100:00100000:0.0:1715330314.051263:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007acb3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+539:18878:x1798653938095680:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 394us (650us total) trans 4294983916 rc 0/0 00000100:00100000:0.0:1715330314.051271:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5194 00000020:00080000:0.0:1715330314.051277:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1715330314.054949:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330314.055573:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938095808 00000100:00100000:1.0:1715330314.055582:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938095808 00000100:00100000:1.0:1715330314.056195:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23688 00000100:00100000:1.0:1715330314.056202:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+539:18878:x1798653938095808:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:1.0:1715330314.056225:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330314.056245:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66dab61 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbdd2 expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.056342:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66dab68 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.056353:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66dab68 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.056364:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66dab68 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.056375:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66dab6f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a2d8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.056380:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66dab6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.056385:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66dab6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:1.0:1715330314.056635:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9fa:0x0], index 0: 0 00000040:00080000:1.0:1715330314.056715:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].270, 184 off55312 00010000:00010000:1.0:1715330314.056946:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66dab76 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1583:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.056952:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66dab76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1583:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.056958:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66dab76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1583:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:1.0:1715330314.057004:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].271, 176 off55488 00000001:00080000:1.0:1715330314.057009:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983917 00010000:00010000:1.0:1715330314.057035:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66dab68 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.057041:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66dab68 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.057057:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66dab68 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.057062:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66dab68 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.057068:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfd440 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330314.057071:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66dab68 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.057078:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66dab68 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.057089:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:1.0:1715330314.057091:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330314.057096:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66dab68 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.057100:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66dab68 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:1.0:1715330314.057170:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012fa87800 reply state ffff8800939eb000 transno 4294983918 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66dab6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.057180:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66dab6f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.057185:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a2d8 (ffff88012ca4df00) 00010000:00010000:1.0:1715330314.057187:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330314.057190:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1715330314.057209:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66dab61 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbdd2 expref: 543 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.057222:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66dab76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1583:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbdd2 expref: 542 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.057227:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1583:0x0].0x0 (ffff88012ca4d100) 00010000:00010000:1.0:1715330314.057229:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715330314.057231:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfd680, rc 0) 00000100:00100000:1.0:1715330314.057294:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+543:18878:x1798653938095808:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 1091us (2356us total) trans 4294983918 rc 0/0 00000100:00100000:1.0:1715330314.057301:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23688 00000020:00080000:1.0:1715330314.057306:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1715330314.060822:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.060940:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938095936 00000100:00100000:3.0:1715330314.060950:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938095936 00000100:00100000:3.0:1715330314.061103:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5195 00000100:00100000:3.0:1715330314.061111:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+543:18878:x1798653938095936:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330314.061363:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].272, 168 off55656 00000001:00080000:3.0:1715330314.061369:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983919 00000100:00100000:3.0:1715330314.061477:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+545:18878:x1798653938095936:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 366us (667us total) trans 4294983920 rc 0/0 00000100:00100000:3.0:1715330314.061484:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5195 00000020:00080000:3.0:1715330314.061489:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1715330314.068386:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330314.069853:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938096064 00000100:00100000:1.0:1715330314.069865:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938096064 00000100:00100000:1.0:1715330314.069929:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23689 00000100:00100000:1.0:1715330314.069938:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+545:18878:x1798653938096064:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:1.0:1715330314.069968:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330314.069993:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66dab84 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbdd9 expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.070116:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087726f40/0xd895711d66dab8b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.070130:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087726f40/0xd895711d66dab8b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.070142:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087726f40/0xd895711d66dab8b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.070158:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087726d00/0xd895711d66dab92 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a3d8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.070163:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087726d00/0xd895711d66dab92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.070168:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087726d00/0xd895711d66dab92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:1.0:1715330314.070468:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9fa:0x0], index 1: 0 00000040:00080000:1.0:1715330314.070551:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].273, 184 off55840 00010000:00010000:1.0:1715330314.070640:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c000/0xd895711d66dab99 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1584:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.070647:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c000/0xd895711d66dab99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1584:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.070652:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c000/0xd895711d66dab99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1584:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:1.0:1715330314.070695:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].274, 176 off56016 00000001:00080000:1.0:1715330314.070699:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983921 00010000:00010000:1.0:1715330314.070725:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087726f40/0xd895711d66dab8b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.070757:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087726f40/0xd895711d66dab8b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.070763:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880087726f40/0xd895711d66dab8b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.070769:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880087726f40/0xd895711d66dab8b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.070780:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087726f40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330314.070783:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087726f40/0xd895711d66dab8b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.070790:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087726f40/0xd895711d66dab8b lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.070801:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:1.0:1715330314.070804:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330314.070808:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880087726f40/0xd895711d66dab8b lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.070813:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087726f40/0xd895711d66dab8b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:1.0:1715330314.070825:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012fa85500 reply state ffff8800939e9000 transno 4294983922 ns: mdt-lustre-MDT0000_UUID lock: ffff880087726d00/0xd895711d66dab92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.070834:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087726d00/0xd895711d66dab92 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.070838:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a3d8 (ffff88012ca4db00) 00010000:00010000:1.0:1715330314.070840:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330314.070842:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1715330314.070866:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66dab84 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbdd9 expref: 549 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.070884:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c000/0xd895711d66dab99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1584:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbdd9 expref: 548 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.070890:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1584:0x0].0x0 (ffff88009d774800) 00010000:00010000:1.0:1715330314.070893:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715330314.070895:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093b9c000, rc 0) 00000100:00100000:1.0:1715330314.070971:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+549:18878:x1798653938096064:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 1034us (2598us total) trans 4294983922 rc 0/0 00000100:00100000:1.0:1715330314.071279:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23689 00000020:00080000:1.0:1715330314.071287:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1715330314.075123:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330314.075861:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938096192 00000100:00100000:0.0:1715330314.075872:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938096192 00000100:00100000:0.0:1715330314.076606:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5196 00000100:00100000:0.0:1715330314.076618:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+549:18878:x1798653938096192:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:0.0:1715330314.077098:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].275, 168 off56184 00000001:00080000:0.0:1715330314.077104:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983923 00000100:00100000:0.0:1715330314.078595:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+551:18878:x1798653938096192:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 1968us (3476us total) trans 4294983924 rc 0/0 00000100:00100000:0.0:1715330314.078609:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5196 00000020:00080000:0.0:1715330314.078617:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1715330314.081940:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330314.082357:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938096320 00000100:00100000:1.0:1715330314.082368:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938096320 00000100:00100000:1.0:1715330314.082710:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23690 00000100:00100000:1.0:1715330314.082718:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+551:18878:x1798653938096320:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:1.0:1715330314.082772:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330314.082795:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c240/0xd895711d66daba7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbde0 expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.082903:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c480/0xd895711d66dabae lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.082918:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c480/0xd895711d66dabae lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.082928:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c480/0xd895711d66dabae lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.082940:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c6c0/0xd895711d66dabb5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989ad9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.082945:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c6c0/0xd895711d66dabb5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.082949:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c6c0/0xd895711d66dabb5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:1.0:1715330314.083250:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9fb:0x0], index 0: 0 00000040:00080000:1.0:1715330314.083337:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].276, 184 off56368 00010000:00010000:1.0:1715330314.083406:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c900/0xd895711d66dabbc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1585:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.083413:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c900/0xd895711d66dabbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1585:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.083419:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c900/0xd895711d66dabbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1585:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:1.0:1715330314.083468:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].277, 176 off56544 00000001:00080000:1.0:1715330314.083473:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983925 00010000:00010000:1.0:1715330314.083498:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c480/0xd895711d66dabae lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.083504:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c480/0xd895711d66dabae lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.083509:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c480/0xd895711d66dabae lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.083515:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c480/0xd895711d66dabae lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.083520:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093b9c480 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330314.083524:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c480/0xd895711d66dabae lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.083530:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c480/0xd895711d66dabae lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.083541:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:1.0:1715330314.083545:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330314.083549:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c480/0xd895711d66dabae lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.083554:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c480/0xd895711d66dabae lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:1.0:1715330314.084340:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012fa86d80 reply state ffff8800939ea000 transno 4294983926 ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c6c0/0xd895711d66dabb5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.084354:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c6c0/0xd895711d66dabb5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.084359:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ad9 (ffff88012cc48700) 00010000:00010000:1.0:1715330314.084361:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330314.084365:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1715330314.084403:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c240/0xd895711d66daba7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbde0 expref: 555 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.084417:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c900/0xd895711d66dabbc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1585:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbde0 expref: 554 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.084423:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1585:0x0].0x0 (ffff88012cc48d00) 00010000:00010000:1.0:1715330314.084425:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715330314.084428:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093b9c900, rc 0) 00000100:00100000:1.0:1715330314.084510:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+555:18878:x1798653938096320:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 1790us (2580us total) trans 4294983926 rc 0/0 00000100:00100000:1.0:1715330314.084518:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23690 00000020:00080000:1.0:1715330314.084525:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1715330314.090510:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330314.091725:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938096448 00000100:00100000:1.0:1715330314.092422:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938096448 00000100:00100000:1.0:1715330314.093113:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5197 00000100:00100000:1.0:1715330314.093121:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+555:18878:x1798653938096448:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:1.0:1715330314.093383:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].278, 168 off56712 00000001:00080000:1.0:1715330314.093390:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983927 00000100:00100000:1.0:1715330314.093515:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+557:18878:x1798653938096448:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 394us (3016us total) trans 4294983928 rc 0/0 00000100:00100000:1.0:1715330314.093523:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5197 00000020:00080000:1.0:1715330314.093528:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1715330314.096640:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330314.096801:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938096576 00000100:00100000:1.0:1715330314.096811:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938096576 00000100:00100000:1.0:1715330314.096857:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23691 00000100:00100000:1.0:1715330314.096865:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+557:18878:x1798653938096576:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:1.0:1715330314.096892:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330314.096915:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cb40/0xd895711d66dabca lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbde7 expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.097017:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cd80/0xd895711d66dabd1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.097029:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cd80/0xd895711d66dabd1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.097040:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cd80/0xd895711d66dabd1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.097064:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cfc0/0xd895711d66dabd8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989bd9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.097070:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cfc0/0xd895711d66dabd8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.097080:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cfc0/0xd895711d66dabd8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:1.0:1715330314.097398:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9fb:0x0], index 1: 0 00000040:00080000:1.0:1715330314.097482:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].279, 184 off56896 00010000:00010000:1.0:1715330314.097545:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d200/0xd895711d66dabdf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1586:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.097552:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d200/0xd895711d66dabdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1586:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.097557:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d200/0xd895711d66dabdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1586:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:1.0:1715330314.097595:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].280, 176 off57072 00000001:00080000:1.0:1715330314.097598:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983929 00010000:00010000:1.0:1715330314.097621:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cd80/0xd895711d66dabd1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.097626:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cd80/0xd895711d66dabd1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.097631:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cd80/0xd895711d66dabd1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.097635:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cd80/0xd895711d66dabd1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.097640:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093b9cd80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330314.097643:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cd80/0xd895711d66dabd1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.097649:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cd80/0xd895711d66dabd1 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.097658:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:1.0:1715330314.097661:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330314.097664:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cd80/0xd895711d66dabd1 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.097669:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cd80/0xd895711d66dabd1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:1.0:1715330314.098822:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012fa85180 reply state ffff8800939ee000 transno 4294983930 ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cfc0/0xd895711d66dabd8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.098838:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cfc0/0xd895711d66dabd8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.098850:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989bd9 (ffff88012cc48e00) 00010000:00010000:1.0:1715330314.098853:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330314.098857:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1715330314.098899:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cb40/0xd895711d66dabca lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbde7 expref: 561 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.098916:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d200/0xd895711d66dabdf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1586:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbde7 expref: 560 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.098930:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1586:0x0].0x0 (ffff88012cc48000) 00010000:00010000:1.0:1715330314.098931:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715330314.098934:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093b9d200, rc 0) 00000100:00100000:1.0:1715330314.099021:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+561:18878:x1798653938096576:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 2156us (2392us total) trans 4294983930 rc 0/0 00000100:00100000:1.0:1715330314.099032:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23691 00000020:00080000:1.0:1715330314.099039:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1715330314.115720:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330314.115890:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938096704 00000100:00100000:1.0:1715330314.115901:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938096704 00000100:00100000:1.0:1715330314.116124:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5198 00000100:00100000:1.0:1715330314.116131:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+561:18878:x1798653938096704:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:1.0:1715330314.116365:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].281, 168 off57240 00000001:00080000:1.0:1715330314.116370:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983931 00000100:00100000:1.0:1715330314.116470:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+563:18878:x1798653938096704:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 338us (761us total) trans 4294983932 rc 0/0 00000100:00100000:1.0:1715330314.116476:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5198 00000020:00080000:1.0:1715330314.116482:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1715330314.120058:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330314.120156:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938096832 00000100:00100000:1.0:1715330314.120164:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938096832 00000100:00100000:1.0:1715330314.120197:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23692 00000100:00100000:1.0:1715330314.120203:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+563:18878:x1798653938096832:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:1.0:1715330314.120222:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330314.120237:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d440/0xd895711d66dabed lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbdee expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.120320:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d680/0xd895711d66dabf4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.120331:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d680/0xd895711d66dabf4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.120340:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d680/0xd895711d66dabf4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.120350:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d8c0/0xd895711d66dabfb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989cd9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.120354:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d8c0/0xd895711d66dabfb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.120359:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d8c0/0xd895711d66dabfb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:1.0:1715330314.120774:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9fc:0x0], index 0: 0 00000040:00080000:1.0:1715330314.120936:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].283, 184 off57528 00010000:00010000:1.0:1715330314.121003:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9db00/0xd895711d66dac02 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1587:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.121010:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9db00/0xd895711d66dac02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1587:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.121017:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9db00/0xd895711d66dac02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1587:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:1.0:1715330314.121076:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].284, 176 off57704 00000001:00080000:1.0:1715330314.121080:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983933 00010000:00010000:1.0:1715330314.121107:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d680/0xd895711d66dabf4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.121113:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d680/0xd895711d66dabf4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.121118:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d680/0xd895711d66dabf4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.121124:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d680/0xd895711d66dabf4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.121129:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093b9d680 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330314.121132:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d680/0xd895711d66dabf4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.121138:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d680/0xd895711d66dabf4 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.121149:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:1.0:1715330314.121151:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330314.121155:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d680/0xd895711d66dabf4 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.121159:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d680/0xd895711d66dabf4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:1.0:1715330314.121169:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009b4c1500 reply state ffff88012f53b000 transno 4294983934 ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d8c0/0xd895711d66dabfb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.121175:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d8c0/0xd895711d66dabfb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.121180:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989cd9 (ffff88012cc48500) 00010000:00010000:1.0:1715330314.121182:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330314.121184:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1715330314.121204:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d440/0xd895711d66dabed lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbdee expref: 567 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.121215:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9db00/0xd895711d66dac02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1587:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbdee expref: 566 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.121221:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1587:0x0].0x0 (ffff88012cc48400) 00010000:00010000:1.0:1715330314.121222:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715330314.121224:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093b9db00, rc 0) 00000100:00100000:1.0:1715330314.121286:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+567:18878:x1798653938096832:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 1082us (1234us total) trans 4294983934 rc 0/0 00000100:00100000:1.0:1715330314.121293:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23692 00000020:00080000:1.0:1715330314.121297:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1715330314.125682:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.125769:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938096960 00000100:00100000:3.0:1715330314.125778:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938096960 00000100:00100000:3.0:1715330314.125827:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5199 00000100:00100000:3.0:1715330314.125833:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+567:18878:x1798653938096960:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330314.126104:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].285, 168 off57872 00000001:00080000:3.0:1715330314.126110:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983935 00000100:00100000:3.0:1715330314.126198:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+569:18878:x1798653938096960:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 363us (523us total) trans 4294983936 rc 0/0 00000100:00100000:3.0:1715330314.126205:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5199 00000020:00080000:3.0:1715330314.126209:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1715330314.128626:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330314.128838:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938097088 00000100:00100000:1.0:1715330314.128850:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938097088 00000100:00100000:1.0:1715330314.128888:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23693 00000100:00100000:1.0:1715330314.128894:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+569:18878:x1798653938097088:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:1.0:1715330314.128911:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330314.128927:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9dd40/0xd895711d66dac10 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbdf5 expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.129015:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9df80/0xd895711d66dac17 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.129026:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9df80/0xd895711d66dac17 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.129034:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9df80/0xd895711d66dac17 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.129054:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e1c0/0xd895711d66dac1e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989dd9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.129059:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e1c0/0xd895711d66dac1e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.129065:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e1c0/0xd895711d66dac1e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:1.0:1715330314.129287:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9fc:0x0], index 1: 0 00000040:00080000:1.0:1715330314.129360:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].286, 184 off58056 00010000:00010000:1.0:1715330314.129410:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e400/0xd895711d66dac25 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1588:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.129416:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e400/0xd895711d66dac25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1588:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.129422:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e400/0xd895711d66dac25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1588:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:1.0:1715330314.129458:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].287, 176 off58232 00000001:00080000:1.0:1715330314.129461:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983937 00010000:00010000:1.0:1715330314.129484:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9df80/0xd895711d66dac17 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.129489:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9df80/0xd895711d66dac17 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.129494:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9df80/0xd895711d66dac17 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.129499:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9df80/0xd895711d66dac17 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.129504:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093b9df80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330314.129507:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9df80/0xd895711d66dac17 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.129512:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9df80/0xd895711d66dac17 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.129522:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:1.0:1715330314.129524:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330314.129527:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9df80/0xd895711d66dac17 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.129532:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9df80/0xd895711d66dac17 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:1.0:1715330314.129559:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009b4c1c00 reply state ffff88012f53c000 transno 4294983938 ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e1c0/0xd895711d66dac1e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.129566:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e1c0/0xd895711d66dac1e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.129571:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989dd9 (ffff88012cc48f00) 00010000:00010000:1.0:1715330314.129572:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330314.129575:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1715330314.129593:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9dd40/0xd895711d66dac10 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbdf5 expref: 573 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.129603:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e400/0xd895711d66dac25 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1588:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbdf5 expref: 572 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.129609:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1588:0x0].0x0 (ffff88009ef2cd00) 00010000:00010000:1.0:1715330314.129611:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715330314.129613:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093b9e400, rc 0) 00000100:00100000:1.0:1715330314.129664:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+573:18878:x1798653938097088:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 769us (1042us total) trans 4294983938 rc 0/0 00000100:00100000:1.0:1715330314.129670:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23693 00000020:00080000:1.0:1715330314.129675:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1715330314.133546:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.133631:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938097216 00000100:00100000:3.0:1715330314.133639:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938097216 00000100:00100000:3.0:1715330314.133683:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5200 00000100:00100000:3.0:1715330314.133690:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007acb3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+573:18878:x1798653938097216:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330314.133993:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].288, 168 off58400 00000001:00080000:3.0:1715330314.133998:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983939 00000100:00100000:3.0:1715330314.134262:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007acb3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+575:18878:x1798653938097216:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 571us (724us total) trans 4294983940 rc 0/0 00000100:00100000:3.0:1715330314.134269:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5200 00000020:00080000:3.0:1715330314.134273:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330314.137562:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330314.137642:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938097344 00000100:00100000:1.0:1715330314.137655:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938097344 00000100:00100000:1.0:1715330314.137718:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23694 00000100:00100000:1.0:1715330314.138251:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+575:18878:x1798653938097344:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:1.0:1715330314.138271:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330314.138288:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e640/0xd895711d66dac33 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbdfc expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.138372:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e880/0xd895711d66dac3a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.138382:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e880/0xd895711d66dac3a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.138391:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e880/0xd895711d66dac3a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.138401:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9eac0/0xd895711d66dac41 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989ed9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.138406:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9eac0/0xd895711d66dac41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.138411:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9eac0/0xd895711d66dac41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:1.0:1715330314.138639:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9fd:0x0], index 0: 0 00000040:00080000:1.0:1715330314.138713:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].289, 184 off58584 00010000:00010000:1.0:1715330314.139925:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9ed00/0xd895711d66dac48 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1589:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.139935:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9ed00/0xd895711d66dac48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1589:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.139942:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9ed00/0xd895711d66dac48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1589:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:1.0:1715330314.139994:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].290, 176 off58760 00000001:00080000:1.0:1715330314.139999:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983941 00010000:00010000:1.0:1715330314.140028:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e880/0xd895711d66dac3a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.140033:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e880/0xd895711d66dac3a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.140051:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e880/0xd895711d66dac3a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.140056:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e880/0xd895711d66dac3a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.140061:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093b9e880 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330314.140065:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e880/0xd895711d66dac3a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.140070:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e880/0xd895711d66dac3a lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.140078:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:1.0:1715330314.140080:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330314.140084:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e880/0xd895711d66dac3a lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.140088:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e880/0xd895711d66dac3a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:1.0:1715330314.140113:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093a8d500 reply state ffff88012f53e000 transno 4294983942 ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9eac0/0xd895711d66dac41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.140121:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9eac0/0xd895711d66dac41 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.140125:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ed9 (ffff88009ef2cc00) 00010000:00010000:1.0:1715330314.140127:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330314.140129:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1715330314.140150:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e640/0xd895711d66dac33 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbdfc expref: 579 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.140164:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9ed00/0xd895711d66dac48 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1589:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbdfc expref: 578 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.140168:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1589:0x0].0x0 (ffff88009ef2c300) 00010000:00010000:1.0:1715330314.140170:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715330314.140172:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093b9ed00, rc 0) 00000100:00100000:1.0:1715330314.140232:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+579:18878:x1798653938097344:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 1984us (2676us total) trans 4294983942 rc 0/0 00000100:00100000:1.0:1715330314.140239:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23694 00000020:00080000:1.0:1715330314.140245:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1715330314.148548:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.148667:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938097472 00000100:00100000:3.0:1715330314.148676:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938097472 00000100:00100000:3.0:1715330314.148722:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5201 00000100:00100000:3.0:1715330314.148746:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+579:18878:x1798653938097472:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330314.148946:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].291, 168 off58928 00000001:00080000:3.0:1715330314.148950:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983943 00000100:00100000:3.0:1715330314.149348:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+581:18878:x1798653938097472:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 618us (806us total) trans 4294983944 rc 0/0 00000100:00100000:3.0:1715330314.149354:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5201 00000020:00080000:3.0:1715330314.149358:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1715330314.160445:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330314.160624:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938097600 00000100:00100000:1.0:1715330314.160632:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938097600 00000100:00100000:1.0:1715330314.160669:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23695 00000100:00100000:1.0:1715330314.160676:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+581:18878:x1798653938097600:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:1.0:1715330314.160697:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330314.160714:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9ef40/0xd895711d66dac56 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbe03 expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.160826:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f180/0xd895711d66dac5d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.160836:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f180/0xd895711d66dac5d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.160845:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f180/0xd895711d66dac5d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.160856:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f3c0/0xd895711d66dac64 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989fd9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.160862:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f3c0/0xd895711d66dac64 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.160867:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f3c0/0xd895711d66dac64 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:1.0:1715330314.161156:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9fd:0x0], index 1: 0 00000040:00080000:1.0:1715330314.161228:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].292, 184 off59112 00010000:00010000:1.0:1715330314.161660:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f600/0xd895711d66dac6b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x158a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.161667:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f600/0xd895711d66dac6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.161673:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f600/0xd895711d66dac6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:1.0:1715330314.161818:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].293, 176 off59288 00000001:00080000:1.0:1715330314.161823:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983945 00010000:00010000:1.0:1715330314.161850:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f180/0xd895711d66dac5d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.161856:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f180/0xd895711d66dac5d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.161861:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f180/0xd895711d66dac5d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.161866:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f180/0xd895711d66dac5d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.161871:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093b9f180 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330314.161875:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f180/0xd895711d66dac5d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.161881:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f180/0xd895711d66dac5d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.161891:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:1.0:1715330314.161893:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330314.161897:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f180/0xd895711d66dac5d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.161902:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f180/0xd895711d66dac5d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:1.0:1715330314.161928:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009b4c0e00 reply state ffff88012f53d000 transno 4294983946 ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f3c0/0xd895711d66dac64 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.161935:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f3c0/0xd895711d66dac64 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.161940:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989fd9 (ffff88009ef2c900) 00010000:00010000:1.0:1715330314.161942:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330314.161944:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1715330314.161962:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9ef40/0xd895711d66dac56 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe03 expref: 585 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.161972:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f600/0xd895711d66dac6b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x158a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe03 expref: 584 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.161979:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158a:0x0].0x0 (ffff88009ef2c800) 00010000:00010000:1.0:1715330314.161980:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715330314.161982:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093b9f600, rc 0) 00000100:00100000:1.0:1715330314.163079:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+585:18878:x1798653938097600:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 2399us (2638us total) trans 4294983946 rc 0/0 00000100:00100000:1.0:1715330314.163091:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23695 00000020:00080000:1.0:1715330314.163344:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330314.168845:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.168945:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938097728 00000100:00100000:3.0:1715330314.168953:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938097728 00000100:00100000:3.0:1715330314.169001:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5202 00000100:00100000:3.0:1715330314.169008:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+585:18878:x1798653938097728:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330314.169222:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].294, 168 off59456 00000001:00080000:3.0:1715330314.169227:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983947 00000100:00100000:3.0:1715330314.169308:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+587:18878:x1798653938097728:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 299us (469us total) trans 4294983948 rc 0/0 00000100:00100000:3.0:1715330314.169314:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5202 00000020:00080000:3.0:1715330314.169319:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1715330314.176910:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330314.179105:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938097856 00000100:00100000:1.0:1715330314.179117:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938097856 00000100:00100000:1.0:1715330314.179166:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23696 00000100:00100000:1.0:1715330314.179172:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+587:18878:x1798653938097856:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:1.0:1715330314.179194:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330314.179209:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f840/0xd895711d66dac79 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbe0a expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.179300:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9fa80/0xd895711d66dac80 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.179311:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9fa80/0xd895711d66dac80 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.179319:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9fa80/0xd895711d66dac80 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.179330:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9fcc0/0xd895711d66dac87 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a0d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.179334:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9fcc0/0xd895711d66dac87 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.179338:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9fcc0/0xd895711d66dac87 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:1.0:1715330314.179563:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9fe:0x0], index 0: 0 00000040:00080000:1.0:1715330314.179633:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].295, 184 off59640 00010000:00010000:1.0:1715330314.179684:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9ef40/0xd895711d66dac8e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x158b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.179691:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9ef40/0xd895711d66dac8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.179697:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9ef40/0xd895711d66dac8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:1.0:1715330314.179754:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].296, 176 off59816 00000001:00080000:1.0:1715330314.179758:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983949 00010000:00010000:1.0:1715330314.179782:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9fa80/0xd895711d66dac80 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.179787:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9fa80/0xd895711d66dac80 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.179792:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9fa80/0xd895711d66dac80 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.179796:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9fa80/0xd895711d66dac80 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.179801:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093b9fa80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330314.179803:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9fa80/0xd895711d66dac80 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.179808:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9fa80/0xd895711d66dac80 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.179817:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:1.0:1715330314.179819:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330314.179822:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9fa80/0xd895711d66dac80 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.179827:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9fa80/0xd895711d66dac80 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:1.0:1715330314.179842:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009b4c3480 reply state ffff88012f53a000 transno 4294983950 ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9fcc0/0xd895711d66dac87 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.179848:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9fcc0/0xd895711d66dac87 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330314.179853:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a0d9 (ffff88009ef2cb00) 00010000:00010000:1.0:1715330314.179855:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330314.179857:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1715330314.179874:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f840/0xd895711d66dac79 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe0a expref: 591 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.179884:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9ef40/0xd895711d66dac8e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x158b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe0a expref: 590 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.179889:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158b:0x0].0x0 (ffff880091c70400) 00010000:00010000:1.0:1715330314.179890:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715330314.179892:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093b9ef40, rc 0) 00000100:00100000:1.0:1715330314.179932:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+591:18878:x1798653938097856:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 760us (3030us total) trans 4294983950 rc 0/0 00000100:00100000:1.0:1715330314.179938:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23696 00000020:00080000:1.0:1715330314.179942:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1715330314.185996:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330314.186107:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938097984 00000100:00100000:1.0:1715330314.186116:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938097984 00000100:00100000:1.0:1715330314.186151:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5203 00000100:00100000:1.0:1715330314.186158:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+591:18878:x1798653938097984:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:1.0:1715330314.186362:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].297, 168 off59984 00000001:00080000:1.0:1715330314.186368:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983951 00000100:00100000:1.0:1715330314.187075:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+593:18878:x1798653938097984:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 916us (1086us total) trans 4294983952 rc 0/0 00000100:00100000:1.0:1715330314.187083:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5203 00000020:00080000:1.0:1715330314.187088:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1715330314.196104:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330314.196177:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938098112 00000100:00100000:0.0:1715330314.196185:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938098112 00000100:00100000:0.0:1715330314.196233:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23697 00000100:00100000:0.0:1715330314.196239:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+593:18878:x1798653938098112:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:0.0:1715330314.196260:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330314.196276:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1f80/0xd895711d66dac9c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbe11 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330314.196358:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66daca3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.196369:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66daca3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.196377:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66daca3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.196387:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2640/0xd895711d66dacaa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.196391:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2640/0xd895711d66dacaa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.196399:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2640/0xd895711d66dacaa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00080000:0.0:1715330314.196626:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9fe:0x0], index 1: 0 00000040:00080000:0.0:1715330314.196692:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].298, 184 off60168 00010000:00010000:0.0:1715330314.196768:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0b40/0xd895711d66dacb1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x158c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.196775:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0b40/0xd895711d66dacb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.196780:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0b40/0xd895711d66dacb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:0.0:1715330314.196820:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].299, 176 off60344 00000001:00080000:0.0:1715330314.196824:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983953 00010000:00010000:0.0:1715330314.196847:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66daca3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.196852:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66daca3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.196856:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66daca3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.196861:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66daca3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.196866:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a1200 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330314.196868:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66daca3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.196873:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66daca3 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.196882:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:0.0:1715330314.196885:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330314.196889:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66daca3 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.196893:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66daca3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:0.0:1715330314.196919:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012fa87b80 reply state ffff880093824000 transno 4294983954 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2640/0xd895711d66dacaa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.196926:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2640/0xd895711d66dacaa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.196930:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a1d9 (ffff88012ca48700) 00010000:00010000:0.0:1715330314.196932:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330314.196934:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1715330314.196950:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1f80/0xd895711d66dac9c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe11 expref: 597 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330314.196966:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0b40/0xd895711d66dacb1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x158c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe11 expref: 596 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330314.196971:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158c:0x0].0x0 (ffff88012ca48800) 00010000:00010000:0.0:1715330314.196973:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715330314.196974:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d7a0b40, rc 0) 00000100:00100000:0.0:1715330314.198211:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+597:18878:x1798653938098112:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 1968us (2111us total) trans 4294983954 rc 0/0 00000100:00100000:0.0:1715330314.198220:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23697 00000020:00080000:0.0:1715330314.198225:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330314.203885:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330314.203988:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938098240 00000100:00100000:1.0:1715330314.203997:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938098240 00000100:00100000:1.0:1715330314.204129:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5204 00000100:00100000:1.0:1715330314.204137:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+597:18878:x1798653938098240:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:1.0:1715330314.204341:0:15159:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].300, 168 off60512 00000001:00080000:1.0:1715330314.204347:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983955 00000100:00100000:1.0:1715330314.204435:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+599:18878:x1798653938098240:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 298us (556us total) trans 4294983956 rc 0/0 00000100:00100000:1.0:1715330314.204442:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5204 00000020:00080000:1.0:1715330314.204446:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1715330314.212542:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330314.212618:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938098368 00000100:00100000:1.0:1715330314.212626:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938098368 00000100:00100000:1.0:1715330314.212794:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23698 00000100:00100000:1.0:1715330314.212801:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+599:18878:x1798653938098368:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:1.0:1715330314.212820:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330314.212836:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f180/0xd895711d66dacbf lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbe18 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.212916:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e640/0xd895711d66dacc6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.212926:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e640/0xd895711d66dacc6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.212934:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e640/0xd895711d66dacc6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.212948:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e880/0xd895711d66daccd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a2d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.212953:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e880/0xd895711d66daccd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.212958:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e880/0xd895711d66daccd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00080000:1.0:1715330314.213176:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9ff:0x0], index 0: 0 00000040:00080000:1.0:1715330314.213242:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].301, 184 off60696 00010000:00010000:1.0:1715330314.213291:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9dd40/0xd895711d66dacd4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x158d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.213298:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9dd40/0xd895711d66dacd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.213303:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9dd40/0xd895711d66dacd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:1.0:1715330314.213343:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].302, 176 off60872 00000001:00080000:1.0:1715330314.213347:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983957 00010000:00010000:1.0:1715330314.213369:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e640/0xd895711d66dacc6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.213375:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e640/0xd895711d66dacc6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.213379:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e640/0xd895711d66dacc6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.213384:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e640/0xd895711d66dacc6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.213392:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093b9e640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330314.213395:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e640/0xd895711d66dacc6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.213401:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e640/0xd895711d66dacc6 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.213409:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:1.0:1715330314.213412:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330314.213415:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e640/0xd895711d66dacc6 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.213419:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e640/0xd895711d66dacc6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:1.0:1715330314.213993:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009b4c0700 reply state ffff88012f53f000 transno 4294983958 ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e880/0xd895711d66daccd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.214003:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e880/0xd895711d66daccd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.214008:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a2d9 (ffff880091c70c00) 00010000:00010000:1.0:1715330314.214011:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330314.214013:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1715330314.214033:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f180/0xd895711d66dacbf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe18 expref: 603 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.214057:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9dd40/0xd895711d66dacd4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x158d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe18 expref: 602 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.214063:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158d:0x0].0x0 (ffff880091c70900) 00010000:00010000:1.0:1715330314.214065:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715330314.214067:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093b9dd40, rc 0) 00000100:00100000:1.0:1715330314.214125:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+603:18878:x1798653938098368:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 1323us (1589us total) trans 4294983958 rc 0/0 00000100:00100000:1.0:1715330314.214132:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23698 00000020:00080000:1.0:1715330314.214136:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1715330314.219413:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330314.221772:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.221970:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938098496 00000100:00100000:3.0:1715330314.221978:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938098496 00000100:00100000:3.0:1715330314.222022:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5205 00000100:00100000:3.0:1715330314.222028:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+603:18878:x1798653938098496:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330314.222241:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].303, 168 off61040 00000001:00080000:3.0:1715330314.222247:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983959 00000100:00100000:3.0:1715330314.222331:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+605:18878:x1798653938098496:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 302us (563us total) trans 4294983960 rc 0/0 00000100:00100000:3.0:1715330314.222338:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5205 00000020:00080000:3.0:1715330314.222343:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330314.226616:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330314.226709:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938098624 00000100:00100000:1.0:1715330314.226718:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938098624 00000100:00100000:1.0:1715330314.227135:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23699 00000100:00100000:1.0:1715330314.227142:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+605:18878:x1798653938098624:12345-192.168.204.49@tcp:101:createmany.0 00010000:00010000:1.0:1715330314.227164:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330314.227183:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9df80/0xd895711d66dace2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbe1f expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.227274:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d440/0xd895711d66dace9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.227285:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d440/0xd895711d66dace9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.227294:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d440/0xd895711d66dace9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.227304:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d680/0xd895711d66dacf0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a3d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.227309:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d680/0xd895711d66dacf0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.227315:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d680/0xd895711d66dacf0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00080000:1.0:1715330314.227541:0:11283:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9ff:0x0], index 1: 0 00000040:00080000:1.0:1715330314.227598:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].304, 184 off61224 00010000:00010000:1.0:1715330314.227638:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cb40/0xd895711d66dacf7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x158e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.227643:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cb40/0xd895711d66dacf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.227647:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cb40/0xd895711d66dacf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:1.0:1715330314.227675:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].305, 176 off61400 00000001:00080000:1.0:1715330314.227677:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983961 00010000:00010000:1.0:1715330314.227693:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d440/0xd895711d66dace9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.227698:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d440/0xd895711d66dace9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.227703:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d440/0xd895711d66dace9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.227707:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d440/0xd895711d66dace9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.227712:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093b9d440 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330314.227716:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d440/0xd895711d66dace9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.227721:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d440/0xd895711d66dace9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.227747:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:1.0:1715330314.227750:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330314.227754:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d440/0xd895711d66dace9 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.227759:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d440/0xd895711d66dace9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:1.0:1715330314.227787:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093a8c700 reply state ffff88012f538000 transno 4294983962 ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d680/0xd895711d66dacf0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.227795:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d680/0xd895711d66dacf0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.227800:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a3d9 (ffff880091c70000) 00010000:00010000:1.0:1715330314.227802:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330314.227804:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1715330314.227823:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9df80/0xd895711d66dace2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe1f expref: 609 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.227834:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cb40/0xd895711d66dacf7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x158e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe1f expref: 608 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.227839:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158e:0x0].0x0 (ffff880091c70f00) 00010000:00010000:1.0:1715330314.227841:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715330314.227843:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093b9cb40, rc 0) 00000100:00100000:1.0:1715330314.227896:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+609:18878:x1798653938098624:12345-192.168.204.49@tcp:101:createmany.0 Request processed in 753us (1286us total) trans 4294983962 rc 0/0 00000100:00100000:1.0:1715330314.227902:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23699 00000020:00080000:1.0:1715330314.227906:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1715330314.230963:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.231024:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938098752 00000100:00100000:3.0:1715330314.231033:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938098752 00000100:00100000:3.0:1715330314.231083:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5206 00000100:00100000:3.0:1715330314.231090:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007acb2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+609:18878:x1798653938098752:12345-192.168.204.49@tcp:35:createmany.0 00000040:00080000:3.0:1715330314.231356:0:7137:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].306, 168 off61568 00000001:00080000:3.0:1715330314.231362:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294983963 00000100:00100000:3.0:1715330314.231440:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007acb2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+611:18878:x1798653938098752:12345-192.168.204.49@tcp:35:createmany.0 Request processed in 349us (483us total) trans 4294983964 rc 0/0 00000100:00100000:3.0:1715330314.231450:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5206 00000020:00080000:3.0:1715330314.231454:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330314.240513:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330314.240571:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938098880 00000100:00100000:1.0:1715330314.240580:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938098880 00000100:00100000:1.0:1715330314.240621:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23700 00000100:00100000:1.0:1715330314.240626:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+611:18881:x1798653938098880:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:1.0:1715330314.240668:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330314.240685:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e1c0/0xd895711d66d9f6e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x152b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb6a expref: 611 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.240706:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152b:0x0].0x0 (ffff880093b42e00) 00010000:00010000:1.0:1715330314.240715:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330314.240759:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cd80/0xd895711d66dad05 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.240769:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cd80/0xd895711d66dad05 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.240775:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cd80/0xd895711d66dad05 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.240783:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c240/0xd895711d66dad0c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca986ad0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.240789:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c240/0xd895711d66dad0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.240793:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c240/0xd895711d66dad0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.240839:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c480/0xd895711d66dad13 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x152b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.240844:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c480/0xd895711d66dad13 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x152b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.240849:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c480/0xd895711d66dad13 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x152b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:1.0:1715330314.241935:0:11283:0:(llog_osd.c:233:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1715330314.241961:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1715330314.242103:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000004:00080000:1.0:1715330314.242109:0:11283:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 288718376976ns, next at 289718375824ns, rc = 0 00000040:00080000:1.0:1715330314.242134:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].307, 184 off61752 00010000:00010000:1.0:1715330314.242173:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9df80/0xd895711d66dad1a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.242181:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9df80/0xd895711d66dad1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.242187:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9df80/0xd895711d66dad1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.242193:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9df80/0xd895711d66dad1a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x152b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.242198:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9df80/0xd895711d66dad1a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x152b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.242203:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9df80/0xd895711d66dad1a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x152b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.242208:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9df80/0xd895711d66dad1a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x152b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.242212:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093b9df80 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:1.0:1715330314.242215:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9df80/0xd895711d66dad1a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x152b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.242221:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9df80/0xd895711d66dad1a lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x152b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.242231:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152b:0x0].0x0 (ffff880091c70800) 00010000:00010000:1.0:1715330314.242234:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1715330314.242237:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9df80/0xd895711d66dad1a lrc: 3/0,0 mode: --/PW res: [0x200000402:0x152b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.242242:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9df80/0xd895711d66dad1a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x152b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.242265:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c480/0xd895711d66dad13 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x152b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.242270:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c480/0xd895711d66dad13 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x152b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.242274:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c480/0xd895711d66dad13 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x152b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.242279:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093b9c480 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330314.242282:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c480/0xd895711d66dad13 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x152b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.242286:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c480/0xd895711d66dad13 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x152b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.242293:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152b:0x0].0x0 (ffff880091c70800) 00010000:00010000:1.0:1715330314.242294:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330314.242296:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c480/0xd895711d66dad13 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x152b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.242301:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c480/0xd895711d66dad13 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x152b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.242367:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cd80/0xd895711d66dad05 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.242373:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cd80/0xd895711d66dad05 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.242378:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cd80/0xd895711d66dad05 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.242383:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cd80/0xd895711d66dad05 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.242387:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093b9cd80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330314.242390:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cd80/0xd895711d66dad05 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.242394:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cd80/0xd895711d66dad05 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.242401:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:1.0:1715330314.242403:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330314.242405:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cd80/0xd895711d66dad05 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.242410:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cd80/0xd895711d66dad05 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:1.0:1715330314.242418:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093a8e680 reply state ffff88012f539000 transno 4294983965 ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c240/0xd895711d66dad0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.242426:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c240/0xd895711d66dad0c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.242431:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca986ad0 (ffff880093b42700) 00010000:00010000:1.0:1715330314.242433:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330314.242436:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1715330314.242509:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+612:18881:x1798653938098880:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 1880us (1999us total) trans 4294983965 rc 0/0 00000100:00100000:1.0:1715330314.242517:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23700 00000100:00100000:0.0:1715330314.246516:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330314.246927:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938099008 00000100:00100000:1.0:1715330314.246935:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938099008 00000100:00100000:1.0:1715330314.246975:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23701 00000100:00100000:1.0:1715330314.247032:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+612:18881:x1798653938099008:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:1.0:1715330314.247097:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330314.247121:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e640/0xd895711d66d9f91 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x152c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb71 expref: 612 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.247136:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152c:0x0].0x0 (ffff880093b42300) 00010000:00010000:1.0:1715330314.247144:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330314.247165:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d440/0xd895711d66dad21 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.247174:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d440/0xd895711d66dad21 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.247181:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d440/0xd895711d66dad21 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.247187:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f180/0xd895711d66dad28 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca986ad1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.247192:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f180/0xd895711d66dad28 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.247197:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f180/0xd895711d66dad28 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.247242:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e640/0xd895711d66dad2f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x152c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.247247:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e640/0xd895711d66dad2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x152c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.247253:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e640/0xd895711d66dad2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x152c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:1.0:1715330314.247412:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2503, 64 off168384 00000004:00080000:1.0:1715330314.247417:0:11283:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 288723684981ns, next at 289723683563ns, rc = 0 00000040:00080000:1.0:1715330314.247432:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].308, 184 off61936 00010000:00010000:1.0:1715330314.247454:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f840/0xd895711d66dad36 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.247459:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f840/0xd895711d66dad36 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.247463:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f840/0xd895711d66dad36 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.247467:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f840/0xd895711d66dad36 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x152c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.247470:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f840/0xd895711d66dad36 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x152c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.247473:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f840/0xd895711d66dad36 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x152c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.247476:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f840/0xd895711d66dad36 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x152c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.247479:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093b9f840 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:1.0:1715330314.247482:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f840/0xd895711d66dad36 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x152c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.247486:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f840/0xd895711d66dad36 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x152c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.247491:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152c:0x0].0x0 (ffff880091c70e00) 00010000:00010000:1.0:1715330314.247492:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1715330314.247494:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f840/0xd895711d66dad36 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x152c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.247496:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f840/0xd895711d66dad36 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x152c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.247511:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e640/0xd895711d66dad2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x152c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.247513:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e640/0xd895711d66dad2f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x152c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.247516:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e640/0xd895711d66dad2f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x152c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.247518:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093b9e640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330314.247520:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e640/0xd895711d66dad2f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x152c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.247523:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e640/0xd895711d66dad2f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x152c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.247526:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152c:0x0].0x0 (ffff880091c70e00) 00010000:00010000:1.0:1715330314.247527:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330314.247528:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e640/0xd895711d66dad2f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x152c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.247533:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e640/0xd895711d66dad2f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x152c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.247600:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d440/0xd895711d66dad21 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.247603:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d440/0xd895711d66dad21 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.247605:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d440/0xd895711d66dad21 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.247608:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d440/0xd895711d66dad21 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.247610:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093b9d440 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330314.247611:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d440/0xd895711d66dad21 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.247613:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d440/0xd895711d66dad21 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.247616:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:1.0:1715330314.247617:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330314.247618:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d440/0xd895711d66dad21 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.247621:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d440/0xd895711d66dad21 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:1.0:1715330314.247625:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093a8ce00 reply state ffff880077684000 transno 4294983966 ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f180/0xd895711d66dad28 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.247632:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f180/0xd895711d66dad28 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.247635:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca986ad1 (ffff880093b42200) 00010000:00010000:1.0:1715330314.247636:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330314.247637:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1715330314.247687:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+613:18881:x1798653938099008:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 657us (1178us total) trans 4294983966 rc 0/0 00000100:00100000:1.0:1715330314.247691:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23701 00000100:00100000:0.0:1715330314.250161:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330314.250412:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938099136 00000100:00100000:1.0:1715330314.250420:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938099136 00000100:00100000:1.0:1715330314.250461:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23702 00000100:00100000:1.0:1715330314.250466:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+613:18881:x1798653938099136:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:1.0:1715330314.250507:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330314.250525:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64000/0xd895711d66d9fb4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x152d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb78 expref: 613 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.250538:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152d:0x0].0x0 (ffff88009d618d00) 00010000:00010000:1.0:1715330314.250544:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330314.250562:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9fa80/0xd895711d66dad3d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.250571:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9fa80/0xd895711d66dad3d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.250577:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9fa80/0xd895711d66dad3d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.250585:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cd80/0xd895711d66dad44 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca986ad2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.250590:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cd80/0xd895711d66dad44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.250595:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cd80/0xd895711d66dad44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.250632:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c480/0xd895711d66dad4b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x152d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.250637:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c480/0xd895711d66dad4b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x152d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.250641:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c480/0xd895711d66dad4b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x152d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:1.0:1715330314.250834:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 64 off8320 00000040:00080000:1.0:1715330314.250859:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].309, 184 off62120 00010000:00010000:1.0:1715330314.250891:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9df80/0xd895711d66dad52 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.250897:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9df80/0xd895711d66dad52 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.250903:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9df80/0xd895711d66dad52 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.250908:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9df80/0xd895711d66dad52 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x152d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.250912:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9df80/0xd895711d66dad52 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x152d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.250916:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9df80/0xd895711d66dad52 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x152d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.250924:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9df80/0xd895711d66dad52 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x152d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.250930:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093b9df80 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:1.0:1715330314.250933:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9df80/0xd895711d66dad52 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x152d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.250939:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9df80/0xd895711d66dad52 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x152d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.250945:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152d:0x0].0x0 (ffff88009b985200) 00010000:00010000:1.0:1715330314.250947:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1715330314.250949:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9df80/0xd895711d66dad52 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x152d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.250953:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9df80/0xd895711d66dad52 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x152d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.250970:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c480/0xd895711d66dad4b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x152d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.250975:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c480/0xd895711d66dad4b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x152d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.250978:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c480/0xd895711d66dad4b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x152d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.250981:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093b9c480 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330314.250983:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c480/0xd895711d66dad4b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x152d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.250987:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c480/0xd895711d66dad4b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x152d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.250994:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152d:0x0].0x0 (ffff88009b985200) 00010000:00010000:1.0:1715330314.250996:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330314.250997:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c480/0xd895711d66dad4b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x152d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.251001:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c480/0xd895711d66dad4b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x152d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.251092:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9fa80/0xd895711d66dad3d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.251096:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9fa80/0xd895711d66dad3d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.251100:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9fa80/0xd895711d66dad3d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.251103:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9fa80/0xd895711d66dad3d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.251107:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093b9fa80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330314.251109:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9fa80/0xd895711d66dad3d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.251112:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9fa80/0xd895711d66dad3d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.251119:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:1.0:1715330314.251120:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330314.251122:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9fa80/0xd895711d66dad3d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.251126:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9fa80/0xd895711d66dad3d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:1.0:1715330314.251133:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012cc7aa00 reply state ffff880077687000 transno 4294983967 ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cd80/0xd895711d66dad44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.251139:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cd80/0xd895711d66dad44 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.251143:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca986ad2 (ffff88009d618900) 00010000:00010000:1.0:1715330314.251145:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330314.251147:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1715330314.251191:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+614:18881:x1798653938099136:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 724us (1036us total) trans 4294983967 rc 0/0 00000100:00100000:1.0:1715330314.251198:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23702 00000100:00100000:0.0:1715330314.255091:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330314.255228:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938099264 00000100:00100000:1.0:1715330314.255236:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938099264 00000100:00100000:1.0:1715330314.255286:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23703 00000100:00100000:1.0:1715330314.255293:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+614:18881:x1798653938099264:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:1.0:1715330314.255397:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330314.255421:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66ac0/0xd895711d66d9fd7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x152e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb7f expref: 614 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.255436:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152e:0x0].0x0 (ffff88009d618c00) 00010000:00010000:1.0:1715330314.255445:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330314.255468:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d440/0xd895711d66dad59 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.255477:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d440/0xd895711d66dad59 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.255484:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d440/0xd895711d66dad59 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.255493:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e640/0xd895711d66dad60 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca986ad3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.255498:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e640/0xd895711d66dad60 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.255503:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e640/0xd895711d66dad60 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.255551:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f840/0xd895711d66dad67 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x152e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.255556:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f840/0xd895711d66dad67 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x152e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.255562:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f840/0xd895711d66dad67 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x152e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:1.0:1715330314.256848:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2504, 64 off168448 00000040:00080000:1.0:1715330314.256881:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].310, 184 off62304 00010000:00010000:1.0:1715330314.256944:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c000/0xd895711d66dad6e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.256952:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c000/0xd895711d66dad6e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.256960:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c000/0xd895711d66dad6e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.256966:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c000/0xd895711d66dad6e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x152e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.256971:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c000/0xd895711d66dad6e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x152e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.256979:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c000/0xd895711d66dad6e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x152e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.256985:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c000/0xd895711d66dad6e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x152e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.256990:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5c000 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:1.0:1715330314.256994:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c000/0xd895711d66dad6e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x152e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.256999:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c000/0xd895711d66dad6e lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x152e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.257007:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152e:0x0].0x0 (ffff88009b985000) 00010000:00010000:1.0:1715330314.257009:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1715330314.257012:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c000/0xd895711d66dad6e lrc: 3/0,0 mode: --/PW res: [0x200000402:0x152e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.257018:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c000/0xd895711d66dad6e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x152e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.257052:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f840/0xd895711d66dad67 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x152e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.257057:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f840/0xd895711d66dad67 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x152e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.257062:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f840/0xd895711d66dad67 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x152e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.257065:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093b9f840 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330314.257068:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f840/0xd895711d66dad67 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x152e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.257076:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f840/0xd895711d66dad67 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x152e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.257081:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152e:0x0].0x0 (ffff88009b985000) 00010000:00010000:1.0:1715330314.257083:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330314.257085:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f840/0xd895711d66dad67 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x152e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.257090:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f840/0xd895711d66dad67 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x152e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.257183:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d440/0xd895711d66dad59 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.257189:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d440/0xd895711d66dad59 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.257193:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d440/0xd895711d66dad59 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.257198:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d440/0xd895711d66dad59 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.257202:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093b9d440 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330314.257204:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d440/0xd895711d66dad59 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.257209:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d440/0xd895711d66dad59 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.257215:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:1.0:1715330314.257217:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330314.257219:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d440/0xd895711d66dad59 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.257224:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d440/0xd895711d66dad59 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:1.0:1715330314.257231:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012cc7ad80 reply state ffff880077686000 transno 4294983968 ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e640/0xd895711d66dad60 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.257239:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e640/0xd895711d66dad60 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.257244:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca986ad3 (ffff88009d618100) 00010000:00010000:1.0:1715330314.257246:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330314.257248:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1715330314.257318:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+615:18881:x1798653938099264:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 2022us (2233us total) trans 4294983968 rc 0/0 00000100:00100000:1.0:1715330314.257325:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23703 00000100:00100000:0.0:1715330314.264855:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330314.265307:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938099392 00000100:00100000:1.0:1715330314.265316:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938099392 00000100:00100000:1.0:1715330314.265363:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23704 00000100:00100000:1.0:1715330314.265368:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+615:18881:x1798653938099392:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:1.0:1715330314.265418:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330314.265442:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65200/0xd895711d66d9ffa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x152f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb86 expref: 615 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.266247:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152f:0x0].0x0 (ffff88009d618f00) 00010000:00010000:1.0:1715330314.266258:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330314.266283:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c240/0xd895711d66dad75 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.266293:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c240/0xd895711d66dad75 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.266302:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c240/0xd895711d66dad75 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.266308:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c480/0xd895711d66dad7c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca986ad4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.266313:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c480/0xd895711d66dad7c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.266317:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c480/0xd895711d66dad7c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.266365:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c6c0/0xd895711d66dad83 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x152f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.266369:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c6c0/0xd895711d66dad83 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x152f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.266374:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c6c0/0xd895711d66dad83 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x152f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:1.0:1715330314.266551:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 64 off8384 00000040:00080000:1.0:1715330314.266577:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].311, 184 off62488 00010000:00010000:1.0:1715330314.266612:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c900/0xd895711d66dad8a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.266619:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c900/0xd895711d66dad8a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.266624:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c900/0xd895711d66dad8a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.266630:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c900/0xd895711d66dad8a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x152f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.266638:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c900/0xd895711d66dad8a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x152f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.266643:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c900/0xd895711d66dad8a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x152f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.266648:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c900/0xd895711d66dad8a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x152f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.266653:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5c900 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:1.0:1715330314.266656:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c900/0xd895711d66dad8a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x152f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.266662:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c900/0xd895711d66dad8a lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x152f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.266668:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152f:0x0].0x0 (ffff88009b985900) 00010000:00010000:1.0:1715330314.266671:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1715330314.266673:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c900/0xd895711d66dad8a lrc: 3/0,0 mode: --/PW res: [0x200000402:0x152f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.266677:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c900/0xd895711d66dad8a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x152f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.266696:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c6c0/0xd895711d66dad83 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x152f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.266701:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c6c0/0xd895711d66dad83 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x152f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.266706:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c6c0/0xd895711d66dad83 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x152f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.266709:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5c6c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330314.266712:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c6c0/0xd895711d66dad83 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x152f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.266716:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c6c0/0xd895711d66dad83 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x152f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.266721:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152f:0x0].0x0 (ffff88009b985900) 00010000:00010000:1.0:1715330314.266723:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330314.266725:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c6c0/0xd895711d66dad83 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x152f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.266750:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c6c0/0xd895711d66dad83 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x152f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.266840:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c240/0xd895711d66dad75 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.266845:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c240/0xd895711d66dad75 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.266848:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c240/0xd895711d66dad75 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.266852:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c240/0xd895711d66dad75 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.266855:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5c240 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330314.266858:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c240/0xd895711d66dad75 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.266862:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c240/0xd895711d66dad75 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.266867:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:1.0:1715330314.266869:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330314.266872:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c240/0xd895711d66dad75 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.266875:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c240/0xd895711d66dad75 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:1.0:1715330314.266882:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012cc78700 reply state ffff880077682000 transno 4294983969 ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c480/0xd895711d66dad7c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.266889:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c480/0xd895711d66dad7c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.266894:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca986ad4 (ffff88009d618e00) 00010000:00010000:1.0:1715330314.266896:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330314.266898:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1715330314.266975:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+616:18881:x1798653938099392:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 1605us (2126us total) trans 4294983969 rc 0/0 00000100:00100000:1.0:1715330314.266982:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23704 00000100:00100000:0.0:1715330314.272463:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330314.273429:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938099520 00000100:00100000:1.0:1715330314.273439:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938099520 00000100:00100000:1.0:1715330314.273719:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23705 00000100:00100000:1.0:1715330314.273727:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+616:18881:x1798653938099520:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:1.0:1715330314.273801:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330314.273826:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64fc0/0xd895711d66da01d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1530:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb8d expref: 616 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.273858:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1530:0x0].0x0 (ffff88009d618200) 00010000:00010000:1.0:1715330314.273867:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330314.273891:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cb40/0xd895711d66dad91 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.273905:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cb40/0xd895711d66dad91 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.273912:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cb40/0xd895711d66dad91 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.273920:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cd80/0xd895711d66dad98 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca986ad5 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.273925:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cd80/0xd895711d66dad98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.273930:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cd80/0xd895711d66dad98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.273981:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cfc0/0xd895711d66dad9f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1530:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.273991:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cfc0/0xd895711d66dad9f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1530:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.273996:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cfc0/0xd895711d66dad9f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1530:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:1.0:1715330314.274396:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2505, 64 off168512 00000040:00080000:1.0:1715330314.274419:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].312, 184 off62672 00010000:00010000:1.0:1715330314.274452:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d200/0xd895711d66dada6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1530:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.274458:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d200/0xd895711d66dada6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1530:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.274463:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d200/0xd895711d66dada6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1530:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.274472:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d200/0xd895711d66dada6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1530:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.274476:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d200/0xd895711d66dada6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1530:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.274480:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d200/0xd895711d66dada6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1530:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.274484:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d200/0xd895711d66dada6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1530:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.274489:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5d200 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:1.0:1715330314.274491:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d200/0xd895711d66dada6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1530:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.274496:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d200/0xd895711d66dada6 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1530:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.274501:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1530:0x0].0x0 (ffff88009b985100) 00010000:00010000:1.0:1715330314.274504:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1715330314.274506:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d200/0xd895711d66dada6 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1530:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.274510:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d200/0xd895711d66dada6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1530:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.274528:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cfc0/0xd895711d66dad9f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1530:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.274533:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cfc0/0xd895711d66dad9f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1530:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.274537:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cfc0/0xd895711d66dad9f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1530:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.274542:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5cfc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330314.274544:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cfc0/0xd895711d66dad9f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1530:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.274548:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cfc0/0xd895711d66dad9f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1530:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.274554:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1530:0x0].0x0 (ffff88009b985100) 00010000:00010000:1.0:1715330314.274556:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330314.274557:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cfc0/0xd895711d66dad9f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1530:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.274561:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cfc0/0xd895711d66dad9f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1530:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.274628:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cb40/0xd895711d66dad91 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.274631:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cb40/0xd895711d66dad91 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.274634:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cb40/0xd895711d66dad91 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.274637:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cb40/0xd895711d66dad91 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.274639:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5cb40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330314.274640:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cb40/0xd895711d66dad91 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.274642:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cb40/0xd895711d66dad91 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.274648:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:1.0:1715330314.274650:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330314.274651:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cb40/0xd895711d66dad91 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.274654:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cb40/0xd895711d66dad91 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:1.0:1715330314.274658:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012cc79500 reply state ffff880077685000 transno 4294983970 ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cd80/0xd895711d66dad98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.274663:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cd80/0xd895711d66dad98 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.274666:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca986ad5 (ffff88009d618700) 00010000:00010000:1.0:1715330314.274668:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330314.274669:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1715330314.274725:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+617:18881:x1798653938099520:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 1000us (2268us total) trans 4294983970 rc 0/0 00000100:00100000:1.0:1715330314.274749:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23705 00000100:00100000:0.0:1715330314.277936:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330314.278111:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938099648 00000100:00100000:1.0:1715330314.278119:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938099648 00000100:00100000:1.0:1715330314.278168:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23706 00000100:00100000:1.0:1715330314.278176:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+617:18881:x1798653938099648:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:1.0:1715330314.278228:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330314.278250:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66f40/0xd895711d66da040 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1531:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb94 expref: 617 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.278266:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1531:0x0].0x0 (ffff88009d618300) 00010000:00010000:1.0:1715330314.278274:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330314.278294:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d440/0xd895711d66dadad lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.278305:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d440/0xd895711d66dadad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.278312:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d440/0xd895711d66dadad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.278321:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d680/0xd895711d66dadb4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca986ad6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.278327:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d680/0xd895711d66dadb4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.278333:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d680/0xd895711d66dadb4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.278378:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d8c0/0xd895711d66dadbb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1531:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.278384:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d8c0/0xd895711d66dadbb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1531:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.278390:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d8c0/0xd895711d66dadbb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1531:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:1.0:1715330314.278565:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 64 off8448 00000040:00080000:1.0:1715330314.278589:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].313, 184 off62856 00010000:00010000:1.0:1715330314.278623:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5db00/0xd895711d66dadc2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1531:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.278630:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5db00/0xd895711d66dadc2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1531:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.278640:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5db00/0xd895711d66dadc2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1531:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.278646:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5db00/0xd895711d66dadc2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1531:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.278652:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5db00/0xd895711d66dadc2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1531:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.278656:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5db00/0xd895711d66dadc2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1531:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.278661:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5db00/0xd895711d66dadc2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1531:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.278667:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5db00 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:1.0:1715330314.278670:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5db00/0xd895711d66dadc2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1531:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.278676:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5db00/0xd895711d66dadc2 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1531:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.278683:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1531:0x0].0x0 (ffff88009b985a00) 00010000:00010000:1.0:1715330314.278685:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1715330314.278688:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5db00/0xd895711d66dadc2 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1531:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.278692:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5db00/0xd895711d66dadc2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1531:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.278711:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d8c0/0xd895711d66dadbb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1531:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.278715:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d8c0/0xd895711d66dadbb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1531:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.278720:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d8c0/0xd895711d66dadbb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1531:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.278723:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5d8c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330314.278726:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d8c0/0xd895711d66dadbb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1531:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.278766:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d8c0/0xd895711d66dadbb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1531:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.278773:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1531:0x0].0x0 (ffff88009b985a00) 00010000:00010000:1.0:1715330314.278774:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330314.278777:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d8c0/0xd895711d66dadbb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1531:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.278781:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d8c0/0xd895711d66dadbb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1531:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.278877:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d440/0xd895711d66dadad lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.278883:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d440/0xd895711d66dadad lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.278887:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d440/0xd895711d66dadad lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.278892:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d440/0xd895711d66dadad lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.278896:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5d440 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330314.278898:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d440/0xd895711d66dadad lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.278906:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d440/0xd895711d66dadad lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.278912:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:1.0:1715330314.278914:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330314.278916:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d440/0xd895711d66dadad lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.278920:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d440/0xd895711d66dadad lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:1.0:1715330314.278927:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012cc79c00 reply state ffff880077680000 transno 4294983971 ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d680/0xd895711d66dadb4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.278934:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d680/0xd895711d66dadb4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.278939:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca986ad6 (ffff88009d618000) 00010000:00010000:1.0:1715330314.278941:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330314.278944:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1715330314.278997:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+618:18881:x1798653938099648:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 821us (1069us total) trans 4294983971 rc 0/0 00000100:00100000:1.0:1715330314.279004:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23706 00000100:00100000:2.0:1715330314.285259:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330314.285336:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938099776 00000100:00100000:0.0:1715330314.285344:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938099776 00000100:00100000:0.0:1715330314.285392:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23707 00000100:00100000:0.0:1715330314.285399:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+618:18881:x1798653938099776:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1715330314.285445:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330314.285474:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c480/0xd895711d66da063 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1532:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb9b expref: 618 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330314.285493:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1532:0x0].0x0 (ffff880093b42000) 00010000:00010000:0.0:1715330314.285501:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715330314.285521:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1f80/0xd895711d66dadc9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.285532:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1f80/0xd895711d66dadc9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.285539:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1f80/0xd895711d66dadc9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.285547:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66dadd0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca986ad7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.285556:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66dadd0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.285560:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66dadd0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.285602:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3cc0/0xd895711d66dadd7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1532:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.285608:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3cc0/0xd895711d66dadd7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1532:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.285613:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3cc0/0xd895711d66dadd7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1532:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:0.0:1715330314.287029:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2506, 64 off168576 00000040:00080000:0.0:1715330314.287068:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].314, 184 off63040 00010000:00010000:0.0:1715330314.287116:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2400/0xd895711d66dadde lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1532:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.287127:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2400/0xd895711d66dadde lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1532:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.287136:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2400/0xd895711d66dadde lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1532:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.287148:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2400/0xd895711d66dadde lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1532:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.287153:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2400/0xd895711d66dadde lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1532:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.287158:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2400/0xd895711d66dadde lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1532:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.287166:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2400/0xd895711d66dadde lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1532:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.287171:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a2400 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330314.287175:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2400/0xd895711d66dadde lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1532:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.287181:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2400/0xd895711d66dadde lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1532:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.287191:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1532:0x0].0x0 (ffff8800aa391f00) 00010000:00010000:0.0:1715330314.287193:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1715330314.287197:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2400/0xd895711d66dadde lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1532:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.287201:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2400/0xd895711d66dadde lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1532:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.287230:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3cc0/0xd895711d66dadd7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1532:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.287234:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3cc0/0xd895711d66dadd7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1532:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.287239:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3cc0/0xd895711d66dadd7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1532:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.287242:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a3cc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330314.287245:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3cc0/0xd895711d66dadd7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1532:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.287249:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3cc0/0xd895711d66dadd7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1532:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.287258:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1532:0x0].0x0 (ffff8800aa391f00) 00010000:00010000:0.0:1715330314.287260:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715330314.287262:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3cc0/0xd895711d66dadd7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1532:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.287265:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3cc0/0xd895711d66dadd7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1532:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.287572:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1f80/0xd895711d66dadc9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.287577:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1f80/0xd895711d66dadc9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.287582:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1f80/0xd895711d66dadc9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.287586:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1f80/0xd895711d66dadc9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.287590:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a1f80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330314.287592:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1f80/0xd895711d66dadc9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.287597:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1f80/0xd895711d66dadc9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.287604:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:0.0:1715330314.287606:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330314.287608:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1f80/0xd895711d66dadc9 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.287613:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1f80/0xd895711d66dadc9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:0.0:1715330314.287621:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012fa84700 reply state ffff880093821000 transno 4294983972 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66dadd0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.287629:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66dadd0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.287633:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca986ad7 (ffff880093b42d00) 00010000:00010000:0.0:1715330314.287635:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330314.287638:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1715330314.288160:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+619:18881:x1798653938099776:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 2758us (2906us total) trans 4294983972 rc 0/0 00000100:00100000:0.0:1715330314.288168:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23707 00000100:00100000:0.0:1715330314.291131:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330314.291276:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938099904 00000100:00100000:2.0:1715330314.291285:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938099904 00000100:00100000:2.0:1715330314.291330:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23708 00000100:00100000:2.0:1715330314.291336:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+619:18881:x1798653938099904:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:2.0:1715330314.291383:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330314.291403:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48dd40/0xd895711d66da086 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1533:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbba2 expref: 619 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330314.291420:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1533:0x0].0x0 (ffff880093b42c00) 00010000:00010000:2.0:1715330314.291428:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330314.291449:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594d80/0xd895711d66dade5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.291458:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594d80/0xd895711d66dade5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.291465:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594d80/0xd895711d66dade5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.291472:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594fc0/0xd895711d66dadec lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca986ad8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.291476:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594fc0/0xd895711d66dadec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.291480:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594fc0/0xd895711d66dadec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.291527:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66dadf3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1533:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.291531:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66dadf3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1533:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.291536:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66dadf3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1533:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:2.0:1715330314.291713:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 64 off8512 00000040:00080000:2.0:1715330314.291760:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].315, 184 off63224 00010000:00010000:2.0:1715330314.291793:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66dadfa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1533:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.291798:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66dadfa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1533:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.291804:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66dadfa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1533:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.291809:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66dadfa lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1533:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.291813:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66dadfa lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1533:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.291817:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66dadfa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1533:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.291821:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66dadfa lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1533:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.291826:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d595440 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330314.291829:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66dadfa lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1533:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.291835:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66dadfa lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1533:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.291841:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1533:0x0].0x0 (ffff880093a11100) 00010000:00010000:2.0:1715330314.291843:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1715330314.291846:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66dadfa lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1533:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.291850:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66dadfa lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1533:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.291869:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66dadf3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1533:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.291874:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66dadf3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1533:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.291878:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66dadf3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1533:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.291882:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d595200 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.291885:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66dadf3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1533:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.291889:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66dadf3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1533:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.291894:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1533:0x0].0x0 (ffff880093a11100) 00010000:00010000:2.0:1715330314.291896:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330314.291897:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66dadf3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1533:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.291901:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66dadf3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1533:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.291983:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594d80/0xd895711d66dade5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.291988:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594d80/0xd895711d66dade5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.291992:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594d80/0xd895711d66dade5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.291996:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594d80/0xd895711d66dade5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.292000:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d594d80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.292003:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594d80/0xd895711d66dade5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.292007:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594d80/0xd895711d66dade5 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.292013:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330314.292015:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330314.292017:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594d80/0xd895711d66dade5 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.292021:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594d80/0xd895711d66dade5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:2.0:1715330314.292029:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012cc78000 reply state ffff880073bdd000 transno 4294983973 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594fc0/0xd895711d66dadec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.292035:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594fc0/0xd895711d66dadec lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.292052:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca986ad8 (ffff880093b42500) 00010000:00010000:2.0:1715330314.292053:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330314.292056:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1715330314.292113:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+620:18881:x1798653938099904:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 776us (989us total) trans 4294983973 rc 0/0 00000100:00100000:2.0:1715330314.292119:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23708 00000100:00100000:0.0:1715330314.296276:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330314.296354:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938100032 00000100:00100000:1.0:1715330314.296362:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938100032 00000100:00100000:1.0:1715330314.296408:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23709 00000100:00100000:1.0:1715330314.296414:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+620:18881:x1798653938100032:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:1.0:1715330314.296462:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330314.296482:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db646c0/0xd895711d66da0a9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1534:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbba9 expref: 620 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.296516:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1534:0x0].0x0 (ffff88009d618600) 00010000:00010000:1.0:1715330314.296524:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330314.296545:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5dd40/0xd895711d66dae01 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.296554:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5dd40/0xd895711d66dae01 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.296562:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5dd40/0xd895711d66dae01 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.296569:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5df80/0xd895711d66dae08 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca986ad9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.296574:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5df80/0xd895711d66dae08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.296578:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5df80/0xd895711d66dae08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.296624:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e1c0/0xd895711d66dae0f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1534:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.296630:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e1c0/0xd895711d66dae0f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1534:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.296635:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e1c0/0xd895711d66dae0f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1534:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:1.0:1715330314.296841:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2507, 64 off168640 00000040:00080000:1.0:1715330314.296865:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].316, 184 off63408 00010000:00010000:1.0:1715330314.296898:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e400/0xd895711d66dae16 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1534:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.296905:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e400/0xd895711d66dae16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1534:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.296911:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e400/0xd895711d66dae16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1534:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.296916:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e400/0xd895711d66dae16 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1534:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.296920:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e400/0xd895711d66dae16 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1534:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.296924:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e400/0xd895711d66dae16 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1534:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.296929:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e400/0xd895711d66dae16 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1534:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.296933:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5e400 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:1.0:1715330314.296936:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e400/0xd895711d66dae16 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1534:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.296941:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e400/0xd895711d66dae16 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1534:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.296946:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1534:0x0].0x0 (ffff88009b985800) 00010000:00010000:1.0:1715330314.296949:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1715330314.296952:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e400/0xd895711d66dae16 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1534:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.296956:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e400/0xd895711d66dae16 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1534:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.296972:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e1c0/0xd895711d66dae0f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1534:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.296978:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e1c0/0xd895711d66dae0f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1534:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.296982:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e1c0/0xd895711d66dae0f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1534:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.296985:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5e1c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330314.296988:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e1c0/0xd895711d66dae0f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1534:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.296992:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e1c0/0xd895711d66dae0f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1534:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.296997:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1534:0x0].0x0 (ffff88009b985800) 00010000:00010000:1.0:1715330314.296999:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330314.297000:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e1c0/0xd895711d66dae0f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1534:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.297004:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e1c0/0xd895711d66dae0f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1534:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.297095:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5dd40/0xd895711d66dae01 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.297100:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5dd40/0xd895711d66dae01 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.297104:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5dd40/0xd895711d66dae01 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.297108:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5dd40/0xd895711d66dae01 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.297111:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5dd40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330314.297114:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5dd40/0xd895711d66dae01 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.297118:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5dd40/0xd895711d66dae01 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.297124:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:1.0:1715330314.297126:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330314.297129:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5dd40/0xd895711d66dae01 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.297132:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5dd40/0xd895711d66dae01 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:1.0:1715330314.297139:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012cc7a300 reply state ffff880077683000 transno 4294983974 ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5df80/0xd895711d66dae08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca986ad9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.297145:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5df80/0xd895711d66dae08 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.297149:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca986ad9 (ffff88009d618a00) 00010000:00010000:1.0:1715330314.297151:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330314.297153:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1715330314.297206:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+621:18881:x1798653938100032:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 791us (938us total) trans 4294983974 rc 0/0 00000100:00100000:1.0:1715330314.297212:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23709 00000100:00100000:0.0:1715330314.300582:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330314.301487:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938100160 00000100:00100000:2.0:1715330314.301498:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938100160 00000100:00100000:2.0:1715330314.301545:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23710 00000100:00100000:2.0:1715330314.301551:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+621:18881:x1798653938100160:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:2.0:1715330314.301600:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330314.301622:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66400/0xd895711d66da0cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1535:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbbb0 expref: 621 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330314.301640:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1535:0x0].0x0 (ffff88009b9a4a00) 00010000:00010000:2.0:1715330314.301649:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330314.301670:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66dae1d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.301681:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66dae1d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.301688:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66dae1d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.301696:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5958c0/0xd895711d66dae24 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989ad1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.301701:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5958c0/0xd895711d66dae24 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.301706:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5958c0/0xd895711d66dae24 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.301772:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66dae2b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1535:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.301778:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66dae2b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1535:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.301786:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66dae2b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1535:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:2.0:1715330314.301968:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 64 off8576 00000040:00080000:2.0:1715330314.301993:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].317, 184 off63592 00010000:00010000:2.0:1715330314.302029:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66dae32 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1535:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.302035:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66dae32 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1535:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.302050:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66dae32 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1535:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.302056:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66dae32 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1535:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.302060:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66dae32 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1535:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.302065:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66dae32 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1535:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.302070:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66dae32 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1535:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.302074:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d595d40 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330314.302077:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66dae32 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1535:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.302082:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66dae32 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1535:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.302089:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1535:0x0].0x0 (ffff880093a11a00) 00010000:00010000:2.0:1715330314.302092:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1715330314.302095:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66dae32 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1535:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.302099:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66dae32 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1535:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.302119:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66dae2b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1535:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.302124:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66dae2b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1535:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.302129:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66dae2b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1535:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.302133:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d595b00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.302136:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66dae2b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1535:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.302140:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66dae2b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1535:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.302145:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1535:0x0].0x0 (ffff880093a11a00) 00010000:00010000:2.0:1715330314.302148:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330314.302150:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66dae2b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1535:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.302154:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66dae2b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1535:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.302232:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66dae1d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.302238:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66dae1d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.302242:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66dae1d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.302247:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66dae1d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.302251:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d595680 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.302253:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66dae1d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.302257:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66dae1d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.302262:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330314.302264:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330314.302266:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66dae1d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.302270:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66dae1d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:2.0:1715330314.302277:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012cc79880 reply state ffff880073bde000 transno 4294983975 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5958c0/0xd895711d66dae24 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.302284:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5958c0/0xd895711d66dae24 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.302288:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ad1 (ffff88009b9a4600) 00010000:00010000:2.0:1715330314.302289:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330314.302291:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1715330314.302363:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+622:18881:x1798653938100160:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 811us (1788us total) trans 4294983975 rc 0/0 00000100:00100000:2.0:1715330314.302371:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23710 00000100:00100000:2.0:1715330314.306809:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330314.306865:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938100288 00000100:00100000:0.0:1715330314.306873:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938100288 00000100:00100000:0.0:1715330314.306908:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23711 00000100:00100000:0.0:1715330314.306914:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+622:18881:x1798653938100288:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1715330314.306961:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330314.306982:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64b40/0xd895711d66da0ef lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1536:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbbb7 expref: 622 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330314.307171:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1536:0x0].0x0 (ffff88008b122200) 00010000:00010000:0.0:1715330314.307180:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715330314.307203:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a18c0/0xd895711d66dae39 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.307218:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a18c0/0xd895711d66dae39 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.307226:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a18c0/0xd895711d66dae39 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.307234:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a33c0/0xd895711d66dae40 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989bd1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.307239:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a33c0/0xd895711d66dae40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.307244:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a33c0/0xd895711d66dae40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.307291:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0480/0xd895711d66dae47 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1536:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.307297:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0480/0xd895711d66dae47 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1536:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.307302:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0480/0xd895711d66dae47 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1536:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:0.0:1715330314.307481:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2508, 64 off168704 00000040:00080000:0.0:1715330314.307507:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].318, 184 off63776 00010000:00010000:0.0:1715330314.307542:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66dae4e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1536:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.307549:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66dae4e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1536:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.307554:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66dae4e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1536:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.307563:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66dae4e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1536:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.307567:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66dae4e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1536:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.307571:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66dae4e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1536:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.307575:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66dae4e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1536:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.307580:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a2880 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330314.307582:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66dae4e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1536:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.307588:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66dae4e lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1536:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.307593:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1536:0x0].0x0 (ffff8800aa391e00) 00010000:00010000:0.0:1715330314.307596:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1715330314.307598:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66dae4e lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1536:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.307603:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2880/0xd895711d66dae4e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1536:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.307620:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0480/0xd895711d66dae47 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1536:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.307624:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0480/0xd895711d66dae47 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1536:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.307628:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0480/0xd895711d66dae47 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1536:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.307633:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a0480 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330314.307636:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0480/0xd895711d66dae47 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1536:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.307641:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0480/0xd895711d66dae47 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1536:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.307646:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1536:0x0].0x0 (ffff8800aa391e00) 00010000:00010000:0.0:1715330314.307647:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715330314.307649:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0480/0xd895711d66dae47 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1536:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.307653:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0480/0xd895711d66dae47 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1536:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.307959:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a18c0/0xd895711d66dae39 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.307964:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a18c0/0xd895711d66dae39 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.307969:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a18c0/0xd895711d66dae39 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.307973:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a18c0/0xd895711d66dae39 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.307976:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a18c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330314.307979:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a18c0/0xd895711d66dae39 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.307983:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a18c0/0xd895711d66dae39 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.307993:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:0.0:1715330314.307994:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330314.307997:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a18c0/0xd895711d66dae39 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.308001:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a18c0/0xd895711d66dae39 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:0.0:1715330314.308007:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012fa84e00 reply state ffff880091e52000 transno 4294983976 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a33c0/0xd895711d66dae40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.308014:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a33c0/0xd895711d66dae40 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.308019:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989bd1 (ffff88008b122a00) 00010000:00010000:0.0:1715330314.308021:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330314.308023:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1715330314.309327:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+623:18881:x1798653938100288:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 2405us (2517us total) trans 4294983976 rc 0/0 00000100:00100000:0.0:1715330314.309336:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23711 00000100:00100000:0.0:1715330314.315084:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330314.315185:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938100416 00000100:00100000:2.0:1715330314.315194:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938100416 00000100:00100000:2.0:1715330314.315240:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23712 00000100:00100000:2.0:1715330314.315247:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+623:18881:x1798653938100416:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:2.0:1715330314.315298:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330314.315320:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65440/0xd895711d66da112 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1537:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbbbe expref: 623 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330314.315352:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1537:0x0].0x0 (ffff88008b122500) 00010000:00010000:2.0:1715330314.315361:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330314.315383:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66dae55 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.315394:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66dae55 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.315402:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66dae55 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.315409:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5961c0/0xd895711d66dae5c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989cd1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.315414:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5961c0/0xd895711d66dae5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.315419:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5961c0/0xd895711d66dae5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.315469:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596400/0xd895711d66dae63 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1537:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.315475:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596400/0xd895711d66dae63 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1537:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.315480:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596400/0xd895711d66dae63 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1537:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:2.0:1715330314.315658:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].7, 64 off8640 00000040:00080000:2.0:1715330314.315681:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].319, 184 off63960 00010000:00010000:2.0:1715330314.315712:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596640/0xd895711d66dae6a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1537:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.315718:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596640/0xd895711d66dae6a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1537:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.315723:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596640/0xd895711d66dae6a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1537:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.315728:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596640/0xd895711d66dae6a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1537:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.315755:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596640/0xd895711d66dae6a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1537:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.315760:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596640/0xd895711d66dae6a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1537:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.315764:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596640/0xd895711d66dae6a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1537:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.315768:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d596640 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330314.315770:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596640/0xd895711d66dae6a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1537:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.315776:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596640/0xd895711d66dae6a lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1537:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.315782:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1537:0x0].0x0 (ffff880093a11a00) 00010000:00010000:2.0:1715330314.315784:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1715330314.315786:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596640/0xd895711d66dae6a lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1537:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.315790:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596640/0xd895711d66dae6a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1537:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.315808:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596400/0xd895711d66dae63 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1537:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.315812:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596400/0xd895711d66dae63 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1537:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.315817:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596400/0xd895711d66dae63 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1537:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.315820:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d596400 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.315823:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596400/0xd895711d66dae63 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1537:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.315826:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596400/0xd895711d66dae63 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1537:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.315831:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1537:0x0].0x0 (ffff880093a11a00) 00010000:00010000:2.0:1715330314.315832:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330314.315833:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596400/0xd895711d66dae63 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1537:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.315837:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596400/0xd895711d66dae63 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1537:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.315914:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66dae55 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.315918:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66dae55 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.315922:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66dae55 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.315926:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66dae55 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.315929:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d595f80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.315931:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66dae55 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.315935:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66dae55 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.315940:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330314.315941:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330314.315943:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66dae55 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.315946:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66dae55 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:2.0:1715330314.315953:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012cc7b100 reply state ffff880073bdf000 transno 4294983977 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5961c0/0xd895711d66dae5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.315959:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5961c0/0xd895711d66dae5c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.315965:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989cd1 (ffff88008b122c00) 00010000:00010000:2.0:1715330314.315967:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330314.315969:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1715330314.318502:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+624:18881:x1798653938100416:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 3243us (3413us total) trans 4294983977 rc 0/0 00000100:00100000:2.0:1715330314.318512:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23712 00000100:00100000:0.0:1715330314.324324:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330314.324451:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938100544 00000100:00100000:2.0:1715330314.324559:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938100544 00000100:00100000:2.0:1715330314.324605:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23713 00000100:00100000:2.0:1715330314.324611:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+624:18881:x1798653938100544:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:2.0:1715330314.324663:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330314.324685:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db661c0/0xd895711d66da135 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1538:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbbc5 expref: 624 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330314.324719:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1538:0x0].0x0 (ffff88008b122600) 00010000:00010000:2.0:1715330314.324728:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330314.324777:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66dae71 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.324787:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66dae71 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.324795:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66dae71 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.324803:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596400/0xd895711d66dae78 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989dd1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.324808:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596400/0xd895711d66dae78 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.324813:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596400/0xd895711d66dae78 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.324863:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596640/0xd895711d66dae7f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1538:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.324869:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596640/0xd895711d66dae7f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1538:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.324874:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596640/0xd895711d66dae7f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1538:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:2.0:1715330314.325082:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2509, 64 off168768 00000040:00080000:2.0:1715330314.325107:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].320, 184 off64144 00010000:00010000:2.0:1715330314.325139:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596880/0xd895711d66dae86 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1538:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.325145:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596880/0xd895711d66dae86 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1538:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.325151:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596880/0xd895711d66dae86 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1538:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.325157:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596880/0xd895711d66dae86 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1538:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.325161:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596880/0xd895711d66dae86 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1538:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.325166:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596880/0xd895711d66dae86 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1538:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.325170:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596880/0xd895711d66dae86 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1538:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.325178:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d596880 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330314.325181:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596880/0xd895711d66dae86 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1538:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.325186:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596880/0xd895711d66dae86 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1538:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.325192:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1538:0x0].0x0 (ffff880093a11a00) 00010000:00010000:2.0:1715330314.325194:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1715330314.325198:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596880/0xd895711d66dae86 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1538:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.325202:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596880/0xd895711d66dae86 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1538:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.325219:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596640/0xd895711d66dae7f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1538:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.325223:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596640/0xd895711d66dae7f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1538:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.325227:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596640/0xd895711d66dae7f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1538:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.325231:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d596640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.325234:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596640/0xd895711d66dae7f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1538:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.325239:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596640/0xd895711d66dae7f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1538:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.325244:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1538:0x0].0x0 (ffff880093a11a00) 00010000:00010000:2.0:1715330314.325246:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330314.325248:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596640/0xd895711d66dae7f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1538:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.325252:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596640/0xd895711d66dae7f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1538:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.325327:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66dae71 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.325331:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66dae71 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.325335:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66dae71 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.325340:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66dae71 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.325344:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d595f80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.325346:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66dae71 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.325351:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66dae71 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.325356:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330314.325357:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330314.325360:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66dae71 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.325363:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66dae71 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:2.0:1715330314.325371:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012cc7bb80 reply state ffff88009ae85000 transno 4294983978 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596400/0xd895711d66dae78 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.325382:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596400/0xd895711d66dae78 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.325387:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989dd1 (ffff88008b122e00) 00010000:00010000:2.0:1715330314.325389:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330314.325391:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1715330314.325461:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+625:18881:x1798653938100544:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 848us (1144us total) trans 4294983978 rc 0/0 00000100:00100000:2.0:1715330314.325467:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23713 00000100:00100000:0.0:1715330314.329062:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330314.329145:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938100672 00000100:00100000:2.0:1715330314.329155:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938100672 00000100:00100000:2.0:1715330314.329193:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23714 00000100:00100000:2.0:1715330314.329199:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+625:18881:x1798653938100672:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:2.0:1715330314.329247:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330314.329269:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c240/0xd895711d66da158 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1539:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbbcc expref: 625 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330314.329284:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1539:0x0].0x0 (ffff880093b42100) 00010000:00010000:2.0:1715330314.329293:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330314.329315:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66dae8d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.329325:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66dae8d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.329333:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66dae8d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.329342:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596d00/0xd895711d66dae94 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989ed1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.329349:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596d00/0xd895711d66dae94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.329354:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596d00/0xd895711d66dae94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.329407:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596f40/0xd895711d66dae9b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1539:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.329413:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596f40/0xd895711d66dae9b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1539:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.329418:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596f40/0xd895711d66dae9b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1539:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:2.0:1715330314.329597:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].8, 64 off8704 00000040:00080000:2.0:1715330314.329622:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].321, 184 off64328 00010000:00010000:2.0:1715330314.329654:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597180/0xd895711d66daea2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1539:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.329661:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597180/0xd895711d66daea2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1539:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.329667:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597180/0xd895711d66daea2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1539:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.329673:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597180/0xd895711d66daea2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1539:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.329678:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597180/0xd895711d66daea2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1539:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.329683:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597180/0xd895711d66daea2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1539:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.329691:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597180/0xd895711d66daea2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1539:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.329696:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d597180 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330314.329699:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597180/0xd895711d66daea2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1539:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.329704:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597180/0xd895711d66daea2 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1539:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.329710:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1539:0x0].0x0 (ffff880093a11800) 00010000:00010000:2.0:1715330314.329713:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1715330314.329715:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597180/0xd895711d66daea2 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1539:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.329720:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597180/0xd895711d66daea2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1539:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.329759:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596f40/0xd895711d66dae9b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1539:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.329764:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596f40/0xd895711d66dae9b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1539:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.329769:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596f40/0xd895711d66dae9b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1539:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.329773:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d596f40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.329776:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596f40/0xd895711d66dae9b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1539:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.329781:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596f40/0xd895711d66dae9b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1539:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.329790:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1539:0x0].0x0 (ffff880093a11800) 00010000:00010000:2.0:1715330314.329792:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330314.329794:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596f40/0xd895711d66dae9b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1539:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.329798:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596f40/0xd895711d66dae9b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1539:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.329880:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66dae8d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.329886:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66dae8d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.329889:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66dae8d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.329892:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66dae8d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.329896:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d596ac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.329898:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66dae8d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.329901:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66dae8d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.329906:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330314.329907:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330314.329909:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66dae8d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.329914:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66dae8d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:2.0:1715330314.329920:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012cc78e00 reply state ffff88009ae86000 transno 4294983979 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596d00/0xd895711d66dae94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.329926:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596d00/0xd895711d66dae94 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.329930:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ed1 (ffff88008b122700) 00010000:00010000:2.0:1715330314.329931:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330314.329934:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1715330314.331061:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+626:18881:x1798653938100672:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 1857us (2016us total) trans 4294983979 rc 0/0 00000100:00100000:2.0:1715330314.331069:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23714 00000100:00100000:0.0:1715330314.337687:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330314.337767:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938100800 00000100:00100000:2.0:1715330314.337775:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938100800 00000100:00100000:2.0:1715330314.338308:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23715 00000100:00100000:2.0:1715330314.338315:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cc79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+626:18881:x1798653938100800:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:2.0:1715330314.338363:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330314.338384:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d200/0xd895711d66da17b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x153a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbbd3 expref: 626 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330314.339189:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153a:0x0].0x0 (ffff880093b42a00) 00010000:00010000:2.0:1715330314.339200:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330314.339223:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5973c0/0xd895711d66daea9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.339233:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5973c0/0xd895711d66daea9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.339240:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5973c0/0xd895711d66daea9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.339247:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597600/0xd895711d66daeb0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989fd1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.339252:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597600/0xd895711d66daeb0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.339256:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597600/0xd895711d66daeb0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.340139:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66daeb7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x153a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.340146:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66daeb7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.340152:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66daeb7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:2.0:1715330314.340540:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2510, 64 off168832 00000040:00080000:2.0:1715330314.340568:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].322, 184 off64512 00010000:00010000:2.0:1715330314.340602:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597a80/0xd895711d66daebe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x153a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.340608:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597a80/0xd895711d66daebe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.340614:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597a80/0xd895711d66daebe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.340619:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597a80/0xd895711d66daebe lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x153a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.340623:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597a80/0xd895711d66daebe lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x153a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.340631:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597a80/0xd895711d66daebe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.340636:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597a80/0xd895711d66daebe lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x153a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.340640:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d597a80 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330314.340643:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597a80/0xd895711d66daebe lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x153a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.340649:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597a80/0xd895711d66daebe lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x153a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.340656:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153a:0x0].0x0 (ffff880093a11800) 00010000:00010000:2.0:1715330314.340658:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1715330314.340661:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597a80/0xd895711d66daebe lrc: 3/0,0 mode: --/PW res: [0x200000402:0x153a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.340666:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597a80/0xd895711d66daebe lrc: 0/0,0 mode: --/PW res: [0x200000402:0x153a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.340685:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66daeb7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.340690:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66daeb7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x153a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.340694:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66daeb7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x153a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.340697:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d597840 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.340700:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66daeb7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x153a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.340706:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66daeb7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x153a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.340711:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153a:0x0].0x0 (ffff880093a11800) 00010000:00010000:2.0:1715330314.340713:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330314.340714:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66daeb7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x153a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.340718:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66daeb7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x153a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.340810:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5973c0/0xd895711d66daea9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.340815:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5973c0/0xd895711d66daea9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.340819:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5973c0/0xd895711d66daea9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.340824:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5973c0/0xd895711d66daea9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.340827:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d5973c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.340829:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5973c0/0xd895711d66daea9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.340834:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5973c0/0xd895711d66daea9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.340840:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330314.340842:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330314.340844:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5973c0/0xd895711d66daea9 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.340848:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5973c0/0xd895711d66daea9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:2.0:1715330314.341096:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012cc79f80 reply state ffff88009ae87000 transno 4294983980 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597600/0xd895711d66daeb0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.341107:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597600/0xd895711d66daeb0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.341111:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989fd1 (ffff880093b42600) 00010000:00010000:2.0:1715330314.341113:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330314.341116:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1715330314.341192:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cc79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+627:18881:x1798653938100800:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 2875us (3508us total) trans 4294983980 rc 0/0 00000100:00100000:2.0:1715330314.341199:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23715 00000100:00100000:0.0:1715330314.350855:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330314.350995:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938100928 00000100:00100000:2.0:1715330314.351003:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938100928 00000100:00100000:2.0:1715330314.351052:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23716 00000100:00100000:2.0:1715330314.351059:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7ec1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+627:18881:x1798653938100928:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:2.0:1715330314.351106:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330314.351127:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48fa80/0xd895711d66da19e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x153b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbbda expref: 627 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330314.352378:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153b:0x0].0x0 (ffff880093b42900) 00010000:00010000:2.0:1715330314.352391:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330314.352417:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597cc0/0xd895711d66daec5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.352429:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597cc0/0xd895711d66daec5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.352437:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597cc0/0xd895711d66daec5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.352446:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5973c0/0xd895711d66daecc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a0d1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.352452:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5973c0/0xd895711d66daecc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.352457:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5973c0/0xd895711d66daecc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.352504:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66daed3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x153b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.352509:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66daed3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.352514:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66daed3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:2.0:1715330314.353256:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].9, 64 off8768 00000040:00080000:2.0:1715330314.353287:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].323, 184 off64696 00010000:00010000:2.0:1715330314.353329:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597a80/0xd895711d66daeda lrc: 3/0,1 mode: --/PW res: [0x200000402:0x153b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.353337:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597a80/0xd895711d66daeda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.353343:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597a80/0xd895711d66daeda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.353348:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597a80/0xd895711d66daeda lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x153b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.353356:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597a80/0xd895711d66daeda lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x153b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.353360:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597a80/0xd895711d66daeda lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.353364:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597a80/0xd895711d66daeda lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x153b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.353369:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d597a80 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330314.353372:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597a80/0xd895711d66daeda lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x153b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.353377:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597a80/0xd895711d66daeda lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x153b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.353385:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153b:0x0].0x0 (ffff880093a11e00) 00010000:00010000:2.0:1715330314.353388:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1715330314.353391:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597a80/0xd895711d66daeda lrc: 3/0,0 mode: --/PW res: [0x200000402:0x153b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.353395:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597a80/0xd895711d66daeda lrc: 0/0,0 mode: --/PW res: [0x200000402:0x153b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.353419:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66daed3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.353424:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66daed3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x153b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.353428:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66daed3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x153b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.353431:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d597840 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.353435:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66daed3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x153b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.353439:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66daed3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x153b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.353444:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153b:0x0].0x0 (ffff880093a11e00) 00010000:00010000:2.0:1715330314.353446:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330314.353448:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66daed3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x153b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.353452:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66daed3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x153b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.353531:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597cc0/0xd895711d66daec5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.353535:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597cc0/0xd895711d66daec5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.353539:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597cc0/0xd895711d66daec5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.353543:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597cc0/0xd895711d66daec5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.353547:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d597cc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.353549:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597cc0/0xd895711d66daec5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.353553:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597cc0/0xd895711d66daec5 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.353559:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330314.353561:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330314.353563:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597cc0/0xd895711d66daec5 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.353567:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597cc0/0xd895711d66daec5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:2.0:1715330314.353577:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800a7ec1500 reply state ffff88012b0a7000 transno 4294983981 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5973c0/0xd895711d66daecc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.353584:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5973c0/0xd895711d66daecc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.353588:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a0d1 (ffff880093b42800) 00010000:00010000:2.0:1715330314.353590:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330314.353594:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1715330314.353674:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7ec1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+628:18881:x1798653938100928:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 2612us (2823us total) trans 4294983981 rc 0/0 00000100:00100000:2.0:1715330314.353682:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23716 00000100:00100000:0.0:1715330314.359878:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330314.359937:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938101056 00000100:00100000:2.0:1715330314.359946:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938101056 00000100:00100000:2.0:1715330314.359994:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23717 00000100:00100000:2.0:1715330314.360000:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7ec0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+628:18881:x1798653938101056:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:2.0:1715330314.360081:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330314.360105:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48fcc0/0xd895711d66da1c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x153c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbbe1 expref: 628 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330314.360119:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153c:0x0].0x0 (ffff880093b42f00) 00010000:00010000:2.0:1715330314.360126:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330314.360148:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66daee1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.360162:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66daee1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.360168:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66daee1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.360176:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596f40/0xd895711d66daee8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a1d1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.360181:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596f40/0xd895711d66daee8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.360185:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596f40/0xd895711d66daee8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.360228:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597180/0xd895711d66daeef lrc: 3/0,1 mode: --/EX res: [0x200000402:0x153c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.360234:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597180/0xd895711d66daeef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.360239:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597180/0xd895711d66daeef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:2.0:1715330314.360811:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2511, 64 off168896 00000040:00080000:2.0:1715330314.360837:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].324, 184 off64880 00010000:00010000:2.0:1715330314.361219:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66daef6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x153c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.361227:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66daef6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.361233:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66daef6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.361241:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66daef6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x153c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.361246:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66daef6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x153c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.361250:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66daef6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.361255:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66daef6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x153c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.361260:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d595f80 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330314.361263:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66daef6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x153c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.361267:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66daef6 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x153c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.361274:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153c:0x0].0x0 (ffff880093a11c00) 00010000:00010000:2.0:1715330314.361277:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1715330314.361279:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66daef6 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x153c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.361283:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66daef6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x153c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.361304:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597180/0xd895711d66daeef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.361308:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597180/0xd895711d66daeef lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x153c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.361312:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597180/0xd895711d66daeef lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x153c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.361316:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d597180 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.361319:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597180/0xd895711d66daeef lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x153c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.361322:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597180/0xd895711d66daeef lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x153c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.361328:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153c:0x0].0x0 (ffff880093a11c00) 00010000:00010000:2.0:1715330314.361330:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330314.361332:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597180/0xd895711d66daeef lrc: 2/0,0 mode: --/EX res: [0x200000402:0x153c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.361335:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597180/0xd895711d66daeef lrc: 0/0,0 mode: --/EX res: [0x200000402:0x153c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.361427:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66daee1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.361432:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66daee1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.361436:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66daee1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.361440:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66daee1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.361444:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d596ac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.361446:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66daee1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.361450:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66daee1 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.361459:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330314.361460:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330314.361462:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66daee1 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.361466:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66daee1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:2.0:1715330314.361472:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800a7ec0e00 reply state ffff88012b0a2000 transno 4294983982 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596f40/0xd895711d66daee8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.361479:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596f40/0xd895711d66daee8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.361484:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a1d1 (ffff880093b42b00) 00010000:00010000:2.0:1715330314.361486:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330314.361488:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1715330314.361602:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7ec0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+629:18881:x1798653938101056:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 1600us (1729us total) trans 4294983982 rc 0/0 00000100:00100000:2.0:1715330314.361607:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23717 00000100:00100000:0.0:1715330314.365959:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330314.366048:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938101184 00000100:00100000:2.0:1715330314.366057:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938101184 00000100:00100000:2.0:1715330314.366397:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23718 00000100:00100000:2.0:1715330314.366404:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7ec2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+629:18881:x1798653938101184:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:2.0:1715330314.366449:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330314.366469:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f600/0xd895711d66da1e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x153d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbbe8 expref: 629 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330314.366484:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153d:0x0].0x0 (ffff88009ef25300) 00010000:00010000:2.0:1715330314.366492:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330314.366514:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596640/0xd895711d66daefd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.366523:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596640/0xd895711d66daefd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.366530:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596640/0xd895711d66daefd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.366538:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596880/0xd895711d66daf04 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a2d1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.366543:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596880/0xd895711d66daf04 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.366547:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596880/0xd895711d66daf04 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.366592:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66daf0b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x153d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.366598:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66daf0b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.366602:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66daf0b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:2.0:1715330314.366827:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].10, 64 off8832 00000040:00080000:2.0:1715330314.366852:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].325, 184 off65064 00010000:00010000:2.0:1715330314.366885:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66daf12 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x153d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.366891:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66daf12 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.366899:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66daf12 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.366904:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66daf12 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x153d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.366908:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66daf12 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x153d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.366912:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66daf12 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.366916:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66daf12 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x153d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.366920:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d595b00 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330314.366923:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66daf12 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x153d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.366927:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66daf12 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x153d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.366934:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153d:0x0].0x0 (ffff880093a11800) 00010000:00010000:2.0:1715330314.366936:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1715330314.366939:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66daf12 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x153d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.366942:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66daf12 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x153d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.366961:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66daf0b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.366965:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66daf0b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x153d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.366969:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66daf0b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x153d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.366973:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d595680 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.366975:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66daf0b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x153d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.366979:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66daf0b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x153d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.366984:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153d:0x0].0x0 (ffff880093a11800) 00010000:00010000:2.0:1715330314.366985:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330314.366987:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66daf0b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x153d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.366991:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66daf0b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x153d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.367088:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596640/0xd895711d66daefd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.367093:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596640/0xd895711d66daefd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.367097:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596640/0xd895711d66daefd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.367101:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596640/0xd895711d66daefd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.367106:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d596640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.367109:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596640/0xd895711d66daefd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.367116:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596640/0xd895711d66daefd lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.367122:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330314.367124:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330314.367126:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596640/0xd895711d66daefd lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.367130:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596640/0xd895711d66daefd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:2.0:1715330314.367138:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800a7ec2300 reply state ffff88012b0a6000 transno 4294983983 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596880/0xd895711d66daf04 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.367145:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596880/0xd895711d66daf04 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.367149:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a2d1 (ffff88009ef25900) 00010000:00010000:2.0:1715330314.367151:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330314.367153:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1715330314.369288:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7ec2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+630:18881:x1798653938101184:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 2867us (3319us total) trans 4294983983 rc 0/0 00000100:00100000:2.0:1715330314.369298:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23718 00000100:00100000:0.0:1715330314.376710:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330314.377124:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938101312 00000100:00100000:2.0:1715330314.377133:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938101312 00000100:00100000:2.0:1715330314.377171:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23719 00000100:00100000:2.0:1715330314.377177:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7ec2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+630:18881:x1798653938101312:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:2.0:1715330314.377605:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330314.377627:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1680/0xd895711d66da207 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x153e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbbef expref: 630 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330314.377659:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153e:0x0].0x0 (ffff88008b122900) 00010000:00010000:2.0:1715330314.377667:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330314.377688:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66daf19 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.377698:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66daf19 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.377705:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66daf19 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.377712:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594d80/0xd895711d66daf20 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a3d1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.377717:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594d80/0xd895711d66daf20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.377721:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594d80/0xd895711d66daf20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.377787:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66daf27 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x153e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.377792:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66daf27 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.377796:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66daf27 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:2.0:1715330314.377964:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2512, 64 off168960 00000040:00080000:2.0:1715330314.377988:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].326, 184 off65248 00010000:00010000:2.0:1715330314.378020:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66daf2e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x153e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.378027:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66daf2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.378033:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66daf2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.378046:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66daf2e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x153e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.378050:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66daf2e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x153e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.378055:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66daf2e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.378059:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66daf2e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x153e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.378063:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d595440 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330314.378066:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66daf2e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x153e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.378072:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66daf2e lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x153e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.378078:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153e:0x0].0x0 (ffff880093a11800) 00010000:00010000:2.0:1715330314.378081:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1715330314.378083:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66daf2e lrc: 3/0,0 mode: --/PW res: [0x200000402:0x153e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.378088:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66daf2e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x153e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.378108:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66daf27 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.378113:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66daf27 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x153e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.378117:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66daf27 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x153e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.378121:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d595200 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.378123:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66daf27 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x153e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.378127:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66daf27 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x153e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.378133:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153e:0x0].0x0 (ffff880093a11800) 00010000:00010000:2.0:1715330314.378134:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330314.378136:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66daf27 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x153e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.378140:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66daf27 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x153e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.378220:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66daf19 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.378226:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66daf19 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.378230:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66daf19 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.378235:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66daf19 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.378239:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d595d40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.378242:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66daf19 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.378246:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66daf19 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.378252:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330314.378255:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330314.378257:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66daf19 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.378262:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66daf19 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:2.0:1715330314.378268:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800a7ec2a00 reply state ffff88012b0a3000 transno 4294983984 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594d80/0xd895711d66daf20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.378275:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594d80/0xd895711d66daf20 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.378280:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a3d1 (ffff88008b122300) 00010000:00010000:2.0:1715330314.378281:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330314.378284:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1715330314.378338:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7ec2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+631:18881:x1798653938101312:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 1160us (1637us total) trans 4294983984 rc 0/0 00000100:00100000:2.0:1715330314.378345:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23719 00000100:00100000:0.0:1715330314.383543:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330314.383622:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938101440 00000100:00100000:2.0:1715330314.383630:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938101440 00000100:00100000:2.0:1715330314.383664:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23720 00000100:00100000:2.0:1715330314.383670:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7ec2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+631:18881:x1798653938101440:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:2.0:1715330314.383716:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330314.383764:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48ed00/0xd895711d66da22a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x153f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbbf6 expref: 631 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330314.383792:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153f:0x0].0x0 (ffff88009ef25200) 00010000:00010000:2.0:1715330314.383802:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330314.383824:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594480/0xd895711d66daf35 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.383835:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594480/0xd895711d66daf35 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.383842:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594480/0xd895711d66daf35 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.383849:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5946c0/0xd895711d66daf3c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989ad2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.383855:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5946c0/0xd895711d66daf3c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.383860:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5946c0/0xd895711d66daf3c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.384107:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66daf43 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x153f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.384114:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66daf43 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.384119:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66daf43 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:2.0:1715330314.384278:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].11, 64 off8896 00000040:00080000:2.0:1715330314.384299:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].327, 184 off65432 00010000:00010000:2.0:1715330314.384327:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66daf4a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x153f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.384332:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66daf4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.384337:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66daf4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.384342:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66daf4a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x153f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.384346:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66daf4a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x153f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.384350:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66daf4a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.384354:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66daf4a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x153f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.384358:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d595200 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330314.384360:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66daf4a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x153f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.384365:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66daf4a lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x153f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.384371:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153f:0x0].0x0 (ffff880093a11a00) 00010000:00010000:2.0:1715330314.384373:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1715330314.384374:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66daf4a lrc: 3/0,0 mode: --/PW res: [0x200000402:0x153f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.384378:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66daf4a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x153f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.384397:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66daf43 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.384401:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66daf43 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x153f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.384405:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66daf43 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x153f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.384408:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d595d40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.384410:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66daf43 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x153f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.384414:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66daf43 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x153f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.384418:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153f:0x0].0x0 (ffff880093a11a00) 00010000:00010000:2.0:1715330314.384419:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330314.384420:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66daf43 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x153f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.384424:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66daf43 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x153f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.384497:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594480/0xd895711d66daf35 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.384501:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594480/0xd895711d66daf35 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.384505:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594480/0xd895711d66daf35 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.384508:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594480/0xd895711d66daf35 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.384513:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d594480 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.384515:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594480/0xd895711d66daf35 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.384520:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594480/0xd895711d66daf35 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.384526:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330314.384528:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330314.384531:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594480/0xd895711d66daf35 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.384535:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594480/0xd895711d66daf35 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:2.0:1715330314.384542:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800a7ec2680 reply state ffff88012b0a0000 transno 4294983985 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5946c0/0xd895711d66daf3c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.384548:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5946c0/0xd895711d66daf3c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.385559:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ad2 (ffff88009ef25b00) 00010000:00010000:2.0:1715330314.385561:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330314.385565:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1715330314.385659:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7ec2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+632:18881:x1798653938101440:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 1986us (2122us total) trans 4294983985 rc 0/0 00000100:00100000:2.0:1715330314.385667:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23720 00000100:00100000:0.0:1715330314.390103:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330314.390571:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938101568 00000100:00100000:2.0:1715330314.390582:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938101568 00000100:00100000:2.0:1715330314.390623:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23721 00000100:00100000:2.0:1715330314.390630:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7ec3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+632:18881:x1798653938101568:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:2.0:1715330314.390683:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330314.390705:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1680/0xd895711d66da24d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1540:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbbfd expref: 632 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330314.390722:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1540:0x0].0x0 (ffff88012ca48000) 00010000:00010000:2.0:1715330314.390758:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330314.390784:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66daf51 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.390796:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66daf51 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.390803:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66daf51 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.390810:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596640/0xd895711d66daf58 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989bd2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.390816:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596640/0xd895711d66daf58 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.390820:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596640/0xd895711d66daf58 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.390867:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66daf5f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1540:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.390872:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66daf5f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1540:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.390877:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66daf5f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1540:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:2.0:1715330314.391093:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2513, 64 off169024 00000040:00080000:2.0:1715330314.391204:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].329, 184 off65720 00010000:00010000:2.0:1715330314.391240:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66daf66 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1540:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.391247:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66daf66 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1540:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.391253:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66daf66 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1540:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.391259:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66daf66 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1540:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.391264:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66daf66 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1540:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.391268:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66daf66 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1540:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.391272:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66daf66 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1540:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.391276:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d595b00 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330314.391279:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66daf66 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1540:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.391284:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66daf66 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1540:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.391290:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1540:0x0].0x0 (ffff880093a11100) 00010000:00010000:2.0:1715330314.391293:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1715330314.391295:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66daf66 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1540:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.391299:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66daf66 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1540:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.391320:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66daf5f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1540:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.391324:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66daf5f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1540:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.391328:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66daf5f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1540:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.391331:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d595680 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.391334:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66daf5f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1540:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.391338:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66daf5f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1540:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.391343:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1540:0x0].0x0 (ffff880093a11100) 00010000:00010000:2.0:1715330314.391344:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330314.391346:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66daf5f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1540:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.391350:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66daf5f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1540:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.391420:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66daf51 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.391424:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66daf51 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.391428:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66daf51 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.391432:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66daf51 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.391437:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d595440 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.391439:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66daf51 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.391443:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66daf51 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.391449:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330314.391451:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330314.391453:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66daf51 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.391457:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66daf51 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:2.0:1715330314.391463:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800a7ec3480 reply state ffff88012f4a0000 transno 4294983986 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596640/0xd895711d66daf58 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.391469:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596640/0xd895711d66daf58 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.391474:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989bd2 (ffff88012ca48100) 00010000:00010000:2.0:1715330314.391476:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330314.391478:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1715330314.393017:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7ec3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+633:18881:x1798653938101568:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 2380us (2916us total) trans 4294983986 rc 0/0 00000100:00100000:2.0:1715330314.393026:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23721 00000100:00100000:0.0:1715330314.399704:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.399981:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938101696 00000100:00100000:3.0:1715330314.399991:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938101696 00000100:00100000:3.0:1715330314.400026:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23722 00000100:00100000:3.0:1715330314.400034:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7ec0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+633:18881:x1798653938101696:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1715330314.400093:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330314.400115:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2ac0/0xd895711d66da270 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1541:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc04 expref: 633 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330314.400146:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff88012ca48200) 00010000:00010000:3.0:1715330314.400154:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330314.400177:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66daf6d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.400188:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66daf6d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.400196:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66daf6d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.400203:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5440/0xd895711d66daf74 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989cd2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.400208:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5440/0xd895711d66daf74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.400213:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5440/0xd895711d66daf74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.400269:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66daf7b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.400276:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66daf7b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1541:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.400281:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66daf7b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1541:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330314.400766:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].12, 64 off8960 00000040:00080000:3.0:1715330314.400792:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].330, 184 off65904 00010000:00010000:3.0:1715330314.400827:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4000/0xd895711d66daf82 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.400833:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4000/0xd895711d66daf82 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.400839:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4000/0xd895711d66daf82 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.400844:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4000/0xd895711d66daf82 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.400849:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4000/0xd895711d66daf82 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.400854:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4000/0xd895711d66daf82 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1541:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.400859:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4000/0xd895711d66daf82 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1541:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.400863:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b4000 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330314.400866:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4000/0xd895711d66daf82 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1541:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.400871:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4000/0xd895711d66daf82 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1541:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.400878:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff88009d5fa900) 00010000:00010000:3.0:1715330314.400880:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330314.400883:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4000/0xd895711d66daf82 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1541:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.400887:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4000/0xd895711d66daf82 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1541:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.400909:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66daf7b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1541:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.400913:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66daf7b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1541:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.400917:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66daf7b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1541:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.400921:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b6ac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.400923:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66daf7b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1541:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.400927:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66daf7b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1541:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.400933:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff88009d5fa900) 00010000:00010000:3.0:1715330314.400935:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330314.400937:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66daf7b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1541:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.400941:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66daf7b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1541:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.401024:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66daf6d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.401029:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66daf6d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.401033:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66daf6d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.401045:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66daf6d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.401049:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b6400 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.401051:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66daf6d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.401055:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66daf6d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.401060:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330314.401062:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330314.401064:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66daf6d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.401067:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66daf6d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330314.401076:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800a7ec0000 reply state ffff88009382c000 transno 4294983987 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5440/0xd895711d66daf74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.401082:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5440/0xd895711d66daf74 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.401086:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989cd2 (ffff88012ca48a00) 00010000:00010000:3.0:1715330314.401088:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330314.401090:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330314.401144:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7ec0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+634:18881:x1798653938101696:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 1110us (1447us total) trans 4294983987 rc 0/0 00000100:00100000:3.0:1715330314.401150:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23722 00000100:00100000:0.0:1715330314.407097:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.407225:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938101824 00000100:00100000:3.0:1715330314.407234:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938101824 00000100:00100000:3.0:1715330314.407429:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23723 00000100:00100000:3.0:1715330314.407487:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7ec2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+634:18881:x1798653938101824:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1715330314.407537:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330314.407558:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2880/0xd895711d66da293 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1542:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc0b expref: 634 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330314.408184:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1542:0x0].0x0 (ffff88008b122d00) 00010000:00010000:3.0:1715330314.408194:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330314.408217:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66daf89 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.408227:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66daf89 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.408234:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66daf89 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.408242:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5b00/0xd895711d66daf90 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989dd2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.408247:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5b00/0xd895711d66daf90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.408252:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5b00/0xd895711d66daf90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.408300:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6880/0xd895711d66daf97 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1542:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.408306:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6880/0xd895711d66daf97 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1542:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.408311:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6880/0xd895711d66daf97 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1542:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330314.408496:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2514, 64 off169088 00000040:00080000:3.0:1715330314.408525:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].331, 184 off66088 00010000:00010000:3.0:1715330314.408562:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5d40/0xd895711d66daf9e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1542:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.408569:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5d40/0xd895711d66daf9e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1542:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.408575:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5d40/0xd895711d66daf9e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1542:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.408581:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5d40/0xd895711d66daf9e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1542:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.408585:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5d40/0xd895711d66daf9e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1542:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.408589:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5d40/0xd895711d66daf9e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1542:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.408593:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5d40/0xd895711d66daf9e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1542:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.408597:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b5d40 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330314.408600:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5d40/0xd895711d66daf9e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1542:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.408607:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5d40/0xd895711d66daf9e lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1542:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.408613:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1542:0x0].0x0 (ffff88009d5fa100) 00010000:00010000:3.0:1715330314.408615:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330314.408617:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5d40/0xd895711d66daf9e lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1542:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.408622:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5d40/0xd895711d66daf9e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1542:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.408643:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6880/0xd895711d66daf97 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1542:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.408648:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6880/0xd895711d66daf97 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1542:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.409315:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6880/0xd895711d66daf97 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1542:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.409323:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b6880 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.409326:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6880/0xd895711d66daf97 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1542:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.409331:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6880/0xd895711d66daf97 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1542:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.409339:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1542:0x0].0x0 (ffff88009d5fa100) 00010000:00010000:3.0:1715330314.409340:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330314.409343:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6880/0xd895711d66daf97 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1542:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.409347:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6880/0xd895711d66daf97 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1542:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.409437:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66daf89 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.409441:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66daf89 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.409445:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66daf89 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.409449:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66daf89 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.409452:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b7180 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.409454:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66daf89 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.409458:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66daf89 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.409463:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330314.409464:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330314.409466:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66daf89 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.409469:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66daf89 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330314.409476:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800a7ec2d80 reply state ffff88009382f000 transno 4294983988 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5b00/0xd895711d66daf90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.409482:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5b00/0xd895711d66daf90 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.409487:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989dd2 (ffff88008b122400) 00010000:00010000:3.0:1715330314.409488:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330314.409491:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330314.409564:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7ec2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+635:18881:x1798653938101824:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 2076us (2474us total) trans 4294983988 rc 0/0 00000100:00100000:3.0:1715330314.409574:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23723 00000100:00100000:0.0:1715330314.413667:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.413771:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938101952 00000100:00100000:3.0:1715330314.413780:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938101952 00000100:00100000:3.0:1715330314.413826:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23724 00000100:00100000:3.0:1715330314.413834:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7ec0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+635:18881:x1798653938101952:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1715330314.413886:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330314.413906:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e400/0xd895711d66da2b6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1543:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc12 expref: 635 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330314.413920:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1543:0x0].0x0 (ffff88009ef25e00) 00010000:00010000:3.0:1715330314.413928:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330314.413949:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66dafa5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.413960:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66dafa5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.413966:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66dafa5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.413974:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7600/0xd895711d66dafac lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989ed2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.413979:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7600/0xd895711d66dafac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.413983:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7600/0xd895711d66dafac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.414033:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7a80/0xd895711d66dafb3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1543:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.414048:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7a80/0xd895711d66dafb3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1543:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.414053:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7a80/0xd895711d66dafb3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1543:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330314.416852:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].13, 64 off9024 00000040:00080000:3.0:1715330314.416896:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].332, 184 off66272 00010000:00010000:3.0:1715330314.416957:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4480/0xd895711d66dafba lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1543:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.416970:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4480/0xd895711d66dafba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1543:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.416981:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4480/0xd895711d66dafba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1543:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.416987:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4480/0xd895711d66dafba lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1543:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.416992:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4480/0xd895711d66dafba lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1543:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.416995:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4480/0xd895711d66dafba lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1543:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.416999:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4480/0xd895711d66dafba lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1543:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.417003:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b4480 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330314.417006:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4480/0xd895711d66dafba lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1543:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.417012:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4480/0xd895711d66dafba lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1543:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.417021:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1543:0x0].0x0 (ffff88009d5fab00) 00010000:00010000:3.0:1715330314.417023:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330314.417026:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4480/0xd895711d66dafba lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1543:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.417030:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4480/0xd895711d66dafba lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1543:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.417064:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7a80/0xd895711d66dafb3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1543:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.417069:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7a80/0xd895711d66dafb3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1543:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.417073:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7a80/0xd895711d66dafb3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1543:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.417076:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b7a80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.417079:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7a80/0xd895711d66dafb3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1543:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.417083:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7a80/0xd895711d66dafb3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1543:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.417088:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1543:0x0].0x0 (ffff88009d5fab00) 00010000:00010000:3.0:1715330314.417089:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330314.417091:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7a80/0xd895711d66dafb3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1543:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.417095:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7a80/0xd895711d66dafb3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1543:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.417199:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66dafa5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.417204:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66dafa5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.417208:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66dafa5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.417211:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66dafa5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.417214:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b5f80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.417216:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66dafa5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.417220:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66dafa5 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.417226:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330314.417227:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330314.417229:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66dafa5 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.417232:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66dafa5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330314.417239:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800a7ec0700 reply state ffff880093ac0000 transno 4294983989 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7600/0xd895711d66dafac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.417247:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7600/0xd895711d66dafac lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.417252:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ed2 (ffff88009ef25f00) 00010000:00010000:3.0:1715330314.417254:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330314.417257:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330314.417863:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7ec0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+636:18881:x1798653938101952:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 4026us (4203us total) trans 4294983989 rc 0/0 00000100:00100000:3.0:1715330314.417872:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23724 00000100:00100000:0.0:1715330314.421394:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.421648:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938102080 00000100:00100000:3.0:1715330314.421656:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938102080 00000100:00100000:3.0:1715330314.421702:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23725 00000100:00100000:3.0:1715330314.421709:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7ec1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+636:18881:x1798653938102080:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1715330314.421791:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330314.421813:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f2400/0xd895711d66da2d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1544:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc19 expref: 636 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330314.421827:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1544:0x0].0x0 (ffff88012bfb5a00) 00010000:00010000:3.0:1715330314.421837:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330314.421860:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5200/0xd895711d66dafc1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.421871:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5200/0xd895711d66dafc1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.421879:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5200/0xd895711d66dafc1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.421887:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6d00/0xd895711d66dafc8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989fd2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.421893:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6d00/0xd895711d66dafc8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.421898:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6d00/0xd895711d66dafc8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.421948:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66dafcf lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1544:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.421953:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66dafcf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1544:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.421958:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66dafcf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1544:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330314.422154:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2515, 64 off169152 00000040:00080000:3.0:1715330314.422177:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].333, 184 off66456 00010000:00010000:3.0:1715330314.422210:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4900/0xd895711d66dafd6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1544:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.422216:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4900/0xd895711d66dafd6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1544:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.422221:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4900/0xd895711d66dafd6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1544:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.422227:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4900/0xd895711d66dafd6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1544:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.422231:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4900/0xd895711d66dafd6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1544:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.422235:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4900/0xd895711d66dafd6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1544:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.422240:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4900/0xd895711d66dafd6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1544:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.422244:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b4900 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330314.422246:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4900/0xd895711d66dafd6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1544:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.422253:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4900/0xd895711d66dafd6 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1544:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.422259:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1544:0x0].0x0 (ffff88009d5fa000) 00010000:00010000:3.0:1715330314.422261:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330314.422264:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4900/0xd895711d66dafd6 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1544:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.422268:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4900/0xd895711d66dafd6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1544:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.422287:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66dafcf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1544:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.422291:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66dafcf lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1544:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.422295:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66dafcf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1544:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.422298:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b4240 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.422301:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66dafcf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1544:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.422304:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66dafcf lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1544:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.422309:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1544:0x0].0x0 (ffff88009d5fa000) 00010000:00010000:3.0:1715330314.422311:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330314.422313:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66dafcf lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1544:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.422316:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66dafcf lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1544:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.422393:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5200/0xd895711d66dafc1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.422398:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5200/0xd895711d66dafc1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.422402:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5200/0xd895711d66dafc1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.422406:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5200/0xd895711d66dafc1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.422409:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b5200 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.422412:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5200/0xd895711d66dafc1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.422415:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5200/0xd895711d66dafc1 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.422421:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330314.422422:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330314.422425:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5200/0xd895711d66dafc1 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.422429:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5200/0xd895711d66dafc1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330314.422437:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800a7ec1f80 reply state ffff880093ac1000 transno 4294983990 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6d00/0xd895711d66dafc8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.422443:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6d00/0xd895711d66dafc8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.422448:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989fd2 (ffff88012bfb5e00) 00010000:00010000:3.0:1715330314.422450:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330314.422452:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330314.422515:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7ec1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+637:18881:x1798653938102080:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 805us (1127us total) trans 4294983990 rc 0/0 00000100:00100000:3.0:1715330314.422521:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23725 00000100:00100000:2.0:1715330314.427695:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330314.427800:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938102208 00000100:00100000:0.0:1715330314.427811:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938102208 00000100:00100000:0.0:1715330314.427870:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23726 00000100:00100000:0.0:1715330314.427879:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+637:18881:x1798653938102208:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1715330314.427938:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330314.427965:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48e880/0xd895711d66da2fc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1545:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc20 expref: 637 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330314.427987:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1545:0x0].0x0 (ffff88009ef25400) 00010000:00010000:0.0:1715330314.427996:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715330314.428021:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66dafdd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.428033:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66dafdd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.428053:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66dafdd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.428061:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3600/0xd895711d66dafe4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a0d2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.428067:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3600/0xd895711d66dafe4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.428072:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3600/0xd895711d66dafe4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.428123:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3a80/0xd895711d66dafeb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1545:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.428129:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3a80/0xd895711d66dafeb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1545:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.428134:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3a80/0xd895711d66dafeb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1545:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:0.0:1715330314.428369:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].14, 64 off9088 00000040:00080000:0.0:1715330314.428402:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].334, 184 off66640 00010000:00010000:0.0:1715330314.428439:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66daff2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1545:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.428446:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66daff2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1545:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.428452:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66daff2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1545:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.428457:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66daff2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1545:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.428462:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66daff2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1545:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.428467:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66daff2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1545:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.428471:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66daff2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1545:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.428476:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a2f40 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330314.428480:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66daff2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1545:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.428486:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66daff2 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1545:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.428492:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1545:0x0].0x0 (ffff8800aa391b00) 00010000:00010000:0.0:1715330314.428494:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1715330314.428496:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66daff2 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1545:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.428500:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66daff2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1545:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.428519:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3a80/0xd895711d66dafeb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1545:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.428524:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3a80/0xd895711d66dafeb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1545:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.428529:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3a80/0xd895711d66dafeb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1545:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.428532:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a3a80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330314.428534:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3a80/0xd895711d66dafeb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1545:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.428538:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3a80/0xd895711d66dafeb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1545:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.428543:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1545:0x0].0x0 (ffff8800aa391b00) 00010000:00010000:0.0:1715330314.428544:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715330314.428546:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3a80/0xd895711d66dafeb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1545:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.428550:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3a80/0xd895711d66dafeb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1545:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.428634:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66dafdd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.428639:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66dafdd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.428643:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66dafdd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.428648:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66dafdd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.428652:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a0900 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330314.428654:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66dafdd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.428658:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66dafdd lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.428664:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:0.0:1715330314.428666:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330314.428668:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66dafdd lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.428672:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66dafdd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:0.0:1715330314.428680:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012fa86300 reply state ffff880091e54000 transno 4294983991 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3600/0xd895711d66dafe4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.428687:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3600/0xd895711d66dafe4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.428696:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a0d2 (ffff88009ef25a00) 00010000:00010000:0.0:1715330314.428698:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330314.428701:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1715330314.428794:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+638:18881:x1798653938102208:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 915us (1110us total) trans 4294983991 rc 0/0 00000100:00100000:0.0:1715330314.428801:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23726 00000100:00100000:1.0:1715330314.434010:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330314.434722:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938102336 00000100:00100000:2.0:1715330314.434801:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938102336 00000100:00100000:2.0:1715330314.434843:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23727 00000100:00100000:2.0:1715330314.434850:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+638:18881:x1798653938102336:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:2.0:1715330314.434896:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330314.435071:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c900/0xd895711d66da31f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1546:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc27 expref: 638 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330314.435098:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff88009ef25500) 00010000:00010000:2.0:1715330314.435109:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330314.435132:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66daff9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.435142:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66daff9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.435149:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66daff9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.435157:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597180/0xd895711d66db000 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a1d2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.435162:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597180/0xd895711d66db000 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.435167:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597180/0xd895711d66db000 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.435214:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66db007 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.435219:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66db007 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1546:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.435225:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66db007 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1546:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:2.0:1715330314.435403:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2516, 64 off169216 00000040:00080000:2.0:1715330314.435428:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].335, 184 off66824 00010000:00010000:2.0:1715330314.435463:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597cc0/0xd895711d66db00e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.435469:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597cc0/0xd895711d66db00e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.435474:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597cc0/0xd895711d66db00e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.435479:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597cc0/0xd895711d66db00e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.435484:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597cc0/0xd895711d66db00e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.435489:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597cc0/0xd895711d66db00e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1546:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.435493:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597cc0/0xd895711d66db00e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1546:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.435498:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d597cc0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330314.435501:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597cc0/0xd895711d66db00e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1546:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.435507:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597cc0/0xd895711d66db00e lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1546:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.435513:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff880093a11800) 00010000:00010000:2.0:1715330314.435515:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1715330314.435517:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597cc0/0xd895711d66db00e lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1546:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.435522:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597cc0/0xd895711d66db00e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1546:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.435543:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66db007 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1546:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.435547:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66db007 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1546:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.435551:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66db007 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1546:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.435555:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d595f80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.435558:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66db007 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1546:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.435562:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66db007 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1546:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.435567:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff880093a11800) 00010000:00010000:2.0:1715330314.435569:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330314.435571:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66db007 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1546:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.435575:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66db007 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1546:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.435655:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66daff9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.435659:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66daff9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.435663:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66daff9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.435668:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66daff9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.435671:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d596ac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.435673:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66daff9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.435676:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66daff9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.435681:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330314.435683:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330314.435685:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66daff9 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.435688:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66daff9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:2.0:1715330314.435694:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007d628a80 reply state ffff88012f4a1000 transno 4294983992 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597180/0xd895711d66db000 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.435700:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597180/0xd895711d66db000 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.435704:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a1d2 (ffff88009ef25d00) 00010000:00010000:2.0:1715330314.435706:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330314.435708:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1715330314.435786:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+639:18881:x1798653938102336:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 935us (1783us total) trans 4294983992 rc 0/0 00000100:00100000:2.0:1715330314.435791:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23727 00000100:00100000:0.0:1715330314.440838:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330314.441011:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938102464 00000100:00100000:2.0:1715330314.441023:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938102464 00000100:00100000:2.0:1715330314.441080:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23728 00000100:00100000:2.0:1715330314.441089:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+639:18881:x1798653938102464:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:2.0:1715330314.441154:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330314.441184:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b6ac0/0xd895711d66da342 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1547:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc2e expref: 639 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330314.441205:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1547:0x0].0x0 (ffff88009ef25100) 00010000:00010000:2.0:1715330314.441216:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330314.441241:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66db015 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.441253:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66db015 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.441262:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66db015 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.441271:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597a80/0xd895711d66db01c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a2d2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.441277:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597a80/0xd895711d66db01c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.441282:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597a80/0xd895711d66db01c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.441338:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66db023 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1547:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.441344:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66db023 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1547:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.441352:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66db023 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1547:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:2.0:1715330314.441561:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].15, 64 off9152 00000040:00080000:2.0:1715330314.441588:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].336, 184 off67008 00010000:00010000:2.0:1715330314.441624:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66db02a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1547:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.441630:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66db02a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1547:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.441636:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66db02a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1547:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.441641:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66db02a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1547:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.441646:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66db02a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1547:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.441651:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66db02a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1547:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.441656:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66db02a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1547:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.441662:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d595680 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330314.441665:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66db02a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1547:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.441670:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66db02a lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1547:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.441676:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1547:0x0].0x0 (ffff880093a11c00) 00010000:00010000:2.0:1715330314.441679:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1715330314.441682:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66db02a lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1547:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.441685:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66db02a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1547:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.441703:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66db023 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1547:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.441707:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66db023 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1547:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.441711:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66db023 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1547:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.441715:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d595440 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.441718:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66db023 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1547:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.441722:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66db023 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1547:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.441728:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1547:0x0].0x0 (ffff880093a11c00) 00010000:00010000:2.0:1715330314.444359:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330314.444369:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66db023 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1547:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.444376:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66db023 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1547:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.444517:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66db015 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.444523:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66db015 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.444529:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66db015 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.444534:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66db015 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.444539:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d597840 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.444542:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66db015 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.444548:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66db015 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.444558:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330314.444560:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330314.444562:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66db015 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.444566:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66db015 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:2.0:1715330314.444574:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880091e98700 reply state ffff88012f4a2000 transno 4294983993 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597a80/0xd895711d66db01c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.444583:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597a80/0xd895711d66db01c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.444589:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a2d2 (ffff88009ef25600) 00010000:00010000:2.0:1715330314.444590:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330314.444593:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1715330314.444691:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+640:18881:x1798653938102464:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 3598us (3862us total) trans 4294983993 rc 0/0 00000100:00100000:2.0:1715330314.444702:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23728 00000100:00100000:0.0:1715330314.450640:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330314.451022:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938102592 00000100:00100000:2.0:1715330314.451031:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938102592 00000100:00100000:2.0:1715330314.451113:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23729 00000100:00100000:2.0:1715330314.451120:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+640:18881:x1798653938102592:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:2.0:1715330314.451162:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330314.451183:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b4d80/0xd895711d66da365 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1548:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc35 expref: 640 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330314.451197:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1548:0x0].0x0 (ffff88009bbf0e00) 00010000:00010000:2.0:1715330314.451205:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330314.451226:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66db031 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.451236:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66db031 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.451243:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66db031 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.451249:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594480/0xd895711d66db038 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a3d2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.451254:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594480/0xd895711d66db038 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.451258:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594480/0xd895711d66db038 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.451301:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66db03f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1548:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.451307:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66db03f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1548:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.451311:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66db03f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1548:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:2.0:1715330314.451475:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2517, 64 off169280 00000040:00080000:2.0:1715330314.451500:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].337, 184 off67192 00010000:00010000:2.0:1715330314.451531:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66db046 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1548:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.451537:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66db046 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1548:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.451542:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66db046 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1548:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.451547:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66db046 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1548:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.451552:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66db046 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1548:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.451557:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66db046 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1548:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.451561:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66db046 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1548:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.451565:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d595200 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330314.451568:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66db046 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1548:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.451574:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66db046 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1548:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.451580:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1548:0x0].0x0 (ffff880093a11a00) 00010000:00010000:2.0:1715330314.451582:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1715330314.451585:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66db046 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1548:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.451589:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66db046 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1548:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.451607:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66db03f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1548:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.451611:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66db03f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1548:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.451615:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66db03f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1548:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.451619:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d595d40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.451621:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66db03f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1548:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.451625:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66db03f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1548:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.451631:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1548:0x0].0x0 (ffff880093a11a00) 00010000:00010000:2.0:1715330314.451633:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330314.451634:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66db03f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1548:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.451639:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66db03f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1548:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.451708:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66db031 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.451714:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66db031 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.451718:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66db031 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.451721:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66db031 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.451724:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d595b00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.451726:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66db031 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.451758:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66db031 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.451763:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330314.451764:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330314.451766:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66db031 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.451770:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66db031 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:2.0:1715330314.451776:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880091e98a80 reply state ffff88012f4a3000 transno 4294983994 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594480/0xd895711d66db038 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.451782:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594480/0xd895711d66db038 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.451786:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a3d2 (ffff88009bbf0800) 00010000:00010000:2.0:1715330314.451788:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330314.451790:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1715330314.452522:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+641:18881:x1798653938102592:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 1399us (1885us total) trans 4294983994 rc 0/0 00000100:00100000:2.0:1715330314.452530:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23729 00000100:00100000:0.0:1715330314.458856:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330314.459033:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938102720 00000100:00100000:2.0:1715330314.459052:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938102720 00000100:00100000:2.0:1715330314.459219:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23730 00000100:00100000:2.0:1715330314.459226:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+641:18881:x1798653938102720:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:2.0:1715330314.459275:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330314.459297:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7180/0xd895711d66da388 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1549:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc3c expref: 641 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330314.459601:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1549:0x0].0x0 (ffff88009bbf0500) 00010000:00010000:2.0:1715330314.459610:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330314.459634:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66db04d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.459644:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66db04d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.459652:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66db04d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.459658:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66db054 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989ad3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.459664:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66db054 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.459668:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66db054 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.459718:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66db05b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1549:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.459723:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66db05b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1549:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.459728:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66db05b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1549:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:2.0:1715330314.459929:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].16, 64 off9216 00000040:00080000:2.0:1715330314.459955:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].338, 184 off67376 00010000:00010000:2.0:1715330314.459990:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66db062 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1549:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.459996:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66db062 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1549:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.460003:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66db062 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1549:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.460009:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66db062 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1549:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.460014:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66db062 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1549:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.460018:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66db062 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1549:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.460023:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66db062 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1549:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.460027:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d597840 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330314.460030:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66db062 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1549:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.460048:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66db062 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1549:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.460055:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1549:0x0].0x0 (ffff880093a11a00) 00010000:00010000:2.0:1715330314.460057:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1715330314.460060:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66db062 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1549:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.460065:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66db062 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1549:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.460083:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66db05b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1549:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.460088:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66db05b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1549:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.460092:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66db05b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1549:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.460095:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d595200 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.460097:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66db05b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1549:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.460102:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66db05b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1549:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.460106:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1549:0x0].0x0 (ffff880093a11a00) 00010000:00010000:2.0:1715330314.460108:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330314.460110:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66db05b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1549:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.460114:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66db05b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1549:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.460188:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66db04d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.460192:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66db04d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.460196:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66db04d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.460200:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66db04d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.460204:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d595b00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.460206:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66db04d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.460210:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66db04d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.460215:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330314.460216:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330314.460218:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66db04d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.460222:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66db04d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:2.0:1715330314.460229:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880091e9ad80 reply state ffff88012f4a4000 transno 4294983995 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66db054 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.460235:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66db054 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.460240:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ad3 (ffff88009bbf0300) 00010000:00010000:2.0:1715330314.460242:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330314.460245:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1715330314.461544:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+642:18881:x1798653938102720:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 2310us (2686us total) trans 4294983995 rc 0/0 00000100:00100000:2.0:1715330314.461555:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23730 00000100:00100000:0.0:1715330314.465495:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330314.465681:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938102848 00000100:00100000:2.0:1715330314.465691:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938102848 00000100:00100000:2.0:1715330314.465754:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23731 00000100:00100000:2.0:1715330314.465761:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+642:18881:x1798653938102848:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:2.0:1715330314.465803:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330314.465823:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b4b40/0xd895711d66da3ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x154a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc43 expref: 642 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330314.465835:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154a:0x0].0x0 (ffff88009bbf0600) 00010000:00010000:2.0:1715330314.465843:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330314.465863:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66db069 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.465873:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66db069 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.465880:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66db069 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.465887:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66db070 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989bd3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.465892:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66db070 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.465896:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66db070 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.465942:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66db077 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x154a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.465947:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66db077 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.465952:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66db077 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:2.0:1715330314.466156:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2518, 64 off169344 00000040:00080000:2.0:1715330314.466182:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].339, 184 off67560 00010000:00010000:2.0:1715330314.466214:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66db07e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x154a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.466219:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66db07e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.466224:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66db07e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.466230:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66db07e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.466234:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66db07e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.466239:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66db07e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x154a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.466244:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66db07e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x154a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.466248:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d595f80 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330314.466251:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66db07e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x154a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.466257:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66db07e lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x154a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.466263:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154a:0x0].0x0 (ffff880093a11e00) 00010000:00010000:2.0:1715330314.466266:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1715330314.466268:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66db07e lrc: 3/0,0 mode: --/PW res: [0x200000402:0x154a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.466273:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66db07e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x154a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.466290:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66db077 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.466295:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66db077 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x154a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.466299:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66db077 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.466302:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d596ac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.466304:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66db077 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.466308:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66db077 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x154a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.466312:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154a:0x0].0x0 (ffff880093a11e00) 00010000:00010000:2.0:1715330314.466314:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330314.466316:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66db077 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x154a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.466320:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66db077 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x154a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.466401:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66db069 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.466406:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66db069 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.466410:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66db069 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.466414:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66db069 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.466418:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d595440 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.466420:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66db069 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.466424:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66db069 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.466430:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330314.466431:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330314.466433:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66db069 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.466437:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66db069 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:2.0:1715330314.466443:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880091e9b800 reply state ffff88012f4a5000 transno 4294983996 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66db070 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.466450:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66db070 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.466455:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989bd3 (ffff88009bbf0200) 00010000:00010000:2.0:1715330314.466456:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330314.466459:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1715330314.466524:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+643:18881:x1798653938102848:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 762us (1035us total) trans 4294983996 rc 0/0 00000100:00100000:2.0:1715330314.466530:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23731 00000100:00100000:1.0:1715330314.470691:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330314.470842:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938102976 00000100:00100000:2.0:1715330314.470849:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938102976 00000100:00100000:2.0:1715330314.471701:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23732 00000100:00100000:2.0:1715330314.471709:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+643:18881:x1798653938102976:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:2.0:1715330314.471776:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330314.471799:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b46c0/0xd895711d66da3ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x154b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc4a expref: 643 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330314.471827:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154b:0x0].0x0 (ffff88009bbf0a00) 00010000:00010000:2.0:1715330314.471836:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330314.471859:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66db085 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.471869:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66db085 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.471877:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66db085 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.471884:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66db08c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989cd3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.471889:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66db08c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.471894:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66db08c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.471942:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66db093 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x154b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.471948:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66db093 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.471953:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66db093 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:2.0:1715330314.472155:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].17, 64 off9280 00000040:00080000:2.0:1715330314.472182:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].340, 184 off67744 00010000:00010000:2.0:1715330314.472213:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597cc0/0xd895711d66db09a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x154b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.472219:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597cc0/0xd895711d66db09a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.472224:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597cc0/0xd895711d66db09a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.472230:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597cc0/0xd895711d66db09a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.472234:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597cc0/0xd895711d66db09a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.472239:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597cc0/0xd895711d66db09a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x154b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.472244:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597cc0/0xd895711d66db09a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x154b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.472249:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d597cc0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330314.472252:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597cc0/0xd895711d66db09a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x154b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.472259:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597cc0/0xd895711d66db09a lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x154b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.472265:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154b:0x0].0x0 (ffff880093a11a00) 00010000:00010000:2.0:1715330314.472267:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1715330314.472270:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597cc0/0xd895711d66db09a lrc: 3/0,0 mode: --/PW res: [0x200000402:0x154b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.472274:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597cc0/0xd895711d66db09a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x154b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.472291:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66db093 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.472295:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66db093 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x154b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.472299:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66db093 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.472303:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d597840 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.472306:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66db093 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.472310:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66db093 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x154b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.472316:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154b:0x0].0x0 (ffff880093a11a00) 00010000:00010000:2.0:1715330314.472317:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330314.472319:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66db093 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x154b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.472323:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597840/0xd895711d66db093 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x154b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.472402:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66db085 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.472407:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66db085 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.472411:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66db085 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.472415:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66db085 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.472418:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d595b00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.472420:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66db085 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.472424:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66db085 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.472429:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330314.472431:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330314.472433:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66db085 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.472437:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595b00/0xd895711d66db085 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:2.0:1715330314.472443:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007d628000 reply state ffff88012f4a6000 transno 4294983997 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66db08c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.472450:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66db08c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.472457:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989cd3 (ffff88009bbf0700) 00010000:00010000:2.0:1715330314.472459:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330314.472461:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1715330314.472515:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+644:18881:x1798653938102976:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 806us (1830us total) trans 4294983997 rc 0/0 00000100:00100000:2.0:1715330314.472521:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23732 00000100:00100000:0.0:1715330314.475970:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330314.476059:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938103104 00000100:00100000:2.0:1715330314.476068:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938103104 00000100:00100000:2.0:1715330314.476106:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23733 00000100:00100000:2.0:1715330314.476113:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+644:18881:x1798653938103104:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:2.0:1715330314.476162:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330314.476188:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cef40/0xd895711d66da3f1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x154c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc51 expref: 644 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330314.476202:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154c:0x0].0x0 (ffff88009bbf0d00) 00010000:00010000:2.0:1715330314.476212:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330314.476234:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66db0a1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.476244:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66db0a1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.476250:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66db0a1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.476258:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66db0a8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989dd3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.476263:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66db0a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.476268:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66db0a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.476312:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66db0af lrc: 3/0,1 mode: --/EX res: [0x200000402:0x154c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.476318:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66db0af lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.476323:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66db0af lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:2.0:1715330314.476506:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2519, 64 off169408 00000040:00080000:2.0:1715330314.476533:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].341, 184 off67928 00010000:00010000:2.0:1715330314.476565:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d440/0xd895711d66db0b6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x154c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.476572:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d440/0xd895711d66db0b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.476578:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d440/0xd895711d66db0b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.476584:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d440/0xd895711d66db0b6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.476588:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d440/0xd895711d66db0b6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.476593:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d440/0xd895711d66db0b6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x154c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.476597:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d440/0xd895711d66db0b6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x154c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.476604:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093b9d440 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330314.476606:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d440/0xd895711d66db0b6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x154c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.476612:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d440/0xd895711d66db0b6 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x154c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.476618:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154c:0x0].0x0 (ffff880093a11100) 00010000:00010000:2.0:1715330314.476621:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1715330314.476624:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d440/0xd895711d66db0b6 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x154c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.476628:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d440/0xd895711d66db0b6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x154c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.476646:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66db0af lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.476651:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66db0af lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x154c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.476655:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66db0af lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.476659:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d595f80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.476661:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66db0af lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.476665:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66db0af lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x154c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.476670:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154c:0x0].0x0 (ffff880093a11100) 00010000:00010000:2.0:1715330314.476671:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330314.476673:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66db0af lrc: 2/0,0 mode: --/EX res: [0x200000402:0x154c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.476677:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595f80/0xd895711d66db0af lrc: 0/0,0 mode: --/EX res: [0x200000402:0x154c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.476794:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66db0a1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.476798:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66db0a1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.476802:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66db0a1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.476807:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66db0a1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.476810:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d595440 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.476812:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66db0a1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.476817:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66db0a1 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.476824:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330314.476825:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330314.476827:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66db0a1 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.476830:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595440/0xd895711d66db0a1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:2.0:1715330314.476837:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880091e9bb80 reply state ffff88012f4a7000 transno 4294983998 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66db0a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.476846:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66db0a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.476850:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989dd3 (ffff88009bbf0b00) 00010000:00010000:2.0:1715330314.476852:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330314.477254:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1715330314.477931:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+645:18881:x1798653938103104:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 1816us (1970us total) trans 4294983998 rc 0/0 00000100:00100000:2.0:1715330314.477938:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23733 00000100:00100000:0.0:1715330314.481176:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330314.481340:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938103232 00000100:00100000:2.0:1715330314.481350:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938103232 00000100:00100000:2.0:1715330314.481708:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23734 00000100:00100000:2.0:1715330314.481715:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+645:18881:x1798653938103232:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:2.0:1715330314.481786:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330314.481809:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cdf80/0xd895711d66da414 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x154d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc58 expref: 645 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330314.481821:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154d:0x0].0x0 (ffff88009bbf0f00) 00010000:00010000:2.0:1715330314.481829:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330314.481850:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f840/0xd895711d66db0bd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.481861:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f840/0xd895711d66db0bd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.481868:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f840/0xd895711d66db0bd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.481876:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9fa80/0xd895711d66db0c4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989ed3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.481882:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9fa80/0xd895711d66db0c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.481886:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9fa80/0xd895711d66db0c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.481936:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c480/0xd895711d66db0cb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x154d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.481942:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c480/0xd895711d66db0cb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.481947:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c480/0xd895711d66db0cb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:2.0:1715330314.482133:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].18, 64 off9344 00000040:00080000:2.0:1715330314.482158:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].342, 184 off68112 00010000:00010000:2.0:1715330314.482189:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9df80/0xd895711d66db0d2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x154d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.482194:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9df80/0xd895711d66db0d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.482200:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9df80/0xd895711d66db0d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.482204:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9df80/0xd895711d66db0d2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.482209:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9df80/0xd895711d66db0d2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.482213:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9df80/0xd895711d66db0d2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x154d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.482220:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9df80/0xd895711d66db0d2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x154d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.482225:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093b9df80 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330314.482227:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9df80/0xd895711d66db0d2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x154d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.482232:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9df80/0xd895711d66db0d2 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x154d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.482238:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154d:0x0].0x0 (ffff880093a11800) 00010000:00010000:2.0:1715330314.482240:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1715330314.482243:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9df80/0xd895711d66db0d2 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x154d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.482246:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9df80/0xd895711d66db0d2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x154d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.482264:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c480/0xd895711d66db0cb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.482268:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c480/0xd895711d66db0cb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x154d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.482272:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c480/0xd895711d66db0cb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.482276:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093b9c480 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.482278:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c480/0xd895711d66db0cb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.482282:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c480/0xd895711d66db0cb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x154d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.482291:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154d:0x0].0x0 (ffff880093a11800) 00010000:00010000:2.0:1715330314.482293:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330314.482295:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c480/0xd895711d66db0cb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x154d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.482299:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c480/0xd895711d66db0cb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x154d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.482375:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f840/0xd895711d66db0bd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.482380:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f840/0xd895711d66db0bd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.482385:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f840/0xd895711d66db0bd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.482388:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f840/0xd895711d66db0bd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.482391:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093b9f840 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.482393:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f840/0xd895711d66db0bd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.482396:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f840/0xd895711d66db0bd lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.482402:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330314.482403:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330314.482405:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f840/0xd895711d66db0bd lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.482408:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f840/0xd895711d66db0bd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:2.0:1715330314.482414:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880091e9b480 reply state ffff88009aea2000 transno 4294983999 ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9fa80/0xd895711d66db0c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.482421:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9fa80/0xd895711d66db0c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.482425:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ed3 (ffff88009bbf0c00) 00010000:00010000:2.0:1715330314.482426:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330314.482429:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1715330314.482494:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+646:18881:x1798653938103232:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 778us (1323us total) trans 4294983999 rc 0/0 00000100:00100000:2.0:1715330314.482501:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23734 00000100:00100000:0.0:1715330314.482807:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1715330314.482820:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091e99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942510080:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1715330314.482862:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330314.483031:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942510080 00000100:00100000:1.0:1715330314.483044:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942510080 00000100:00100000:1.0:1715330314.483075:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3045 00000100:00100000:1.0:1715330314.483080:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942510080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1715330314.483099:0:19960:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445060608 avail 1315598336 00000100:00100000:1.0:1715330314.483125:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942510080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 45us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330314.483129:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3045 00000100:00100000:0.0:1715330314.483639:0:3688:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968499 gen 2 00000004:00080000:0.0:1715330314.483643:0:3688:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968494 committed transno 4294968499 00000004:00080000:0.0:1715330314.483659:0:3688:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968495 committed transno 4294968499 00000004:00080000:0.0:1715330314.483670:0:3688:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968496 committed transno 4294968499 00000004:00080000:0.0:1715330314.483679:0:3688:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968497 committed transno 4294968499 00000004:00080000:0.0:1715330314.483689:0:3688:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968498 committed transno 4294968499 00000004:00080000:0.0:1715330314.483701:0:3688:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294968499 committed transno 4294968499 00000100:00100000:0.0:1715330314.483717:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091e99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942510080:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1715330314.487533:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330314.487621:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938103360 00000100:00100000:2.0:1715330314.487629:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938103360 00000100:00100000:2.0:1715330314.487664:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23735 00000100:00100000:2.0:1715330314.487670:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+646:18881:x1798653938103360:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:2.0:1715330314.487718:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330314.487761:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cf600/0xd895711d66da437 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x154e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc5f expref: 646 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330314.487775:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154e:0x0].0x0 (ffff8800ad835d00) 00010000:00010000:2.0:1715330314.487784:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330314.487818:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4000/0xd895711d66db0d9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.487828:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4000/0xd895711d66db0d9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.487835:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4000/0xd895711d66db0d9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.487843:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4240/0xd895711d66db0e0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989fd3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.487849:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4240/0xd895711d66db0e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.487854:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4240/0xd895711d66db0e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.487905:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4480/0xd895711d66db0e7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x154e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.487911:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4480/0xd895711d66db0e7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.487916:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4480/0xd895711d66db0e7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:2.0:1715330314.488114:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2520, 64 off169472 00000040:00080000:2.0:1715330314.488141:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].343, 184 off68296 00010000:00010000:2.0:1715330314.488175:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b46c0/0xd895711d66db0ee lrc: 3/0,1 mode: --/PW res: [0x200000402:0x154e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.488180:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b46c0/0xd895711d66db0ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.488186:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b46c0/0xd895711d66db0ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.488192:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b46c0/0xd895711d66db0ee lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.488196:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b46c0/0xd895711d66db0ee lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.488204:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b46c0/0xd895711d66db0ee lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x154e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.488209:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b46c0/0xd895711d66db0ee lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x154e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.488213:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b46c0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330314.488215:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b46c0/0xd895711d66db0ee lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x154e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.488220:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b46c0/0xd895711d66db0ee lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x154e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.488226:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154e:0x0].0x0 (ffff880093a11c00) 00010000:00010000:2.0:1715330314.488227:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1715330314.488230:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b46c0/0xd895711d66db0ee lrc: 3/0,0 mode: --/PW res: [0x200000402:0x154e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.488234:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b46c0/0xd895711d66db0ee lrc: 0/0,0 mode: --/PW res: [0x200000402:0x154e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.488255:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4480/0xd895711d66db0e7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.488259:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4480/0xd895711d66db0e7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x154e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.488263:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4480/0xd895711d66db0e7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.488266:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b4480 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.488269:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4480/0xd895711d66db0e7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.488275:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4480/0xd895711d66db0e7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x154e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.488282:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154e:0x0].0x0 (ffff880093a11c00) 00010000:00010000:2.0:1715330314.488283:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330314.488285:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4480/0xd895711d66db0e7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x154e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.488288:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4480/0xd895711d66db0e7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x154e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.488366:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4000/0xd895711d66db0d9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.488370:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4000/0xd895711d66db0d9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.488374:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4000/0xd895711d66db0d9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.488377:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4000/0xd895711d66db0d9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.488381:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b4000 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.488383:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4000/0xd895711d66db0d9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.488387:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4000/0xd895711d66db0d9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.488392:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330314.488393:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330314.488396:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4000/0xd895711d66db0d9 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.488400:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4000/0xd895711d66db0d9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:2.0:1715330314.488407:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880091e99c00 reply state ffff88009aea0000 transno 4294984000 ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4240/0xd895711d66db0e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.488413:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4240/0xd895711d66db0e0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.488417:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989fd3 (ffff8800ad835f00) 00010000:00010000:2.0:1715330314.488418:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330314.488420:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1715330314.488482:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+647:18881:x1798653938103360:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 811us (957us total) trans 4294984000 rc 0/0 00000100:00100000:2.0:1715330314.488488:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23735 00000100:00100000:0.0:1715330314.492124:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330314.493145:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938103488 00000100:00100000:2.0:1715330314.493155:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938103488 00000100:00100000:2.0:1715330314.493196:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23736 00000100:00100000:2.0:1715330314.493202:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+647:18881:x1798653938103488:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:2.0:1715330314.493259:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330314.493281:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a21c0/0xd895711d66da45a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x154f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc66 expref: 647 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330314.493297:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154f:0x0].0x0 (ffff88012ca48e00) 00010000:00010000:2.0:1715330314.493304:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330314.493326:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66db0f5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.493336:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66db0f5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.493344:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66db0f5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.493351:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4b40/0xd895711d66db0fc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a0d3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.493356:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4b40/0xd895711d66db0fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.493360:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4b40/0xd895711d66db0fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.493404:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4d80/0xd895711d66db103 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x154f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.493408:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4d80/0xd895711d66db103 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.493417:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4d80/0xd895711d66db103 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:2.0:1715330314.493618:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].19, 64 off9408 00000040:00080000:2.0:1715330314.493645:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].344, 184 off68480 00010000:00010000:2.0:1715330314.493681:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4fc0/0xd895711d66db10a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x154f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.493687:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4fc0/0xd895711d66db10a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.493692:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4fc0/0xd895711d66db10a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.493697:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4fc0/0xd895711d66db10a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.493706:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4fc0/0xd895711d66db10a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.493710:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4fc0/0xd895711d66db10a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x154f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.493715:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4fc0/0xd895711d66db10a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x154f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.493720:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b4fc0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330314.493723:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4fc0/0xd895711d66db10a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x154f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.493728:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4fc0/0xd895711d66db10a lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x154f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.493766:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154f:0x0].0x0 (ffff880093a11e00) 00010000:00010000:2.0:1715330314.493768:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1715330314.493771:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4fc0/0xd895711d66db10a lrc: 3/0,0 mode: --/PW res: [0x200000402:0x154f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.493775:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4fc0/0xd895711d66db10a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x154f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.493796:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4d80/0xd895711d66db103 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.493801:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4d80/0xd895711d66db103 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x154f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.493805:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4d80/0xd895711d66db103 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.493809:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b4d80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.493812:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4d80/0xd895711d66db103 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.493816:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4d80/0xd895711d66db103 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x154f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.493821:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154f:0x0].0x0 (ffff880093a11e00) 00010000:00010000:2.0:1715330314.493823:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330314.493825:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4d80/0xd895711d66db103 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x154f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.493828:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4d80/0xd895711d66db103 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x154f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.493907:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66db0f5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.493911:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66db0f5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.493915:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66db0f5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.493919:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66db0f5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.493922:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b4900 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.493924:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66db0f5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.493928:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66db0f5 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.493933:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330314.493935:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330314.493937:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66db0f5 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.493941:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66db0f5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:2.0:1715330314.493947:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880091e98380 reply state ffff88009aea7000 transno 4294984001 ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4b40/0xd895711d66db0fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.493954:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4b40/0xd895711d66db0fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.493958:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a0d3 (ffff88012ca48b00) 00010000:00010000:2.0:1715330314.493960:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330314.493962:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1715330314.494029:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+648:18881:x1798653938103488:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 825us (1914us total) trans 4294984001 rc 0/0 00000100:00100000:2.0:1715330314.494049:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23736 00000100:00100000:0.0:1715330314.506772:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330314.508093:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938103616 00000100:00100000:2.0:1715330314.508104:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938103616 00000100:00100000:2.0:1715330314.508843:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23737 00000100:00100000:2.0:1715330314.508852:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+648:18881:x1798653938103616:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:2.0:1715330314.508903:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330314.508928:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f21c0/0xd895711d66da47d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1550:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc6d expref: 648 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330314.508958:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1550:0x0].0x0 (ffff88012bfb5900) 00010000:00010000:2.0:1715330314.508967:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330314.508989:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66db111 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.509003:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66db111 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.509010:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66db111 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.509018:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5440/0xd895711d66db118 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a1d3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.509023:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5440/0xd895711d66db118 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.509027:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5440/0xd895711d66db118 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.509090:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5680/0xd895711d66db11f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1550:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.509095:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5680/0xd895711d66db11f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1550:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.509100:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5680/0xd895711d66db11f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1550:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:2.0:1715330314.509288:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2521, 64 off169536 00000040:00080000:2.0:1715330314.509314:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].345, 184 off68664 00010000:00010000:2.0:1715330314.509350:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b58c0/0xd895711d66db126 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1550:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.509355:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b58c0/0xd895711d66db126 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1550:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.509361:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b58c0/0xd895711d66db126 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1550:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.509369:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b58c0/0xd895711d66db126 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1550:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.509374:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b58c0/0xd895711d66db126 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1550:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.509377:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b58c0/0xd895711d66db126 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1550:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.509382:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b58c0/0xd895711d66db126 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1550:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.509385:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b58c0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330314.509388:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b58c0/0xd895711d66db126 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1550:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.509393:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b58c0/0xd895711d66db126 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1550:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.509398:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1550:0x0].0x0 (ffff880093a11800) 00010000:00010000:2.0:1715330314.509400:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1715330314.509402:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b58c0/0xd895711d66db126 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1550:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.509406:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b58c0/0xd895711d66db126 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1550:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.509422:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5680/0xd895711d66db11f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1550:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.509425:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5680/0xd895711d66db11f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1550:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.509429:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5680/0xd895711d66db11f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1550:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.509433:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b5680 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.509436:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5680/0xd895711d66db11f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1550:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.509440:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5680/0xd895711d66db11f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1550:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.509444:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1550:0x0].0x0 (ffff880093a11800) 00010000:00010000:2.0:1715330314.509445:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330314.509447:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5680/0xd895711d66db11f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1550:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.509450:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5680/0xd895711d66db11f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1550:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.509516:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66db111 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.509520:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66db111 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.509524:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66db111 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.509527:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66db111 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.509530:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b5200 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.509532:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66db111 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.509535:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66db111 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.509543:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330314.509545:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330314.509547:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66db111 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.509550:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66db111 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:2.0:1715330314.509556:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880091e9b100 reply state ffff88009aea1000 transno 4294984002 ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5440/0xd895711d66db118 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.509562:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5440/0xd895711d66db118 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.509566:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a1d3 (ffff88012bfb5100) 00010000:00010000:2.0:1715330314.509567:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330314.509569:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1715330314.509632:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+649:18881:x1798653938103616:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 781us (2913us total) trans 4294984002 rc 0/0 00000100:00100000:2.0:1715330314.509638:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23737 00000100:00100000:0.0:1715330314.517452:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.517621:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938103744 00000100:00100000:3.0:1715330314.517630:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938103744 00000100:00100000:3.0:1715330314.517680:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23738 00000100:00100000:3.0:1715330314.517686:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+649:18881:x1798653938103744:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1715330314.517751:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330314.517773:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1440/0xd895711d66da4a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1551:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc74 expref: 649 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330314.517799:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1551:0x0].0x0 (ffff88012bfb5200) 00010000:00010000:3.0:1715330314.517809:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330314.517833:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4d80/0xd895711d66db12d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.517843:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4d80/0xd895711d66db12d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.517850:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4d80/0xd895711d66db12d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.517857:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b61c0/0xd895711d66db134 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a2d3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.517862:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b61c0/0xd895711d66db134 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.517866:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b61c0/0xd895711d66db134 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.517916:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db13b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1551:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.517922:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db13b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1551:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.517927:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db13b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1551:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:3.0:1715330314.518115:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].20, 64 off9472 00000040:00080000:3.0:1715330314.518140:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].346, 184 off68848 00010000:00010000:3.0:1715330314.518173:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db142 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1551:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.518179:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db142 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1551:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.518185:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db142 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1551:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.518191:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db142 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1551:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.518195:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db142 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1551:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.518199:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db142 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1551:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.518203:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db142 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1551:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.518208:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b46c0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330314.518211:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db142 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1551:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.518216:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db142 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1551:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.518222:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1551:0x0].0x0 (ffff88009d5fae00) 00010000:00010000:3.0:1715330314.518224:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330314.518227:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db142 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1551:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.518232:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db142 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1551:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.518250:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db13b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1551:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.518255:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db13b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1551:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.518259:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db13b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1551:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.518264:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b6640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.518266:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db13b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1551:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.518271:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db13b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1551:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.518276:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1551:0x0].0x0 (ffff88009d5fae00) 00010000:00010000:3.0:1715330314.518278:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330314.518280:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db13b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1551:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.518284:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db13b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1551:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.518364:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4d80/0xd895711d66db12d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.518369:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4d80/0xd895711d66db12d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.518373:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4d80/0xd895711d66db12d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.518377:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4d80/0xd895711d66db12d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.518381:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b4d80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.518383:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4d80/0xd895711d66db12d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.518388:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4d80/0xd895711d66db12d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.518394:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330314.518395:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330314.518397:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4d80/0xd895711d66db12d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.518401:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4d80/0xd895711d66db12d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:3.0:1715330314.518408:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880091e9aa00 reply state ffff880093ac3000 transno 4294984003 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b61c0/0xd895711d66db134 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.518415:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b61c0/0xd895711d66db134 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.518423:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a2d3 (ffff88012bfb5400) 00010000:00010000:3.0:1715330314.518425:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330314.518427:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330314.518484:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+650:18881:x1798653938103744:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 797us (1039us total) trans 4294984003 rc 0/0 00000100:00100000:3.0:1715330314.518491:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23738 00000100:00100000:0.0:1715330314.526136:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.526377:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938103872 00000100:00100000:3.0:1715330314.526386:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938103872 00000100:00100000:3.0:1715330314.526535:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23739 00000100:00100000:3.0:1715330314.526543:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b162d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+650:18881:x1798653938103872:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1715330314.526589:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330314.526614:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738240/0xd895711d66da4c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1552:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc7b expref: 650 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330314.526630:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1552:0x0].0x0 (ffff88012bfb5700) 00010000:00010000:3.0:1715330314.526639:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330314.526661:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4fc0/0xd895711d66db149 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.526672:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4fc0/0xd895711d66db149 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.526678:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4fc0/0xd895711d66db149 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.526686:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b58c0/0xd895711d66db150 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a3d3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.526691:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b58c0/0xd895711d66db150 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.526696:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b58c0/0xd895711d66db150 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.527655:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5680/0xd895711d66db157 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1552:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.527664:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5680/0xd895711d66db157 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1552:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.527670:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5680/0xd895711d66db157 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1552:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330314.527890:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2522, 64 off169600 00000040:00080000:3.0:1715330314.527916:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].347, 184 off69032 00010000:00010000:3.0:1715330314.527950:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db15e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1552:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.527956:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db15e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1552:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.527961:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db15e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1552:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.527966:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db15e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1552:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.527970:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db15e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1552:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.527974:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db15e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1552:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.527978:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db15e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1552:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.527985:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b7cc0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330314.527988:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db15e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1552:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.527993:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db15e lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1552:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.528000:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1552:0x0].0x0 (ffff88009d5fab00) 00010000:00010000:3.0:1715330314.528002:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330314.528005:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db15e lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1552:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.528010:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db15e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1552:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.528048:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5680/0xd895711d66db157 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1552:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.528053:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5680/0xd895711d66db157 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1552:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.528057:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5680/0xd895711d66db157 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1552:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.528061:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b5680 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.528063:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5680/0xd895711d66db157 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1552:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.528067:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5680/0xd895711d66db157 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1552:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.528072:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1552:0x0].0x0 (ffff88009d5fab00) 00010000:00010000:3.0:1715330314.528074:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330314.528076:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5680/0xd895711d66db157 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1552:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.528080:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5680/0xd895711d66db157 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1552:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.528166:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4fc0/0xd895711d66db149 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.528171:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4fc0/0xd895711d66db149 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.528175:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4fc0/0xd895711d66db149 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.528180:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4fc0/0xd895711d66db149 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.528183:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b4fc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.528185:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4fc0/0xd895711d66db149 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.528189:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4fc0/0xd895711d66db149 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.528195:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330314.528197:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330314.528199:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4fc0/0xd895711d66db149 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.528204:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4fc0/0xd895711d66db149 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330314.528212:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008b162d80 reply state ffff880093ac4000 transno 4294984004 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b58c0/0xd895711d66db150 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.528225:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b58c0/0xd895711d66db150 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.528230:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a3d3 (ffff88012bfb5500) 00010000:00010000:3.0:1715330314.528232:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330314.528234:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330314.528311:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b162d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+651:18881:x1798653938103872:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 1766us (2181us total) trans 4294984004 rc 0/0 00000100:00100000:3.0:1715330314.528319:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23739 00000100:00100000:0.0:1715330314.532003:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.532912:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938104000 00000100:00100000:3.0:1715330314.532922:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938104000 00000100:00100000:3.0:1715330314.532967:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23740 00000100:00100000:3.0:1715330314.532974:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+651:18881:x1798653938104000:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1715330314.533024:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330314.533055:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738b40/0xd895711d66da4e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1553:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc82 expref: 651 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330314.533070:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1553:0x0].0x0 (ffff88008b374d00) 00010000:00010000:3.0:1715330314.533078:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330314.533101:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db165 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.533110:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db165 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.533117:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db165 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.533123:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4b40/0xd895711d66db16c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989ad4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.533129:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4b40/0xd895711d66db16c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.533134:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4b40/0xd895711d66db16c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.533186:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4d80/0xd895711d66db173 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1553:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.533191:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4d80/0xd895711d66db173 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1553:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.533196:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4d80/0xd895711d66db173 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1553:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330314.533391:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].21, 64 off9536 00000040:00080000:3.0:1715330314.533415:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].348, 184 off69216 00010000:00010000:3.0:1715330314.533448:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db17a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1553:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.533454:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db17a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1553:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.533459:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db17a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1553:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.533464:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db17a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1553:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.533468:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db17a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1553:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.533473:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db17a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1553:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.533481:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db17a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1553:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.533486:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b6640 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330314.533490:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db17a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1553:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.533496:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db17a lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1553:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.533502:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1553:0x0].0x0 (ffff88009d5fa100) 00010000:00010000:3.0:1715330314.533505:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330314.533508:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db17a lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1553:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.533513:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db17a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1553:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.533534:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4d80/0xd895711d66db173 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1553:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.533538:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4d80/0xd895711d66db173 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1553:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.533543:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4d80/0xd895711d66db173 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1553:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.533546:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b4d80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.533549:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4d80/0xd895711d66db173 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1553:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.533554:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4d80/0xd895711d66db173 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1553:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.533563:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1553:0x0].0x0 (ffff88009d5fa100) 00010000:00010000:3.0:1715330314.533564:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330314.533567:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4d80/0xd895711d66db173 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1553:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.533571:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4d80/0xd895711d66db173 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1553:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.533656:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db165 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.533661:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db165 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.533665:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db165 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.533668:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db165 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.533672:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b6f40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.533674:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db165 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.533678:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db165 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.533684:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330314.533685:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330314.533687:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db165 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.533691:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db165 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330314.533697:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008b161c00 reply state ffff880093ac6000 transno 4294984005 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4b40/0xd895711d66db16c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.533704:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4b40/0xd895711d66db16c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.533708:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ad4 (ffff88008b374e00) 00010000:00010000:3.0:1715330314.533709:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330314.533712:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330314.533793:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+652:18881:x1798653938104000:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 818us (1797us total) trans 4294984005 rc 0/0 00000100:00100000:3.0:1715330314.533799:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23740 00000100:00100000:0.0:1715330314.537225:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330314.538706:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938104128 00000100:00100000:2.0:1715330314.538717:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938104128 00000100:00100000:2.0:1715330314.540055:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23741 00000100:00100000:2.0:1715330314.540063:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b160380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+652:18881:x1798653938104128:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:2.0:1715330314.540115:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330314.540138:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739440/0xd895711d66da509 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1554:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc89 expref: 652 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330314.540160:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1554:0x0].0x0 (ffff88008b374700) 00010000:00010000:2.0:1715330314.540170:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330314.540193:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5b00/0xd895711d66db181 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.540203:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5b00/0xd895711d66db181 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.540211:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5b00/0xd895711d66db181 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.540218:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5d40/0xd895711d66db188 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989bd4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.540224:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5d40/0xd895711d66db188 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.540228:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5d40/0xd895711d66db188 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.540281:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5f80/0xd895711d66db18f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1554:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.540287:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5f80/0xd895711d66db18f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1554:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.540292:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5f80/0xd895711d66db18f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1554:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:2.0:1715330314.540470:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2523, 64 off169664 00000040:00080000:2.0:1715330314.540497:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].349, 184 off69400 00010000:00010000:2.0:1715330314.540534:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b61c0/0xd895711d66db196 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1554:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.540540:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b61c0/0xd895711d66db196 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1554:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.540549:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b61c0/0xd895711d66db196 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1554:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.540555:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b61c0/0xd895711d66db196 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1554:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.540559:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b61c0/0xd895711d66db196 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1554:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.540564:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b61c0/0xd895711d66db196 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1554:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.540568:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b61c0/0xd895711d66db196 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1554:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.540573:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b61c0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330314.540576:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b61c0/0xd895711d66db196 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1554:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.540582:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b61c0/0xd895711d66db196 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1554:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.540588:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1554:0x0].0x0 (ffff880093a11a00) 00010000:00010000:2.0:1715330314.540591:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1715330314.540593:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b61c0/0xd895711d66db196 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1554:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.540597:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b61c0/0xd895711d66db196 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1554:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.540618:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5f80/0xd895711d66db18f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1554:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.540623:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5f80/0xd895711d66db18f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1554:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.540627:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5f80/0xd895711d66db18f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1554:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.540631:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b5f80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.540633:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5f80/0xd895711d66db18f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1554:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.540638:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5f80/0xd895711d66db18f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1554:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.540644:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1554:0x0].0x0 (ffff880093a11a00) 00010000:00010000:2.0:1715330314.540645:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330314.540647:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5f80/0xd895711d66db18f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1554:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.540650:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5f80/0xd895711d66db18f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1554:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.540752:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5b00/0xd895711d66db181 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.540758:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5b00/0xd895711d66db181 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.540761:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5b00/0xd895711d66db181 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.540765:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5b00/0xd895711d66db181 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.540769:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b5b00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.540771:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5b00/0xd895711d66db181 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.540778:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5b00/0xd895711d66db181 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.540784:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330314.540786:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330314.540788:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5b00/0xd895711d66db181 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.540792:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5b00/0xd895711d66db181 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:2.0:1715330314.540799:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008b160380 reply state ffff88009aea5000 transno 4294984006 ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5d40/0xd895711d66db188 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.540805:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5d40/0xd895711d66db188 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.540810:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989bd4 (ffff88008b374a00) 00010000:00010000:2.0:1715330314.540811:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330314.540814:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1715330314.540886:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b160380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+653:18881:x1798653938104128:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 823us (3666us total) trans 4294984006 rc 0/0 00000100:00100000:2.0:1715330314.540892:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23741 00000100:00100000:0.0:1715330314.544765:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.545845:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938104256 00000100:00100000:3.0:1715330314.545854:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938104256 00000100:00100000:3.0:1715330314.545904:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23742 00000100:00100000:3.0:1715330314.545910:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+653:18881:x1798653938104256:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1715330314.545956:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330314.545979:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739d40/0xd895711d66da52c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1555:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc90 expref: 653 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330314.546005:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1555:0x0].0x0 (ffff88008b374100) 00010000:00010000:3.0:1715330314.546014:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330314.546044:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db19d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.546055:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db19d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.546062:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db19d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.546070:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5200/0xd895711d66db1a4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989cd4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.546075:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5200/0xd895711d66db1a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.546079:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5200/0xd895711d66db1a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.546127:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66db1ab lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1555:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.546133:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66db1ab lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1555:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.546138:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66db1ab lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1555:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330314.546315:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].22, 64 off9600 00000040:00080000:3.0:1715330314.546340:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].350, 184 off69584 00010000:00010000:3.0:1715330314.546372:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4900/0xd895711d66db1b2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1555:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.546378:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4900/0xd895711d66db1b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1555:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.546384:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4900/0xd895711d66db1b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1555:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.546389:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4900/0xd895711d66db1b2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1555:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.546395:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4900/0xd895711d66db1b2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1555:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.546403:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4900/0xd895711d66db1b2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1555:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.546409:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4900/0xd895711d66db1b2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1555:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.546414:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b4900 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330314.546416:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4900/0xd895711d66db1b2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1555:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.546420:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4900/0xd895711d66db1b2 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1555:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.546426:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1555:0x0].0x0 (ffff88009d5fac00) 00010000:00010000:3.0:1715330314.546428:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330314.546430:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4900/0xd895711d66db1b2 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1555:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.546435:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4900/0xd895711d66db1b2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1555:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.546454:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66db1ab lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1555:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.546458:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66db1ab lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1555:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.546462:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66db1ab lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1555:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.546466:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b4240 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.546468:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66db1ab lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1555:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.546476:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66db1ab lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1555:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.546482:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1555:0x0].0x0 (ffff88009d5fac00) 00010000:00010000:3.0:1715330314.546483:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330314.546485:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66db1ab lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1555:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.546489:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66db1ab lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1555:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.546569:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db19d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.546574:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db19d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.546578:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db19d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.546582:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db19d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.546585:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b46c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.546587:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db19d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.546591:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db19d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.546596:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330314.546597:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330314.546600:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db19d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.546604:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db19d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330314.546610:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008b162680 reply state ffff880093ac7000 transno 4294984007 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5200/0xd895711d66db1a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.546617:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5200/0xd895711d66db1a4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.546621:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989cd4 (ffff88008b374900) 00010000:00010000:3.0:1715330314.546623:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330314.546625:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330314.546673:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+654:18881:x1798653938104256:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 762us (1949us total) trans 4294984007 rc 0/0 00000100:00100000:3.0:1715330314.546679:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23742 00000100:00100000:0.0:1715330314.555576:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330314.555672:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938104384 00000100:00100000:2.0:1715330314.555680:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938104384 00000100:00100000:2.0:1715330314.555727:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23743 00000100:00100000:2.0:1715330314.555766:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b161f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+654:18881:x1798653938104384:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:2.0:1715330314.555813:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330314.555843:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cd8c0/0xd895711d66da54f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1556:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc97 expref: 654 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330314.555867:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1556:0x0].0x0 (ffff8800ab6b5000) 00010000:00010000:2.0:1715330314.555876:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330314.555897:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6400/0xd895711d66db1b9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.555911:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6400/0xd895711d66db1b9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.555920:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6400/0xd895711d66db1b9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.555928:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6640/0xd895711d66db1c0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989dd4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.555934:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6640/0xd895711d66db1c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.555938:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6640/0xd895711d66db1c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.555991:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6880/0xd895711d66db1c7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1556:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.555997:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6880/0xd895711d66db1c7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1556:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.556002:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6880/0xd895711d66db1c7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1556:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:2.0:1715330314.556191:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2524, 64 off169728 00000040:00080000:2.0:1715330314.556437:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].351, 184 off69768 00010000:00010000:2.0:1715330314.556475:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6ac0/0xd895711d66db1ce lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1556:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.556482:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6ac0/0xd895711d66db1ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1556:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.556490:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6ac0/0xd895711d66db1ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1556:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.556495:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6ac0/0xd895711d66db1ce lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1556:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.556500:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6ac0/0xd895711d66db1ce lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1556:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.556504:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6ac0/0xd895711d66db1ce lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1556:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.556509:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6ac0/0xd895711d66db1ce lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1556:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.556514:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b6ac0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330314.556517:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6ac0/0xd895711d66db1ce lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1556:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.556521:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6ac0/0xd895711d66db1ce lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1556:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.556526:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1556:0x0].0x0 (ffff880093a11100) 00010000:00010000:2.0:1715330314.556528:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1715330314.556531:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6ac0/0xd895711d66db1ce lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1556:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.556535:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6ac0/0xd895711d66db1ce lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1556:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.556552:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6880/0xd895711d66db1c7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1556:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.556556:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6880/0xd895711d66db1c7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1556:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.556560:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6880/0xd895711d66db1c7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1556:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.556563:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b6880 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.556565:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6880/0xd895711d66db1c7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1556:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.556569:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6880/0xd895711d66db1c7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1556:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.556573:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1556:0x0].0x0 (ffff880093a11100) 00010000:00010000:2.0:1715330314.556575:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330314.556577:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6880/0xd895711d66db1c7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1556:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.556580:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6880/0xd895711d66db1c7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1556:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.556641:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6400/0xd895711d66db1b9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.556645:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6400/0xd895711d66db1b9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.556649:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6400/0xd895711d66db1b9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.556653:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6400/0xd895711d66db1b9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.556656:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b6400 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.556658:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6400/0xd895711d66db1b9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.556662:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6400/0xd895711d66db1b9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.556667:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330314.556668:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330314.556670:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6400/0xd895711d66db1b9 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.556674:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6400/0xd895711d66db1b9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:2.0:1715330314.556679:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008b161f80 reply state ffff88009aea6000 transno 4294984008 ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6640/0xd895711d66db1c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.556685:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6640/0xd895711d66db1c0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.556689:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989dd4 (ffff8800ab6b5500) 00010000:00010000:2.0:1715330314.556691:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330314.556693:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1715330314.557505:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b161f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+655:18881:x1798653938104384:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 1738us (1934us total) trans 4294984008 rc 0/0 00000100:00100000:2.0:1715330314.557511:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23743 00000100:00100000:0.0:1715330314.563489:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330314.564336:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938104512 00000100:00100000:2.0:1715330314.564345:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938104512 00000100:00100000:2.0:1715330314.564400:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23744 00000100:00100000:2.0:1715330314.564407:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b161880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+655:18881:x1798653938104512:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:2.0:1715330314.564461:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330314.564486:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73a640/0xd895711d66da572 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1557:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbc9e expref: 655 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330314.564502:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1557:0x0].0x0 (ffff88008b374c00) 00010000:00010000:2.0:1715330314.564510:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330314.564532:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6d00/0xd895711d66db1d5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.564542:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6d00/0xd895711d66db1d5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.564550:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6d00/0xd895711d66db1d5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.564557:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6f40/0xd895711d66db1dc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989ed4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.564562:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6f40/0xd895711d66db1dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.564567:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6f40/0xd895711d66db1dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.564613:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7180/0xd895711d66db1e3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1557:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.564618:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7180/0xd895711d66db1e3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1557:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.564622:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7180/0xd895711d66db1e3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1557:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:2.0:1715330314.564842:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].23, 64 off9664 00000040:00080000:2.0:1715330314.564867:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].352, 184 off69952 00010000:00010000:2.0:1715330314.564902:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b73c0/0xd895711d66db1ea lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1557:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.564908:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b73c0/0xd895711d66db1ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1557:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.564914:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b73c0/0xd895711d66db1ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1557:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.564919:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b73c0/0xd895711d66db1ea lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1557:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.564924:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b73c0/0xd895711d66db1ea lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1557:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.564928:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b73c0/0xd895711d66db1ea lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1557:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.564933:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b73c0/0xd895711d66db1ea lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1557:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.564937:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b73c0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330314.564941:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b73c0/0xd895711d66db1ea lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1557:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.564946:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b73c0/0xd895711d66db1ea lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1557:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.567251:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1557:0x0].0x0 (ffff880093a11c00) 00010000:00010000:2.0:1715330314.567254:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1715330314.567259:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b73c0/0xd895711d66db1ea lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1557:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.567265:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b73c0/0xd895711d66db1ea lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1557:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.567305:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7180/0xd895711d66db1e3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1557:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.567311:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7180/0xd895711d66db1e3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1557:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.567315:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7180/0xd895711d66db1e3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1557:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.567320:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b7180 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.567323:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7180/0xd895711d66db1e3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1557:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.567329:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7180/0xd895711d66db1e3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1557:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.567335:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1557:0x0].0x0 (ffff880093a11c00) 00010000:00010000:2.0:1715330314.567336:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330314.567338:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7180/0xd895711d66db1e3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1557:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.567342:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7180/0xd895711d66db1e3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1557:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.567471:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6d00/0xd895711d66db1d5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.567476:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6d00/0xd895711d66db1d5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.567480:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6d00/0xd895711d66db1d5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.567484:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6d00/0xd895711d66db1d5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.567489:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b6d00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.567491:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6d00/0xd895711d66db1d5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.567495:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6d00/0xd895711d66db1d5 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.567501:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330314.567502:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330314.567505:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6d00/0xd895711d66db1d5 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.567509:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6d00/0xd895711d66db1d5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:2.0:1715330314.567516:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008b161880 reply state ffff88009aea3000 transno 4294984009 ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6f40/0xd895711d66db1dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.567526:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6f40/0xd895711d66db1dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.567532:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ed4 (ffff88008b374000) 00010000:00010000:2.0:1715330314.567534:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330314.567537:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1715330314.567629:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b161880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+656:18881:x1798653938104512:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 3217us (4145us total) trans 4294984009 rc 0/0 00000100:00100000:2.0:1715330314.567637:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23744 00000100:00100000:0.0:1715330314.575292:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330314.575361:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938104640 00000100:00100000:2.0:1715330314.575369:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938104640 00000100:00100000:2.0:1715330314.575423:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23745 00000100:00100000:2.0:1715330314.575430:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b163b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+656:18881:x1798653938104640:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:2.0:1715330314.575485:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330314.575508:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc900/0xd895711d66da595 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1558:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbca5 expref: 656 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330314.575525:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1558:0x0].0x0 (ffff8800ab6b5b00) 00010000:00010000:2.0:1715330314.575533:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330314.575556:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7600/0xd895711d66db1f1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.575567:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7600/0xd895711d66db1f1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.575575:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7600/0xd895711d66db1f1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.575582:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66db1f8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989fd4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.575587:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66db1f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.575592:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66db1f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.575641:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7a80/0xd895711d66db1ff lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1558:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.575646:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7a80/0xd895711d66db1ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1558:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.575651:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7a80/0xd895711d66db1ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1558:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:2.0:1715330314.575877:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2525, 64 off169792 00000040:00080000:2.0:1715330314.575904:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].353, 184 off70136 00010000:00010000:2.0:1715330314.575938:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7cc0/0xd895711d66db206 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1558:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.575944:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7cc0/0xd895711d66db206 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1558:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.575950:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7cc0/0xd895711d66db206 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1558:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.575955:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7cc0/0xd895711d66db206 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1558:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.575961:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7cc0/0xd895711d66db206 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1558:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.575965:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7cc0/0xd895711d66db206 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1558:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.575971:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7cc0/0xd895711d66db206 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1558:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.575975:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b7cc0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330314.575978:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7cc0/0xd895711d66db206 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1558:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.575982:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7cc0/0xd895711d66db206 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1558:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.575988:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1558:0x0].0x0 (ffff880093a11a00) 00010000:00010000:2.0:1715330314.575990:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1715330314.575993:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7cc0/0xd895711d66db206 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1558:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.575998:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7cc0/0xd895711d66db206 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1558:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.576017:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7a80/0xd895711d66db1ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1558:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.576021:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7a80/0xd895711d66db1ff lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1558:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.576025:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7a80/0xd895711d66db1ff lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1558:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.576029:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b7a80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.576031:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7a80/0xd895711d66db1ff lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1558:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.576049:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7a80/0xd895711d66db1ff lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1558:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.576054:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1558:0x0].0x0 (ffff880093a11a00) 00010000:00010000:2.0:1715330314.576056:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330314.576058:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7a80/0xd895711d66db1ff lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1558:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.576062:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7a80/0xd895711d66db1ff lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1558:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.576142:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7600/0xd895711d66db1f1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.576147:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7600/0xd895711d66db1f1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.576151:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7600/0xd895711d66db1f1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.576156:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7600/0xd895711d66db1f1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.576159:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b7600 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.576161:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7600/0xd895711d66db1f1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.576165:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7600/0xd895711d66db1f1 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.576170:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330314.576172:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330314.576174:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7600/0xd895711d66db1f1 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.576178:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7600/0xd895711d66db1f1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:2.0:1715330314.576185:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008b163b80 reply state ffff88009c618000 transno 4294984010 ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66db1f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.576192:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66db1f8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.576196:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989fd4 (ffff8800ab6b5400) 00010000:00010000:2.0:1715330314.576198:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330314.576200:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1715330314.576267:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b163b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+657:18881:x1798653938104640:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 837us (982us total) trans 4294984010 rc 0/0 00000100:00100000:2.0:1715330314.576273:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23745 00000100:00100000:0.0:1715330314.589600:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.590410:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938104768 00000100:00100000:3.0:1715330314.590419:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938104768 00000100:00100000:3.0:1715330314.591205:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23746 00000100:00100000:3.0:1715330314.591213:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b163800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+657:18881:x1798653938104768:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1715330314.591260:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330314.591281:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cdb00/0xd895711d66da5b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1559:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbcac expref: 657 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330314.591451:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1559:0x0].0x0 (ffff8800ab6b5200) 00010000:00010000:3.0:1715330314.591461:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330314.591488:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66db20d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.591498:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66db20d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.591506:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66db20d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.591514:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7a80/0xd895711d66db214 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a0d4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.591518:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7a80/0xd895711d66db214 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.591522:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7a80/0xd895711d66db214 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.591570:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4480/0xd895711d66db21b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1559:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.591575:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4480/0xd895711d66db21b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1559:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.591580:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4480/0xd895711d66db21b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1559:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330314.591938:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].24, 64 off9728 00000040:00080000:3.0:1715330314.591964:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].354, 184 off70320 00010000:00010000:3.0:1715330314.591996:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db222 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1559:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.592002:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db222 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1559:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.592007:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db222 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1559:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.592012:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db222 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1559:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.592020:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db222 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1559:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.592024:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db222 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1559:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.592029:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db222 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1559:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.592042:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b7180 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330314.592044:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db222 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1559:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.592049:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db222 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1559:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.592056:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1559:0x0].0x0 (ffff88009d5faf00) 00010000:00010000:3.0:1715330314.592058:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330314.592061:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db222 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1559:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.592065:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db222 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1559:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.592085:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4480/0xd895711d66db21b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1559:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.592090:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4480/0xd895711d66db21b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1559:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.592094:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4480/0xd895711d66db21b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1559:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.592098:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b4480 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.592101:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4480/0xd895711d66db21b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1559:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.592105:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4480/0xd895711d66db21b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1559:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.592111:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1559:0x0].0x0 (ffff88009d5faf00) 00010000:00010000:3.0:1715330314.592113:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330314.592115:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4480/0xd895711d66db21b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1559:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.592119:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4480/0xd895711d66db21b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1559:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.593505:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66db20d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.593513:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66db20d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.593517:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66db20d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.593522:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66db20d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.593526:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b5f80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.593529:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66db20d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.593533:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66db20d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.593542:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330314.593544:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330314.593547:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66db20d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.593551:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66db20d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330314.593560:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008b163800 reply state ffff880093ac5000 transno 4294984011 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7a80/0xd895711d66db214 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.593568:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7a80/0xd895711d66db214 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.593573:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a0d4 (ffff8800ab6b5f00) 00010000:00010000:3.0:1715330314.593575:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330314.593578:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330314.593659:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b163800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+658:18881:x1798653938104768:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 2442us (4063us total) trans 4294984011 rc 0/0 00000100:00100000:3.0:1715330314.593666:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23746 00000100:00100000:0.0:1715330314.599645:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.600184:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938104896 00000100:00100000:3.0:1715330314.600192:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938104896 00000100:00100000:3.0:1715330314.602229:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23747 00000100:00100000:3.0:1715330314.602241:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b162a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+658:18881:x1798653938104896:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1715330314.602300:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330314.602324:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cf180/0xd895711d66da5db lrc: 0/0,0 mode: --/PR res: [0x200000402:0x155a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbcb3 expref: 658 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330314.603836:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155a:0x0].0x0 (ffff8800ab6b5100) 00010000:00010000:3.0:1715330314.603854:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330314.603883:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6880/0xd895711d66db229 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.603897:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6880/0xd895711d66db229 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.603905:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6880/0xd895711d66db229 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.603913:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5d40/0xd895711d66db230 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a1d4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.603917:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5d40/0xd895711d66db230 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.603921:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5d40/0xd895711d66db230 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.603969:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db237 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x155a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.603974:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db237 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.603978:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db237 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330314.604177:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2526, 64 off169856 00000040:00080000:3.0:1715330314.604205:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].355, 184 off70504 00010000:00010000:3.0:1715330314.604243:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db23e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x155a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.604250:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db23e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.604256:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db23e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.604265:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db23e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.604270:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db23e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.604275:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db23e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x155a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.604280:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db23e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x155a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.604285:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b6ac0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330314.604289:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db23e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x155a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.604294:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db23e lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x155a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.604302:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155a:0x0].0x0 (ffff88009d5fa700) 00010000:00010000:3.0:1715330314.604305:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330314.604308:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db23e lrc: 3/0,0 mode: --/PW res: [0x200000402:0x155a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.604313:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db23e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x155a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.604340:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db237 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.604345:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db237 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x155a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.604349:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db237 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.604354:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b6400 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.604356:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db237 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.604361:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db237 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x155a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.604366:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155a:0x0].0x0 (ffff88009d5fa700) 00010000:00010000:3.0:1715330314.604368:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330314.604370:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db237 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x155a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.604375:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db237 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x155a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.604465:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6880/0xd895711d66db229 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.604470:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6880/0xd895711d66db229 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.604475:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6880/0xd895711d66db229 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.604479:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6880/0xd895711d66db229 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.604483:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b6880 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.604485:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6880/0xd895711d66db229 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.604489:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6880/0xd895711d66db229 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.604498:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330314.604500:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330314.604502:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6880/0xd895711d66db229 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.604507:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6880/0xd895711d66db229 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330314.604514:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008b162a00 reply state ffff880093ac2000 transno 4294984012 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5d40/0xd895711d66db230 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.604521:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5d40/0xd895711d66db230 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.604525:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a1d4 (ffff8800ab6b5300) 00010000:00010000:3.0:1715330314.604527:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330314.604531:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330314.604639:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b162a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+659:18881:x1798653938104896:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 2397us (4996us total) trans 4294984012 rc 0/0 00000100:00100000:3.0:1715330314.604648:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23747 00000100:00100000:0.0:1715330314.615088:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.616659:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938105024 00000100:00100000:3.0:1715330314.616670:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938105024 00000100:00100000:3.0:1715330314.616725:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23748 00000100:00100000:3.0:1715330314.616971:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b160a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+659:18881:x1798653938105024:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1715330314.617031:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330314.617064:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73af40/0xd895711d66da5fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x155b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbcba expref: 659 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330314.617094:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155b:0x0].0x0 (ffff88008b374400) 00010000:00010000:3.0:1715330314.617104:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330314.617129:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4000/0xd895711d66db245 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.617140:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4000/0xd895711d66db245 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.617148:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4000/0xd895711d66db245 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.617157:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6880/0xd895711d66db24c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a2d4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.617162:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6880/0xd895711d66db24c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.617167:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6880/0xd895711d66db24c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.617221:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db253 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x155b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.617227:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db253 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.617232:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db253 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330314.617440:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].25, 64 off9792 00000040:00080000:3.0:1715330314.617468:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].356, 184 off70688 00010000:00010000:3.0:1715330314.617506:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db25a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x155b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.617512:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db25a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.617522:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db25a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.617528:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db25a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.617533:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db25a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.617538:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db25a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x155b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.617543:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db25a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x155b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.617548:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b6ac0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330314.617551:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db25a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x155b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.617559:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db25a lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x155b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.617565:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155b:0x0].0x0 (ffff88009d5fa300) 00010000:00010000:3.0:1715330314.617568:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330314.617570:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db25a lrc: 3/0,0 mode: --/PW res: [0x200000402:0x155b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.617574:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db25a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x155b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.617595:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db253 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.617599:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db253 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x155b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.617605:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db253 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.617609:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b6400 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.617611:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db253 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.617615:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db253 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x155b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.617620:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155b:0x0].0x0 (ffff88009d5fa300) 00010000:00010000:3.0:1715330314.618752:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330314.618759:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db253 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x155b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.618765:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db253 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x155b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.618879:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4000/0xd895711d66db245 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.618885:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4000/0xd895711d66db245 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.618889:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4000/0xd895711d66db245 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.618894:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4000/0xd895711d66db245 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.618898:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b4000 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.618910:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4000/0xd895711d66db245 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.618919:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4000/0xd895711d66db245 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.618929:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330314.618931:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330314.618934:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4000/0xd895711d66db245 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.618937:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4000/0xd895711d66db245 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330314.618946:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008b160a80 reply state ffff880091fdb000 transno 4294984013 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6880/0xd895711d66db24c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.618964:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6880/0xd895711d66db24c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.618969:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a2d4 (ffff88008b374600) 00010000:00010000:3.0:1715330314.618971:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330314.618974:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330314.619603:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b160a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+660:18881:x1798653938105024:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 2630us (4519us total) trans 4294984013 rc 0/0 00000100:00100000:3.0:1715330314.619613:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23748 00000100:00100000:0.0:1715330314.627085:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.627227:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938105152 00000100:00100000:3.0:1715330314.627235:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938105152 00000100:00100000:3.0:1715330314.627292:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23749 00000100:00100000:3.0:1715330314.627299:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+660:18881:x1798653938105152:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1715330314.627351:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330314.627377:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b840/0xd895711d66da621 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x155c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbcc1 expref: 660 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330314.627413:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155c:0x0].0x0 (ffff88009ef57100) 00010000:00010000:3.0:1715330314.627423:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330314.627448:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66db261 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.627459:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66db261 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.627467:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66db261 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.627476:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4480/0xd895711d66db268 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a3d4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.627482:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4480/0xd895711d66db268 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.627487:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4480/0xd895711d66db268 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.627538:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db26f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x155c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.627544:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db26f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.627549:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db26f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330314.627772:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2527, 64 off169920 00000040:00080000:3.0:1715330314.627800:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].357, 184 off70872 00010000:00010000:3.0:1715330314.627834:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db276 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x155c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.627841:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db276 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.627847:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db276 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.627853:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db276 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.627858:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db276 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.627862:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db276 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x155c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.627867:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db276 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x155c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.627873:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b46c0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330314.627875:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db276 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x155c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.627882:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db276 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x155c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.627888:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155c:0x0].0x0 (ffff88009d5fa900) 00010000:00010000:3.0:1715330314.627891:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330314.627894:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db276 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x155c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.627898:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db276 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x155c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.627918:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db26f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.627923:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db26f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x155c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.627927:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db26f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.627930:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b7180 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.627933:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db26f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.627938:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db26f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x155c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.627943:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155c:0x0].0x0 (ffff88009d5fa900) 00010000:00010000:3.0:1715330314.627944:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330314.631752:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db26f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x155c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.631770:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db26f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x155c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.631900:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66db261 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.631906:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66db261 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.631911:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66db261 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.631915:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66db261 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.631919:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b5f80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.631923:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66db261 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.631928:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66db261 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.631941:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330314.631944:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330314.631946:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66db261 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.631951:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66db261 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330314.631959:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008b162300 reply state ffff880091fde000 transno 4294984014 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4480/0xd895711d66db268 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.631968:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4480/0xd895711d66db268 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.631974:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a3d4 (ffff88008b374b00) 00010000:00010000:3.0:1715330314.631976:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330314.631978:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330314.632073:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+661:18881:x1798653938105152:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 4769us (4991us total) trans 4294984014 rc 0/0 00000100:00100000:3.0:1715330314.632081:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23749 00000100:00100000:0.0:1715330314.636911:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.637020:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938105280 00000100:00100000:3.0:1715330314.637029:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938105280 00000100:00100000:3.0:1715330314.637091:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23750 00000100:00100000:3.0:1715330314.637098:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+661:18881:x1798653938105280:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1715330314.637148:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330314.637172:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73bcc0/0xd895711d66da644 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x155d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbcc8 expref: 661 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330314.639261:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155d:0x0].0x0 (ffff88009ef57a00) 00010000:00010000:3.0:1715330314.639279:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330314.639309:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66db27d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.639321:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66db27d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.639332:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66db27d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.639339:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4900/0xd895711d66db284 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989ad5 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.639345:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4900/0xd895711d66db284 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.639349:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4900/0xd895711d66db284 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.639559:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db28b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x155d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.639565:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db28b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.639571:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db28b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330314.639776:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].26, 64 off9856 00000040:00080000:3.0:1715330314.639799:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].358, 184 off71056 00010000:00010000:3.0:1715330314.639834:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4d80/0xd895711d66db292 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x155d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.639840:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4d80/0xd895711d66db292 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.639846:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4d80/0xd895711d66db292 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.639851:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4d80/0xd895711d66db292 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.639855:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4d80/0xd895711d66db292 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.639860:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4d80/0xd895711d66db292 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x155d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.639864:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4d80/0xd895711d66db292 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x155d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.639869:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b4d80 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330314.639872:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4d80/0xd895711d66db292 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x155d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.639877:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4d80/0xd895711d66db292 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x155d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.639884:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155d:0x0].0x0 (ffff88009d5fab00) 00010000:00010000:3.0:1715330314.639887:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330314.639889:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4d80/0xd895711d66db292 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x155d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.639893:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4d80/0xd895711d66db292 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x155d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.639919:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db28b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.639924:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db28b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x155d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.639928:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db28b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.639932:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b6f40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.639935:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db28b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.639938:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db28b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x155d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.639943:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155d:0x0].0x0 (ffff88009d5fab00) 00010000:00010000:3.0:1715330314.639945:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330314.639946:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db28b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x155d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.639951:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db28b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x155d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.640044:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66db27d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.640049:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66db27d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.640053:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66db27d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.640058:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66db27d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.640062:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b4240 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.640064:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66db27d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.640069:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66db27d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.640075:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330314.640077:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330314.640080:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66db27d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.640084:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66db27d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330314.640092:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008b160e00 reply state ffff880091fd9000 transno 4294984015 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4900/0xd895711d66db284 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.640099:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4900/0xd895711d66db284 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.640104:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ad5 (ffff88009ef57f00) 00010000:00010000:3.0:1715330314.640105:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330314.640107:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330314.642121:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+662:18881:x1798653938105280:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 5013us (5208us total) trans 4294984015 rc 0/0 00000100:00100000:3.0:1715330314.642131:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23750 00000100:00100000:0.0:1715330314.651491:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.651567:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938105408 00000100:00100000:3.0:1715330314.651576:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938105408 00000100:00100000:3.0:1715330314.651627:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23751 00000100:00100000:3.0:1715330314.651634:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b163480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+662:18881:x1798653938105408:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1715330314.651687:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330314.651710:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73aac0/0xd895711d66da667 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x155e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbccf expref: 662 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330314.651767:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155e:0x0].0x0 (ffff88009ef57400) 00010000:00010000:3.0:1715330314.651778:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330314.651800:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db299 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.651811:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db299 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.651818:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db299 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.651825:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4fc0/0xd895711d66db2a0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989bd5 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.651830:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4fc0/0xd895711d66db2a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.651834:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4fc0/0xd895711d66db2a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.651879:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5680/0xd895711d66db2a7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x155e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.651883:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5680/0xd895711d66db2a7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.651887:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5680/0xd895711d66db2a7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330314.652085:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2528, 64 off169984 00000040:00080000:3.0:1715330314.652107:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].359, 184 off71240 00010000:00010000:3.0:1715330314.652139:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db2ae lrc: 3/0,1 mode: --/PW res: [0x200000402:0x155e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.652146:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db2ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.652152:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db2ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.652157:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db2ae lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.652162:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db2ae lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.652167:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db2ae lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x155e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.652171:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db2ae lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x155e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.652175:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b7cc0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330314.652178:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db2ae lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x155e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.652183:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db2ae lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x155e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.652188:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155e:0x0].0x0 (ffff88009d5fae00) 00010000:00010000:3.0:1715330314.652191:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330314.652193:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db2ae lrc: 3/0,0 mode: --/PW res: [0x200000402:0x155e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.652198:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db2ae lrc: 0/0,0 mode: --/PW res: [0x200000402:0x155e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.652218:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5680/0xd895711d66db2a7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.652222:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5680/0xd895711d66db2a7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x155e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.652226:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5680/0xd895711d66db2a7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.652229:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b5680 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.652232:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5680/0xd895711d66db2a7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.652235:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5680/0xd895711d66db2a7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x155e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.652239:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155e:0x0].0x0 (ffff88009d5fae00) 00010000:00010000:3.0:1715330314.652241:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330314.652242:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5680/0xd895711d66db2a7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x155e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.652246:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5680/0xd895711d66db2a7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x155e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.652314:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db299 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.652318:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db299 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.652322:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db299 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.652325:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db299 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.652329:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b6640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.652331:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db299 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.652335:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db299 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.652339:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330314.652341:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330314.652342:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db299 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.652346:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db299 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330314.652351:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008b163480 reply state ffff88011db70000 transno 4294984016 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4fc0/0xd895711d66db2a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.652357:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4fc0/0xd895711d66db2a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.652361:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989bd5 (ffff88009ef57200) 00010000:00010000:3.0:1715330314.652362:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330314.652364:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330314.652424:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b163480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+663:18881:x1798653938105408:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 789us (940us total) trans 4294984016 rc 0/0 00000100:00100000:3.0:1715330314.652429:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23751 00000100:00100000:0.0:1715330314.662391:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330314.662660:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938105536 00000100:00100000:2.0:1715330314.662669:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938105536 00000100:00100000:2.0:1715330314.662720:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23752 00000100:00100000:2.0:1715330314.662728:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+663:18881:x1798653938105536:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:2.0:1715330314.662812:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330314.662835:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73a1c0/0xd895711d66da68a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x155f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbcd6 expref: 663 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330314.662861:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155f:0x0].0x0 (ffff88009bbb0300) 00010000:00010000:2.0:1715330314.662870:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330314.662898:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7600/0xd895711d66db2b5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.662910:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7600/0xd895711d66db2b5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.662919:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7600/0xd895711d66db2b5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.662927:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7a80/0xd895711d66db2bc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989cd5 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.662933:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7a80/0xd895711d66db2bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.662938:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7a80/0xd895711d66db2bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.662988:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7cc0/0xd895711d66db2c3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x155f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.662995:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7cc0/0xd895711d66db2c3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.663003:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7cc0/0xd895711d66db2c3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:2.0:1715330314.663212:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].27, 64 off9920 00000040:00080000:2.0:1715330314.663238:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].360, 184 off71424 00010000:00010000:2.0:1715330314.663271:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6d00/0xd895711d66db2ca lrc: 3/0,1 mode: --/PW res: [0x200000402:0x155f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.663277:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6d00/0xd895711d66db2ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.663283:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6d00/0xd895711d66db2ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.663289:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6d00/0xd895711d66db2ca lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.663294:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6d00/0xd895711d66db2ca lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.663298:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6d00/0xd895711d66db2ca lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x155f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.663302:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6d00/0xd895711d66db2ca lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x155f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.663307:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b6d00 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330314.663310:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6d00/0xd895711d66db2ca lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x155f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.663315:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6d00/0xd895711d66db2ca lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x155f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.663322:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155f:0x0].0x0 (ffff880093a11a00) 00010000:00010000:2.0:1715330314.663324:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1715330314.663327:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6d00/0xd895711d66db2ca lrc: 3/0,0 mode: --/PW res: [0x200000402:0x155f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.663331:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6d00/0xd895711d66db2ca lrc: 0/0,0 mode: --/PW res: [0x200000402:0x155f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.663351:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7cc0/0xd895711d66db2c3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.663355:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7cc0/0xd895711d66db2c3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x155f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.663359:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7cc0/0xd895711d66db2c3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.663363:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b7cc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.663365:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7cc0/0xd895711d66db2c3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.663368:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7cc0/0xd895711d66db2c3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x155f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.663373:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155f:0x0].0x0 (ffff880093a11a00) 00010000:00010000:2.0:1715330314.663375:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330314.663377:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7cc0/0xd895711d66db2c3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x155f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.663381:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7cc0/0xd895711d66db2c3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x155f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.663470:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7600/0xd895711d66db2b5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.663475:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7600/0xd895711d66db2b5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.663480:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7600/0xd895711d66db2b5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.663484:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7600/0xd895711d66db2b5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.663488:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b7600 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.663490:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7600/0xd895711d66db2b5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.663494:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7600/0xd895711d66db2b5 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.663500:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330314.663501:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330314.663504:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7600/0xd895711d66db2b5 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.663507:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7600/0xd895711d66db2b5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:2.0:1715330314.663513:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008b163100 reply state ffff88009c619000 transno 4294984017 ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7a80/0xd895711d66db2bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.663520:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7a80/0xd895711d66db2bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.663525:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989cd5 (ffff88009ef57900) 00010000:00010000:2.0:1715330314.663527:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330314.663529:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1715330314.663610:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+664:18881:x1798653938105536:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 881us (1226us total) trans 4294984017 rc 0/0 00000100:00100000:2.0:1715330314.663621:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23752 00000100:00100000:0.0:1715330314.667894:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.667994:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938105664 00000100:00100000:3.0:1715330314.668002:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938105664 00000100:00100000:3.0:1715330314.668656:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23753 00000100:00100000:3.0:1715330314.668665:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b161500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+664:18881:x1798653938105664:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1715330314.668721:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330314.668818:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738fc0/0xd895711d66da6ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1560:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbcdd expref: 664 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330314.668927:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1560:0x0].0x0 (ffff88009bbb0100) 00010000:00010000:3.0:1715330314.668941:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330314.668967:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db2d1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.668977:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db2d1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.668983:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db2d1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.668992:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5680/0xd895711d66db2d8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989dd5 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.668997:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5680/0xd895711d66db2d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.669001:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5680/0xd895711d66db2d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.669066:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db2df lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1560:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.669071:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db2df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1560:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.669076:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db2df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1560:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330314.669290:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2529, 64 off170048 00000040:00080000:3.0:1715330314.669319:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].361, 184 off71608 00010000:00010000:3.0:1715330314.669357:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66db2e6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1560:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.669364:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66db2e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1560:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.669369:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66db2e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1560:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.669375:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66db2e6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1560:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.669380:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66db2e6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1560:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.669385:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66db2e6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1560:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.669390:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66db2e6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1560:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.669396:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b4240 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330314.669399:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66db2e6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1560:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.669405:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66db2e6 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1560:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.669411:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1560:0x0].0x0 (ffff88009d5fa000) 00010000:00010000:3.0:1715330314.669413:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330314.669416:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66db2e6 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1560:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.669421:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66db2e6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1560:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.669442:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db2df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1560:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.669446:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db2df lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1560:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.669449:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db2df lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1560:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.669452:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b7cc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.669455:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db2df lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1560:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.669459:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db2df lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1560:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.669463:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1560:0x0].0x0 (ffff88009d5fa000) 00010000:00010000:3.0:1715330314.669465:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330314.669467:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db2df lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1560:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.669471:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db2df lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1560:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.669564:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db2d1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.669569:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db2d1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.669574:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db2d1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.669578:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db2d1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.669583:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b6640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.669585:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db2d1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.669589:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db2d1 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.669595:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330314.669598:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330314.669600:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db2d1 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.669603:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db2d1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330314.669611:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008b161500 reply state ffff88011db72000 transno 4294984018 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5680/0xd895711d66db2d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.669618:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5680/0xd895711d66db2d8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.669623:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989dd5 (ffff88009bbb0600) 00010000:00010000:3.0:1715330314.669624:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330314.669627:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330314.669709:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b161500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+665:18881:x1798653938105664:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 1044us (1824us total) trans 4294984018 rc 0/0 00000100:00100000:3.0:1715330314.669717:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23753 00000100:00100000:0.0:1715330314.677100:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.678693:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938105792 00000100:00100000:3.0:1715330314.678704:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938105792 00000100:00100000:3.0:1715330314.679864:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23754 00000100:00100000:3.0:1715330314.679872:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+665:18881:x1798653938105792:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1715330314.679933:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330314.679958:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d7398c0/0xd895711d66da6d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1561:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbce4 expref: 665 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330314.680596:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1561:0x0].0x0 (ffff88009bbb0d00) 00010000:00010000:3.0:1715330314.680609:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330314.680637:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db2ed lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.680648:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db2ed lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.680658:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db2ed lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.680665:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4d80/0xd895711d66db2f4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989ed5 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.680671:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4d80/0xd895711d66db2f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.680676:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4d80/0xd895711d66db2f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.680727:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66db2fb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1561:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.680749:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66db2fb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1561:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.680754:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66db2fb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1561:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330314.681185:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].28, 64 off9984 00000040:00080000:3.0:1715330314.681213:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].362, 184 off71792 00010000:00010000:3.0:1715330314.681254:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db302 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1561:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.681261:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db302 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1561:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.681267:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db302 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1561:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.681272:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db302 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1561:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.681278:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db302 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1561:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.681282:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db302 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1561:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.681288:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db302 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1561:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.681293:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b7180 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330314.681297:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db302 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1561:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.681303:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db302 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1561:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.681309:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1561:0x0].0x0 (ffff88009d5fa800) 00010000:00010000:3.0:1715330314.681311:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330314.681314:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db302 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1561:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.681319:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db302 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1561:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.681344:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66db2fb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1561:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.681348:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66db2fb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1561:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.681352:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66db2fb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1561:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.681356:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b5f80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.681358:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66db2fb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1561:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.681363:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66db2fb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1561:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.681367:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1561:0x0].0x0 (ffff88009d5fa800) 00010000:00010000:3.0:1715330314.681369:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330314.681371:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66db2fb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1561:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.681375:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66db2fb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1561:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.681459:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db2ed lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.681464:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db2ed lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.681468:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db2ed lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.681472:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db2ed lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.681477:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b6f40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.681479:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db2ed lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.681484:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db2ed lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.681489:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330314.681491:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330314.681493:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db2ed lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.681497:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db2ed lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330314.681505:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012faed180 reply state ffff88011db71000 transno 4294984019 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4d80/0xd895711d66db2f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.681512:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4d80/0xd895711d66db2f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.681516:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ed5 (ffff88009bbb0700) 00010000:00010000:3.0:1715330314.681518:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330314.681521:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330314.681607:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+666:18881:x1798653938105792:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 1733us (4512us total) trans 4294984019 rc 0/0 00000100:00100000:3.0:1715330314.681614:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23754 00000100:00100000:0.0:1715330314.685907:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.686183:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938105920 00000100:00100000:3.0:1715330314.686192:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938105920 00000100:00100000:3.0:1715330314.686262:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23755 00000100:00100000:3.0:1715330314.686270:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+666:18881:x1798653938105920:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1715330314.686318:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330314.686340:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cdd40/0xd895711d66da6f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1562:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbceb expref: 666 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330314.686353:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1562:0x0].0x0 (ffff8800ab6b5e00) 00010000:00010000:3.0:1715330314.686362:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330314.686385:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db309 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.686395:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db309 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.686401:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db309 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.686409:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4000/0xd895711d66db310 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989fd5 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.686414:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4000/0xd895711d66db310 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.686420:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4000/0xd895711d66db310 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.686464:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db317 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1562:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.686469:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db317 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1562:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.686474:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db317 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1562:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330314.686651:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2530, 64 off170112 00000040:00080000:3.0:1715330314.686676:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].363, 184 off71976 00010000:00010000:3.0:1715330314.686708:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db31e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1562:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.686715:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db31e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1562:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.686720:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db31e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1562:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.686726:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db31e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1562:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.687363:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db31e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1562:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.687369:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db31e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1562:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.687375:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db31e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1562:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.687380:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b6ac0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330314.687383:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db31e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1562:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.687389:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db31e lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1562:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.687398:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1562:0x0].0x0 (ffff88009d5fa500) 00010000:00010000:3.0:1715330314.687400:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330314.687403:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db31e lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1562:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.687408:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db31e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1562:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.687433:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db317 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1562:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.687438:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db317 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1562:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.687442:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db317 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1562:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.687446:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b6400 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.687448:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db317 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1562:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.687452:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db317 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1562:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.687457:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1562:0x0].0x0 (ffff88009d5fa500) 00010000:00010000:3.0:1715330314.687459:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330314.687461:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db317 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1562:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.687465:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db317 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1562:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.687554:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db309 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.687560:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db309 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.687565:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db309 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.687569:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db309 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.687573:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b46c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.687576:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db309 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.687580:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db309 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.687585:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330314.687587:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330314.687590:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db309 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.687594:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db309 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330314.687602:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012faed500 reply state ffff88011db75000 transno 4294984020 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4000/0xd895711d66db310 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.687609:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4000/0xd895711d66db310 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.687614:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989fd5 (ffff8800b2570000) 00010000:00010000:3.0:1715330314.687616:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330314.687618:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330314.688637:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+667:18881:x1798653938105920:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 2362us (2733us total) trans 4294984020 rc 0/0 00000100:00100000:3.0:1715330314.688646:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23755 00000100:00100000:0.0:1715330314.694827:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.695029:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938106048 00000100:00100000:3.0:1715330314.695045:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938106048 00000100:00100000:3.0:1715330314.695082:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23756 00000100:00100000:3.0:1715330314.695088:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+667:18881:x1798653938106048:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1715330314.695136:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330314.695158:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b3c0/0xd895711d66da716 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1563:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbcf2 expref: 667 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330314.695173:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1563:0x0].0x0 (ffff880093a11d00) 00010000:00010000:3.0:1715330314.695181:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330314.695204:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db325 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.695214:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db325 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.695220:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db325 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.695226:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66db32c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a0d5 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.695230:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66db32c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.695234:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66db32c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.695279:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db333 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1563:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.695283:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db333 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1563:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.695288:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db333 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1563:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330314.696417:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].29, 64 off10048 00000040:00080000:3.0:1715330314.696443:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].364, 184 off72160 00010000:00010000:3.0:1715330314.696478:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db33a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1563:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.696485:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db33a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1563:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.696491:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db33a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1563:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.696496:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db33a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1563:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.696501:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db33a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1563:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.696506:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db33a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1563:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.696510:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db33a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1563:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.696514:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b6640 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330314.696518:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db33a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1563:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.696523:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db33a lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1563:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.696529:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1563:0x0].0x0 (ffff88009d5fa100) 00010000:00010000:3.0:1715330314.696532:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330314.696534:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db33a lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1563:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.696538:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db33a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1563:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.696559:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db333 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1563:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.696563:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db333 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1563:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.696567:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db333 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1563:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.696570:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b7180 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.696573:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db333 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1563:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.696578:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db333 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1563:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.696582:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1563:0x0].0x0 (ffff88009d5fa100) 00010000:00010000:3.0:1715330314.696584:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330314.696586:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db333 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1563:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.696589:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db333 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1563:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.696672:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db325 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.696677:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db325 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.696682:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db325 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.696686:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db325 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.696690:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b6f40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.696692:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db325 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.696696:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db325 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.696703:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330314.696704:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330314.696706:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db325 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.696711:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db325 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330314.696717:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012faeea00 reply state ffff88011db74000 transno 4294984021 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66db32c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.696723:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66db32c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.696745:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a0d5 (ffff880093a11f00) 00010000:00010000:3.0:1715330314.696747:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330314.696750:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330314.696982:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+668:18881:x1798653938106048:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 1891us (2159us total) trans 4294984021 rc 0/0 00000100:00100000:3.0:1715330314.696989:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23756 00000100:00100000:0.0:1715330314.701691:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.701881:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938106176 00000100:00100000:3.0:1715330314.701891:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938106176 00000100:00100000:3.0:1715330314.702041:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23757 00000100:00100000:3.0:1715330314.702049:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+668:18881:x1798653938106176:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1715330314.702100:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330314.702125:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cd440/0xd895711d66da739 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1564:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbcf9 expref: 668 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330314.702142:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1564:0x0].0x0 (ffff880092dfdb00) 00010000:00010000:3.0:1715330314.702152:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330314.702178:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db341 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.702188:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db341 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.702196:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db341 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.702204:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66db348 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a1d5 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.702208:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66db348 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.702213:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66db348 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.702260:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db34f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1564:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.702265:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db34f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1564:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.702270:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db34f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1564:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330314.702461:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2531, 64 off170176 00000040:00080000:3.0:1715330314.702491:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].365, 184 off72344 00010000:00010000:3.0:1715330314.702526:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db356 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1564:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.702531:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db356 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1564:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.702537:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db356 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1564:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.702542:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db356 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1564:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.702547:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db356 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1564:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.702552:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db356 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1564:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.702557:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db356 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1564:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.702562:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b6400 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330314.702566:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db356 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1564:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.702572:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db356 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1564:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.702579:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1564:0x0].0x0 (ffff88009d5fac00) 00010000:00010000:3.0:1715330314.702581:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330314.702584:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db356 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1564:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.702589:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db356 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1564:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.702613:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db34f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1564:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.702617:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db34f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1564:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.702621:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db34f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1564:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.702624:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b46c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.702628:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db34f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1564:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.702633:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db34f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1564:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.702638:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1564:0x0].0x0 (ffff88009d5fac00) 00010000:00010000:3.0:1715330314.702640:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330314.702641:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db34f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1564:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.702645:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db34f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1564:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.703085:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db341 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.703091:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db341 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.703096:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db341 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.703100:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db341 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.703104:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b7cc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.703106:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db341 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.703111:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db341 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.703119:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330314.703121:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330314.703123:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db341 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.703127:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db341 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330314.703136:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012faece00 reply state ffff880091c44000 transno 4294984022 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66db348 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.703142:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66db348 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.703147:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a1d5 (ffff880092dfde00) 00010000:00010000:3.0:1715330314.703149:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330314.703150:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330314.703216:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+669:18881:x1798653938106176:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 1166us (1532us total) trans 4294984022 rc 0/0 00000100:00100000:3.0:1715330314.703222:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23757 00000100:00100000:0.0:1715330314.707572:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.707694:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938106304 00000100:00100000:3.0:1715330314.707704:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938106304 00000100:00100000:3.0:1715330314.707907:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23758 00000100:00100000:3.0:1715330314.707914:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+669:18881:x1798653938106304:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1715330314.707962:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330314.707985:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce400/0xd895711d66da75c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1565:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd00 expref: 669 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330314.707998:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1565:0x0].0x0 (ffff880092dfdc00) 00010000:00010000:3.0:1715330314.708005:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330314.708029:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db35d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.708051:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db35d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.708060:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db35d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.708071:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db364 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a2d5 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.708076:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db364 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.708081:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db364 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.708128:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db36b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1565:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.708134:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db36b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1565:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.708139:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db36b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1565:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330314.708318:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].30, 64 off10112 00000040:00080000:3.0:1715330314.708341:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].366, 184 off72528 00010000:00010000:3.0:1715330314.708373:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db372 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1565:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.708379:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db372 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1565:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.708385:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db372 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1565:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.708391:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db372 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1565:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.708396:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db372 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1565:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.708401:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db372 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1565:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.708405:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db372 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1565:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.708409:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b6640 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330314.708413:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db372 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1565:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.708418:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db372 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1565:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.708424:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1565:0x0].0x0 (ffff88009d5faf00) 00010000:00010000:3.0:1715330314.708426:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330314.708428:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db372 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1565:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.708433:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db372 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1565:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.708454:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db36b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1565:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.708458:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db36b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1565:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.708462:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db36b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1565:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.708465:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b7180 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.708468:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db36b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1565:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.708472:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db36b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1565:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.708478:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1565:0x0].0x0 (ffff88009d5faf00) 00010000:00010000:3.0:1715330314.708479:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330314.708481:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db36b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1565:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.708485:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db36b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1565:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.708564:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db35d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.708569:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db35d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.708573:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db35d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.708577:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db35d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.708581:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b6ac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.708583:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db35d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.708587:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db35d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.708592:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330314.708594:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330314.708596:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db35d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.708600:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db35d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330314.708607:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012faefb80 reply state ffff880091c41000 transno 4294984023 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db364 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.708614:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db364 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.708618:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a2d5 (ffff880092dfd500) 00010000:00010000:3.0:1715330314.708620:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330314.708622:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330314.708675:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+670:18881:x1798653938106304:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 761us (1111us total) trans 4294984023 rc 0/0 00000100:00100000:3.0:1715330314.708682:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23758 00000100:00100000:0.0:1715330314.713221:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330314.714139:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938106432 00000100:00100000:1.0:1715330314.714148:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938106432 00000100:00100000:1.0:1715330314.714193:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23759 00000100:00100000:1.0:1715330314.714199:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+670:18881:x1798653938106432:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:1.0:1715330314.714246:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330314.714267:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66da77f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1566:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd07 expref: 670 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.714294:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1566:0x0].0x0 (ffff88008b0d2c00) 00010000:00010000:1.0:1715330314.714302:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330314.714324:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e640/0xd895711d66db379 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.714333:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e640/0xd895711d66db379 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.714341:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e640/0xd895711d66db379 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.714348:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e880/0xd895711d66db380 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a3d5 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.714354:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e880/0xd895711d66db380 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.714359:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e880/0xd895711d66db380 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.714401:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5eac0/0xd895711d66db387 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1566:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.714407:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5eac0/0xd895711d66db387 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1566:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.714412:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5eac0/0xd895711d66db387 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1566:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:1.0:1715330314.714593:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2532, 64 off170240 00000040:00080000:1.0:1715330314.714620:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].367, 184 off72712 00010000:00010000:1.0:1715330314.714656:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ed00/0xd895711d66db38e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1566:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.714662:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ed00/0xd895711d66db38e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1566:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.714669:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ed00/0xd895711d66db38e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1566:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.714675:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ed00/0xd895711d66db38e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1566:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.714680:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ed00/0xd895711d66db38e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1566:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.714685:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ed00/0xd895711d66db38e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1566:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.714690:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ed00/0xd895711d66db38e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1566:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.714694:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5ed00 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:1.0:1715330314.714697:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ed00/0xd895711d66db38e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1566:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.714704:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ed00/0xd895711d66db38e lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1566:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.714710:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1566:0x0].0x0 (ffff88009b985800) 00010000:00010000:1.0:1715330314.714712:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1715330314.714715:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ed00/0xd895711d66db38e lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1566:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.714719:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ed00/0xd895711d66db38e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1566:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.714770:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5eac0/0xd895711d66db387 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1566:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.714776:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5eac0/0xd895711d66db387 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1566:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.714780:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5eac0/0xd895711d66db387 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1566:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.714784:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5eac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330314.714786:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5eac0/0xd895711d66db387 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1566:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.714791:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5eac0/0xd895711d66db387 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1566:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.714796:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1566:0x0].0x0 (ffff88009b985800) 00010000:00010000:1.0:1715330314.714798:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330314.714799:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5eac0/0xd895711d66db387 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1566:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.714803:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5eac0/0xd895711d66db387 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1566:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.714884:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e640/0xd895711d66db379 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.714889:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e640/0xd895711d66db379 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.714892:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e640/0xd895711d66db379 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.714896:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e640/0xd895711d66db379 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.714898:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5e640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330314.714900:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e640/0xd895711d66db379 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.714904:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e640/0xd895711d66db379 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.714909:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:1.0:1715330314.714911:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330314.714913:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e640/0xd895711d66db379 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.714917:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e640/0xd895711d66db379 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:1.0:1715330314.714924:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012faec380 reply state ffff880077681000 transno 4294984024 ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e880/0xd895711d66db380 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.714931:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e880/0xd895711d66db380 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.714938:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a3d5 (ffff88008b0d2a00) 00010000:00010000:1.0:1715330314.714940:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330314.714943:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1715330314.714999:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+671:18881:x1798653938106432:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 799us (1785us total) trans 4294984024 rc 0/0 00000100:00100000:1.0:1715330314.715006:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23759 00000100:00100000:0.0:1715330314.722869:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.722949:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938106560 00000100:00100000:3.0:1715330314.722957:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938106560 00000100:00100000:3.0:1715330314.723253:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23760 00000100:00100000:3.0:1715330314.723260:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+671:18881:x1798653938106560:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1715330314.723308:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330314.723329:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cfcc0/0xd895711d66da7a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1567:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd0e expref: 671 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330314.723353:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1567:0x0].0x0 (ffff880092dfd000) 00010000:00010000:3.0:1715330314.723360:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330314.723382:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db395 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.723392:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db395 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.723398:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db395 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.723405:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db39c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989ad6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.723410:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db39c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.723414:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db39c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.723455:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db3a3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1567:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.723459:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db3a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1567:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.723463:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db3a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1567:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330314.723623:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].31, 64 off10176 00000040:00080000:3.0:1715330314.723645:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].368, 184 off72896 00010000:00010000:3.0:1715330314.723675:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db3aa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1567:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.723681:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db3aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1567:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.723686:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db3aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1567:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.723690:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db3aa lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1567:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.723695:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db3aa lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1567:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.723698:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db3aa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1567:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.723702:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db3aa lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1567:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.723707:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b7cc0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330314.723709:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db3aa lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1567:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.723714:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db3aa lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1567:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.723719:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1567:0x0].0x0 (ffff88009d5fa700) 00010000:00010000:3.0:1715330314.723721:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330314.723723:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db3aa lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1567:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.723726:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db3aa lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1567:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.723765:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db3a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1567:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.723769:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db3a3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1567:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.723773:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db3a3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1567:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.723776:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b6640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.723779:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db3a3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1567:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.723782:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db3a3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1567:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.723787:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1567:0x0].0x0 (ffff88009d5fa700) 00010000:00010000:3.0:1715330314.723788:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330314.723790:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db3a3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1567:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.723793:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db3a3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1567:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.723862:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db395 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.723866:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db395 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.723869:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db395 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.723873:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db395 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.723878:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b6ac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.723880:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db395 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.723883:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db395 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.723888:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330314.723889:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330314.723891:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db395 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.723894:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db395 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330314.723899:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012faec000 reply state ffff880091c47000 transno 4294984025 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db39c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.723905:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db39c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.723908:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ad6 (ffff880092dfd300) 00010000:00010000:3.0:1715330314.723910:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330314.723912:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330314.723958:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+672:18881:x1798653938106560:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 698us (1097us total) trans 4294984025 rc 0/0 00000100:00100000:3.0:1715330314.723963:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23760 00000100:00100000:0.0:1715330314.729024:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330314.729417:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938106688 00000100:00100000:1.0:1715330314.729425:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938106688 00000100:00100000:1.0:1715330314.729467:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23761 00000100:00100000:1.0:1715330314.729474:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+672:18881:x1798653938106688:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:1.0:1715330314.729522:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330314.729542:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66da7c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1568:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd15 expref: 672 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.729565:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1568:0x0].0x0 (ffff88008b0d2700) 00010000:00010000:1.0:1715330314.729573:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330314.729593:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ef40/0xd895711d66db3b1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.729602:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ef40/0xd895711d66db3b1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.729609:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ef40/0xd895711d66db3b1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.729616:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f180/0xd895711d66db3b8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989bd6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.729622:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f180/0xd895711d66db3b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.729627:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f180/0xd895711d66db3b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.729669:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f3c0/0xd895711d66db3bf lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1568:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.729674:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f3c0/0xd895711d66db3bf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1568:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.729678:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f3c0/0xd895711d66db3bf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1568:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:1.0:1715330314.729857:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2533, 64 off170304 00000040:00080000:1.0:1715330314.729881:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].369, 184 off73080 00010000:00010000:1.0:1715330314.729910:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f600/0xd895711d66db3c6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1568:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.729915:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f600/0xd895711d66db3c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1568:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.729921:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f600/0xd895711d66db3c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1568:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.729926:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f600/0xd895711d66db3c6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1568:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.729931:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f600/0xd895711d66db3c6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1568:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.729935:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f600/0xd895711d66db3c6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1568:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.729940:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f600/0xd895711d66db3c6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1568:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.729949:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5f600 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:1.0:1715330314.729952:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f600/0xd895711d66db3c6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1568:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.729957:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f600/0xd895711d66db3c6 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1568:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.729963:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1568:0x0].0x0 (ffff88009b985a00) 00010000:00010000:1.0:1715330314.729965:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1715330314.729967:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f600/0xd895711d66db3c6 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1568:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.729971:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f600/0xd895711d66db3c6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1568:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.729987:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f3c0/0xd895711d66db3bf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1568:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.729991:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f3c0/0xd895711d66db3bf lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1568:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.729995:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f3c0/0xd895711d66db3bf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1568:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.729998:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5f3c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330314.730001:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f3c0/0xd895711d66db3bf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1568:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.730004:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f3c0/0xd895711d66db3bf lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1568:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.730008:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1568:0x0].0x0 (ffff88009b985a00) 00010000:00010000:1.0:1715330314.730010:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330314.730012:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f3c0/0xd895711d66db3bf lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1568:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.730016:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f3c0/0xd895711d66db3bf lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1568:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.730103:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ef40/0xd895711d66db3b1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.730107:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ef40/0xd895711d66db3b1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.730110:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ef40/0xd895711d66db3b1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.730114:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ef40/0xd895711d66db3b1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.730117:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5ef40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330314.730119:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ef40/0xd895711d66db3b1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.730123:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ef40/0xd895711d66db3b1 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.730128:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:1.0:1715330314.730129:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330314.730131:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ef40/0xd895711d66db3b1 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.730135:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ef40/0xd895711d66db3b1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:1.0:1715330314.730141:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012faee300 reply state ffff8800939e5000 transno 4294984026 ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f180/0xd895711d66db3b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.730150:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f180/0xd895711d66db3b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.730154:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989bd6 (ffff88008b0d2600) 00010000:00010000:1.0:1715330314.730155:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330314.730157:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1715330314.730205:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+673:18881:x1798653938106688:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 731us (1188us total) trans 4294984026 rc 0/0 00000100:00100000:1.0:1715330314.730211:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23761 00000100:00100000:0.0:1715330314.735867:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.735954:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938106816 00000100:00100000:3.0:1715330314.735962:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938106816 00000100:00100000:3.0:1715330314.736009:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23762 00000100:00100000:3.0:1715330314.736015:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+673:18881:x1798653938106816:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1715330314.736071:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330314.736091:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ccb40/0xd895711d66da7e8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1569:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd1c expref: 673 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330314.736109:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1569:0x0].0x0 (ffff880092dfd400) 00010000:00010000:3.0:1715330314.736117:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330314.736139:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db3cd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.736150:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db3cd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.736157:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db3cd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.736164:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db3d4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989cd6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.736169:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db3d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.736174:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db3d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.736223:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db3db lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1569:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.736228:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db3db lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1569:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.736232:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db3db lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1569:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330314.736420:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].32, 64 off10240 00000040:00080000:3.0:1715330314.736448:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].370, 184 off73264 00010000:00010000:3.0:1715330314.736481:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db3e2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1569:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.736488:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db3e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1569:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.736494:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db3e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1569:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.736500:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db3e2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1569:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.736504:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db3e2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1569:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.736508:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db3e2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1569:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.736513:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db3e2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1569:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.736517:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b6640 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330314.736520:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db3e2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1569:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.736525:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db3e2 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1569:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.736531:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1569:0x0].0x0 (ffff88009d5fa300) 00010000:00010000:3.0:1715330314.736533:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330314.736536:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db3e2 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1569:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.736541:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db3e2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1569:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.736562:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db3db lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1569:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.736566:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db3db lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1569:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.736570:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db3db lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1569:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.736573:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b6ac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.736576:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db3db lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1569:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.736580:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db3db lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1569:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.736585:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1569:0x0].0x0 (ffff88009d5fa300) 00010000:00010000:3.0:1715330314.736587:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330314.736588:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db3db lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1569:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.736592:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db3db lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1569:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.736676:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db3cd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.736681:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db3cd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.736685:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db3cd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.736690:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db3cd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.736695:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b46c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.736697:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db3cd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.736701:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db3cd lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.736707:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330314.736708:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330314.736711:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db3cd lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.736715:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db3cd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330314.736722:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012faee680 reply state ffff880091c40000 transno 4294984027 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db3d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.736764:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db3d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.736770:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989cd6 (ffff880092dfd200) 00010000:00010000:3.0:1715330314.736772:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330314.736774:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330314.736828:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+674:18881:x1798653938106816:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 811us (966us total) trans 4294984027 rc 0/0 00000100:00100000:3.0:1715330314.736834:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23762 00000100:00100000:0.0:1715330314.741356:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330314.741463:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938106944 00000100:00100000:1.0:1715330314.741472:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938106944 00000100:00100000:1.0:1715330314.741528:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23763 00000100:00100000:1.0:1715330314.741536:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+674:18881:x1798653938106944:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:1.0:1715330314.741593:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330314.741617:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ced00/0xd895711d66da80b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x156a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd23 expref: 674 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.741647:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156a:0x0].0x0 (ffff880092dfd100) 00010000:00010000:1.0:1715330314.741656:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330314.741685:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f840/0xd895711d66db3e9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.741697:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f840/0xd895711d66db3e9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.741706:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f840/0xd895711d66db3e9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.741714:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5fa80/0xd895711d66db3f0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989dd6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.741720:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5fa80/0xd895711d66db3f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.741725:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5fa80/0xd895711d66db3f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.741804:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5fcc0/0xd895711d66db3f7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x156a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.741810:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5fcc0/0xd895711d66db3f7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.741816:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5fcc0/0xd895711d66db3f7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:1.0:1715330314.742027:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2534, 64 off170368 00000040:00080000:1.0:1715330314.742073:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].371, 184 off73448 00010000:00010000:1.0:1715330314.742111:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ef40/0xd895711d66db3fe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x156a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.742118:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ef40/0xd895711d66db3fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.742123:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ef40/0xd895711d66db3fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.742129:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ef40/0xd895711d66db3fe lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.742133:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ef40/0xd895711d66db3fe lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.742137:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ef40/0xd895711d66db3fe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x156a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.742145:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ef40/0xd895711d66db3fe lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x156a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.742150:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5ef40 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:1.0:1715330314.742152:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ef40/0xd895711d66db3fe lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x156a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.742158:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ef40/0xd895711d66db3fe lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x156a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.742163:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156a:0x0].0x0 (ffff88009b985100) 00010000:00010000:1.0:1715330314.742165:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1715330314.742168:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ef40/0xd895711d66db3fe lrc: 3/0,0 mode: --/PW res: [0x200000402:0x156a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.742172:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ef40/0xd895711d66db3fe lrc: 0/0,0 mode: --/PW res: [0x200000402:0x156a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.742191:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5fcc0/0xd895711d66db3f7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.742195:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5fcc0/0xd895711d66db3f7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x156a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.742200:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5fcc0/0xd895711d66db3f7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.742203:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5fcc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330314.742205:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5fcc0/0xd895711d66db3f7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.742209:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5fcc0/0xd895711d66db3f7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x156a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.742216:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156a:0x0].0x0 (ffff88009b985100) 00010000:00010000:1.0:1715330314.742218:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330314.742220:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5fcc0/0xd895711d66db3f7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x156a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.742223:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5fcc0/0xd895711d66db3f7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x156a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.742308:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f840/0xd895711d66db3e9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.742313:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f840/0xd895711d66db3e9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.742317:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f840/0xd895711d66db3e9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.742321:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f840/0xd895711d66db3e9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.742324:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5f840 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330314.742326:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f840/0xd895711d66db3e9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.742330:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f840/0xd895711d66db3e9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.742335:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:1.0:1715330314.742337:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330314.742339:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f840/0xd895711d66db3e9 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.742343:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f840/0xd895711d66db3e9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:1.0:1715330314.742350:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012faed880 reply state ffff8800939e7000 transno 4294984028 ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5fa80/0xd895711d66db3f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.742357:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5fa80/0xd895711d66db3f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.742361:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989dd6 (ffff880092dfd800) 00010000:00010000:1.0:1715330314.742363:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330314.742365:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1715330314.742419:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+675:18881:x1798653938106944:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 882us (1072us total) trans 4294984028 rc 0/0 00000100:00100000:1.0:1715330314.742425:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23763 00000100:00100000:0.0:1715330314.746615:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.746713:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938107072 00000100:00100000:3.0:1715330314.746724:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938107072 00000100:00100000:3.0:1715330314.747413:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23764 00000100:00100000:3.0:1715330314.747420:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+675:18881:x1798653938107072:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1715330314.747467:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330314.747488:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7cc0/0xd895711d66da82e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x156b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd2a expref: 675 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330314.747518:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156b:0x0].0x0 (ffff880092dfdd00) 00010000:00010000:3.0:1715330314.747526:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330314.747550:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db405 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.747562:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db405 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.747569:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db405 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.747578:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db40c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989ed6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.747583:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db40c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.747589:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db40c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.747637:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db413 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x156b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.747642:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db413 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.747646:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db413 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330314.747850:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].33, 64 off10304 00000040:00080000:3.0:1715330314.747876:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].372, 184 off73632 00010000:00010000:3.0:1715330314.747911:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db41a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x156b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.747917:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db41a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.747922:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db41a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.747928:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db41a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.747933:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db41a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.747937:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db41a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x156b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.747942:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db41a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x156b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.747946:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b6640 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330314.747949:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db41a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x156b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.747954:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db41a lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x156b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.747961:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156b:0x0].0x0 (ffff88009d5fa500) 00010000:00010000:3.0:1715330314.747963:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330314.747966:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db41a lrc: 3/0,0 mode: --/PW res: [0x200000402:0x156b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.747970:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db41a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x156b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.747991:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db413 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.747995:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db413 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x156b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.747999:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db413 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.748002:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b6ac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.748005:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db413 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.748008:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db413 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x156b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.748013:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156b:0x0].0x0 (ffff88009d5fa500) 00010000:00010000:3.0:1715330314.748014:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330314.748016:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db413 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x156b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.748019:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db413 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x156b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.748099:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db405 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.748103:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db405 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.748107:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db405 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.748110:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db405 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.748114:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b7cc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.748116:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db405 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.748120:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db405 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.748125:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330314.748126:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330314.748128:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db405 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.748131:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db405 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330314.748137:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012faedf80 reply state ffff880091c46000 transno 4294984029 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db40c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.748143:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db40c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.748148:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ed6 (ffff880092dfd900) 00010000:00010000:3.0:1715330314.748149:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330314.748151:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330314.748198:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+676:18881:x1798653938107072:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 778us (1593us total) trans 4294984029 rc 0/0 00000100:00100000:3.0:1715330314.748203:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23764 00000100:00100000:0.0:1715330314.752602:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330314.753057:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938107200 00000100:00100000:1.0:1715330314.753066:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938107200 00000100:00100000:1.0:1715330314.753110:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23765 00000100:00100000:1.0:1715330314.753117:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+676:18881:x1798653938107200:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:1.0:1715330314.753163:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330314.753184:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087725440/0xd895711d66da851 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x156c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd31 expref: 676 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.753204:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156c:0x0].0x0 (ffff88008d699c00) 00010000:00010000:1.0:1715330314.753212:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330314.753233:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f3c0/0xd895711d66db421 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.753245:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f3c0/0xd895711d66db421 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.753252:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f3c0/0xd895711d66db421 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.753262:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f600/0xd895711d66db428 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989fd6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.753267:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f600/0xd895711d66db428 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.753272:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f600/0xd895711d66db428 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.753323:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e640/0xd895711d66db42f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x156c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.753328:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e640/0xd895711d66db42f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.753333:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e640/0xd895711d66db42f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:1.0:1715330314.753511:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2535, 64 off170432 00000040:00080000:1.0:1715330314.753608:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].374, 184 off73912 00010000:00010000:1.0:1715330314.753644:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5eac0/0xd895711d66db436 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x156c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.753650:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5eac0/0xd895711d66db436 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.753656:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5eac0/0xd895711d66db436 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.753661:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5eac0/0xd895711d66db436 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.753665:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5eac0/0xd895711d66db436 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.753673:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5eac0/0xd895711d66db436 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x156c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.753677:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5eac0/0xd895711d66db436 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x156c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.753681:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5eac0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:1.0:1715330314.753683:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5eac0/0xd895711d66db436 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x156c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.753688:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5eac0/0xd895711d66db436 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x156c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.753694:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156c:0x0].0x0 (ffff88009b985e00) 00010000:00010000:1.0:1715330314.753696:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1715330314.753699:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5eac0/0xd895711d66db436 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x156c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.753702:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5eac0/0xd895711d66db436 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x156c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.753720:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e640/0xd895711d66db42f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.753724:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e640/0xd895711d66db42f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x156c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.753747:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e640/0xd895711d66db42f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.753751:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5e640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330314.753753:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e640/0xd895711d66db42f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.753760:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e640/0xd895711d66db42f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x156c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.753765:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156c:0x0].0x0 (ffff88009b985e00) 00010000:00010000:1.0:1715330314.753766:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330314.753768:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e640/0xd895711d66db42f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x156c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.753772:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e640/0xd895711d66db42f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x156c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.753837:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f3c0/0xd895711d66db421 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.753843:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f3c0/0xd895711d66db421 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.753846:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f3c0/0xd895711d66db421 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.753850:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f3c0/0xd895711d66db421 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.753854:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5f3c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330314.753855:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f3c0/0xd895711d66db421 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.753860:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f3c0/0xd895711d66db421 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.753865:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:1.0:1715330314.753866:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330314.753868:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f3c0/0xd895711d66db421 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.753872:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f3c0/0xd895711d66db421 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:1.0:1715330314.753878:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012faeed80 reply state ffff8800939e1000 transno 4294984030 ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f600/0xd895711d66db428 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.753884:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f600/0xd895711d66db428 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.753888:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989fd6 (ffff88008d699700) 00010000:00010000:1.0:1715330314.753890:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330314.753892:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1715330314.753937:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+677:18881:x1798653938107200:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 820us (1343us total) trans 4294984030 rc 0/0 00000100:00100000:1.0:1715330314.753947:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23765 00000100:00100000:0.0:1715330314.759150:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.759255:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938107328 00000100:00100000:3.0:1715330314.759265:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938107328 00000100:00100000:3.0:1715330314.759313:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23766 00000100:00100000:3.0:1715330314.759320:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+677:18881:x1798653938107328:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1715330314.759369:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330314.759389:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087727840/0xd895711d66da874 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x156d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd38 expref: 677 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330314.759511:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156d:0x0].0x0 (ffff88008d699f00) 00010000:00010000:3.0:1715330314.759521:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330314.759545:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db43d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.759556:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db43d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.759564:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db43d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.759573:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db444 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a0d6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.759578:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db444 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.759583:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db444 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.759632:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db44b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x156d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.759638:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db44b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.759642:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db44b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330314.759856:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].34, 64 off10368 00000040:00080000:3.0:1715330314.759880:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].375, 184 off74096 00010000:00010000:3.0:1715330314.759911:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087725440/0xd895711d66db452 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x156d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.759916:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087725440/0xd895711d66db452 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.759922:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087725440/0xd895711d66db452 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.759926:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087725440/0xd895711d66db452 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.759931:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087725440/0xd895711d66db452 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.759935:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880087725440/0xd895711d66db452 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x156d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.759939:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880087725440/0xd895711d66db452 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x156d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.759943:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087725440 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330314.759946:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087725440/0xd895711d66db452 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x156d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.759952:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087725440/0xd895711d66db452 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x156d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.759957:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156d:0x0].0x0 (ffff88009d5fa900) 00010000:00010000:3.0:1715330314.759959:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330314.759962:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880087725440/0xd895711d66db452 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x156d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.759966:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087725440/0xd895711d66db452 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x156d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.759983:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db44b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.759987:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db44b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x156d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.759991:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db44b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.759995:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b6640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.759997:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db44b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.760001:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db44b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x156d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.760005:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156d:0x0].0x0 (ffff88009d5fa900) 00010000:00010000:3.0:1715330314.760007:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330314.760009:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db44b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x156d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.760013:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6640/0xd895711d66db44b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x156d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.760107:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db43d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.760112:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db43d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.760116:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db43d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.760121:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db43d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.760125:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b7cc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.760128:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db43d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.760132:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db43d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.760137:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330314.760140:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330314.760142:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db43d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.760146:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7cc0/0xd895711d66db43d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330314.760153:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012faeca80 reply state ffff880091c45000 transno 4294984031 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db444 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.760160:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db444 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.760164:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a0d6 (ffff88008d699e00) 00010000:00010000:3.0:1715330314.760166:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330314.760168:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330314.761145:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+678:18881:x1798653938107328:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 1820us (1998us total) trans 4294984031 rc 0/0 00000100:00100000:3.0:1715330314.761153:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23766 00000100:00100000:0.0:1715330314.766404:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.766585:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938107456 00000100:00100000:3.0:1715330314.766595:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938107456 00000100:00100000:3.0:1715330314.766652:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23767 00000100:00100000:3.0:1715330314.766659:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+678:18881:x1798653938107456:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1715330314.766706:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330314.766727:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087727180/0xd895711d66da897 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x156e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd3f expref: 678 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330314.766783:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156e:0x0].0x0 (ffff88008d699500) 00010000:00010000:3.0:1715330314.766791:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330314.766813:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087726f40/0xd895711d66db459 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.766823:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087726f40/0xd895711d66db459 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.766829:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087726f40/0xd895711d66db459 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.766837:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087725440/0xd895711d66db460 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a1d6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.766841:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087725440/0xd895711d66db460 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.766845:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087725440/0xd895711d66db460 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.766891:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880087727840/0xd895711d66db467 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x156e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.766895:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087727840/0xd895711d66db467 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.766899:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087727840/0xd895711d66db467 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330314.767080:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2536, 64 off170496 00000040:00080000:3.0:1715330314.767106:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].376, 184 off74280 00010000:00010000:3.0:1715330314.767141:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66db46e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x156e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.767147:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66db46e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.767153:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66db46e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.767158:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66db46e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.767162:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66db46e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.767166:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66db46e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x156e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.767170:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66db46e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x156e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.767174:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfdd40 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330314.767177:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66db46e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x156e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.767182:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66db46e lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x156e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.767188:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156e:0x0].0x0 (ffff88009d5fab00) 00010000:00010000:3.0:1715330314.767190:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330314.767192:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66db46e lrc: 3/0,0 mode: --/PW res: [0x200000402:0x156e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.767196:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66db46e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x156e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.767217:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880087727840/0xd895711d66db467 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.767221:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880087727840/0xd895711d66db467 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x156e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.767225:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880087727840/0xd895711d66db467 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.767228:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087727840 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.767231:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087727840/0xd895711d66db467 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.767234:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087727840/0xd895711d66db467 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x156e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.767239:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156e:0x0].0x0 (ffff88009d5fab00) 00010000:00010000:3.0:1715330314.767241:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330314.767242:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880087727840/0xd895711d66db467 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x156e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.767245:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087727840/0xd895711d66db467 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x156e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.767323:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087726f40/0xd895711d66db459 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.767328:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087726f40/0xd895711d66db459 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.767331:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880087726f40/0xd895711d66db459 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.767335:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880087726f40/0xd895711d66db459 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.767339:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087726f40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.767341:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087726f40/0xd895711d66db459 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.767345:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087726f40/0xd895711d66db459 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.767350:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330314.767352:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330314.767354:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880087726f40/0xd895711d66db459 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.767359:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087726f40/0xd895711d66db459 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330314.767365:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012faef480 reply state ffff880091c43000 transno 4294984032 ns: mdt-lustre-MDT0000_UUID lock: ffff880087725440/0xd895711d66db460 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.767372:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087725440/0xd895711d66db460 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.767377:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a1d6 (ffff88008d699400) 00010000:00010000:3.0:1715330314.767378:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330314.767381:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330314.767425:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+679:18881:x1798653938107456:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 767us (1030us total) trans 4294984032 rc 0/0 00000100:00100000:3.0:1715330314.767431:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23767 00000100:00100000:0.0:1715330314.772150:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330314.772334:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938107584 00000100:00100000:1.0:1715330314.772343:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938107584 00000100:00100000:1.0:1715330314.772388:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23768 00000100:00100000:1.0:1715330314.772395:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+679:18881:x1798653938107584:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:1.0:1715330314.772442:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330314.772464:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66da8ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x156f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd46 expref: 679 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.772489:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156f:0x0].0x0 (ffff88008b0d2e00) 00010000:00010000:1.0:1715330314.772498:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330314.772519:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ed00/0xd895711d66db475 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.772528:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ed00/0xd895711d66db475 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.772536:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ed00/0xd895711d66db475 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.772543:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5dd40/0xd895711d66db47c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a2d6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.772548:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5dd40/0xd895711d66db47c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.772552:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5dd40/0xd895711d66db47c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.772597:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e1c0/0xd895711d66db483 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x156f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.772602:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e1c0/0xd895711d66db483 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.772608:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e1c0/0xd895711d66db483 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:1.0:1715330314.772817:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].35, 64 off10432 00000040:00080000:1.0:1715330314.772841:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].377, 184 off74464 00010000:00010000:1.0:1715330314.772874:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e400/0xd895711d66db48a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x156f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.772881:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e400/0xd895711d66db48a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.772887:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e400/0xd895711d66db48a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.772892:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e400/0xd895711d66db48a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.772899:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e400/0xd895711d66db48a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.772903:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e400/0xd895711d66db48a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x156f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.772908:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e400/0xd895711d66db48a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x156f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.772912:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5e400 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:1.0:1715330314.772915:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e400/0xd895711d66db48a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x156f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.772920:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e400/0xd895711d66db48a lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x156f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.772925:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156f:0x0].0x0 (ffff88009b985d00) 00010000:00010000:1.0:1715330314.772927:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1715330314.772930:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e400/0xd895711d66db48a lrc: 3/0,0 mode: --/PW res: [0x200000402:0x156f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.772934:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e400/0xd895711d66db48a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x156f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.772952:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e1c0/0xd895711d66db483 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.772956:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e1c0/0xd895711d66db483 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x156f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.772959:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e1c0/0xd895711d66db483 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.772962:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5e1c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330314.772966:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e1c0/0xd895711d66db483 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.772970:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e1c0/0xd895711d66db483 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x156f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.772975:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156f:0x0].0x0 (ffff88009b985d00) 00010000:00010000:1.0:1715330314.772977:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330314.772979:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e1c0/0xd895711d66db483 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x156f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.772982:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e1c0/0xd895711d66db483 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x156f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.773078:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ed00/0xd895711d66db475 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.773083:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ed00/0xd895711d66db475 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.773087:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ed00/0xd895711d66db475 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.773091:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ed00/0xd895711d66db475 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.773094:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5ed00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330314.773097:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ed00/0xd895711d66db475 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.773100:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ed00/0xd895711d66db475 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.773106:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:1.0:1715330314.773107:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330314.773110:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ed00/0xd895711d66db475 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.773114:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ed00/0xd895711d66db475 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:1.0:1715330314.773120:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012faedc00 reply state ffff8800939e2000 transno 4294984033 ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5dd40/0xd895711d66db47c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.773126:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5dd40/0xd895711d66db47c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.773130:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a2d6 (ffff88008b0d2900) 00010000:00010000:1.0:1715330314.773132:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330314.773134:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1715330314.773186:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+680:18881:x1798653938107584:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 791us (1042us total) trans 4294984033 rc 0/0 00000100:00100000:1.0:1715330314.773191:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23768 00000100:00100000:0.0:1715330314.778666:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.778763:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938107712 00000100:00100000:3.0:1715330314.778770:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938107712 00000100:00100000:3.0:1715330314.778872:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23769 00000100:00100000:3.0:1715330314.778877:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+680:18881:x1798653938107712:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1715330314.778923:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330314.778944:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800877246c0/0xd895711d66da8dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1570:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd4d expref: 680 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330314.778969:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1570:0x0].0x0 (ffff88008d699800) 00010000:00010000:3.0:1715330314.778976:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330314.778997:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66db491 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.779006:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66db491 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.779012:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66db491 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.779018:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66db498 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a3d6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.779023:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66db498 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.779027:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66db498 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.779076:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66db49f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1570:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.779080:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66db49f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1570:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.779084:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66db49f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1570:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330314.779247:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2537, 64 off170560 00000040:00080000:3.0:1715330314.779272:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].378, 184 off74648 00010000:00010000:3.0:1715330314.779303:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66db4a6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1570:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.779309:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66db4a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1570:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.779314:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66db4a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1570:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.779319:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66db4a6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1570:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.779323:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66db4a6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1570:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.779327:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66db4a6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1570:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.779331:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66db4a6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1570:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.779335:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfdf80 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330314.779338:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66db4a6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1570:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.779342:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66db4a6 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1570:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.779347:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1570:0x0].0x0 (ffff88009d5fa000) 00010000:00010000:3.0:1715330314.779349:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330314.779351:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66db4a6 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1570:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.779355:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66db4a6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1570:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.779374:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66db49f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1570:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.779377:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66db49f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1570:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.779381:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66db49f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1570:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.779384:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfeac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.779387:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66db49f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1570:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.779390:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66db49f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1570:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.779394:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1570:0x0].0x0 (ffff88009d5fa000) 00010000:00010000:3.0:1715330314.779395:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330314.779397:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66db49f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1570:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.779400:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66db49f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1570:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.779632:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66db491 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.779636:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66db491 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.779640:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66db491 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.779643:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66db491 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.779647:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfc240 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.779649:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66db491 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.779653:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66db491 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.779657:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330314.779659:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330314.779661:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66db491 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.779664:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66db491 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330314.779670:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012faef100 reply state ffff88012fbbc000 transno 4294984034 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66db498 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.779677:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66db498 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.779681:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a3d6 (ffff88008d699200) 00010000:00010000:3.0:1715330314.779682:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330314.779684:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330314.779757:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+681:18881:x1798653938107712:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 851us (1071us total) trans 4294984034 rc 0/0 00000100:00100000:3.0:1715330314.779763:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23769 00000100:00100000:0.0:1715330314.782932:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330314.783254:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938107840 00000100:00100000:1.0:1715330314.783261:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938107840 00000100:00100000:1.0:1715330314.783305:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23770 00000100:00100000:1.0:1715330314.783311:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+681:18881:x1798653938107840:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:1.0:1715330314.783351:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330314.783370:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66da900 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1571:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd54 expref: 681 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.783393:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1571:0x0].0x0 (ffff88012ca48400) 00010000:00010000:1.0:1715330314.783400:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330314.783421:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d440/0xd895711d66db4ad lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.783433:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d440/0xd895711d66db4ad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.783439:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d440/0xd895711d66db4ad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.783445:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d8c0/0xd895711d66db4b4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989ad7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.783450:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d8c0/0xd895711d66db4b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.783454:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d8c0/0xd895711d66db4b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.783493:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5db00/0xd895711d66db4bb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1571:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.783497:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5db00/0xd895711d66db4bb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1571:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.783501:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5db00/0xd895711d66db4bb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1571:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:1.0:1715330314.783652:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].36, 64 off10496 00000040:00080000:1.0:1715330314.783672:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].379, 184 off74832 00010000:00010000:1.0:1715330314.783700:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cb40/0xd895711d66db4c2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1571:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.783706:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cb40/0xd895711d66db4c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1571:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.783710:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cb40/0xd895711d66db4c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1571:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.783719:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cb40/0xd895711d66db4c2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1571:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.783723:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cb40/0xd895711d66db4c2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1571:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.783726:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cb40/0xd895711d66db4c2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1571:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.783749:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cb40/0xd895711d66db4c2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1571:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.783753:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5cb40 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:1.0:1715330314.783756:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cb40/0xd895711d66db4c2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1571:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.783761:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cb40/0xd895711d66db4c2 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1571:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.783765:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1571:0x0].0x0 (ffff88009b985900) 00010000:00010000:1.0:1715330314.783767:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1715330314.783769:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cb40/0xd895711d66db4c2 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1571:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.783773:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cb40/0xd895711d66db4c2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1571:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.783789:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5db00/0xd895711d66db4bb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1571:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.783792:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5db00/0xd895711d66db4bb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1571:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.783796:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5db00/0xd895711d66db4bb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1571:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.783800:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5db00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330314.783802:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5db00/0xd895711d66db4bb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1571:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.783806:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5db00/0xd895711d66db4bb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1571:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.783810:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1571:0x0].0x0 (ffff88009b985900) 00010000:00010000:1.0:1715330314.783811:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330314.783813:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5db00/0xd895711d66db4bb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1571:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.783816:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5db00/0xd895711d66db4bb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1571:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.783898:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d440/0xd895711d66db4ad lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.783902:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d440/0xd895711d66db4ad lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.783905:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d440/0xd895711d66db4ad lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.783909:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d440/0xd895711d66db4ad lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.783912:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5d440 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330314.783914:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d440/0xd895711d66db4ad lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.783917:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d440/0xd895711d66db4ad lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.783925:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:1.0:1715330314.783926:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330314.783928:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d440/0xd895711d66db4ad lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.783932:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d440/0xd895711d66db4ad lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:1.0:1715330314.783937:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8801344c8700 reply state ffff8800939e3000 transno 4294984035 ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d8c0/0xd895711d66db4b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.783943:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d8c0/0xd895711d66db4b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.783947:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ad7 (ffff88012ca48900) 00010000:00010000:1.0:1715330314.783948:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330314.783950:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1715330314.783992:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+682:18881:x1798653938107840:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 681us (1068us total) trans 4294984035 rc 0/0 00000100:00100000:1.0:1715330314.783997:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23770 00000100:00100000:0.0:1715330314.788006:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.788108:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938107968 00000100:00100000:3.0:1715330314.788115:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938107968 00000100:00100000:3.0:1715330314.788655:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23771 00000100:00100000:3.0:1715330314.788662:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+682:18881:x1798653938107968:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1715330314.788713:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330314.788879:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdb00/0xd895711d66da923 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1572:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd5b expref: 682 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330314.788903:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1572:0x0].0x0 (ffff88008b0d2800) 00010000:00010000:3.0:1715330314.788911:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330314.788933:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66db4c9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.788943:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66db4c9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.788949:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66db4c9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.788957:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66db4d0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989bd7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.788963:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66db4d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.788967:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66db4d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.789014:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66db4d7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1572:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.789019:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66db4d7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1572:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.789023:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66db4d7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1572:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330314.789210:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2538, 64 off170624 00000040:00080000:3.0:1715330314.789232:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].380, 184 off75016 00010000:00010000:3.0:1715330314.789265:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66db4de lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1572:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.789272:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66db4de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1572:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.789277:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66db4de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1572:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.789282:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66db4de lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1572:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.789287:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66db4de lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1572:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.789291:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66db4de lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1572:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.789295:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66db4de lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1572:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.789299:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfdf80 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330314.789302:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66db4de lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1572:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.789307:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66db4de lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1572:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.789312:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1572:0x0].0x0 (ffff88009d5fae00) 00010000:00010000:3.0:1715330314.789314:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330314.789316:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66db4de lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1572:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.789320:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdf80/0xd895711d66db4de lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1572:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.789339:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66db4d7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1572:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.789343:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66db4d7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1572:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.789347:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66db4d7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1572:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.789350:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfeac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.789353:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66db4d7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1572:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.789357:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66db4d7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1572:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.789361:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1572:0x0].0x0 (ffff88009d5fae00) 00010000:00010000:3.0:1715330314.789363:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330314.789365:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66db4d7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1572:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.789369:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfeac0/0xd895711d66db4d7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1572:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.789448:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66db4c9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.789452:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66db4c9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.789456:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66db4c9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.789459:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66db4c9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.789464:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfdd40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.789466:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66db4c9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.789470:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66db4c9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.789475:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330314.789476:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330314.789478:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66db4c9 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.789482:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfdd40/0xd895711d66db4c9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330314.789488:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8801344cb800 reply state ffff88012fbbd000 transno 4294984036 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66db4d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.789495:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66db4d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.789500:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989bd7 (ffff88008b0d2d00) 00010000:00010000:3.0:1715330314.789501:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330314.789503:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330314.789563:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+683:18881:x1798653938107968:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 901us (1564us total) trans 4294984036 rc 0/0 00000100:00100000:3.0:1715330314.789570:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23771 00000100:00100000:0.0:1715330314.792845:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.792935:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938108096 00000100:00100000:3.0:1715330314.792943:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938108096 00000100:00100000:3.0:1715330314.792986:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23772 00000100:00100000:3.0:1715330314.792991:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+683:18881:x1798653938108096:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1715330314.793044:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330314.793064:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfed00/0xd895711d66da946 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1573:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd62 expref: 683 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330314.793077:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1573:0x0].0x0 (ffff88008b0d2400) 00010000:00010000:3.0:1715330314.793083:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330314.793105:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4b40/0xd895711d66db4e5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.793114:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4b40/0xd895711d66db4e5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.793121:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4b40/0xd895711d66db4e5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.793127:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab61c0/0xd895711d66db4ec lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989cd7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.793132:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab61c0/0xd895711d66db4ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.793136:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab61c0/0xd895711d66db4ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.793176:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab5b00/0xd895711d66db4f3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1573:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.793180:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab5b00/0xd895711d66db4f3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1573:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.793184:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab5b00/0xd895711d66db4f3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1573:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330314.793335:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].37, 64 off10560 00000040:00080000:3.0:1715330314.793354:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].381, 184 off75200 00010000:00010000:3.0:1715330314.793381:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab46c0/0xd895711d66db4fa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1573:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.793387:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab46c0/0xd895711d66db4fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1573:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.793391:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab46c0/0xd895711d66db4fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1573:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.793396:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab46c0/0xd895711d66db4fa lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1573:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.793400:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab46c0/0xd895711d66db4fa lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1573:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.793404:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab46c0/0xd895711d66db4fa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1573:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.793408:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab46c0/0xd895711d66db4fa lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1573:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.793412:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078ab46c0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330314.793415:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab46c0/0xd895711d66db4fa lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1573:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.793420:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab46c0/0xd895711d66db4fa lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1573:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.793424:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1573:0x0].0x0 (ffff88009d5fa900) 00010000:00010000:3.0:1715330314.793426:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330314.793429:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab46c0/0xd895711d66db4fa lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1573:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.793433:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab46c0/0xd895711d66db4fa lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1573:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.793449:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab5b00/0xd895711d66db4f3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1573:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.793453:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab5b00/0xd895711d66db4f3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1573:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.793457:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab5b00/0xd895711d66db4f3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1573:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.793460:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078ab5b00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.793462:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab5b00/0xd895711d66db4f3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1573:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.793465:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab5b00/0xd895711d66db4f3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1573:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.793469:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1573:0x0].0x0 (ffff88009d5fa900) 00010000:00010000:3.0:1715330314.793471:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330314.793472:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab5b00/0xd895711d66db4f3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1573:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.793475:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab5b00/0xd895711d66db4f3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1573:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.793543:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4b40/0xd895711d66db4e5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.793547:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4b40/0xd895711d66db4e5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.793551:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4b40/0xd895711d66db4e5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.793554:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4b40/0xd895711d66db4e5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.793558:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078ab4b40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.793560:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4b40/0xd895711d66db4e5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.793564:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4b40/0xd895711d66db4e5 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.793568:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330314.793569:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330314.793571:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4b40/0xd895711d66db4e5 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.793575:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4b40/0xd895711d66db4e5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330314.793580:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8801344c8380 reply state ffff88012fbb8000 transno 4294984037 ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab61c0/0xd895711d66db4ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.793586:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab61c0/0xd895711d66db4ec lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.793590:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989cd7 (ffff88008b0d2200) 00010000:00010000:3.0:1715330314.793592:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330314.793593:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330314.795498:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+684:18881:x1798653938108096:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 1862us (2017us total) trans 4294984037 rc 0/0 00000100:00100000:3.0:1715330314.795509:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23772 00000100:00100000:1.0:1715330314.798184:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.798321:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938108224 00000100:00100000:3.0:1715330314.798330:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938108224 00000100:00100000:3.0:1715330314.798365:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23773 00000100:00100000:3.0:1715330314.798370:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+684:18881:x1798653938108224:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1715330314.798416:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330314.798438:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0d80/0xd895711d66da969 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1574:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd69 expref: 684 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330314.798451:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1574:0x0].0x0 (ffff88012ca48c00) 00010000:00010000:3.0:1715330314.798458:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330314.798479:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab73c0/0xd895711d66db501 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.798488:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab73c0/0xd895711d66db501 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.798495:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab73c0/0xd895711d66db501 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.798501:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab7a80/0xd895711d66db508 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989dd7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.798506:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab7a80/0xd895711d66db508 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.798511:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab7a80/0xd895711d66db508 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.798555:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4900/0xd895711d66db50f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1574:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.798559:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4900/0xd895711d66db50f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1574:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.798563:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4900/0xd895711d66db50f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1574:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330314.798764:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2539, 64 off170688 00000040:00080000:3.0:1715330314.798792:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].382, 184 off75384 00010000:00010000:3.0:1715330314.798826:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6400/0xd895711d66db516 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1574:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.798832:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6400/0xd895711d66db516 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1574:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.798838:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6400/0xd895711d66db516 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1574:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.798845:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6400/0xd895711d66db516 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1574:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.798849:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6400/0xd895711d66db516 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1574:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.798854:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6400/0xd895711d66db516 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1574:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.798858:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6400/0xd895711d66db516 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1574:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.798864:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078ab6400 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330314.798867:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6400/0xd895711d66db516 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1574:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.798873:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6400/0xd895711d66db516 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1574:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.798880:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1574:0x0].0x0 (ffff88009d5fa500) 00010000:00010000:3.0:1715330314.798882:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330314.798885:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6400/0xd895711d66db516 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1574:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.798890:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6400/0xd895711d66db516 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1574:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.798908:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4900/0xd895711d66db50f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1574:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.798912:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4900/0xd895711d66db50f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1574:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.798917:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4900/0xd895711d66db50f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1574:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.798920:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078ab4900 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.798922:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4900/0xd895711d66db50f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1574:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.798925:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4900/0xd895711d66db50f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1574:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.798930:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1574:0x0].0x0 (ffff88009d5fa500) 00010000:00010000:3.0:1715330314.798931:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330314.798933:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4900/0xd895711d66db50f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1574:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.798937:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4900/0xd895711d66db50f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1574:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.799009:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab73c0/0xd895711d66db501 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.799014:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab73c0/0xd895711d66db501 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.799019:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab73c0/0xd895711d66db501 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.799022:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab73c0/0xd895711d66db501 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.799026:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078ab73c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.799028:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab73c0/0xd895711d66db501 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.799041:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab73c0/0xd895711d66db501 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.799046:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330314.799048:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330314.799050:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab73c0/0xd895711d66db501 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.799053:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab73c0/0xd895711d66db501 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330314.799059:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007d629500 reply state ffff88012fbb9000 transno 4294984038 ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab7a80/0xd895711d66db508 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.799065:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab7a80/0xd895711d66db508 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.799069:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989dd7 (ffff88012ca48f00) 00010000:00010000:3.0:1715330314.799071:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330314.799073:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330314.799120:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+685:18881:x1798653938108224:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 748us (940us total) trans 4294984038 rc 0/0 00000100:00100000:3.0:1715330314.799125:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23773 00000100:00100000:0.0:1715330314.803229:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330314.803527:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938108352 00000100:00100000:1.0:1715330314.803535:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938108352 00000100:00100000:1.0:1715330314.803576:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23774 00000100:00100000:1.0:1715330314.803581:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+685:18881:x1798653938108352:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:1.0:1715330314.803625:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330314.803644:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087725f80/0xd895711d66da98c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1575:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd70 expref: 685 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.803670:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1575:0x0].0x0 (ffff88008d699d00) 00010000:00010000:1.0:1715330314.803677:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330314.803696:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cfc0/0xd895711d66db51d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.803704:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cfc0/0xd895711d66db51d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.803711:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cfc0/0xd895711d66db51d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.803718:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d200/0xd895711d66db524 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989ed7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.803723:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d200/0xd895711d66db524 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.803726:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d200/0xd895711d66db524 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.803796:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c240/0xd895711d66db52b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1575:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.803801:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c240/0xd895711d66db52b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1575:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.803805:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c240/0xd895711d66db52b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1575:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:1.0:1715330314.803956:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].38, 64 off10624 00000040:00080000:1.0:1715330314.803977:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].383, 184 off75568 00010000:00010000:1.0:1715330314.804006:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c6c0/0xd895711d66db532 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1575:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.804012:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c6c0/0xd895711d66db532 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1575:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.804017:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c6c0/0xd895711d66db532 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1575:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.804022:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c6c0/0xd895711d66db532 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1575:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.804026:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c6c0/0xd895711d66db532 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1575:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.804042:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c6c0/0xd895711d66db532 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1575:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.804047:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c6c0/0xd895711d66db532 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1575:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.804051:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5c6c0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:1.0:1715330314.804054:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c6c0/0xd895711d66db532 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1575:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.804058:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c6c0/0xd895711d66db532 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1575:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.804063:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1575:0x0].0x0 (ffff88009b985c00) 00010000:00010000:1.0:1715330314.804065:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1715330314.804067:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c6c0/0xd895711d66db532 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1575:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.804071:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c6c0/0xd895711d66db532 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1575:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.804087:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c240/0xd895711d66db52b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1575:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.804092:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c240/0xd895711d66db52b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1575:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.804095:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c240/0xd895711d66db52b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1575:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.804098:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5c240 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330314.804101:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c240/0xd895711d66db52b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1575:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.804104:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c240/0xd895711d66db52b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1575:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.804108:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1575:0x0].0x0 (ffff88009b985c00) 00010000:00010000:1.0:1715330314.804109:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330314.804111:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c240/0xd895711d66db52b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1575:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.804114:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c240/0xd895711d66db52b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1575:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.804184:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cfc0/0xd895711d66db51d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.804187:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cfc0/0xd895711d66db51d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.804191:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cfc0/0xd895711d66db51d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.804194:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cfc0/0xd895711d66db51d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.804197:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5cfc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330314.804199:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cfc0/0xd895711d66db51d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.804203:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cfc0/0xd895711d66db51d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.804208:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:1.0:1715330314.804209:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330314.804211:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cfc0/0xd895711d66db51d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.804214:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cfc0/0xd895711d66db51d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:1.0:1715330314.804219:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8801344c9500 reply state ffff8800939e4000 transno 4294984039 ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d200/0xd895711d66db524 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.804225:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d200/0xd895711d66db524 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.804229:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ed7 (ffff88008d699900) 00010000:00010000:1.0:1715330314.804231:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330314.804232:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1715330314.804279:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+686:18881:x1798653938108352:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 696us (1056us total) trans 4294984039 rc 0/0 00000100:00100000:1.0:1715330314.804285:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23774 00000100:00100000:0.0:1715330314.807602:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.808490:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938108480 00000100:00100000:3.0:1715330314.808500:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938108480 00000100:00100000:3.0:1715330314.808544:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23775 00000100:00100000:3.0:1715330314.808551:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+686:18881:x1798653938108480:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1715330314.808596:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330314.808615:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66da9af lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1576:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd77 expref: 686 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330314.809312:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1576:0x0].0x0 (ffff88012ca48d00) 00010000:00010000:3.0:1715330314.809325:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330314.809352:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6ac0/0xd895711d66db539 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.809363:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6ac0/0xd895711d66db539 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.809370:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6ac0/0xd895711d66db539 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.809376:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6f40/0xd895711d66db540 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989fd7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.809381:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6f40/0xd895711d66db540 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.809385:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6f40/0xd895711d66db540 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.809432:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4fc0/0xd895711d66db547 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1576:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.809437:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4fc0/0xd895711d66db547 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1576:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.809442:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4fc0/0xd895711d66db547 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1576:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330314.809627:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2540, 64 off170752 00000040:00080000:3.0:1715330314.809655:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].384, 184 off75752 00010000:00010000:3.0:1715330314.809689:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6d00/0xd895711d66db54e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1576:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.809695:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6d00/0xd895711d66db54e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1576:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.809701:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6d00/0xd895711d66db54e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1576:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.809706:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6d00/0xd895711d66db54e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1576:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.809711:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6d00/0xd895711d66db54e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1576:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.809715:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6d00/0xd895711d66db54e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1576:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.809720:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6d00/0xd895711d66db54e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1576:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.809725:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078ab6d00 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330314.809728:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6d00/0xd895711d66db54e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1576:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.809752:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6d00/0xd895711d66db54e lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1576:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.809759:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1576:0x0].0x0 (ffff88009d5fa700) 00010000:00010000:3.0:1715330314.809761:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330314.809764:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6d00/0xd895711d66db54e lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1576:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.809768:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6d00/0xd895711d66db54e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1576:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.809790:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4fc0/0xd895711d66db547 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1576:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.809794:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4fc0/0xd895711d66db547 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1576:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.809798:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4fc0/0xd895711d66db547 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1576:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.809802:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078ab4fc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.809805:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4fc0/0xd895711d66db547 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1576:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.809808:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4fc0/0xd895711d66db547 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1576:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.809814:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1576:0x0].0x0 (ffff88009d5fa700) 00010000:00010000:3.0:1715330314.809815:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330314.809817:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4fc0/0xd895711d66db547 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1576:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.809821:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4fc0/0xd895711d66db547 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1576:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.810508:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6ac0/0xd895711d66db539 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.810515:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6ac0/0xd895711d66db539 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.810520:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6ac0/0xd895711d66db539 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.810525:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6ac0/0xd895711d66db539 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.810530:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078ab6ac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.810532:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6ac0/0xd895711d66db539 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.810537:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6ac0/0xd895711d66db539 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.810544:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330314.810546:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330314.810548:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6ac0/0xd895711d66db539 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.810553:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6ac0/0xd895711d66db539 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330314.810561:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8801344c9c00 reply state ffff88012fbbb000 transno 4294984040 ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6f40/0xd895711d66db540 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.810568:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6f40/0xd895711d66db540 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.810574:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989fd7 (ffff88012ca48600) 00010000:00010000:3.0:1715330314.810576:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330314.810579:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330314.810668:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+687:18881:x1798653938108480:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 2115us (3071us total) trans 4294984040 rc 0/0 00000100:00100000:3.0:1715330314.810677:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23775 00000100:00100000:1.0:1715330314.817294:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.817395:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938108608 00000100:00100000:3.0:1715330314.817404:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938108608 00000100:00100000:3.0:1715330314.817444:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23776 00000100:00100000:3.0:1715330314.817451:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+687:18881:x1798653938108608:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1715330314.817501:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330314.817524:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087724240/0xd895711d66da9d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1577:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd7e expref: 687 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330314.817538:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1577:0x0].0x0 (ffff88008d699600) 00010000:00010000:3.0:1715330314.817546:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330314.817567:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab7840/0xd895711d66db555 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.817577:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab7840/0xd895711d66db555 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.817583:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab7840/0xd895711d66db555 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.817591:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4fc0/0xd895711d66db55c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a0d7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.817597:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4fc0/0xd895711d66db55c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.817602:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4fc0/0xd895711d66db55c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.817651:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6d00/0xd895711d66db563 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1577:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.817657:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6d00/0xd895711d66db563 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1577:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.817661:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6d00/0xd895711d66db563 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1577:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330314.817867:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].39, 64 off10688 00000040:00080000:3.0:1715330314.817891:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].385, 184 off75936 00010000:00010000:3.0:1715330314.817924:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab73c0/0xd895711d66db56a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1577:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.817931:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab73c0/0xd895711d66db56a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1577:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.817936:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab73c0/0xd895711d66db56a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1577:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.817941:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab73c0/0xd895711d66db56a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1577:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.817946:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab73c0/0xd895711d66db56a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1577:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.817950:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab73c0/0xd895711d66db56a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1577:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.817954:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab73c0/0xd895711d66db56a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1577:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.817959:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078ab73c0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330314.817962:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab73c0/0xd895711d66db56a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1577:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.817967:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab73c0/0xd895711d66db56a lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1577:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.817973:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1577:0x0].0x0 (ffff88009d5fac00) 00010000:00010000:3.0:1715330314.817975:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330314.817977:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab73c0/0xd895711d66db56a lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1577:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.817981:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab73c0/0xd895711d66db56a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1577:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.817999:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6d00/0xd895711d66db563 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1577:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.818004:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6d00/0xd895711d66db563 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1577:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.818008:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6d00/0xd895711d66db563 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1577:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.818012:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078ab6d00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.818015:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6d00/0xd895711d66db563 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1577:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.818019:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6d00/0xd895711d66db563 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1577:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.818024:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1577:0x0].0x0 (ffff88009d5fac00) 00010000:00010000:3.0:1715330314.818026:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330314.818041:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6d00/0xd895711d66db563 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1577:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.818046:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6d00/0xd895711d66db563 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1577:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.818125:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab7840/0xd895711d66db555 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.818130:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab7840/0xd895711d66db555 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.818135:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab7840/0xd895711d66db555 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.818138:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab7840/0xd895711d66db555 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.818141:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078ab7840 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.818144:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab7840/0xd895711d66db555 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.818147:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab7840/0xd895711d66db555 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.818153:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330314.818155:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330314.818157:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab7840/0xd895711d66db555 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.818161:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab7840/0xd895711d66db555 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330314.818168:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007d629180 reply state ffff88012fbbf000 transno 4294984041 ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4fc0/0xd895711d66db55c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.818175:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4fc0/0xd895711d66db55c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.818179:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a0d7 (ffff88008d699b00) 00010000:00010000:3.0:1715330314.818181:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330314.818183:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330314.822879:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+688:18881:x1798653938108608:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 5417us (5584us total) trans 4294984041 rc 0/0 00000100:00100000:3.0:1715330314.822890:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23776 00000100:00100000:0.0:1715330314.827998:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.828245:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938108736 00000100:00100000:3.0:1715330314.828254:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938108736 00000100:00100000:3.0:1715330314.828512:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23777 00000100:00100000:3.0:1715330314.828518:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+688:18881:x1798653938108736:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1715330314.828564:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330314.828585:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800877273c0/0xd895711d66da9f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1578:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd85 expref: 688 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330314.828598:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1578:0x0].0x0 (ffff88008d699a00) 00010000:00010000:3.0:1715330314.828607:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330314.828626:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4900/0xd895711d66db571 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.828636:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4900/0xd895711d66db571 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.828642:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4900/0xd895711d66db571 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.828649:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6400/0xd895711d66db578 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a1d7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.828653:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6400/0xd895711d66db578 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.828657:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6400/0xd895711d66db578 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.828699:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4b40/0xd895711d66db57f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1578:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.828704:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4b40/0xd895711d66db57f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1578:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.828708:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4b40/0xd895711d66db57f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1578:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330314.829254:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2541, 64 off170816 00000040:00080000:3.0:1715330314.829278:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].386, 184 off76120 00010000:00010000:3.0:1715330314.829310:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab5b00/0xd895711d66db586 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1578:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.829316:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab5b00/0xd895711d66db586 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1578:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.829322:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab5b00/0xd895711d66db586 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1578:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.829327:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab5b00/0xd895711d66db586 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1578:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.829332:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab5b00/0xd895711d66db586 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1578:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.829336:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab5b00/0xd895711d66db586 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1578:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.829340:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab5b00/0xd895711d66db586 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1578:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.829345:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078ab5b00 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330314.829347:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab5b00/0xd895711d66db586 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1578:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.829352:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab5b00/0xd895711d66db586 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1578:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.829358:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1578:0x0].0x0 (ffff88009d5fa100) 00010000:00010000:3.0:1715330314.829360:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330314.829362:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab5b00/0xd895711d66db586 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1578:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.829365:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab5b00/0xd895711d66db586 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1578:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.829383:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4b40/0xd895711d66db57f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1578:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.829387:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4b40/0xd895711d66db57f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1578:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.829391:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4b40/0xd895711d66db57f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1578:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.829394:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078ab4b40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.829397:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4b40/0xd895711d66db57f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1578:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.829400:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4b40/0xd895711d66db57f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1578:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.829404:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1578:0x0].0x0 (ffff88009d5fa100) 00010000:00010000:3.0:1715330314.829405:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330314.829407:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4b40/0xd895711d66db57f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1578:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.829410:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4b40/0xd895711d66db57f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1578:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.829480:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4900/0xd895711d66db571 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.829484:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4900/0xd895711d66db571 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.829487:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4900/0xd895711d66db571 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.829491:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4900/0xd895711d66db571 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.829494:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078ab4900 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.829496:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4900/0xd895711d66db571 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.829500:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4900/0xd895711d66db571 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.829504:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330314.829506:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330314.829507:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4900/0xd895711d66db571 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.829511:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4900/0xd895711d66db571 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330314.829516:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8801344caa00 reply state ffff88008b189000 transno 4294984042 ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6400/0xd895711d66db578 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.829522:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6400/0xd895711d66db578 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.829526:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a1d7 (ffff88008d699100) 00010000:00010000:3.0:1715330314.829528:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330314.829530:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330314.831645:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+689:18881:x1798653938108736:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 3119us (3646us total) trans 4294984042 rc 0/0 00000100:00100000:3.0:1715330314.831655:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23777 00000100:00100000:0.0:1715330314.850149:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.850335:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938108864 00000100:00100000:3.0:1715330314.850344:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938108864 00000100:00100000:3.0:1715330314.850378:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23778 00000100:00100000:3.0:1715330314.850384:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+689:18881:x1798653938108864:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1715330314.850429:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330314.850448:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087724b40/0xd895711d66daa18 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1579:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd8c expref: 689 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330314.850904:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1579:0x0].0x0 (ffff8800b4184800) 00010000:00010000:3.0:1715330314.850914:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330314.850936:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab46c0/0xd895711d66db58d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.850946:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab46c0/0xd895711d66db58d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.850953:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab46c0/0xd895711d66db58d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.850960:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4900/0xd895711d66db594 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a2d7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.850965:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4900/0xd895711d66db594 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.850969:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4900/0xd895711d66db594 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.851009:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4b40/0xd895711d66db59b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1579:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.851013:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4b40/0xd895711d66db59b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1579:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.851017:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4b40/0xd895711d66db59b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1579:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:3.0:1715330314.851190:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].40, 64 off10752 00000040:00080000:3.0:1715330314.851211:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].387, 184 off76304 00010000:00010000:3.0:1715330314.851239:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab5b00/0xd895711d66db5a2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1579:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.851245:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab5b00/0xd895711d66db5a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1579:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.851251:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab5b00/0xd895711d66db5a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1579:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.851256:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab5b00/0xd895711d66db5a2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1579:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.851260:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab5b00/0xd895711d66db5a2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1579:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.851265:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab5b00/0xd895711d66db5a2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1579:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.851269:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab5b00/0xd895711d66db5a2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1579:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.851273:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078ab5b00 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330314.851275:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab5b00/0xd895711d66db5a2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1579:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.851280:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab5b00/0xd895711d66db5a2 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1579:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.851285:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1579:0x0].0x0 (ffff88009d5faf00) 00010000:00010000:3.0:1715330314.851287:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330314.851289:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab5b00/0xd895711d66db5a2 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1579:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.851293:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab5b00/0xd895711d66db5a2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1579:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.851310:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4b40/0xd895711d66db59b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1579:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.851315:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4b40/0xd895711d66db59b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1579:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.851319:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4b40/0xd895711d66db59b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1579:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.851322:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078ab4b40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.851325:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4b40/0xd895711d66db59b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1579:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.851328:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4b40/0xd895711d66db59b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1579:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.851332:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1579:0x0].0x0 (ffff88009d5faf00) 00010000:00010000:3.0:1715330314.851333:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330314.851335:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4b40/0xd895711d66db59b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1579:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.851338:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4b40/0xd895711d66db59b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1579:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.851405:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab46c0/0xd895711d66db58d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.851409:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab46c0/0xd895711d66db58d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.851412:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab46c0/0xd895711d66db58d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.851416:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab46c0/0xd895711d66db58d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.851420:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078ab46c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.851422:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab46c0/0xd895711d66db58d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.851426:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab46c0/0xd895711d66db58d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.851430:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330314.851432:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330314.851433:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab46c0/0xd895711d66db58d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.851437:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab46c0/0xd895711d66db58d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330314.851442:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8801344cad80 reply state ffff88008b18c000 transno 4294984043 ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4900/0xd895711d66db594 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.851448:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4900/0xd895711d66db594 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330314.851453:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a2d7 (ffff8800b4184000) 00010000:00010000:3.0:1715330314.851454:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330314.851456:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330314.851503:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+690:18881:x1798653938108864:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 1118us (1360us total) trans 4294984043 rc 0/0 00000100:00100000:3.0:1715330314.851509:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23778 00000100:00100000:0.0:1715330314.857771:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330314.857797:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938108992 00000100:00100000:0.0:1715330314.857804:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938108992 00000100:00100000:0.0:1715330314.857851:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23779 00000100:00100000:0.0:1715330314.857856:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+690:18881:x1798653938108992:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1715330314.857901:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330314.857921:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087724000/0xd895711d66daa3b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x157a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd93 expref: 690 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330314.857942:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157a:0x0].0x0 (ffff8800b4184b00) 00010000:00010000:0.0:1715330314.857950:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715330314.857976:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66db5a9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.857985:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66db5a9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.857992:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66db5a9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.858001:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66db5b0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a3d7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.858006:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66db5b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.858010:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66db5b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.858092:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3a80/0xd895711d66db5b7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x157a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.858097:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3a80/0xd895711d66db5b7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330314.858101:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3a80/0xd895711d66db5b7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:1.0:1715330314.859348:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2542, 64 off170880 00000040:00080000:1.0:1715330314.859370:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].388, 184 off76488 00010000:00010000:1.0:1715330314.859405:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cfc0/0xd895711d66db5be lrc: 3/0,1 mode: --/PW res: [0x200000402:0x157a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.859413:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cfc0/0xd895711d66db5be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.859419:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cfc0/0xd895711d66db5be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.859424:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cfc0/0xd895711d66db5be lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.859428:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cfc0/0xd895711d66db5be lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.859432:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cfc0/0xd895711d66db5be lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x157a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.859436:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cfc0/0xd895711d66db5be lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x157a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.859441:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5cfc0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:1.0:1715330314.859443:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cfc0/0xd895711d66db5be lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x157a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.859448:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cfc0/0xd895711d66db5be lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x157a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.859454:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157a:0x0].0x0 (ffff8800aa391b00) 00010000:00010000:1.0:1715330314.859456:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1715330314.859458:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cfc0/0xd895711d66db5be lrc: 3/0,0 mode: --/PW res: [0x200000402:0x157a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.859461:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cfc0/0xd895711d66db5be lrc: 0/0,0 mode: --/PW res: [0x200000402:0x157a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.859483:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3a80/0xd895711d66db5b7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.859486:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3a80/0xd895711d66db5b7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x157a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.859491:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3a80/0xd895711d66db5b7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.859494:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a3a80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330314.859497:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3a80/0xd895711d66db5b7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.859500:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3a80/0xd895711d66db5b7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x157a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.859504:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157a:0x0].0x0 (ffff8800aa391b00) 00010000:00010000:1.0:1715330314.859505:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330314.859507:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3a80/0xd895711d66db5b7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x157a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.859510:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3a80/0xd895711d66db5b7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x157a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.859581:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66db5a9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.859585:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66db5a9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.859589:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66db5a9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.859592:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66db5a9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.859595:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a06c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330314.859597:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66db5a9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.859603:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66db5a9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.859608:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:1.0:1715330314.859610:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330314.859611:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66db5a9 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.859615:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66db5a9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:1.0:1715330314.859620:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8801344ca680 reply state ffff880091e55000 transno 4294984044 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66db5b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.859626:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66db5b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.859630:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a3d7 (ffff8800b4184d00) 00010000:00010000:1.0:1715330314.859632:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330314.859634:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1715330314.859685:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+691:18881:x1798653938108992:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 1827us (1920us total) trans 4294984044 rc 0/0 00000100:00100000:1.0:1715330314.859691:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23779 00000100:00100000:3.0:1715330314.873443:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330314.873508:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938109120 00000100:00100000:1.0:1715330314.873517:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938109120 00000100:00100000:1.0:1715330314.873575:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23780 00000100:00100000:1.0:1715330314.873584:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+691:18881:x1798653938109120:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:1.0:1715330314.873643:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330314.873670:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087727600/0xd895711d66daa5e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x157b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbd9a expref: 691 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330314.873706:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157b:0x0].0x0 (ffff88009d5fa200) 00010000:00010000:1.0:1715330314.873716:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330314.873773:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c240/0xd895711d66db5c5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.873785:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c240/0xd895711d66db5c5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.873793:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c240/0xd895711d66db5c5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.873800:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c6c0/0xd895711d66db5cc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989ad8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.873805:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c6c0/0xd895711d66db5cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.873809:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c6c0/0xd895711d66db5cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.873858:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c900/0xd895711d66db5d3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x157b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.873863:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c900/0xd895711d66db5d3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.873868:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c900/0xd895711d66db5d3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:1.0:1715330314.874076:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].41, 64 off10816 00000040:00080000:1.0:1715330314.874100:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].389, 184 off76672 00010000:00010000:1.0:1715330314.874131:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c000/0xd895711d66db5da lrc: 3/0,1 mode: --/PW res: [0x200000402:0x157b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.874138:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c000/0xd895711d66db5da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.874143:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c000/0xd895711d66db5da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.874149:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c000/0xd895711d66db5da lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.874154:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c000/0xd895711d66db5da lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.874158:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c000/0xd895711d66db5da lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x157b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.874162:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c000/0xd895711d66db5da lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x157b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.874166:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5c000 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:1.0:1715330314.874168:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c000/0xd895711d66db5da lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x157b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.874174:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c000/0xd895711d66db5da lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x157b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.874181:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157b:0x0].0x0 (ffff88009b985c00) 00010000:00010000:1.0:1715330314.874184:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1715330314.874187:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c000/0xd895711d66db5da lrc: 3/0,0 mode: --/PW res: [0x200000402:0x157b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.874192:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c000/0xd895711d66db5da lrc: 0/0,0 mode: --/PW res: [0x200000402:0x157b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.874213:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c900/0xd895711d66db5d3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.874218:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c900/0xd895711d66db5d3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x157b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.874222:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c900/0xd895711d66db5d3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.874226:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5c900 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330314.874228:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c900/0xd895711d66db5d3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.874232:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c900/0xd895711d66db5d3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x157b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.874237:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157b:0x0].0x0 (ffff88009b985c00) 00010000:00010000:1.0:1715330314.874239:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330314.874241:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c900/0xd895711d66db5d3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x157b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.874245:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c900/0xd895711d66db5d3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x157b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.874325:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c240/0xd895711d66db5c5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.874330:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c240/0xd895711d66db5c5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.874335:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c240/0xd895711d66db5c5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.874339:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c240/0xd895711d66db5c5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.874343:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5c240 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330314.874346:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c240/0xd895711d66db5c5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.874350:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c240/0xd895711d66db5c5 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.874356:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:1.0:1715330314.874358:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330314.874360:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c240/0xd895711d66db5c5 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.874365:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c240/0xd895711d66db5c5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:1.0:1715330314.874372:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009b4c1880 reply state ffff88009d7c4000 transno 4294984045 ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c6c0/0xd895711d66db5cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.874379:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c6c0/0xd895711d66db5cc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330314.874383:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ad8 (ffff88009d5faa00) 00010000:00010000:1.0:1715330314.874385:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330314.874386:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1715330314.876167:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+692:18881:x1798653938109120:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 2575us (2724us total) trans 4294984045 rc 0/0 00000100:00100000:1.0:1715330314.876177:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23780 00000100:00100000:1.0:1715330314.882067:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330314.882128:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938109248 00000100:00100000:2.0:1715330314.882137:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938109248 00000100:00100000:2.0:1715330314.882183:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23781 00000100:00100000:2.0:1715330314.882190:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+692:18881:x1798653938109248:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:2.0:1715330314.882236:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330314.882257:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff3c0/0xd895711d66daa81 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x157c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbda1 expref: 692 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330314.882276:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157c:0x0].0x0 (ffff88008b0d2f00) 00010000:00010000:2.0:1715330314.882284:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330314.882307:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7180/0xd895711d66db5e1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.882317:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7180/0xd895711d66db5e1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.882323:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7180/0xd895711d66db5e1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.882329:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b73c0/0xd895711d66db5e8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989bd8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.882334:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b73c0/0xd895711d66db5e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.882339:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b73c0/0xd895711d66db5e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.882382:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6400/0xd895711d66db5ef lrc: 3/0,1 mode: --/EX res: [0x200000402:0x157c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.882388:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6400/0xd895711d66db5ef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.882393:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6400/0xd895711d66db5ef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:2.0:1715330314.882572:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2543, 64 off170944 00000040:00080000:2.0:1715330314.882598:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].390, 184 off76856 00010000:00010000:2.0:1715330314.882628:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6880/0xd895711d66db5f6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x157c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.882634:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6880/0xd895711d66db5f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.882639:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6880/0xd895711d66db5f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.882644:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6880/0xd895711d66db5f6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.882648:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6880/0xd895711d66db5f6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.882653:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6880/0xd895711d66db5f6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x157c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.882657:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6880/0xd895711d66db5f6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x157c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.882661:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b6880 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330314.882664:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6880/0xd895711d66db5f6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x157c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.882668:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6880/0xd895711d66db5f6 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x157c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.882674:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157c:0x0].0x0 (ffff880093a11c00) 00010000:00010000:2.0:1715330314.882677:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1715330314.882679:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6880/0xd895711d66db5f6 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x157c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.882683:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6880/0xd895711d66db5f6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x157c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.882699:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6400/0xd895711d66db5ef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.882702:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6400/0xd895711d66db5ef lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x157c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.882706:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6400/0xd895711d66db5ef lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.882709:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b6400 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.882712:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6400/0xd895711d66db5ef lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.882716:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6400/0xd895711d66db5ef lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x157c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.882721:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157c:0x0].0x0 (ffff880093a11c00) 00010000:00010000:2.0:1715330314.882722:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330314.882724:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6400/0xd895711d66db5ef lrc: 2/0,0 mode: --/EX res: [0x200000402:0x157c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.882727:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6400/0xd895711d66db5ef lrc: 0/0,0 mode: --/EX res: [0x200000402:0x157c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.882830:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7180/0xd895711d66db5e1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.882835:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7180/0xd895711d66db5e1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.882839:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7180/0xd895711d66db5e1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.882842:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7180/0xd895711d66db5e1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.882846:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b7180 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.882847:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7180/0xd895711d66db5e1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.882851:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7180/0xd895711d66db5e1 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.889941:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330314.889947:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330314.889953:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7180/0xd895711d66db5e1 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.889961:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7180/0xd895711d66db5e1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:2.0:1715330314.889977:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012fa4f800 reply state ffff88009c61a000 transno 4294984046 ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b73c0/0xd895711d66db5e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.889985:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b73c0/0xd895711d66db5e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330314.889991:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989bd8 (ffff88008b0d2300) 00010000:00010000:2.0:1715330314.889993:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330314.889996:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330314.892167:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+693:18881:x1798653938109248:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 9968us (10097us total) trans 4294984046 rc 0/0 00000100:00100000:3.0:1715330314.892180:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23781 00000100:00100000:2.0:1715330314.895481:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.895813:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938109376 00000100:00100000:3.0:1715330314.895822:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938109376 00000100:00100000:3.0:1715330314.895869:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23782 00000100:00100000:3.0:1715330314.895876:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+693:18881:x1798653938109376:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1715330314.895924:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330314.895946:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe1c0/0xd895711d66daaa4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x157d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbda8 expref: 693 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330314.896167:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157d:0x0].0x0 (ffff88008b0d2000) 00010000:00010000:3.0:1715330314.896177:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330314.896203:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab7840/0xd895711d66db5fd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.896214:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab7840/0xd895711d66db5fd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.896221:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab7840/0xd895711d66db5fd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.896228:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6d00/0xd895711d66db604 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989cd8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.896233:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6d00/0xd895711d66db604 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.896237:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6d00/0xd895711d66db604 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.896280:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab73c0/0xd895711d66db60b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x157d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.896285:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab73c0/0xd895711d66db60b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.896290:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab73c0/0xd895711d66db60b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:3.0:1715330314.896455:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].42, 64 off10880 00000040:00080000:3.0:1715330314.896478:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].391, 184 off77040 00010000:00010000:3.0:1715330314.896511:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6ac0/0xd895711d66db612 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x157d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.896517:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6ac0/0xd895711d66db612 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.896522:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6ac0/0xd895711d66db612 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.896528:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6ac0/0xd895711d66db612 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.896533:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6ac0/0xd895711d66db612 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.896538:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6ac0/0xd895711d66db612 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x157d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.896543:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6ac0/0xd895711d66db612 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x157d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.896547:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078ab6ac0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330314.896550:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6ac0/0xd895711d66db612 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x157d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.896556:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6ac0/0xd895711d66db612 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x157d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.896562:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157d:0x0].0x0 (ffff88009d5fa900) 00010000:00010000:3.0:1715330314.896564:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330314.896567:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6ac0/0xd895711d66db612 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x157d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.896571:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6ac0/0xd895711d66db612 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x157d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.896588:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab73c0/0xd895711d66db60b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.896592:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab73c0/0xd895711d66db60b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x157d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.896595:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab73c0/0xd895711d66db60b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.896598:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078ab73c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.896601:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab73c0/0xd895711d66db60b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.896604:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab73c0/0xd895711d66db60b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x157d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.896609:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157d:0x0].0x0 (ffff88009d5fa900) 00010000:00010000:3.0:1715330314.896610:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330314.896612:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab73c0/0xd895711d66db60b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x157d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.896615:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab73c0/0xd895711d66db60b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x157d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.896696:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab7840/0xd895711d66db5fd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.896701:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab7840/0xd895711d66db5fd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.896704:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab7840/0xd895711d66db5fd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.896707:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab7840/0xd895711d66db5fd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.896710:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078ab7840 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.896712:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab7840/0xd895711d66db5fd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.896715:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab7840/0xd895711d66db5fd lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.896722:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330314.896723:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330314.896725:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab7840/0xd895711d66db5fd lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.896749:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab7840/0xd895711d66db5fd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:3.0:1715330314.896755:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012fa86680 reply state ffff88008b18a000 transno 4294984047 ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6d00/0xd895711d66db604 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.896761:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6d00/0xd895711d66db604 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.896765:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989cd8 (ffff88008b0d2100) 00010000:00010000:3.0:1715330314.896767:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330314.896769:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330314.897235:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+694:18881:x1798653938109376:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 1357us (1759us total) trans 4294984047 rc 0/0 00000100:00100000:3.0:1715330314.897722:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23782 00000100:00100000:0.0:1715330314.900014:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.900093:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938109504 00000100:00100000:3.0:1715330314.900101:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938109504 00000100:00100000:3.0:1715330314.900126:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23783 00000100:00100000:3.0:1715330314.900132:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+694:18881:x1798653938109504:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1715330314.900176:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330314.900195:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd8c0/0xd895711d66daac7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x157e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbdaf expref: 694 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330314.900209:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157e:0x0].0x0 (ffff88009d774900) 00010000:00010000:3.0:1715330314.900216:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330314.900235:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab46c0/0xd895711d66db619 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.900626:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab46c0/0xd895711d66db619 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.900635:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab46c0/0xd895711d66db619 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.900644:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4b40/0xd895711d66db620 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989dd8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.900649:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4b40/0xd895711d66db620 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.900654:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4b40/0xd895711d66db620 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.900704:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab5b00/0xd895711d66db627 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x157e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.900710:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab5b00/0xd895711d66db627 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.900715:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab5b00/0xd895711d66db627 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:3.0:1715330314.901366:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2544, 64 off171008 00000040:00080000:3.0:1715330314.901397:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].392, 184 off77224 00010000:00010000:3.0:1715330314.901432:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab7840/0xd895711d66db62e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x157e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.901439:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab7840/0xd895711d66db62e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.901445:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab7840/0xd895711d66db62e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.901450:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab7840/0xd895711d66db62e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.901454:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab7840/0xd895711d66db62e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.901458:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab7840/0xd895711d66db62e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x157e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.901463:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab7840/0xd895711d66db62e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x157e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.901467:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078ab7840 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330314.901470:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab7840/0xd895711d66db62e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x157e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.901475:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab7840/0xd895711d66db62e lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x157e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.901482:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157e:0x0].0x0 (ffff88009d5fae00) 00010000:00010000:3.0:1715330314.901484:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330314.901487:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab7840/0xd895711d66db62e lrc: 3/0,0 mode: --/PW res: [0x200000402:0x157e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.901491:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab7840/0xd895711d66db62e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x157e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.901511:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab5b00/0xd895711d66db627 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.901515:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab5b00/0xd895711d66db627 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x157e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.901519:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab5b00/0xd895711d66db627 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.901522:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078ab5b00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.901525:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab5b00/0xd895711d66db627 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.901528:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab5b00/0xd895711d66db627 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x157e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.901533:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157e:0x0].0x0 (ffff88009d5fae00) 00010000:00010000:3.0:1715330314.901534:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330314.901536:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab5b00/0xd895711d66db627 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x157e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.901540:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab5b00/0xd895711d66db627 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x157e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.901619:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab46c0/0xd895711d66db619 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.901624:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab46c0/0xd895711d66db619 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.901628:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab46c0/0xd895711d66db619 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.901632:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab46c0/0xd895711d66db619 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.901636:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078ab46c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.901638:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab46c0/0xd895711d66db619 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.901642:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab46c0/0xd895711d66db619 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.901648:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330314.901649:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330314.901652:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab46c0/0xd895711d66db619 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.901656:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab46c0/0xd895711d66db619 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:3.0:1715330314.901663:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8801344c9880 reply state ffff88009d513000 transno 4294984048 ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4b40/0xd895711d66db620 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.901669:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4b40/0xd895711d66db620 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.901677:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989dd8 (ffff88008b0d2b00) 00010000:00010000:3.0:1715330314.901678:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330314.901681:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330314.901754:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+695:18881:x1798653938109504:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 1620us (1743us total) trans 4294984048 rc 0/0 00000100:00100000:3.0:1715330314.901760:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23783 00000100:00100000:0.0:1715330314.907261:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.908504:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938109632 00000100:00100000:3.0:1715330314.908515:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938109632 00000100:00100000:3.0:1715330314.908570:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23784 00000100:00100000:3.0:1715330314.908577:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+695:18881:x1798653938109632:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1715330314.908625:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330314.908646:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594240/0xd895711d66daaea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x157f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbdb6 expref: 695 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330314.908660:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157f:0x0].0x0 (ffff880093a11500) 00010000:00010000:3.0:1715330314.908668:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330314.908688:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab73c0/0xd895711d66db635 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.908697:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab73c0/0xd895711d66db635 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.908704:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab73c0/0xd895711d66db635 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.908711:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6ac0/0xd895711d66db63c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989ed8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.908716:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6ac0/0xd895711d66db63c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.908721:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6ac0/0xd895711d66db63c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.908796:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83840/0xd895711d66db643 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x157f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.908802:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83840/0xd895711d66db643 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.908807:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83840/0xd895711d66db643 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:3.0:1715330314.908975:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].43, 64 off10944 00000040:00080000:3.0:1715330314.908999:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].393, 184 off77408 00010000:00010000:3.0:1715330314.909038:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81680/0xd895711d66db64a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x157f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.909044:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81680/0xd895711d66db64a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.909050:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81680/0xd895711d66db64a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.909055:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81680/0xd895711d66db64a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.909060:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81680/0xd895711d66db64a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.909064:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81680/0xd895711d66db64a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x157f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.909068:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81680/0xd895711d66db64a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x157f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.909076:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da81680 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330314.909078:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81680/0xd895711d66db64a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x157f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.909084:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81680/0xd895711d66db64a lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x157f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.909089:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157f:0x0].0x0 (ffff88009d5fab00) 00010000:00010000:3.0:1715330314.909091:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330314.909093:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81680/0xd895711d66db64a lrc: 3/0,0 mode: --/PW res: [0x200000402:0x157f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.909097:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81680/0xd895711d66db64a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x157f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.909114:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83840/0xd895711d66db643 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.909118:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83840/0xd895711d66db643 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x157f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.909122:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83840/0xd895711d66db643 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.909126:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da83840 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.909128:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83840/0xd895711d66db643 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.909132:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83840/0xd895711d66db643 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x157f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.909136:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157f:0x0].0x0 (ffff88009d5fab00) 00010000:00010000:3.0:1715330314.909138:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330314.909140:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83840/0xd895711d66db643 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x157f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.909143:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83840/0xd895711d66db643 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x157f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.909211:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab73c0/0xd895711d66db635 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.909215:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab73c0/0xd895711d66db635 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.909219:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab73c0/0xd895711d66db635 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.909223:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab73c0/0xd895711d66db635 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.909227:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078ab73c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.909229:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab73c0/0xd895711d66db635 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.909233:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab73c0/0xd895711d66db635 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.909239:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330314.909240:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330314.909243:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab73c0/0xd895711d66db635 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.909247:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab73c0/0xd895711d66db635 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:3.0:1715330314.909254:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8801344cb100 reply state ffff88009d514000 transno 4294984049 ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6ac0/0xd895711d66db63c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.909265:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6ac0/0xd895711d66db63c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.909269:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ed8 (ffff880093a11200) 00010000:00010000:3.0:1715330314.909271:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330314.909273:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330314.909337:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+696:18881:x1798653938109632:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 759us (2094us total) trans 4294984049 rc 0/0 00000100:00100000:3.0:1715330314.909343:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23784 00000100:00100000:2.0:1715330314.912968:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.913653:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938109760 00000100:00100000:3.0:1715330314.913660:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938109760 00000100:00100000:3.0:1715330314.913702:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23785 00000100:00100000:3.0:1715330314.913708:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+696:18881:x1798653938109760:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1715330314.913783:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330314.913802:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594b40/0xd895711d66dab0d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1580:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbdbd expref: 696 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330314.913816:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1580:0x0].0x0 (ffff880093a11b00) 00010000:00010000:3.0:1715330314.913824:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330314.913845:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da818c0/0xd895711d66db651 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.913855:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da818c0/0xd895711d66db651 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.913862:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da818c0/0xd895711d66db651 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.913868:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82f40/0xd895711d66db658 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989fd8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.913874:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82f40/0xd895711d66db658 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.913879:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82f40/0xd895711d66db658 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.913922:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80b40/0xd895711d66db65f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1580:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.913927:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80b40/0xd895711d66db65f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1580:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.913931:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80b40/0xd895711d66db65f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1580:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:3.0:1715330314.914106:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2545, 64 off171072 00000040:00080000:3.0:1715330314.914129:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].394, 184 off77592 00010000:00010000:3.0:1715330314.914157:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81b00/0xd895711d66db666 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1580:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.914164:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81b00/0xd895711d66db666 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1580:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.914170:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81b00/0xd895711d66db666 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1580:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.914175:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81b00/0xd895711d66db666 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1580:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.914180:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81b00/0xd895711d66db666 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1580:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.914185:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81b00/0xd895711d66db666 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1580:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.914193:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81b00/0xd895711d66db666 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1580:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.914198:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da81b00 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330314.914201:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81b00/0xd895711d66db666 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1580:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.914206:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81b00/0xd895711d66db666 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1580:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.914212:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1580:0x0].0x0 (ffff88009d5fae00) 00010000:00010000:3.0:1715330314.914214:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330314.914216:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81b00/0xd895711d66db666 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1580:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.914220:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81b00/0xd895711d66db666 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1580:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.914238:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80b40/0xd895711d66db65f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1580:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.914242:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80b40/0xd895711d66db65f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1580:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.914247:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80b40/0xd895711d66db65f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1580:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.914250:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da80b40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.914253:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80b40/0xd895711d66db65f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1580:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.914257:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80b40/0xd895711d66db65f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1580:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.914265:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1580:0x0].0x0 (ffff88009d5fae00) 00010000:00010000:3.0:1715330314.914267:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330314.914269:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80b40/0xd895711d66db65f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1580:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.914273:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80b40/0xd895711d66db65f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1580:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.914356:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da818c0/0xd895711d66db651 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.914361:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da818c0/0xd895711d66db651 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.914366:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da818c0/0xd895711d66db651 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.914370:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da818c0/0xd895711d66db651 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.914373:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da818c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.914376:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da818c0/0xd895711d66db651 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.914380:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da818c0/0xd895711d66db651 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.914385:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330314.914387:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330314.914389:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da818c0/0xd895711d66db651 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.914394:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da818c0/0xd895711d66db651 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:3.0:1715330314.914401:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012fa84a80 reply state ffff88009d62e000 transno 4294984050 ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82f40/0xd895711d66db658 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.914408:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82f40/0xd895711d66db658 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.914413:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989fd8 (ffff880093a11900) 00010000:00010000:3.0:1715330314.914414:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330314.914416:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330314.914468:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+697:18881:x1798653938109760:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 759us (1506us total) trans 4294984050 rc 0/0 00000100:00100000:3.0:1715330314.914474:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23785 00000100:00100000:0.0:1715330314.920593:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.921432:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938109888 00000100:00100000:3.0:1715330314.921441:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938109888 00000100:00100000:0.0:1715330314.922133:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23786 00000100:00100000:0.0:1715330314.922141:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+697:18881:x1798653938109888:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1715330314.922187:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330314.922209:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b73c0/0xd895711d66dab30 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1581:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbdc4 expref: 697 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330314.922241:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1581:0x0].0x0 (ffff88009d5fa400) 00010000:00010000:0.0:1715330314.922250:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715330314.922272:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66db66d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.922282:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66db66d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.922288:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66db66d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.922296:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3a80/0xd895711d66db674 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a0d8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.922301:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3a80/0xd895711d66db674 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.922306:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3a80/0xd895711d66db674 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.922348:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66db67b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1581:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.922354:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66db67b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1581:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.922359:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66db67b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1581:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:0.0:1715330314.922540:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].44, 64 off11008 00000040:00080000:0.0:1715330314.922565:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].395, 184 off77776 00010000:00010000:0.0:1715330314.922600:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66db682 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1581:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.922607:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66db682 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1581:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.922612:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66db682 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1581:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.922621:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66db682 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1581:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.922626:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66db682 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1581:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.922630:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66db682 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1581:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.922635:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66db682 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1581:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.922640:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a1d40 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330314.922643:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66db682 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1581:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.922648:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66db682 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1581:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.922655:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1581:0x0].0x0 (ffff8800aa391e00) 00010000:00010000:0.0:1715330314.922658:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1715330314.922661:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66db682 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1581:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.922665:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66db682 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1581:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.922684:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66db67b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1581:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.922689:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66db67b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1581:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.922693:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66db67b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1581:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.922698:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a2f40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330314.922700:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66db67b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1581:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.922705:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66db67b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1581:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.922710:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1581:0x0].0x0 (ffff8800aa391e00) 00010000:00010000:0.0:1715330314.922712:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715330314.922714:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66db67b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1581:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.922718:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66db67b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1581:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.922816:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66db66d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.922822:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66db66d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.922826:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66db66d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.922830:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66db66d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.922834:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a06c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330314.922837:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66db66d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.922841:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66db66d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.922851:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:0.0:1715330314.922853:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330314.922855:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66db66d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.922858:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66db66d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:0.0:1715330314.922865:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8801344cb480 reply state ffff880091e56000 transno 4294984051 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3a80/0xd895711d66db674 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.922872:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3a80/0xd895711d66db674 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.922876:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a0d8 (ffff88009d5fa600) 00010000:00010000:0.0:1715330314.922877:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330314.922880:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1715330314.925912:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+698:18881:x1798653938109888:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 3763us (5318us total) trans 4294984051 rc 0/0 00000100:00100000:0.0:1715330314.925922:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23786 00000100:00100000:0.0:1715330314.933995:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330314.934101:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938110016 00000100:00100000:2.0:1715330314.934110:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938110016 00000100:00100000:2.0:1715330314.934160:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23787 00000100:00100000:2.0:1715330314.934168:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+698:18881:x1798653938110016:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:2.0:1715330314.934216:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330314.934237:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffcc0/0xd895711d66dab53 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1582:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbdcb expref: 698 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330314.934266:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1582:0x0].0x0 (ffff88012ca4d900) 00010000:00010000:2.0:1715330314.934274:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330314.934294:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6ac0/0xd895711d66db689 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.934304:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6ac0/0xd895711d66db689 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.934311:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6ac0/0xd895711d66db689 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.934317:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5b00/0xd895711d66db690 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a1d8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.934323:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5b00/0xd895711d66db690 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.934327:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5b00/0xd895711d66db690 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.934369:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5f80/0xd895711d66db697 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1582:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.934375:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5f80/0xd895711d66db697 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1582:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.934381:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5f80/0xd895711d66db697 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1582:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:2.0:1715330314.934552:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2546, 64 off171136 00000040:00080000:2.0:1715330314.934648:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].396, 184 off77960 00010000:00010000:2.0:1715330314.934683:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b61c0/0xd895711d66db69e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1582:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.934690:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b61c0/0xd895711d66db69e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1582:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.934696:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b61c0/0xd895711d66db69e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1582:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.934702:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b61c0/0xd895711d66db69e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1582:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.934707:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b61c0/0xd895711d66db69e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1582:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.934712:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b61c0/0xd895711d66db69e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1582:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.934717:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b61c0/0xd895711d66db69e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1582:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.934722:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b61c0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330314.934726:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b61c0/0xd895711d66db69e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1582:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.934765:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b61c0/0xd895711d66db69e lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1582:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.934773:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1582:0x0].0x0 (ffff880093a11100) 00010000:00010000:2.0:1715330314.934775:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1715330314.934778:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b61c0/0xd895711d66db69e lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1582:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.934783:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b61c0/0xd895711d66db69e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1582:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.934802:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5f80/0xd895711d66db697 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1582:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.934806:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5f80/0xd895711d66db697 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1582:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.934810:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5f80/0xd895711d66db697 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1582:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.934814:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b5f80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.934817:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5f80/0xd895711d66db697 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1582:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.934820:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5f80/0xd895711d66db697 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1582:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.934826:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1582:0x0].0x0 (ffff880093a11100) 00010000:00010000:2.0:1715330314.934828:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330314.934830:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5f80/0xd895711d66db697 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1582:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.934833:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5f80/0xd895711d66db697 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1582:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.934901:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6ac0/0xd895711d66db689 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.934907:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6ac0/0xd895711d66db689 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.934911:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6ac0/0xd895711d66db689 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.934915:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6ac0/0xd895711d66db689 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.934919:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b6ac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330314.934921:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6ac0/0xd895711d66db689 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.934925:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6ac0/0xd895711d66db689 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.934931:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330314.934932:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330314.934934:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6ac0/0xd895711d66db689 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.934938:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6ac0/0xd895711d66db689 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:2.0:1715330314.934945:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8801344cbb80 reply state ffff88009c61b000 transno 4294984052 ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5b00/0xd895711d66db690 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.934951:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5b00/0xd895711d66db690 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330314.934956:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a1d8 (ffff88012ca4dc00) 00010000:00010000:2.0:1715330314.934957:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330314.934960:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1715330314.935008:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+699:18881:x1798653938110016:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 840us (1021us total) trans 4294984052 rc 0/0 00000100:00100000:2.0:1715330314.935015:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23787 00000100:00100000:2.0:1715330314.942128:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.942350:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938110144 00000100:00100000:3.0:1715330314.942359:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938110144 00000100:00100000:3.0:1715330314.942405:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23788 00000100:00100000:3.0:1715330314.942412:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+699:18881:x1798653938110144:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1715330314.942459:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330314.942483:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd680/0xd895711d66dab76 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1583:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbdd2 expref: 699 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330314.942518:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1583:0x0].0x0 (ffff88012ca4d100) 00010000:00010000:3.0:1715330314.942526:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330314.942548:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82d00/0xd895711d66db6a5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.942558:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82d00/0xd895711d66db6a5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.942569:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82d00/0xd895711d66db6a5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.942575:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83cc0/0xd895711d66db6ac lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a2d8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.942580:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83cc0/0xd895711d66db6ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.942585:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83cc0/0xd895711d66db6ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.942630:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da806c0/0xd895711d66db6b3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1583:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.942636:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da806c0/0xd895711d66db6b3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1583:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.942640:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da806c0/0xd895711d66db6b3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1583:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:3.0:1715330314.942999:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].45, 64 off11072 00000040:00080000:3.0:1715330314.943024:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].397, 184 off78144 00010000:00010000:3.0:1715330314.943068:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81440/0xd895711d66db6ba lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1583:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.943075:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81440/0xd895711d66db6ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1583:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.943080:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81440/0xd895711d66db6ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1583:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.943086:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81440/0xd895711d66db6ba lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1583:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.943093:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81440/0xd895711d66db6ba lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1583:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.943098:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81440/0xd895711d66db6ba lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1583:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.943102:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81440/0xd895711d66db6ba lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1583:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.943106:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da81440 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330314.943109:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81440/0xd895711d66db6ba lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1583:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.943114:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81440/0xd895711d66db6ba lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1583:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.943119:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1583:0x0].0x0 (ffff88009d5fa800) 00010000:00010000:3.0:1715330314.943122:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330314.943124:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81440/0xd895711d66db6ba lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1583:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.943128:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81440/0xd895711d66db6ba lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1583:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.943147:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da806c0/0xd895711d66db6b3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1583:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.943151:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da806c0/0xd895711d66db6b3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1583:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.943155:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da806c0/0xd895711d66db6b3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1583:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.943159:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da806c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.943162:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da806c0/0xd895711d66db6b3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1583:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.943167:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da806c0/0xd895711d66db6b3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1583:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.943172:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1583:0x0].0x0 (ffff88009d5fa800) 00010000:00010000:3.0:1715330314.943173:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330314.943175:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da806c0/0xd895711d66db6b3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1583:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.943179:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da806c0/0xd895711d66db6b3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1583:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.943258:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82d00/0xd895711d66db6a5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.943264:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82d00/0xd895711d66db6a5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.943268:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82d00/0xd895711d66db6a5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.943272:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82d00/0xd895711d66db6a5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.943276:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da82d00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.943278:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82d00/0xd895711d66db6a5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.943281:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82d00/0xd895711d66db6a5 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.943288:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330314.943289:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330314.943292:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82d00/0xd895711d66db6a5 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.943296:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82d00/0xd895711d66db6a5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:3.0:1715330314.943303:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012fa85f80 reply state ffff88009d629000 transno 4294984053 ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83cc0/0xd895711d66db6ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.943309:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83cc0/0xd895711d66db6ac lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.943314:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a2d8 (ffff88012ca4df00) 00010000:00010000:3.0:1715330314.943315:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330314.943318:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330314.945138:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+700:18881:x1798653938110144:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 2720us (3011us total) trans 4294984053 rc 0/0 00000100:00100000:3.0:1715330314.945146:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23788 00000100:00100000:1.0:1715330314.956813:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.956907:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938110272 00000100:00100000:3.0:1715330314.956915:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938110272 00000100:00100000:3.0:1715330314.957014:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23789 00000100:00100000:3.0:1715330314.957020:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+700:18881:x1798653938110272:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1715330314.957086:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330314.957106:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c000/0xd895711d66dab99 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1584:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbdd9 expref: 700 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330314.957203:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1584:0x0].0x0 (ffff88009d774800) 00010000:00010000:3.0:1715330314.957213:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330314.957235:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81f80/0xd895711d66db6c1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.957247:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81f80/0xd895711d66db6c1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.957254:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81f80/0xd895711d66db6c1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.957260:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82400/0xd895711d66db6c8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a3d8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.957265:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82400/0xd895711d66db6c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.957270:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82400/0xd895711d66db6c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.957311:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80d80/0xd895711d66db6cf lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1584:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.957316:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80d80/0xd895711d66db6cf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1584:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.957320:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80d80/0xd895711d66db6cf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1584:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:3.0:1715330314.957485:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2547, 64 off171200 00000040:00080000:3.0:1715330314.957508:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].398, 184 off78328 00010000:00010000:3.0:1715330314.957537:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da821c0/0xd895711d66db6d6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1584:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.957542:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da821c0/0xd895711d66db6d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1584:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.957548:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da821c0/0xd895711d66db6d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1584:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.957556:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da821c0/0xd895711d66db6d6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1584:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.958903:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da821c0/0xd895711d66db6d6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1584:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.958908:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da821c0/0xd895711d66db6d6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1584:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.958913:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da821c0/0xd895711d66db6d6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1584:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.958917:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da821c0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330314.958920:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da821c0/0xd895711d66db6d6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1584:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.958926:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da821c0/0xd895711d66db6d6 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1584:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.958933:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1584:0x0].0x0 (ffff88009d5fa300) 00010000:00010000:3.0:1715330314.958935:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330314.958938:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da821c0/0xd895711d66db6d6 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1584:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.958942:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da821c0/0xd895711d66db6d6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1584:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.958964:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80d80/0xd895711d66db6cf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1584:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.958968:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80d80/0xd895711d66db6cf lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1584:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.958972:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80d80/0xd895711d66db6cf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1584:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.958976:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da80d80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.958979:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80d80/0xd895711d66db6cf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1584:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.958983:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80d80/0xd895711d66db6cf lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1584:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.958988:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1584:0x0].0x0 (ffff88009d5fa300) 00010000:00010000:3.0:1715330314.958990:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330314.958992:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80d80/0xd895711d66db6cf lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1584:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.958996:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80d80/0xd895711d66db6cf lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1584:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.959103:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81f80/0xd895711d66db6c1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.959108:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81f80/0xd895711d66db6c1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.959112:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81f80/0xd895711d66db6c1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.959116:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81f80/0xd895711d66db6c1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.959120:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da81f80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.959122:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81f80/0xd895711d66db6c1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.959126:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81f80/0xd895711d66db6c1 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.959140:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330314.959141:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330314.959144:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81f80/0xd895711d66db6c1 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.959147:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81f80/0xd895711d66db6c1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:3.0:1715330314.959155:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012fa4c000 reply state ffff88009d62f000 transno 4294984054 ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82400/0xd895711d66db6c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.959161:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82400/0xd895711d66db6c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.959165:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a3d8 (ffff88012ca4db00) 00010000:00010000:3.0:1715330314.959167:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330314.959169:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330314.960093:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+701:18881:x1798653938110272:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 3069us (3284us total) trans 4294984054 rc 0/0 00000100:00100000:3.0:1715330314.960101:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23789 00000100:00100000:1.0:1715330314.966369:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.966461:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938110400 00000100:00100000:3.0:1715330314.966470:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938110400 00000100:00100000:3.0:1715330314.966519:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23790 00000100:00100000:3.0:1715330314.966526:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+701:18881:x1798653938110400:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1715330314.966573:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330314.966596:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c900/0xd895711d66dabbc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1585:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbde0 expref: 701 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330314.966615:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1585:0x0].0x0 (ffff88012cc48d00) 00010000:00010000:3.0:1715330314.966625:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330314.966649:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81200/0xd895711d66db6dd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.966659:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81200/0xd895711d66db6dd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.966666:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81200/0xd895711d66db6dd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.966674:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80900/0xd895711d66db6e4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989ad9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.966679:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80900/0xd895711d66db6e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.966683:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80900/0xd895711d66db6e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.966752:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80000/0xd895711d66db6eb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1585:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.966758:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80000/0xd895711d66db6eb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1585:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.966763:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80000/0xd895711d66db6eb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1585:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:3.0:1715330314.966937:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].46, 64 off11136 00000040:00080000:3.0:1715330314.966963:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].399, 184 off78512 00010000:00010000:3.0:1715330314.966995:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da833c0/0xd895711d66db6f2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1585:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.967001:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da833c0/0xd895711d66db6f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1585:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.967011:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da833c0/0xd895711d66db6f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1585:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.967017:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da833c0/0xd895711d66db6f2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1585:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.967022:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da833c0/0xd895711d66db6f2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1585:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.967036:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da833c0/0xd895711d66db6f2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1585:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.967041:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da833c0/0xd895711d66db6f2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1585:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.967046:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da833c0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330314.967049:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da833c0/0xd895711d66db6f2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1585:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.967054:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da833c0/0xd895711d66db6f2 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1585:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.967060:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1585:0x0].0x0 (ffff88009d5fa200) 00010000:00010000:3.0:1715330314.967063:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330314.967066:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da833c0/0xd895711d66db6f2 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1585:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.967070:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da833c0/0xd895711d66db6f2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1585:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.967089:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80000/0xd895711d66db6eb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1585:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.967093:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80000/0xd895711d66db6eb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1585:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.967097:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80000/0xd895711d66db6eb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1585:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.967101:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da80000 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.967103:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80000/0xd895711d66db6eb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1585:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.967107:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80000/0xd895711d66db6eb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1585:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.967111:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1585:0x0].0x0 (ffff88009d5fa200) 00010000:00010000:3.0:1715330314.967112:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330314.967114:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80000/0xd895711d66db6eb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1585:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.967118:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80000/0xd895711d66db6eb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1585:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.967190:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81200/0xd895711d66db6dd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.967194:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81200/0xd895711d66db6dd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.967198:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81200/0xd895711d66db6dd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.967202:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81200/0xd895711d66db6dd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.967205:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da81200 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.967207:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81200/0xd895711d66db6dd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.967214:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81200/0xd895711d66db6dd lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.967220:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330314.967222:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330314.967224:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81200/0xd895711d66db6dd lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.967228:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81200/0xd895711d66db6dd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:3.0:1715330314.967236:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012fa4f480 reply state ffff88009d62d000 transno 4294984055 ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80900/0xd895711d66db6e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ad9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.967243:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80900/0xd895711d66db6e4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.967248:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ad9 (ffff88012cc48700) 00010000:00010000:3.0:1715330314.967250:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330314.967252:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330314.967297:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+702:18881:x1798653938110400:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 771us (936us total) trans 4294984055 rc 0/0 00000100:00100000:3.0:1715330314.967303:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23790 00000100:00100000:2.0:1715330314.975655:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330314.975721:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938110528 00000100:00100000:0.0:1715330314.975762:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938110528 00000100:00100000:0.0:1715330314.975808:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23791 00000100:00100000:0.0:1715330314.975815:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+702:18881:x1798653938110528:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1715330314.975862:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330314.975884:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d200/0xd895711d66dabdf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1586:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbde7 expref: 702 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330314.975912:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1586:0x0].0x0 (ffff88012cc48000) 00010000:00010000:0.0:1715330314.975920:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715330314.975942:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66db6f9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.975952:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66db6f9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.975959:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66db6f9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.975967:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66db700 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989bd9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.975972:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66db700 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.975976:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66db700 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.976037:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66db707 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1586:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.976042:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66db707 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1586:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.976047:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66db707 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1586:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:0.0:1715330314.976227:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2548, 64 off171264 00000040:00080000:0.0:1715330314.976250:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].400, 184 off78696 00010000:00010000:0.0:1715330314.976282:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66db70e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1586:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.976288:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66db70e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1586:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.976294:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66db70e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1586:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.976299:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66db70e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1586:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.976302:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66db70e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1586:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.976306:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66db70e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1586:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.976311:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66db70e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1586:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.976314:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a1440 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330314.976317:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66db70e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1586:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.976321:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66db70e lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1586:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.976327:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1586:0x0].0x0 (ffff8800aa391b00) 00010000:00010000:0.0:1715330314.976329:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1715330314.976331:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66db70e lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1586:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.976335:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66db70e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1586:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.976359:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66db707 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1586:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.976363:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66db707 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1586:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.976367:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66db707 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1586:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.976370:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a1d40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330314.976372:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66db707 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1586:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.976376:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66db707 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1586:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.976381:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1586:0x0].0x0 (ffff8800aa391b00) 00010000:00010000:0.0:1715330314.976383:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715330314.976385:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66db707 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1586:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.976389:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66db707 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1586:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.976466:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66db6f9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.976472:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66db6f9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.976476:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66db6f9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.976481:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66db6f9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.976485:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a06c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330314.976487:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66db6f9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.976491:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66db6f9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.976497:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:0.0:1715330314.976499:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330314.976501:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66db6f9 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.976505:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66db6f9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:0.0:1715330314.976511:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012fa85c00 reply state ffff880091e57000 transno 4294984056 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66db700 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989bd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.976519:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66db700 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330314.976524:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989bd9 (ffff88012cc48e00) 00010000:00010000:0.0:1715330314.976526:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330314.976528:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1715330314.976572:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+703:18881:x1798653938110528:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 757us (924us total) trans 4294984056 rc 0/0 00000100:00100000:0.0:1715330314.976579:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23791 00000100:00100000:1.0:1715330314.981761:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.982182:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938110656 00000100:00100000:3.0:1715330314.982191:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938110656 00000100:00100000:3.0:1715330314.982237:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23792 00000100:00100000:3.0:1715330314.982245:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+703:18881:x1798653938110656:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1715330314.982292:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330314.982314:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9db00/0xd895711d66dac02 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1587:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbdee expref: 703 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330314.982381:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1587:0x0].0x0 (ffff88012cc48400) 00010000:00010000:3.0:1715330314.982392:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330314.982416:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83a80/0xd895711d66db715 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.982427:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83a80/0xd895711d66db715 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.982435:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83a80/0xd895711d66db715 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.982442:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82880/0xd895711d66db71c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989cd9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.982447:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82880/0xd895711d66db71c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.982452:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82880/0xd895711d66db71c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.982498:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80480/0xd895711d66db723 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1587:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.982503:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80480/0xd895711d66db723 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1587:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.982508:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80480/0xd895711d66db723 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1587:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:3.0:1715330314.982683:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].47, 64 off11200 00000040:00080000:3.0:1715330314.982707:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].401, 184 off78880 00010000:00010000:3.0:1715330314.982768:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82640/0xd895711d66db72a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1587:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.982776:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82640/0xd895711d66db72a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1587:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.982781:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82640/0xd895711d66db72a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1587:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.982787:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82640/0xd895711d66db72a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1587:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.982791:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82640/0xd895711d66db72a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1587:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.982796:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82640/0xd895711d66db72a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1587:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.982801:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82640/0xd895711d66db72a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1587:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.982806:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da82640 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330314.982809:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82640/0xd895711d66db72a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1587:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.982815:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82640/0xd895711d66db72a lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1587:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.982821:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1587:0x0].0x0 (ffff88009d5fa100) 00010000:00010000:3.0:1715330314.982824:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330314.982826:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82640/0xd895711d66db72a lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1587:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.982831:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82640/0xd895711d66db72a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1587:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.982968:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80480/0xd895711d66db723 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1587:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.982973:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80480/0xd895711d66db723 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1587:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.982978:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80480/0xd895711d66db723 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1587:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.982982:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da80480 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.982984:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80480/0xd895711d66db723 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1587:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.982989:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80480/0xd895711d66db723 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1587:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.982995:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1587:0x0].0x0 (ffff88009d5fa100) 00010000:00010000:3.0:1715330314.982997:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330314.982999:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80480/0xd895711d66db723 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1587:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.983003:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80480/0xd895711d66db723 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1587:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.983092:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83a80/0xd895711d66db715 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.983097:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83a80/0xd895711d66db715 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.983101:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83a80/0xd895711d66db715 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.983106:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83a80/0xd895711d66db715 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.983109:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da83a80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.983112:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83a80/0xd895711d66db715 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.983117:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83a80/0xd895711d66db715 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.983123:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330314.983125:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330314.983128:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83a80/0xd895711d66db715 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.983133:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83a80/0xd895711d66db715 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:3.0:1715330314.983140:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012fa4df80 reply state ffff88009b473000 transno 4294984057 ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82880/0xd895711d66db71c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989cd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.983147:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82880/0xd895711d66db71c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.983152:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989cd9 (ffff88012cc48500) 00010000:00010000:3.0:1715330314.983153:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330314.983155:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330314.983215:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+704:18881:x1798653938110656:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 969us (2744us total) trans 4294984057 rc 0/0 00000100:00100000:3.0:1715330314.983222:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23792 00000100:00100000:0.0:1715330314.991162:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.991288:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938110784 00000100:00100000:3.0:1715330314.991296:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938110784 00000100:00100000:3.0:1715330314.991330:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23793 00000100:00100000:3.0:1715330314.991337:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+704:18881:x1798653938110784:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1715330314.991380:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330314.991401:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e400/0xd895711d66dac25 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1588:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbdf5 expref: 704 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330314.991415:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1588:0x0].0x0 (ffff88009ef2cd00) 00010000:00010000:3.0:1715330314.991422:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330314.991442:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83180/0xd895711d66db731 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.991452:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83180/0xd895711d66db731 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.991459:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83180/0xd895711d66db731 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.991467:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82ac0/0xd895711d66db738 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989dd9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.991472:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82ac0/0xd895711d66db738 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.991477:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82ac0/0xd895711d66db738 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.991521:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80240/0xd895711d66db73f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1588:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.991526:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80240/0xd895711d66db73f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1588:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.991531:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80240/0xd895711d66db73f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1588:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:3.0:1715330314.991943:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2549, 64 off171328 00000040:00080000:3.0:1715330314.991967:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].402, 184 off79064 00010000:00010000:3.0:1715330314.992000:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83600/0xd895711d66db746 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1588:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.992007:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83600/0xd895711d66db746 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1588:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.992013:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83600/0xd895711d66db746 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1588:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.992019:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83600/0xd895711d66db746 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1588:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.992023:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83600/0xd895711d66db746 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1588:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.992038:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83600/0xd895711d66db746 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1588:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.992043:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83600/0xd895711d66db746 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1588:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.992048:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da83600 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330314.992051:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83600/0xd895711d66db746 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1588:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.992056:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83600/0xd895711d66db746 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1588:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.992063:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1588:0x0].0x0 (ffff88009d5fac00) 00010000:00010000:3.0:1715330314.992065:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330314.992068:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83600/0xd895711d66db746 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1588:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.992072:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83600/0xd895711d66db746 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1588:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.992096:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80240/0xd895711d66db73f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1588:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.992100:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80240/0xd895711d66db73f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1588:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.992105:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80240/0xd895711d66db73f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1588:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.992109:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da80240 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.992111:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80240/0xd895711d66db73f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1588:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.992116:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80240/0xd895711d66db73f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1588:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.992121:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1588:0x0].0x0 (ffff88009d5fac00) 00010000:00010000:3.0:1715330314.992123:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330314.992124:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80240/0xd895711d66db73f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1588:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.992129:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80240/0xd895711d66db73f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1588:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.992205:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83180/0xd895711d66db731 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.992210:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83180/0xd895711d66db731 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.992215:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83180/0xd895711d66db731 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.992219:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83180/0xd895711d66db731 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.992224:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da83180 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.992226:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83180/0xd895711d66db731 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.992231:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83180/0xd895711d66db731 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.992237:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330314.992239:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330314.992241:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83180/0xd895711d66db731 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.992246:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83180/0xd895711d66db731 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:3.0:1715330314.992255:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8801344c8e00 reply state ffff88009b477000 transno 4294984058 ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82ac0/0xd895711d66db738 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989dd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.992262:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82ac0/0xd895711d66db738 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.992267:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989dd9 (ffff88012cc48f00) 00010000:00010000:3.0:1715330314.992269:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330314.992271:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330314.992331:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+705:18881:x1798653938110784:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 993us (1175us total) trans 4294984058 rc 0/0 00000100:00100000:3.0:1715330314.992338:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23793 00000100:00100000:2.0:1715330314.997186:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330314.997423:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938110912 00000100:00100000:3.0:1715330314.997433:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938110912 00000100:00100000:3.0:1715330314.997567:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23794 00000100:00100000:3.0:1715330314.997574:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+705:18881:x1798653938110912:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1715330314.997624:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330314.997648:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9ed00/0xd895711d66dac48 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1589:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbdfc expref: 705 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330314.997663:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1589:0x0].0x0 (ffff88009ef2c300) 00010000:00010000:3.0:1715330314.997677:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330314.997923:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80fc0/0xd895711d66db74d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.997934:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80fc0/0xd895711d66db74d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.997942:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80fc0/0xd895711d66db74d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.997951:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81d40/0xd895711d66db754 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989ed9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.997956:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81d40/0xd895711d66db754 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.997962:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81d40/0xd895711d66db754 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.998008:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83a80/0xd895711d66db75b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1589:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.998014:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83a80/0xd895711d66db75b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1589:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.998019:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83a80/0xd895711d66db75b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1589:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:3.0:1715330314.998206:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].48, 64 off11264 00000040:00080000:3.0:1715330314.998228:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].403, 184 off79248 00010000:00010000:3.0:1715330314.998258:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80480/0xd895711d66db762 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1589:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.998264:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80480/0xd895711d66db762 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1589:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.998269:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80480/0xd895711d66db762 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1589:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.998274:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80480/0xd895711d66db762 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1589:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.998279:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80480/0xd895711d66db762 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1589:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.998283:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80480/0xd895711d66db762 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1589:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.998288:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80480/0xd895711d66db762 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1589:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.998292:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da80480 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330314.998295:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80480/0xd895711d66db762 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1589:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.998300:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80480/0xd895711d66db762 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1589:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.998306:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1589:0x0].0x0 (ffff88009d5fa200) 00010000:00010000:3.0:1715330314.998308:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330314.998311:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80480/0xd895711d66db762 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1589:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.998316:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80480/0xd895711d66db762 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1589:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.998333:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83a80/0xd895711d66db75b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1589:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.998337:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83a80/0xd895711d66db75b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1589:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.998341:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83a80/0xd895711d66db75b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1589:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.998344:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da83a80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.998347:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83a80/0xd895711d66db75b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1589:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.998350:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83a80/0xd895711d66db75b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1589:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.998355:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1589:0x0].0x0 (ffff88009d5fa200) 00010000:00010000:3.0:1715330314.998356:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330314.998358:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83a80/0xd895711d66db75b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1589:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.998362:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83a80/0xd895711d66db75b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1589:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.998435:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80fc0/0xd895711d66db74d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.998440:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80fc0/0xd895711d66db74d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.998444:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80fc0/0xd895711d66db74d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.998449:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80fc0/0xd895711d66db74d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.998452:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da80fc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330314.998454:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80fc0/0xd895711d66db74d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.998458:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80fc0/0xd895711d66db74d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.998464:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330314.998466:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330314.998468:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80fc0/0xd895711d66db74d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.998471:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80fc0/0xd895711d66db74d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:3.0:1715330314.998478:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093b58000 reply state ffff88009b475000 transno 4294984059 ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81d40/0xd895711d66db754 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989ed9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.998485:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81d40/0xd895711d66db754 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330314.998490:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ed9 (ffff88009ef2cc00) 00010000:00010000:3.0:1715330314.998492:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330314.998494:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330314.998556:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+706:18881:x1798653938110912:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 980us (1377us total) trans 4294984059 rc 0/0 00000100:00100000:3.0:1715330314.998563:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23794 00000100:00100000:1.0:1715330315.012139:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330315.012262:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938111040 00000100:00100000:3.0:1715330315.012272:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938111040 00000100:00100000:3.0:1715330315.012307:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23795 00000100:00100000:3.0:1715330315.012313:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+706:18881:x1798653938111040:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1715330315.012360:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330315.012382:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f600/0xd895711d66dac6b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x158a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe03 expref: 706 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.012412:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158a:0x0].0x0 (ffff88009ef2c800) 00010000:00010000:3.0:1715330315.012420:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330315.012442:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82640/0xd895711d66db769 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.012708:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82640/0xd895711d66db769 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.012717:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82640/0xd895711d66db769 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.012761:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81200/0xd895711d66db770 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca989fd9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.012768:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81200/0xd895711d66db770 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.012773:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81200/0xd895711d66db770 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.013036:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80000/0xd895711d66db777 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x158a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.013043:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80000/0xd895711d66db777 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.013051:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80000/0xd895711d66db777 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:3.0:1715330315.013342:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2550, 64 off171392 00000040:00080000:3.0:1715330315.013369:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].404, 184 off79432 00010000:00010000:3.0:1715330315.013404:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da833c0/0xd895711d66db77e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x158a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.013410:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da833c0/0xd895711d66db77e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x158a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.013416:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da833c0/0xd895711d66db77e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x158a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.013421:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da833c0/0xd895711d66db77e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x158a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.013426:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da833c0/0xd895711d66db77e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x158a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.013431:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da833c0/0xd895711d66db77e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x158a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.013435:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da833c0/0xd895711d66db77e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x158a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.013441:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da833c0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330315.013444:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da833c0/0xd895711d66db77e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x158a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.013449:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da833c0/0xd895711d66db77e lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x158a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.013456:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158a:0x0].0x0 (ffff88009d5fa300) 00010000:00010000:3.0:1715330315.013459:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330315.013462:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da833c0/0xd895711d66db77e lrc: 3/0,0 mode: --/PW res: [0x200000402:0x158a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.013467:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da833c0/0xd895711d66db77e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x158a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.013488:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80000/0xd895711d66db777 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.013493:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80000/0xd895711d66db777 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x158a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.013498:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80000/0xd895711d66db777 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x158a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.013503:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da80000 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.013506:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80000/0xd895711d66db777 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x158a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.013510:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80000/0xd895711d66db777 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x158a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.013516:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158a:0x0].0x0 (ffff88009d5fa300) 00010000:00010000:3.0:1715330315.013518:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330315.013520:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80000/0xd895711d66db777 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x158a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.013524:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80000/0xd895711d66db777 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x158a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.013608:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82640/0xd895711d66db769 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.013614:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82640/0xd895711d66db769 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.013619:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82640/0xd895711d66db769 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.013623:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82640/0xd895711d66db769 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.013627:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da82640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.013629:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82640/0xd895711d66db769 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.013634:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82640/0xd895711d66db769 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.013640:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330315.013642:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.013644:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82640/0xd895711d66db769 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.013648:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82640/0xd895711d66db769 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:3.0:1715330315.013656:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012fa4c700 reply state ffff88009d6e5000 transno 4294984060 ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81200/0xd895711d66db770 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca989fd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.013663:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81200/0xd895711d66db770 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.013667:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989fd9 (ffff88009ef2c900) 00010000:00010000:3.0:1715330315.013669:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330315.013672:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330315.014294:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+707:18881:x1798653938111040:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 1976us (2159us total) trans 4294984060 rc 0/0 00000100:00100000:3.0:1715330315.014304:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23795 00000100:00100000:0.0:1715330315.019602:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330315.019716:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938111168 00000100:00100000:3.0:1715330315.019725:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938111168 00000100:00100000:2.0:1715330315.019963:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23796 00000100:00100000:2.0:1715330315.019970:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+707:18881:x1798653938111168:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:2.0:1715330315.020020:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330315.020049:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9ef40/0xd895711d66dac8e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x158b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe0a expref: 707 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330315.021455:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158b:0x0].0x0 (ffff880091c70400) 00010000:00010000:2.0:1715330315.021470:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330315.021496:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66db785 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.021507:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66db785 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.021514:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66db785 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.021522:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5680/0xd895711d66db78c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a0d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.021528:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5680/0xd895711d66db78c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.021532:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5680/0xd895711d66db78c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.021580:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b58c0/0xd895711d66db793 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x158b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.021586:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b58c0/0xd895711d66db793 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.021590:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b58c0/0xd895711d66db793 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:3.0:1715330315.023113:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].49, 64 off11328 00000040:00080000:3.0:1715330315.023143:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].405, 184 off79616 00010000:00010000:3.0:1715330315.023190:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81f80/0xd895711d66db79a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x158b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.023200:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81f80/0xd895711d66db79a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x158b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.023207:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81f80/0xd895711d66db79a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x158b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.023214:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81f80/0xd895711d66db79a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x158b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.023218:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81f80/0xd895711d66db79a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x158b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.023221:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81f80/0xd895711d66db79a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x158b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.023227:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81f80/0xd895711d66db79a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x158b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.023231:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da81f80 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330315.023233:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81f80/0xd895711d66db79a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x158b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.023239:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81f80/0xd895711d66db79a lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x158b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.023248:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158b:0x0].0x0 (ffff880093a11100) 00010000:00010000:3.0:1715330315.023252:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715330315.023254:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81f80/0xd895711d66db79a lrc: 3/0,0 mode: --/PW res: [0x200000402:0x158b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.023258:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81f80/0xd895711d66db79a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x158b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.023285:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b58c0/0xd895711d66db793 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.023290:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b58c0/0xd895711d66db793 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x158b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.023295:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b58c0/0xd895711d66db793 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x158b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.023299:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b58c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.023301:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b58c0/0xd895711d66db793 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x158b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.023305:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b58c0/0xd895711d66db793 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x158b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.023311:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158b:0x0].0x0 (ffff880093a11100) 00010000:00010000:3.0:1715330315.023313:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715330315.023315:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b58c0/0xd895711d66db793 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x158b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.023318:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b58c0/0xd895711d66db793 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x158b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.023412:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66db785 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.023418:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66db785 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.023422:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66db785 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.023426:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66db785 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.023430:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b5200 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.023431:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66db785 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.023435:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66db785 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.023441:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:3.0:1715330315.023443:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.023445:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66db785 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.023449:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66db785 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:3.0:1715330315.023455:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8801344c9f80 reply state ffff88009c61d000 transno 4294984061 ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5680/0xd895711d66db78c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a0d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.023463:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5680/0xd895711d66db78c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.023467:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a0d9 (ffff88009ef2cb00) 00010000:00010000:3.0:1715330315.023469:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330315.023471:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330315.023555:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+708:18881:x1798653938111168:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 3580us (3956us total) trans 4294984061 rc 0/0 00000100:00100000:3.0:1715330315.023566:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23796 00000100:00100000:2.0:1715330315.026897:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330315.027229:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938111296 00000100:00100000:0.0:1715330315.027238:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938111296 00000100:00100000:0.0:1715330315.027283:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23797 00000100:00100000:0.0:1715330315.027290:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+708:18881:x1798653938111296:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1715330315.027335:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330315.027356:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0b40/0xd895711d66dacb1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x158c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe11 expref: 708 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.027375:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158c:0x0].0x0 (ffff88012ca48800) 00010000:00010000:0.0:1715330315.027382:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715330315.027410:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66db7a1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.027420:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66db7a1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.027428:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66db7a1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.027435:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66db7a8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.027440:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66db7a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.027444:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66db7a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.027489:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66db7af lrc: 3/0,1 mode: --/EX res: [0x200000402:0x158c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.027494:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66db7af lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.027499:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66db7af lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:0.0:1715330315.027673:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2551, 64 off171456 00000040:00080000:0.0:1715330315.027697:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].406, 184 off79800 00010000:00010000:0.0:1715330315.027749:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0d80/0xd895711d66db7b6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x158c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.027756:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0d80/0xd895711d66db7b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x158c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.027762:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0d80/0xd895711d66db7b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x158c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.027768:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0d80/0xd895711d66db7b6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x158c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.027773:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0d80/0xd895711d66db7b6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x158c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.027777:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0d80/0xd895711d66db7b6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x158c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.027782:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0d80/0xd895711d66db7b6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x158c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.027787:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a0d80 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330315.027790:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0d80/0xd895711d66db7b6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x158c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.027795:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0d80/0xd895711d66db7b6 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x158c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.027802:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158c:0x0].0x0 (ffff8800aa391f00) 00010000:00010000:0.0:1715330315.027804:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1715330315.027806:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0d80/0xd895711d66db7b6 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x158c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.027811:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0d80/0xd895711d66db7b6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x158c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.027829:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66db7af lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.027833:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66db7af lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x158c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.027838:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66db7af lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x158c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.027842:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a1440 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330315.027844:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66db7af lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x158c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.027848:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66db7af lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x158c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.027853:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158c:0x0].0x0 (ffff8800aa391f00) 00010000:00010000:0.0:1715330315.027855:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715330315.027856:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66db7af lrc: 2/0,0 mode: --/EX res: [0x200000402:0x158c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.027867:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1440/0xd895711d66db7af lrc: 0/0,0 mode: --/EX res: [0x200000402:0x158c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.027942:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66db7a1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.027946:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66db7a1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.027950:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66db7a1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.027955:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66db7a1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.027958:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a06c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330315.027960:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66db7a1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.027964:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66db7a1 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.027970:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:0.0:1715330315.027972:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330315.027974:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66db7a1 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.027978:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a06c0/0xd895711d66db7a1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:0.0:1715330315.027985:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880093b58700 reply state ffff880091e50000 transno 4294984062 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66db7a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.027992:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66db7a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.027997:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a1d9 (ffff88012ca48700) 00010000:00010000:0.0:1715330315.027999:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330315.028001:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1715330315.028065:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+709:18881:x1798653938111296:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 774us (1175us total) trans 4294984062 rc 0/0 00000100:00100000:0.0:1715330315.028072:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23797 00000100:00100000:1.0:1715330315.035486:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330315.035569:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938111424 00000100:00100000:2.0:1715330315.035578:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938111424 00000100:00100000:2.0:1715330315.035616:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23798 00000100:00100000:2.0:1715330315.035622:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+709:18881:x1798653938111424:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:2.0:1715330315.035668:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330315.035690:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9dd40/0xd895711d66dacd4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x158d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe18 expref: 709 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330315.035705:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158d:0x0].0x0 (ffff880091c70900) 00010000:00010000:2.0:1715330315.035714:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330315.035779:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66db7bd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.035790:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66db7bd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.035798:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66db7bd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.035806:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4d80/0xd895711d66db7c4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a2d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.035812:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4d80/0xd895711d66db7c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.035817:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4d80/0xd895711d66db7c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.035857:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4fc0/0xd895711d66db7cb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x158d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.035862:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4fc0/0xd895711d66db7cb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.035866:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4fc0/0xd895711d66db7cb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000040:00080000:2.0:1715330315.036068:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].50, 64 off11392 00000040:00080000:2.0:1715330315.036095:0:7133:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].407, 184 off79984 00010000:00010000:2.0:1715330315.036130:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4000/0xd895711d66db7d2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x158d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.036136:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4000/0xd895711d66db7d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x158d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.036142:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4000/0xd895711d66db7d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x158d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.036147:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4000/0xd895711d66db7d2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x158d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.036152:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4000/0xd895711d66db7d2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x158d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.036157:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4000/0xd895711d66db7d2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x158d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.036165:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4000/0xd895711d66db7d2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x158d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.036170:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b4000 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330315.036173:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4000/0xd895711d66db7d2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x158d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.036179:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4000/0xd895711d66db7d2 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x158d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.036186:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158d:0x0].0x0 (ffff880093a11e00) 00010000:00010000:2.0:1715330315.036188:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1715330315.036191:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4000/0xd895711d66db7d2 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x158d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.036195:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4000/0xd895711d66db7d2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x158d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.036213:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4fc0/0xd895711d66db7cb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.036217:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4fc0/0xd895711d66db7cb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x158d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.036221:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4fc0/0xd895711d66db7cb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x158d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.036225:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b4fc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330315.036227:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4fc0/0xd895711d66db7cb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x158d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.036230:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4fc0/0xd895711d66db7cb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x158d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.036238:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158d:0x0].0x0 (ffff880093a11e00) 00010000:00010000:2.0:1715330315.036240:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330315.036242:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4fc0/0xd895711d66db7cb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x158d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.036246:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4fc0/0xd895711d66db7cb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x158d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.036331:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66db7bd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.036336:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66db7bd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.036340:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66db7bd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.036344:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66db7bd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.036348:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b4900 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330315.036350:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66db7bd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.036354:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66db7bd lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.036358:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330315.036360:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330315.036362:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66db7bd lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.036365:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66db7bd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:2.0:1715330315.036372:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012fa4ea00 reply state ffff88009c61f000 transno 4294984063 ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4d80/0xd895711d66db7c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a2d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.036379:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4d80/0xd895711d66db7c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.036383:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a2d9 (ffff880091c70c00) 00010000:00010000:2.0:1715330315.036384:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330315.036386:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1715330315.036434:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+710:18881:x1798653938111424:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 812us (955us total) trans 4294984063 rc 0/0 00000100:00100000:2.0:1715330315.036441:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23798 00000100:00100000:0.0:1715330315.045088:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330315.045179:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938111552 00000100:00100000:2.0:1715330315.045189:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938111552 00000100:00100000:2.0:1715330315.045229:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23799 00000100:00100000:2.0:1715330315.045235:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+710:18881:x1798653938111552:12345-192.168.204.49@tcp:36:unlinkmany.0 00010000:00010000:2.0:1715330315.045283:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330315.045304:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cb40/0xd895711d66dacf7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x158e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe1f expref: 710 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330315.045321:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158e:0x0].0x0 (ffff880091c70f00) 00010000:00010000:2.0:1715330315.045329:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330315.045352:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4480/0xd895711d66db7d9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.045363:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4480/0xd895711d66db7d9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.045371:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4480/0xd895711d66db7d9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.045380:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b46c0/0xd895711d66db7e0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152a:0x0].0xca98a3d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.045385:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b46c0/0xd895711d66db7e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.045390:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b46c0/0xd895711d66db7e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.045436:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66db7e7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x158e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.045441:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66db7e7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.045446:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66db7e7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:2.0:1715330315.045625:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2552, 64 off171520 00000040:00080000:2.0:1715330315.045648:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xc:0x0].408, 184 off80168 00010000:00010000:2.0:1715330315.045677:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b58c0/0xd895711d66db7ee lrc: 3/0,1 mode: --/PW res: [0x200000402:0x158e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.045684:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b58c0/0xd895711d66db7ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x158e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.045690:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b58c0/0xd895711d66db7ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x158e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.045695:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b58c0/0xd895711d66db7ee lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x158e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.045700:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b58c0/0xd895711d66db7ee lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x158e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.045709:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b58c0/0xd895711d66db7ee lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x158e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.045714:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b58c0/0xd895711d66db7ee lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x158e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.045718:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b58c0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330315.045721:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b58c0/0xd895711d66db7ee lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x158e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.045726:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b58c0/0xd895711d66db7ee lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x158e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.045761:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158e:0x0].0x0 (ffff880093a11b00) 00010000:00010000:2.0:1715330315.045763:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1715330315.045766:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b58c0/0xd895711d66db7ee lrc: 3/0,0 mode: --/PW res: [0x200000402:0x158e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.045770:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b58c0/0xd895711d66db7ee lrc: 0/0,0 mode: --/PW res: [0x200000402:0x158e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.045787:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66db7e7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.045792:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66db7e7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x158e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.045796:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66db7e7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x158e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.045800:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b5200 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330315.045803:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66db7e7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x158e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.045811:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66db7e7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x158e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.045816:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158e:0x0].0x0 (ffff880093a11b00) 00010000:00010000:2.0:1715330315.045818:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330315.045819:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66db7e7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x158e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.045823:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66db7e7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x158e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.045899:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4480/0xd895711d66db7d9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.045904:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4480/0xd895711d66db7d9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.045908:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4480/0xd895711d66db7d9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.045912:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4480/0xd895711d66db7d9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.045916:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b4480 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330315.045918:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4480/0xd895711d66db7d9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.045922:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4480/0xd895711d66db7d9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.045928:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330315.045930:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330315.045932:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4480/0xd895711d66db7d9 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.045937:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4480/0xd895711d66db7d9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:2.0:1715330315.045945:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8801344c8a80 reply state ffff88009c61e000 transno 4294984064 ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b46c0/0xd895711d66db7e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0xca98a3d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.045952:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b46c0/0xd895711d66db7e0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.045957:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a3d9 (ffff880091c70000) 00010000:00010000:2.0:1715330315.045958:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330315.045960:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1715330315.050699:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+711:18881:x1798653938111552:12345-192.168.204.49@tcp:36:unlinkmany.0 Request processed in 5451us (5609us total) trans 4294984064 rc 0/0 00000100:00100000:2.0:1715330315.050711:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23799 00010000:00010000:1.0:1715330315.225314:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1715330315.315089:0:9630:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 289791355910ns, next at 290791353164ns, rc = 0 00000100:00100000:0.0:1715330315.315146:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1715330315.315177:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942510144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1715330315.315271:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330315.315338:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942510144 00000100:00100000:1.0:1715330315.315346:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942510144 00000100:00100000:1.0:1715330315.315410:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1715330315.315417:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3691:x1798653942510144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1715330315.315440:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 67475136 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1715330315.315507:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3691:x1798653942510144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330315.315513:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:2.0:1715330315.315933:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330285 00000100:00100000:0.0:1715330315.316518:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942510144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1715330315.347459:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1715330315.347482:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942510208:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1715330315.347556:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330315.347601:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942510208 00000100:00100000:3.0:1715330315.347607:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942510208 00000100:00100000:3.0:1715330315.347643:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1715330315.347649:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942510208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1715330315.347671:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 67475136 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1715330315.347698:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942510208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330315.347704:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1715330315.347744:0:3690:0:(client.c:2956:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294969897 gen 2 00000004:00080000:3.0:1715330315.347748:0:3690:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fa4e680, transno 4294969893 00000004:00080000:3.0:1715330315.347755:0:3690:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f57a300, transno 4294969894 00000004:00080000:3.0:1715330315.347757:0:3690:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f578000, transno 4294969895 00000004:00080000:3.0:1715330315.347760:0:3690:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f57b100, transno 4294969896 00000004:00080000:3.0:1715330315.347762:0:3690:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fa4ca80, transno 4294969897 00000100:00100000:3.0:1715330315.347771:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942510208:0@lo:13:osp-pre-0-1.0 00000004:00080000:3.0:1715330315.347875:0:9619:0:(osp_sync.c:1105:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 0 in progress, 0 in flight, 5 done 00000100:00080000:3.0:1715330315.347887:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330285 00000001:00080000:3.0:1715330315.622723:0:10666:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4294969900 is committed 00000001:00080000:1.0:1715330315.623088:0:9395:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0000: transno 4294969899 is committed 00000004:00080000:2.0:1715330315.623241:0:7116:0:(osp_sync.c:1604:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 33 committed 00000001:00080000:2.0:1715330315.623333:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984064 is committed 00010000:00010000:3.0:1715330315.623373:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d680/0xd895711d66d9f67 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.623385:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d680/0xd895711d66d9f67 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.623392:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d680/0xd895711d66d9f67 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.623399:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48d680 already unused, calling callback (ffffffffa0ee8730) 00000040:00080000:0.0:1715330315.623401:0:9629:0:(llog.c:792:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 2501 count 1 00010000:00010000:3.0:1715330315.623403:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d680/0xd895711d66d9f67 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.623409:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d680/0xd895711d66d9f67 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.623429:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca986ad0 (ffff880093b42700) 00010000:00010000:3.0:1715330315.623432:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.623437:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d680/0xd895711d66d9f67 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca986ad0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.623442:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d680/0xd895711d66d9f67 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca986ad0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00080000:2.0:1715330315.623460:0:7116:0:(osp_sync.c:1604:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 33 committed 00010000:00010000:3.0:1715330315.623469:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f180/0xd895711d66d9f8a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00000004:00080000:2.0:1715330315.623470:0:7116:0:(osp_sync.c:1604:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 32 committed 00010000:00010000:3.0:1715330315.623474:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f180/0xd895711d66d9f8a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.623478:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f180/0xd895711d66d9f8a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.623483:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48f180 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.623485:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f180/0xd895711d66d9f8a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.623489:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f180/0xd895711d66d9f8a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.623495:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca986ad1 (ffff880093b42200) 00010000:00010000:3.0:1715330315.623496:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.623498:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f180/0xd895711d66d9f8a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca986ad1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.623501:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f180/0xd895711d66d9f8a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca986ad1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.623511:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9fad lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623513:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9fad lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623516:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9fad lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623519:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64900 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.623520:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9fad lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623523:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9fad lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623526:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca986ad2 (ffff88009d618900) 00010000:00010000:3.0:1715330315.623527:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.623528:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9fad lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca986ad2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623531:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64900/0xd895711d66d9fad lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca986ad2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623543:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d9fd0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623546:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d9fd0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623549:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d9fd0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623551:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db673c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.623553:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d9fd0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623555:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d9fd0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623558:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca986ad3 (ffff88009d618100) 00010000:00010000:3.0:1715330315.623559:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.623560:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d9fd0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca986ad3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623562:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db673c0/0xd895711d66d9fd0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca986ad3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623572:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d9ff3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623574:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d9ff3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623577:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d9ff3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623582:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db65b00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.623583:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d9ff3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623586:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d9ff3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623590:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca986ad4 (ffff88009d618e00) 00010000:00010000:3.0:1715330315.623591:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.623593:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d9ff3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca986ad4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623595:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db65b00/0xd895711d66d9ff3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca986ad4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623606:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66da016 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623608:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66da016 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623611:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66da016 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623613:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db67cc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.623614:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66da016 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623616:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66da016 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623620:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca986ad5 (ffff88009d618700) 00010000:00010000:3.0:1715330315.623622:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.623623:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66da016 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca986ad5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623626:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67cc0/0xd895711d66da016 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca986ad5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623634:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66da039 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623636:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66da039 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623638:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66da039 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623640:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db66d00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.623641:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66da039 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623643:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66da039 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623647:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca986ad6 (ffff88009d618000) 00010000:00010000:3.0:1715330315.623648:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.623649:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66da039 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca986ad6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623651:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66d00/0xd895711d66da039 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca986ad6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623661:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48df80/0xd895711d66da05c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.623667:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48df80/0xd895711d66da05c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.623670:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48df80/0xd895711d66da05c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.623672:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48df80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.623673:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48df80/0xd895711d66da05c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.623675:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48df80/0xd895711d66da05c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.623679:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca986ad7 (ffff880093b42d00) 00010000:00010000:3.0:1715330315.623679:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.623681:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48df80/0xd895711d66da05c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca986ad7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.623683:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48df80/0xd895711d66da05c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca986ad7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.623690:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f3c0/0xd895711d66da07f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.623692:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f3c0/0xd895711d66da07f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.623695:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f3c0/0xd895711d66da07f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.623697:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48f3c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.623698:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f3c0/0xd895711d66da07f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.623701:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f3c0/0xd895711d66da07f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.623706:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca986ad8 (ffff880093b42500) 00010000:00010000:3.0:1715330315.623706:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.623708:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f3c0/0xd895711d66da07f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca986ad8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.623710:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48f3c0/0xd895711d66da07f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca986ad8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.623717:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66da0a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623720:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66da0a2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623722:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66da0a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623724:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64d80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.623725:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66da0a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623727:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66da0a2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623752:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca986ad9 (ffff88009d618a00) 00010000:00010000:3.0:1715330315.623753:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.623754:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66da0a2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca986ad9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623760:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64d80/0xd895711d66da0a2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca986ad9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623769:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66da0c5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623771:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66da0c5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623774:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66da0c5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623777:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db64240 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.623778:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66da0c5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623780:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66da0c5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623784:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ad1 (ffff88009b9a4600) 00010000:00010000:3.0:1715330315.623784:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.623786:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66da0c5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ad1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623788:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db64240/0xd895711d66da0c5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ad1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623797:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66da0e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623799:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66da0e8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623804:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66da0e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623806:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db67180 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.623808:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66da0e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623810:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66da0e8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623813:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989bd1 (ffff88008b122a00) 00010000:00010000:3.0:1715330315.623814:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.623815:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66da0e8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989bd1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623817:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67180/0xd895711d66da0e8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989bd1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623823:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66da10b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623826:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66da10b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623828:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66da10b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623830:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db67600 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.623831:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66da10b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623833:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66da10b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623838:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989cd1 (ffff88008b122c00) 00010000:00010000:3.0:1715330315.623839:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.623840:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66da10b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989cd1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623842:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67600/0xd895711d66da10b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989cd1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623851:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66da12e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623853:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66da12e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623855:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66da12e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623857:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011db67a80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.623859:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66da12e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623861:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66da12e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623864:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989dd1 (ffff88008b122e00) 00000040:00080000:0.0:1715330315.623864:0:9629:0:(llog.c:735:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00010000:00010000:3.0:1715330315.623865:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.623866:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66da12e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989dd1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000040:00080000:0.0:1715330315.623867:0:9629:0:(llog_cat.c:796:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00010000:00010000:3.0:1715330315.623868:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67a80/0xd895711d66da12e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989dd1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623879:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66da151 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623882:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66da151 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623884:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66da151 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623886:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f18c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.623887:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66da151 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623890:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66da151 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623893:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ed1 (ffff88008b122700) 00010000:00010000:3.0:1715330315.623894:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.623895:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66da151 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ed1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623897:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f18c0/0xd895711d66da151 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ed1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623906:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c6c0/0xd895711d66da174 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623908:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c6c0/0xd895711d66da174 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623910:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c6c0/0xd895711d66da174 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623915:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48c6c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.623916:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c6c0/0xd895711d66da174 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.623919:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c6c0/0xd895711d66da174 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00000100:00100000:2.0:1715330315.623945:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942510336:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1715330315.623945:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093983b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942510272:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.624053:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989fd1 (ffff880093b42600) 00010000:00010000:3.0:1715330315.624055:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.624057:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c6c0/0xd895711d66da174 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989fd1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624061:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c6c0/0xd895711d66da174 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989fd1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624075:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48eac0/0xd895711d66da197 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624080:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48eac0/0xd895711d66da197 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624084:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48eac0/0xd895711d66da197 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624088:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48eac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.624090:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48eac0/0xd895711d66da197 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624096:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48eac0/0xd895711d66da197 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624102:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a0d1 (ffff880093b42800) 00010000:00010000:3.0:1715330315.624105:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.624107:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48eac0/0xd895711d66da197 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a0d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624111:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48eac0/0xd895711d66da197 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a0d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624123:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cb40/0xd895711d66da1ba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624128:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cb40/0xd895711d66da1ba lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624132:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cb40/0xd895711d66da1ba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624136:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48cb40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.624139:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cb40/0xd895711d66da1ba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624143:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cb40/0xd895711d66da1ba lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624150:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a1d1 (ffff880093b42b00) 00010000:00010000:3.0:1715330315.624152:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.624154:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cb40/0xd895711d66da1ba lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a1d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624158:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cb40/0xd895711d66da1ba lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a1d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624168:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d8c0/0xd895711d66da1dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624175:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d8c0/0xd895711d66da1dd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624179:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d8c0/0xd895711d66da1dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624182:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48d8c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.624184:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d8c0/0xd895711d66da1dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624187:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d8c0/0xd895711d66da1dd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624192:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a2d1 (ffff88009ef25900) 00010000:00010000:3.0:1715330315.624193:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.624195:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d8c0/0xd895711d66da1dd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a2d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624198:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d8c0/0xd895711d66da1dd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a2d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624207:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66da200 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624210:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66da200 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624214:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66da200 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624216:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f3840 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.624218:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66da200 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624223:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66da200 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624227:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a3d1 (ffff88008b122300) 00010000:00010000:3.0:1715330315.624229:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.624230:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66da200 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a3d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624234:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3840/0xd895711d66da200 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a3d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624243:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48db00/0xd895711d66da223 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624247:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48db00/0xd895711d66da223 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624250:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48db00/0xd895711d66da223 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624253:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48db00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.624255:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48db00/0xd895711d66da223 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624258:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48db00/0xd895711d66da223 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624263:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ad2 (ffff88009ef25b00) 00010000:00010000:3.0:1715330315.624265:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.624266:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48db00/0xd895711d66da223 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ad2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624273:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48db00/0xd895711d66da223 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ad2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624283:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0000/0xd895711d66da246 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624286:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0000/0xd895711d66da246 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624290:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0000/0xd895711d66da246 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624293:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a0000 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.624294:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0000/0xd895711d66da246 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624298:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0000/0xd895711d66da246 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624303:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989bd2 (ffff88012ca48100) 00010000:00010000:3.0:1715330315.624304:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.624305:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0000/0xd895711d66da246 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989bd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624309:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0000/0xd895711d66da246 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989bd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624319:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0fc0/0xd895711d66da269 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624322:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0fc0/0xd895711d66da269 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624329:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0fc0/0xd895711d66da269 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624333:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a0fc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.624335:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0fc0/0xd895711d66da269 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624338:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0fc0/0xd895711d66da269 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624343:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989cd2 (ffff88012ca48a00) 00010000:00010000:3.0:1715330315.624344:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.624345:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0fc0/0xd895711d66da269 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989cd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624349:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0fc0/0xd895711d66da269 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989cd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624357:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66da28c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624360:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66da28c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624364:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66da28c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624367:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f1d40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.624369:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66da28c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624372:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66da28c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624378:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989dd2 (ffff88008b122400) 00010000:00010000:3.0:1715330315.624379:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.624381:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66da28c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989dd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624384:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1d40/0xd895711d66da28c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989dd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624393:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48ef40/0xd895711d66da2af lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624397:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48ef40/0xd895711d66da2af lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624400:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48ef40/0xd895711d66da2af lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624403:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48ef40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.624405:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48ef40/0xd895711d66da2af lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624408:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48ef40/0xd895711d66da2af lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624413:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ed2 (ffff88009ef25f00) 00010000:00010000:3.0:1715330315.624414:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.624415:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48ef40/0xd895711d66da2af lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ed2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624419:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48ef40/0xd895711d66da2af lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ed2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624428:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66da2d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624432:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66da2d2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624436:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66da2d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624439:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f3cc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.624440:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66da2d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624444:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66da2d2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624448:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989fd2 (ffff88012bfb5e00) 00010000:00010000:3.0:1715330315.624449:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.624451:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66da2d2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989fd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624454:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3cc0/0xd895711d66da2d2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989fd2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624462:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c000/0xd895711d66da2f5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624466:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c000/0xd895711d66da2f5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624469:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c000/0xd895711d66da2f5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624472:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48c000 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.624474:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c000/0xd895711d66da2f5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624478:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c000/0xd895711d66da2f5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624483:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a0d2 (ffff88009ef25a00) 00010000:00010000:3.0:1715330315.624484:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.624486:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c000/0xd895711d66da2f5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a0d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624489:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48c000/0xd895711d66da2f5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a0d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624498:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cfc0/0xd895711d66da318 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624501:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cfc0/0xd895711d66da318 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624505:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cfc0/0xd895711d66da318 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624508:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48cfc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.624509:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cfc0/0xd895711d66da318 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624513:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cfc0/0xd895711d66da318 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624517:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a1d2 (ffff88009ef25d00) 00010000:00010000:3.0:1715330315.624519:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.624520:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cfc0/0xd895711d66da318 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a1d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624527:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48cfc0/0xd895711d66da318 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a1d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624536:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d440/0xd895711d66da33b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624540:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d440/0xd895711d66da33b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624543:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d440/0xd895711d66da33b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624546:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f48d440 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.624548:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d440/0xd895711d66da33b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624551:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d440/0xd895711d66da33b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624555:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a2d2 (ffff88009ef25600) 00010000:00010000:3.0:1715330315.624556:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.624558:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d440/0xd895711d66da33b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a2d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624561:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f48d440/0xd895711d66da33b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a2d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624570:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7600/0xd895711d66da35e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624574:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7600/0xd895711d66da35e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624580:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7600/0xd895711d66da35e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624584:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a91b7600 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.624585:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7600/0xd895711d66da35e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624589:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7600/0xd895711d66da35e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624593:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a3d2 (ffff88009bbf0800) 00010000:00010000:3.0:1715330315.624595:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.624596:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7600/0xd895711d66da35e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a3d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624599:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7600/0xd895711d66da35e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a3d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624607:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b6d00/0xd895711d66da381 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624611:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b6d00/0xd895711d66da381 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624614:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b6d00/0xd895711d66da381 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624617:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a91b6d00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.624619:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b6d00/0xd895711d66da381 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624622:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b6d00/0xd895711d66da381 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624627:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ad3 (ffff88009bbf0300) 00010000:00010000:3.0:1715330315.624629:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.624630:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b6d00/0xd895711d66da381 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ad3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624634:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b6d00/0xd895711d66da381 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ad3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000100:00100000:0.0:1715330315.624640:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1715330315.624644:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b5680/0xd895711d66da3a4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624647:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b5680/0xd895711d66da3a4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624651:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b5680/0xd895711d66da3a4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624653:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a91b5680 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.624655:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b5680/0xd895711d66da3a4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624659:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b5680/0xd895711d66da3a4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624663:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989bd3 (ffff88009bbf0200) 00010000:00010000:3.0:1715330315.624664:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.624666:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b5680/0xd895711d66da3a4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989bd3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624669:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b5680/0xd895711d66da3a4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989bd3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624681:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b73c0/0xd895711d66da3c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624685:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b73c0/0xd895711d66da3c7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624688:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b73c0/0xd895711d66da3c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624691:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a91b73c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.624693:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b73c0/0xd895711d66da3c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624696:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b73c0/0xd895711d66da3c7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624701:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989cd3 (ffff88009bbf0700) 00010000:00010000:3.0:1715330315.624702:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.624703:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b73c0/0xd895711d66da3c7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989cd3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624707:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b73c0/0xd895711d66da3c7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989cd3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624716:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cfa80/0xd895711d66da3ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624719:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cfa80/0xd895711d66da3ea lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624722:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cfa80/0xd895711d66da3ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624728:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800939cfa80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.624748:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cfa80/0xd895711d66da3ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624753:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cfa80/0xd895711d66da3ea lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624758:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989dd3 (ffff88009bbf0b00) 00010000:00010000:3.0:1715330315.624759:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.624761:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cfa80/0xd895711d66da3ea lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989dd3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624764:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cfa80/0xd895711d66da3ea lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989dd3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624774:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc480/0xd895711d66da40d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624777:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc480/0xd895711d66da40d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624781:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc480/0xd895711d66da40d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624784:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800939cc480 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.624786:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc480/0xd895711d66da40d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624790:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc480/0xd895711d66da40d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624795:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ed3 (ffff88009bbf0c00) 00010000:00010000:3.0:1715330315.624797:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.624799:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc480/0xd895711d66da40d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ed3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624803:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc480/0xd895711d66da40d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ed3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624812:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce1c0/0xd895711d66da430 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624816:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce1c0/0xd895711d66da430 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624819:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce1c0/0xd895711d66da430 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624822:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800939ce1c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.624824:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce1c0/0xd895711d66da430 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624827:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce1c0/0xd895711d66da430 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624832:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989fd3 (ffff8800ad835f00) 00010000:00010000:3.0:1715330315.624833:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.624835:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce1c0/0xd895711d66da430 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989fd3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624839:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce1c0/0xd895711d66da430 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989fd3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.624849:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3840/0xd895711d66da453 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624856:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3840/0xd895711d66da453 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624861:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3840/0xd895711d66da453 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624865:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a3840 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.624867:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3840/0xd895711d66da453 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624872:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3840/0xd895711d66da453 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624877:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a0d3 (ffff88012ca48b00) 00010000:00010000:3.0:1715330315.624879:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.624881:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3840/0xd895711d66da453 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a0d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624885:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3840/0xd895711d66da453 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a0d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.624897:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942510528:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.624898:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66da476 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624903:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66da476 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624907:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66da476 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624910:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f0000 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.624912:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66da476 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.624916:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1715330315.624917:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66da476 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624923:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a1d3 (ffff88012bfb5100) 00010000:00010000:3.0:1715330315.624924:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.624926:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66da476 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a1d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.624926:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093981880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942510784:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.624929:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f0000/0xd895711d66da476 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a1d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624938:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66da499 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.624939:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1715330315.624941:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66da499 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624945:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66da499 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624948:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ad9f3a80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.624950:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66da499 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624954:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66da499 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624959:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a2d3 (ffff88012bfb5400) 00010000:00010000:3.0:1715330315.624960:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330315.624961:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093983100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942510464:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.624962:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66da499 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a2d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624968:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3a80/0xd895711d66da499 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a2d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.624977:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1715330315.624978:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738000/0xd895711d66da4bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624982:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738000/0xd895711d66da4bc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624985:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738000/0xd895711d66da4bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.624986:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093982d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942510720:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.624988:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d738000 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.624990:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738000/0xd895711d66da4bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624993:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738000/0xd895711d66da4bc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.624998:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a3d3 (ffff88012bfb5500) 00000100:00100000:0.0:1715330315.624998:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1715330315.624999:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.625001:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738000/0xd895711d66da4bc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a3d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625004:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738000/0xd895711d66da4bc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a3d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.625007:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1715330315.625011:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093983800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942510400:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.625023:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738900/0xd895711d66da4df lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625027:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738900/0xd895711d66da4df lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.625037:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330315.625046:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942510592:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1715330315.625059:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330315.625077:0:17197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942510272 00000100:00100000:0.0:1715330315.625082:0:17197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942510272 00000100:00100000:0.0:1715330315.625111:0:17197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942510528 00000100:00100000:0.0:1715330315.625114:0:17197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942510528 00000100:00100000:0.0:1715330315.625124:0:17197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942510784 00000100:00100000:0.0:1715330315.625125:0:17197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942510784 00000100:00100000:0.0:1715330315.625133:0:17197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942510464 00000100:00100000:0.0:1715330315.625134:0:17197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942510464 00010000:00010000:3.0:1715330315.625158:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738900/0xd895711d66da4df lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625162:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d738900 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.625164:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738900/0xd895711d66da4df lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625168:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738900/0xd895711d66da4df lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625173:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ad4 (ffff88008b374e00) 00010000:00010000:3.0:1715330315.625175:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.625177:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738900/0xd895711d66da4df lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ad4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625180:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738900/0xd895711d66da4df lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ad4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625204:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739200/0xd895711d66da502 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625209:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739200/0xd895711d66da502 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625213:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739200/0xd895711d66da502 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625216:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d739200 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.625218:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739200/0xd895711d66da502 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625221:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739200/0xd895711d66da502 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625227:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989bd4 (ffff88008b374a00) 00010000:00010000:3.0:1715330315.625228:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.625230:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739200/0xd895711d66da502 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989bd4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625233:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739200/0xd895711d66da502 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989bd4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625250:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739b00/0xd895711d66da525 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625253:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739b00/0xd895711d66da525 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625257:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739b00/0xd895711d66da525 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625260:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d739b00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.625262:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739b00/0xd895711d66da525 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625266:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739b00/0xd895711d66da525 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625271:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989cd4 (ffff88008b374900) 00010000:00010000:3.0:1715330315.625272:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.625274:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739b00/0xd895711d66da525 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989cd4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625277:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739b00/0xd895711d66da525 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989cd4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625286:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ccfc0/0xd895711d66da548 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.625290:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ccfc0/0xd895711d66da548 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.625294:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ccfc0/0xd895711d66da548 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.625297:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800939ccfc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.625299:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ccfc0/0xd895711d66da548 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.625302:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ccfc0/0xd895711d66da548 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.625307:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989dd4 (ffff8800ab6b5500) 00010000:00010000:3.0:1715330315.625308:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.625309:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ccfc0/0xd895711d66da548 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989dd4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.625313:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ccfc0/0xd895711d66da548 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989dd4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.625322:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73a400/0xd895711d66da56b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625325:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73a400/0xd895711d66da56b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625329:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73a400/0xd895711d66da56b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625332:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d73a400 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.625334:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73a400/0xd895711d66da56b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625338:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73a400/0xd895711d66da56b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625343:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ed4 (ffff88008b374000) 00010000:00010000:3.0:1715330315.625344:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.625346:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73a400/0xd895711d66da56b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ed4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625349:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73a400/0xd895711d66da56b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ed4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625357:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc6c0/0xd895711d66da58e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.625361:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc6c0/0xd895711d66da58e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.625364:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc6c0/0xd895711d66da58e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.625367:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800939cc6c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.625369:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc6c0/0xd895711d66da58e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.625372:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc6c0/0xd895711d66da58e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.625377:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989fd4 (ffff8800ab6b5400) 00010000:00010000:3.0:1715330315.625378:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.625380:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc6c0/0xd895711d66da58e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989fd4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.625387:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc6c0/0xd895711d66da58e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989fd4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.625397:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cd680/0xd895711d66da5b1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.625401:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cd680/0xd895711d66da5b1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.625406:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cd680/0xd895711d66da5b1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.625410:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800939cd680 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.625412:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cd680/0xd895711d66da5b1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.625417:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cd680/0xd895711d66da5b1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.625422:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a0d4 (ffff8800ab6b5f00) 00010000:00010000:3.0:1715330315.625424:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.625426:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cd680/0xd895711d66da5b1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a0d4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.625430:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cd680/0xd895711d66da5b1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a0d4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.625440:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cf3c0/0xd895711d66da5d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.625444:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cf3c0/0xd895711d66da5d4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.625451:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cf3c0/0xd895711d66da5d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.625455:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800939cf3c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.625457:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cf3c0/0xd895711d66da5d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.625460:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cf3c0/0xd895711d66da5d4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.625466:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a1d4 (ffff8800ab6b5300) 00010000:00010000:3.0:1715330315.625468:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.625469:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cf3c0/0xd895711d66da5d4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a1d4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.625473:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cf3c0/0xd895711d66da5d4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a1d4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.625482:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73ad00/0xd895711d66da5f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625485:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73ad00/0xd895711d66da5f7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625489:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73ad00/0xd895711d66da5f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625492:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d73ad00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.625494:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73ad00/0xd895711d66da5f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625497:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73ad00/0xd895711d66da5f7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625503:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a2d4 (ffff88008b374600) 00010000:00010000:3.0:1715330315.625505:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.625507:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73ad00/0xd895711d66da5f7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a2d4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625510:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73ad00/0xd895711d66da5f7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a2d4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625520:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b600/0xd895711d66da61a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625524:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b600/0xd895711d66da61a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625528:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b600/0xd895711d66da61a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625531:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d73b600 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.625533:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b600/0xd895711d66da61a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625537:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b600/0xd895711d66da61a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625542:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a3d4 (ffff88008b374b00) 00010000:00010000:3.0:1715330315.625544:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.625545:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b600/0xd895711d66da61a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a3d4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625549:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b600/0xd895711d66da61a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a3d4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625557:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73ba80/0xd895711d66da63d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625562:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73ba80/0xd895711d66da63d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625567:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73ba80/0xd895711d66da63d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625571:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d73ba80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.625572:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73ba80/0xd895711d66da63d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625576:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73ba80/0xd895711d66da63d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625581:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ad5 (ffff88009ef57f00) 00010000:00010000:3.0:1715330315.625582:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.625584:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73ba80/0xd895711d66da63d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ad5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625587:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73ba80/0xd895711d66da63d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ad5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625597:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73a880/0xd895711d66da660 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625601:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73a880/0xd895711d66da660 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625605:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73a880/0xd895711d66da660 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625608:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d73a880 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.625610:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73a880/0xd895711d66da660 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625616:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73a880/0xd895711d66da660 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625622:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989bd5 (ffff88009ef57200) 00010000:00010000:3.0:1715330315.625623:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.625624:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73a880/0xd895711d66da660 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989bd5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625628:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73a880/0xd895711d66da660 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989bd5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625639:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739f80/0xd895711d66da683 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625642:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739f80/0xd895711d66da683 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625646:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739f80/0xd895711d66da683 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625649:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d739f80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.625651:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739f80/0xd895711d66da683 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625655:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739f80/0xd895711d66da683 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625660:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989cd5 (ffff88009ef57900) 00010000:00010000:3.0:1715330315.625661:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.625663:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739f80/0xd895711d66da683 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989cd5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625670:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739f80/0xd895711d66da683 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989cd5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625680:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738d80/0xd895711d66da6a6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625684:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738d80/0xd895711d66da6a6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625688:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738d80/0xd895711d66da6a6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625691:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d738d80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.625693:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738d80/0xd895711d66da6a6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625697:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738d80/0xd895711d66da6a6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625703:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989dd5 (ffff88009bbb0600) 00010000:00010000:3.0:1715330315.625704:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.625706:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738d80/0xd895711d66da6a6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989dd5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625709:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d738d80/0xd895711d66da6a6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989dd5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625720:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739680/0xd895711d66da6c9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625724:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739680/0xd895711d66da6c9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625748:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739680/0xd895711d66da6c9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625751:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d739680 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.625753:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739680/0xd895711d66da6c9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625757:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739680/0xd895711d66da6c9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625762:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ed5 (ffff88009bbb0700) 00010000:00010000:3.0:1715330315.625764:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.625765:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739680/0xd895711d66da6c9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ed5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625769:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d739680/0xd895711d66da6c9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ed5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.625773:0:17197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942510720 00000100:00100000:0.0:1715330315.625777:0:17197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942510720 00010000:00010000:3.0:1715330315.625780:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ceac0/0xd895711d66da6ec lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.625784:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ceac0/0xd895711d66da6ec lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.625789:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ceac0/0xd895711d66da6ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.625792:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800939ceac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.625794:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ceac0/0xd895711d66da6ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.625797:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ceac0/0xd895711d66da6ec lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.625803:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989fd5 (ffff8800b2570000) 00010000:00010000:3.0:1715330315.625805:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.625807:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ceac0/0xd895711d66da6ec lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989fd5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.625810:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ceac0/0xd895711d66da6ec lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989fd5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.625826:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b180/0xd895711d66da70f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625830:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b180/0xd895711d66da70f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625833:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b180/0xd895711d66da70f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625837:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d73b180 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.625839:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b180/0xd895711d66da70f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625843:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b180/0xd895711d66da70f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625850:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a0d5 (ffff880093a11f00) 00010000:00010000:3.0:1715330315.625851:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.625854:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b180/0xd895711d66da70f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a0d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625858:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d73b180/0xd895711d66da70f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a0d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625870:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cd200/0xd895711d66da732 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.625875:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cd200/0xd895711d66da732 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.625880:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cd200/0xd895711d66da732 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.625883:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800939cd200 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.625885:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cd200/0xd895711d66da732 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.625888:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cd200/0xd895711d66da732 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.625893:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a1d5 (ffff880092dfde00) 00010000:00010000:3.0:1715330315.625894:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.625896:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cd200/0xd895711d66da732 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a1d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.625900:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cd200/0xd895711d66da732 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a1d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000100:00100000:1.0:1715330315.625902:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942510400 00000100:00100000:1.0:1715330315.625905:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942510400 00010000:00010000:3.0:1715330315.625908:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc240/0xd895711d66da755 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625912:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc240/0xd895711d66da755 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625916:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc240/0xd895711d66da755 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00000100:00100000:1.0:1715330315.625919:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942510592 00010000:00010000:3.0:1715330315.625920:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800939cc240 already unused, calling callback (ffffffffa0ee8730) 00000100:00100000:1.0:1715330315.625920:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942510592 00010000:00010000:3.0:1715330315.625922:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc240/0xd895711d66da755 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625927:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc240/0xd895711d66da755 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625934:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a2d5 (ffff880092dfd500) 00010000:00010000:3.0:1715330315.625935:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.625937:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc240/0xd895711d66da755 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a2d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000100:00100000:1.0:1715330315.625939:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5240 00010000:00010000:3.0:1715330315.625940:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cc240/0xd895711d66da755 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a2d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000100:00100000:1.0:1715330315.625946:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093981500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3688:x1798653942510272:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.625949:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66da778 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.625953:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66da778 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.625957:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66da778 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.625960:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bff600 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.625962:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66da778 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.625966:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66da778 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00002000:00080000:1.0:1715330315.625970:0:9633:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2510 count 1 00010000:00010000:3.0:1715330315.625972:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a3d5 (ffff88008b0d2a00) 00010000:00010000:3.0:1715330315.625973:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.625974:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66da778 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a3d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.625981:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff600/0xd895711d66da778 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a3d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.625993:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce880/0xd895711d66da79b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.625997:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce880/0xd895711d66da79b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00002000:00010000:1.0:1715330315.625999:0:9633:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1715330315.626000:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce880/0xd895711d66da79b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.626003:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800939ce880 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.626005:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce880/0xd895711d66da79b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.626009:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce880/0xd895711d66da79b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330315.626010:0:9633:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091c5c240/0xd895711d66db7f5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626022:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ad6 (ffff880092dfd300) 00010000:00010000:3.0:1715330315.626023:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.626025:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce880/0xd895711d66da79b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ad6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.626029:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce880/0xd895711d66da79b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ad6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330315.626030:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330315.626032:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330315.626036:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66da7be lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.626039:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66da7be lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.626047:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66da7be lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.626050:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfc480 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.626052:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66da7be lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.626056:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66da7be lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00000100:00100000:2.0:1715330315.626058:0:17205:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5241 00010000:00010000:3.0:1715330315.626061:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989bd6 (ffff88008b0d2600) 00010000:00010000:3.0:1715330315.626062:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330315.626063:0:17205:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093980a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+10:3688:x1798653942510528:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.626064:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66da7be lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989bd6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.626067:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc480/0xd895711d66da7be lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989bd6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00002000:00080000:2.0:1715330315.626074:0:17205:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2514 count 1 00010000:00010000:3.0:1715330315.626075:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cf840/0xd895711d66da7e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.626078:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cf840/0xd895711d66da7e1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.626082:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cf840/0xd895711d66da7e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.626085:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800939cf840 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.626087:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cf840/0xd895711d66da7e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00002000:00010000:2.0:1715330315.626087:0:17205:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1715330315.626091:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cf840/0xd895711d66da7e1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.626091:0:17205:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800938b6ac0/0xd895711d66db7fc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626097:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989cd6 (ffff880092dfd200) 00010000:00010000:3.0:1715330315.626098:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.626100:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cf840/0xd895711d66da7e1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989cd6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.626101:0:17205:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330315.626102:0:17205:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330315.626104:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939cf840/0xd895711d66da7e1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989cd6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.626106:0:17205:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800938b6ac0/0xd895711d66db7fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626111:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce640/0xd895711d66da804 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.626114:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce640/0xd895711d66da804 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.626117:0:17205:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800938b6ac0/0xd895711d66db7fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626118:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce640/0xd895711d66da804 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.626121:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800939ce640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.626123:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce640/0xd895711d66da804 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.626123:0:17205:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800938b6ac0/0xd895711d66db7fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626126:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce640/0xd895711d66da804 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.626128:0:17205:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800938b6ac0/0xd895711d66db7fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626131:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989dd6 (ffff880092dfd800) 00010000:00010000:3.0:1715330315.626132:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.626134:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce640/0xd895711d66da804 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989dd6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.626134:0:17205:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800938b6ac0/0xd895711d66db7fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626138:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939ce640/0xd895711d66da804 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989dd6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.626139:0:17205:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b6ac0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330315.626142:0:17205:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800938b6ac0/0xd895711d66db7fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626144:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7a80/0xd895711d66da827 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.626147:0:17205:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800938b6ac0/0xd895711d66db7fc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626149:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7a80/0xd895711d66da827 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.626154:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7a80/0xd895711d66da827 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.626158:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a91b7a80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330315.626158:0:17205:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800938b6ac0/0xd895711d66db7fc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626160:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7a80/0xd895711d66da827 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.626164:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7a80/0xd895711d66da827 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.626167:0:17205:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800938b6ac0/0xd895711d66db7fc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626169:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ed6 (ffff880092dfd900) 00010000:00010000:3.0:1715330315.626170:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.626172:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7a80/0xd895711d66da827 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.626176:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a91b7a80/0xd895711d66da827 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.626184:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800877261c0/0xd895711d66da84a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.626188:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800877261c0/0xd895711d66da84a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.626188:0:17197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5242 00010000:00010000:3.0:1715330315.626192:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800877261c0/0xd895711d66da84a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.626193:0:17197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093981f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3688:x1798653942510784:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.626195:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800877261c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.626197:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800877261c0/0xd895711d66da84a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.626202:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800877261c0/0xd895711d66da84a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00002000:00080000:0.0:1715330315.626203:0:17197:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2517 count 1 00010000:00010000:3.0:1715330315.626208:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989fd6 (ffff88008d699700) 00010000:00010000:3.0:1715330315.626209:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.626211:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800877261c0/0xd895711d66da84a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989fd6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.626214:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800877261c0/0xd895711d66da84a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989fd6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00002000:00010000:0.0:1715330315.626215:0:17197:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1715330315.626219:0:17197:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d7a06c0/0xd895711d66db803 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626222:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880087726ac0/0xd895711d66da86d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.626224:0:17197:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330315.626226:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880087726ac0/0xd895711d66da86d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.626226:0:17197:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.626228:0:17197:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7a06c0/0xd895711d66db803 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626229:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880087726ac0/0xd895711d66da86d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.626232:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087726ac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.626234:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087726ac0/0xd895711d66da86d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.626235:0:17197:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d7a06c0/0xd895711d66db803 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626237:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087726ac0/0xd895711d66da86d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.626241:0:17197:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d7a06c0/0xd895711d66db803 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626242:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a0d6 (ffff88008d699e00) 00010000:00010000:3.0:1715330315.626243:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.626245:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880087726ac0/0xd895711d66da86d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a0d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.626246:0:17197:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7a06c0/0xd895711d66db803 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.626251:0:17197:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d7a06c0/0xd895711d66db803 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626252:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087726ac0/0xd895711d66da86d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a0d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.626259:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880087725200/0xd895711d66da890 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.626259:0:17197:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a06c0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330315.626261:0:17197:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d7a06c0/0xd895711d66db803 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626263:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880087725200/0xd895711d66da890 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.626267:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880087725200/0xd895711d66da890 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.626267:0:17197:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d7a06c0/0xd895711d66db803 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626270:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087725200 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.626272:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087725200/0xd895711d66da890 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.626275:0:17197:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d7a06c0/0xd895711d66db803 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626276:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087725200/0xd895711d66da890 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.626280:0:17197:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d7a06c0/0xd895711d66db803 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626312:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a1d6 (ffff88008d699400) 00010000:00010000:3.0:1715330315.626314:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.626317:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880087725200/0xd895711d66da890 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a1d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.626320:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087725200/0xd895711d66da890 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a1d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.626328:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66da8b3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.626333:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66da8b3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00000100:00100000:2.0:1715330315.626337:0:17205:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093980a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3688:x1798653942510528:12345-0@lo:6:osp-syn-0-0.0 Request processed in 273us (1420us total) trans 4294969900 rc 0/0 00010000:00010000:3.0:1715330315.626341:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66da8b3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00000100:00100000:2.0:1715330315.626343:0:17205:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5241 00010000:00010000:3.0:1715330315.626345:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfc6c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.626347:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66da8b3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.626350:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66da8b3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00000100:00100000:0.0:1715330315.626355:0:17197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093981f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3688:x1798653942510784:12345-0@lo:6:osp-syn-0-0.0 Request processed in 162us (1416us total) trans 4294969901 rc 0/0 00010000:00010000:3.0:1715330315.626356:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a2d6 (ffff88008b0d2900) 00000100:00100000:2.0:1715330315.626356:0:17205:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5243 00010000:00010000:3.0:1715330315.626357:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.626358:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66da8b3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a2d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000100:00100000:2.0:1715330315.626359:0:17205:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:3691:x1798653942510464:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1715330315.626360:0:17197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5242 00010000:00010000:3.0:1715330315.626362:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc6c0/0xd895711d66da8b3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a2d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00002000:00080000:2.0:1715330315.626368:0:17205:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2513 count 1 00000100:00100000:0.0:1715330315.626368:0:17197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5244 00010000:00010000:3.0:1715330315.626369:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880087724fc0/0xd895711d66da8d6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.626371:0:17197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3691:x1798653942510720:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.626373:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880087724fc0/0xd895711d66da8d6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00002000:00010000:2.0:1715330315.626377:0:17205:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00080000:0.0:1715330315.626377:0:17197:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2516 count 1 00010000:00010000:3.0:1715330315.626378:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880087724fc0/0xd895711d66da8d6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.626381:0:17205:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800938b5f80/0xd895711d66db80a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626382:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087724fc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.626384:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087724fc0/0xd895711d66da8d6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00002000:00010000:0.0:1715330315.626386:0:17197:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1715330315.626387:0:17205:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330315.626388:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087724fc0/0xd895711d66da8d6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.626388:0:17205:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.626389:0:17197:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d7a1440/0xd895711d66db811 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330315.626390:0:17205:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800938b5f80/0xd895711d66db80a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626394:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a3d6 (ffff88008d699200) 00010000:00010000:0.0:1715330315.626394:0:17197:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.626395:0:17197:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330315.626396:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330315.626397:0:17205:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800938b5f80/0xd895711d66db80a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.626397:0:17197:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7a1440/0xd895711d66db811 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626398:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880087724fc0/0xd895711d66da8d6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a3d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.626401:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087724fc0/0xd895711d66da8d6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a3d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.626403:0:17205:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800938b5f80/0xd895711d66db80a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.626404:0:17197:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d7a1440/0xd895711d66db811 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626408:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2d00/0xd895711d66da8f9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.626409:0:17205:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800938b5f80/0xd895711d66db80a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.626410:0:17197:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d7a1440/0xd895711d66db811 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626412:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2d00/0xd895711d66da8f9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.626415:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2d00/0xd895711d66da8f9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.626415:0:17197:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7a1440/0xd895711d66db811 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626418:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a2d00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330315.626418:0:17205:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800938b5f80/0xd895711d66db80a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.626419:0:17197:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d7a1440/0xd895711d66db811 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626420:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2d00/0xd895711d66da8f9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.626423:0:17205:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b5f80 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330315.626424:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2d00/0xd895711d66da8f9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.626424:0:17197:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a1440 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330315.626426:0:17205:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800938b5f80/0xd895711d66db80a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.626426:0:17197:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d7a1440/0xd895711d66db811 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626429:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ad7 (ffff88012ca48900) 00010000:00010000:3.0:1715330315.626430:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330315.626431:0:17205:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800938b5f80/0xd895711d66db80a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.626431:0:17197:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d7a1440/0xd895711d66db811 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626432:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2d00/0xd895711d66da8f9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ad7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.626435:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2d00/0xd895711d66da8f9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ad7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.626439:0:17205:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800938b5f80/0xd895711d66db80a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.626439:0:17197:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d7a1440/0xd895711d66db811 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330315.626444:0:17205:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800938b5f80/0xd895711d66db80a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.626444:0:17197:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d7a1440/0xd895711d66db811 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626447:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66da91c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.626451:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66da91c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.626455:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66da91c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.626458:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfe640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.626460:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66da91c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.626464:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66da91c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.626470:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989bd7 (ffff88008b0d2d00) 00010000:00010000:3.0:1715330315.626471:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.626473:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66da91c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989bd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.626477:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfe640/0xd895711d66da91c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989bd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.626484:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66da93f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.626488:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66da93f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.626492:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66da93f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330315.626494:0:9633:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091c5c240/0xd895711d66db7f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626499:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfd200 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.626501:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66da93f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330315.626503:0:9633:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091c5c240/0xd895711d66db7f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626505:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66da93f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.626511:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989cd7 (ffff88008b0d2200) 00010000:00010000:3.0:1715330315.626512:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330315.626513:0:9633:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091c5c240/0xd895711d66db7f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626514:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66da93f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989cd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.626517:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd200/0xd895711d66da93f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989cd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330315.626518:0:9633:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091c5c240/0xd895711d66db7f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.626524:0:9633:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091c5c240/0xd895711d66db7f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626526:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3180/0xd895711d66da962 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330315.626529:0:9633:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5c240 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330315.626530:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3180/0xd895711d66da962 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00000100:00100000:0.0:1715330315.626530:0:17197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3691:x1798653942510720:12345-0@lo:6:osp-syn-0-0.0 Request processed in 158us (1531us total) trans 4294969902 rc 0/0 00010000:00010000:1.0:1715330315.626531:0:9633:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091c5c240/0xd895711d66db7f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626534:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3180/0xd895711d66da962 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00000100:00100000:0.0:1715330315.626535:0:17197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5244 00010000:00010000:1.0:1715330315.626536:0:9633:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091c5c240/0xd895711d66db7f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626538:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a3180 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.626540:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3180/0xd895711d66da962 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.626544:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3180/0xd895711d66da962 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00000100:00100000:0.0:1715330315.626544:0:17197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5245 00010000:00010000:1.0:1715330315.626545:0:9633:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091c5c240/0xd895711d66db7f5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330315.626547:0:17197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3691:x1798653942510400:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.626549:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989dd7 (ffff88012ca48f00) 00010000:00010000:1.0:1715330315.626551:0:9633:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091c5c240/0xd895711d66db7f5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626552:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.626554:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3180/0xd895711d66da962 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989dd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00002000:00080000:0.0:1715330315.626555:0:17197:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2512 count 1 00010000:00010000:3.0:1715330315.626558:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3180/0xd895711d66da962 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989dd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00002000:00010000:0.0:1715330315.626565:0:17197:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1715330315.626566:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880087724480/0xd895711d66da985 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.626569:0:17197:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d7a0d80/0xd895711d66db818 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626571:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880087724480/0xd895711d66da985 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.626574:0:17197:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330315.626575:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880087724480/0xd895711d66da985 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.626575:0:17197:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.626577:0:17197:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7a0d80/0xd895711d66db818 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626578:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087724480 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.626580:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087724480/0xd895711d66da985 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.626584:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087724480/0xd895711d66da985 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.626584:0:17197:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d7a0d80/0xd895711d66db818 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626589:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ed7 (ffff88008d699900) 00010000:00010000:3.0:1715330315.626590:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330315.626590:0:17197:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d7a0d80/0xd895711d66db818 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626592:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880087724480/0xd895711d66da985 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ed7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.626595:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087724480/0xd895711d66da985 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ed7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.626596:0:17197:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7a0d80/0xd895711d66db818 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626602:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1b00/0xd895711d66da9a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.626602:0:17197:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d7a0d80/0xd895711d66db818 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.626606:0:17197:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a0d80 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330315.626609:0:17197:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d7a0d80/0xd895711d66db818 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626610:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1b00/0xd895711d66da9a8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.626614:0:17197:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d7a0d80/0xd895711d66db818 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626615:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1b00/0xd895711d66da9a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.626619:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a1b00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.626621:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1b00/0xd895711d66da9a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.626622:0:17197:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d7a0d80/0xd895711d66db818 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626625:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1b00/0xd895711d66da9a8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.626627:0:17197:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d7a0d80/0xd895711d66db818 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626630:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989fd7 (ffff88012ca48600) 00010000:00010000:3.0:1715330315.626631:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.626633:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1b00/0xd895711d66da9a8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989fd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.626637:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1b00/0xd895711d66da9a8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989fd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000100:00100000:1.0:1715330315.626639:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093981500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3688:x1798653942510272:12345-0@lo:6:osp-syn-0-0.0 Request processed in 693us (2000us total) trans 4294969904 rc 0/0 00010000:00010000:3.0:1715330315.626644:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880087727cc0/0xd895711d66da9cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00000100:00100000:1.0:1715330315.626644:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5240 00010000:00010000:3.0:1715330315.626648:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880087727cc0/0xd895711d66da9cb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.626653:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880087727cc0/0xd895711d66da9cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00000100:00100000:1.0:1715330315.626654:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5246 00010000:00010000:3.0:1715330315.626656:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087727cc0 already unused, calling callback (ffffffffa0ee8730) 00000100:00100000:1.0:1715330315.626657:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942510592:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1715330315.626658:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087727cc0/0xd895711d66da9cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.626662:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087727cc0/0xd895711d66da9cb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00002000:00080000:1.0:1715330315.626667:0:9633:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2510 count 1 00010000:00010000:3.0:1715330315.626668:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a0d7 (ffff88008d699b00) 00010000:00010000:3.0:1715330315.626669:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.626671:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880087727cc0/0xd895711d66da9cb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a0d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.626674:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087727cc0/0xd895711d66da9cb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a0d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.626681:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880087724900/0xd895711d66da9ee lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00002000:00010000:1.0:1715330315.626681:0:9633:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1715330315.626684:0:9633:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091c5c900/0xd895711d66db81f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626685:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880087724900/0xd895711d66da9ee lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.626689:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880087724900/0xd895711d66da9ee lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330315.626690:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330315.626691:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330315.626692:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087724900 already unused, calling callback (ffffffffa0ee8730) 00000100:00100000:0.0:1715330315.626693:0:17197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3691:x1798653942510400:12345-0@lo:6:osp-syn-0-0.0 Request processed in 146us (1655us total) trans 4294969905 rc 0/0 00010000:00010000:3.0:1715330315.626694:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087724900/0xd895711d66da9ee lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330315.626694:0:9633:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091c5c900/0xd895711d66db81f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626698:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087724900/0xd895711d66da9ee lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.626698:0:17197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5245 00010000:00010000:3.0:1715330315.626703:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a1d7 (ffff88008d699100) 00010000:00010000:1.0:1715330315.626703:0:9633:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091c5c900/0xd895711d66db81f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626705:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.626706:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880087724900/0xd895711d66da9ee lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a1d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330315.626708:0:9633:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091c5c900/0xd895711d66db81f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626713:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087724900/0xd895711d66da9ee lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a1d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330315.626713:0:9633:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091c5c900/0xd895711d66db81f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.626718:0:9633:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091c5c900/0xd895711d66db81f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626721:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880087727a80/0xd895711d66daa11 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330315.626722:0:9633:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5c900 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330315.626725:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880087727a80/0xd895711d66daa11 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330315.626725:0:9633:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091c5c900/0xd895711d66db81f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626728:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880087727a80/0xd895711d66daa11 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330315.626744:0:9633:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091c5c900/0xd895711d66db81f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626748:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087727a80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.626750:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087727a80/0xd895711d66daa11 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330315.626753:0:9633:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091c5c900/0xd895711d66db81f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626754:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087727a80/0xd895711d66daa11 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330315.626758:0:9633:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091c5c900/0xd895711d66db81f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626761:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a2d7 (ffff8800b4184000) 00010000:00010000:3.0:1715330315.626763:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330315.626763:0:3691:0:(client.c:2956:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969899 gen 2 00010000:00010000:3.0:1715330315.626765:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880087727a80/0xd895711d66daa11 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a2d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.626769:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087727a80/0xd895711d66daa11 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a2d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.626777:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800877258c0/0xd895711d66daa34 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.626780:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800877258c0/0xd895711d66daa34 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.626782:0:3691:0:(client.c:3000:ptlrpc_free_committed()) @@@ stopping search req@ffff880093983800 x1798653942510400/t4294969905(4294969905) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715330331 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00010000:00010000:3.0:1715330315.626788:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800877258c0/0xd895711d66daa34 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.626791:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800877258c0 already unused, calling callback (ffffffffa0ee8730) 00000004:00080000:0.0:1715330315.626791:0:3691:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880093983800/2, rc 0, transno 2609 00010000:00010000:3.0:1715330315.626793:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800877258c0/0xd895711d66daa34 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.626797:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800877258c0/0xd895711d66daa34 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.626799:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093983800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942510400:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.626801:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a3d7 (ffff8800b4184d00) 00010000:00010000:3.0:1715330315.626803:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.626804:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800877258c0/0xd895711d66daa34 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a3d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.626808:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800877258c0/0xd895711d66daa34 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a3d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00080000:0.0:1715330315.626808:0:3691:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880093982d80/2, rc 0, transno 2606 00000100:00100000:0.0:1715330315.626810:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093982d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942510720:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.626814:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880087725680/0xd895711d66daa57 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.626818:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880087725680/0xd895711d66daa57 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.626822:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880087725680/0xd895711d66daa57 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.626826:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087725680 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.626827:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087725680/0xd895711d66daa57 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.626831:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087725680/0xd895711d66daa57 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.626838:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ad8 (ffff88009d5faa00) 00010000:00010000:3.0:1715330315.626839:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.626842:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880087725680/0xd895711d66daa57 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ad8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.626846:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087725680/0xd895711d66daa57 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ad8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.626852:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1715330315.626854:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66daa7a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00000100:00100000:1.0:1715330315.626857:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3691:x1798653942510592:12345-0@lo:6:osp-syn-1-0.0 Request processed in 198us (1796us total) trans 4294969901 rc 0/0 00010000:00010000:3.0:1715330315.626858:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66daa7a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00000100:00100000:0.0:1715330315.626860:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942510912:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1715330315.626862:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5246 00010000:00010000:3.0:1715330315.626863:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66daa7a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.626866:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfcfc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.626868:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66daa7a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.626871:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66daa7a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.626876:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989bd8 (ffff88008b0d2300) 00010000:00010000:3.0:1715330315.626878:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330315.626878:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1715330315.626879:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66daa7a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989bd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.626883:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcfc0/0xd895711d66daa7a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989bd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.626894:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66daa9d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.626898:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66daa9d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00000100:00100000:1.0:1715330315.626898:0:13361:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942510912 00000100:00100000:1.0:1715330315.626901:0:13361:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942510912 00010000:00010000:3.0:1715330315.626902:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66daa9d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00000100:00100000:0.0:1715330315.626904:0:3691:0:(client.c:2956:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969900 gen 2 00010000:00010000:3.0:1715330315.626906:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bffa80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.626908:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66daa9d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.626912:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66daa9d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00000100:00100000:1.0:1715330315.626915:0:13361:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5247 00000100:00100000:0.0:1715330315.626916:0:3691:0:(client.c:3000:ptlrpc_free_committed()) @@@ stopping search req@ffff880093b59180 x1798653942510592/t4294969901(4294969901) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715330331 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00010000:00010000:3.0:1715330315.626918:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989cd8 (ffff88008b0d2100) 00000100:00100000:1.0:1715330315.626918:0:13361:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3691:x1798653942510912:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.626920:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.626922:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66daa9d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989cd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.626926:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bffa80/0xd895711d66daa9d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989cd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00002000:00080000:1.0:1715330315.626927:0:13361:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2519 count 1 00000004:00080000:0.0:1715330315.626927:0:3691:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880093b59180/2, rc 0, transno 2605 00000100:00100000:0.0:1715330315.626933:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942510592:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1715330315.626937:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66daac0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00002000:00010000:1.0:1715330315.626939:0:13361:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1715330315.626941:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66daac0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330315.626943:0:13361:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091c5c000/0xd895711d66db826 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626945:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66daac0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330315.626949:0:13361:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330315.626950:0:13361:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330315.626952:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfcd80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330315.626952:0:13361:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091c5c000/0xd895711d66db826 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626954:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66daac0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.626958:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66daac0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330315.626959:0:13361:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091c5c000/0xd895711d66db826 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626963:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989dd8 (ffff88008b0d2b00) 00010000:00010000:3.0:1715330315.626964:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330315.626965:0:13361:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091c5c000/0xd895711d66db826 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626966:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66daac0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.626969:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfcd80/0xd895711d66daac0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330315.626971:0:13361:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091c5c000/0xd895711d66db826 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626977:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594000/0xd895711d66daae3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330315.626977:0:13361:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091c5c000/0xd895711d66db826 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.626981:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594000/0xd895711d66daae3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.626985:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594000/0xd895711d66daae3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.626988:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d594000 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.626989:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594000/0xd895711d66daae3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.626993:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594000/0xd895711d66daae3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.626999:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ed8 (ffff880093a11200) 00010000:00010000:3.0:1715330315.627002:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.627004:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594000/0xd895711d66daae3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ed8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.627008:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594000/0xd895711d66daae3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ed8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.627024:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594900/0xd895711d66dab06 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.627029:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594900/0xd895711d66dab06 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.627034:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594900/0xd895711d66dab06 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.627038:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d594900 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.627041:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594900/0xd895711d66dab06 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00000100:00100000:0.0:1715330315.627043:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1715330315.627045:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594900/0xd895711d66dab06 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.627053:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989fd8 (ffff880093a11900) 00010000:00010000:3.0:1715330315.627056:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330315.627056:0:17198:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942510336 00000100:00100000:0.0:1715330315.627056:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093982300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942510656:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.627058:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594900/0xd895711d66dab06 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989fd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000100:00100000:2.0:1715330315.627059:0:17198:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942510336 00010000:00010000:3.0:1715330315.627062:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594900/0xd895711d66dab06 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989fd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.627071:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7840/0xd895711d66dab29 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.627072:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330315.627073:0:17198:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5248 00000100:00100000:2.0:1715330315.627077:0:17198:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3689:x1798653942510336:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.627078:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7840/0xd895711d66dab29 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.627083:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7840/0xd895711d66dab29 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00002000:00080000:2.0:1715330315.627085:0:17198:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2511 count 1 00010000:00010000:3.0:1715330315.627087:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b7840 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.627090:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7840/0xd895711d66dab29 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.627093:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7840/0xd895711d66dab29 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00002000:00010000:2.0:1715330315.627097:0:17198:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1715330315.627098:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942510848:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.627100:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a0d8 (ffff88009d5fa600) 00010000:00010000:2.0:1715330315.627101:0:17198:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800938b61c0/0xd895711d66db82d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.627102:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.627104:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7840/0xd895711d66dab29 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a0d8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.627107:0:17198:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330315.627108:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7840/0xd895711d66dab29 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a0d8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.627109:0:17198:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330315.627111:0:17198:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800938b61c0/0xd895711d66db82d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330315.627112:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1715330315.627117:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66dab4c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.627118:0:17198:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800938b61c0/0xd895711d66db82d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.627121:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66dab4c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.627124:0:17198:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800938b61c0/0xd895711d66db82d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.627125:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66dab4c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.627129:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bff180 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330315.627130:0:17198:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800938b61c0/0xd895711d66db82d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.627131:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66dab4c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.627131:0:9397:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942510656 00000100:00100000:0.0:1715330315.627133:0:9397:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942510656 00010000:00010000:3.0:1715330315.627135:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66dab4c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.627135:0:17198:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800938b61c0/0xd895711d66db82d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330315.627140:0:17198:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b61c0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330315.627141:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a1d8 (ffff88012ca4dc00) 00010000:00010000:3.0:1715330315.627142:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330315.627142:0:17198:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800938b61c0/0xd895711d66db82d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330315.627142:0:9397:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942510848 00010000:00010000:3.0:1715330315.627144:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66dab4c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a1d8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.627144:0:9397:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942510848 00010000:00010000:3.0:1715330315.627148:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bff180/0xd895711d66dab4c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a1d8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330315.627148:0:17198:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800938b61c0/0xd895711d66db82d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330315.627150:0:9397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5249 00000100:00100000:0.0:1715330315.627154:0:9397:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:3689:x1798653942510656:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1715330315.627157:0:17198:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800938b61c0/0xd895711d66db82d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330315.627162:0:17198:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800938b61c0/0xd895711d66db82d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.627163:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66dab6f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00002000:00080000:0.0:1715330315.627163:0:9397:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2515 count 1 00010000:00010000:3.0:1715330315.627167:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66dab6f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.627171:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66dab6f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00002000:00010000:0.0:1715330315.627173:0:9397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1715330315.627174:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfef40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.627176:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66dab6f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.627176:0:9397:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d7a0b40/0xd895711d66db834 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.627181:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66dab6f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.627182:0:9397:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.627183:0:9397:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.627186:0:9397:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7a0b40/0xd895711d66db834 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.627187:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a2d8 (ffff88012ca4df00) 00010000:00010000:3.0:1715330315.627188:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.627190:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66dab6f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a2d8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.627194:0:9397:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d7a0b40/0xd895711d66db834 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.627198:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfef40/0xd895711d66dab6f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a2d8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.627200:0:9397:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d7a0b40/0xd895711d66db834 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.627206:0:9397:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7a0b40/0xd895711d66db834 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.627209:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880087726d00/0xd895711d66dab92 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.627212:0:9397:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d7a0b40/0xd895711d66db834 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.627213:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880087726d00/0xd895711d66dab92 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.627217:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880087726d00/0xd895711d66dab92 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.627217:0:9397:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a0b40 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330315.627219:0:9397:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d7a0b40/0xd895711d66db834 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.627221:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087726d00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.627223:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087726d00/0xd895711d66dab92 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.627225:0:9397:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d7a0b40/0xd895711d66db834 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.627227:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087726d00/0xd895711d66dab92 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.627232:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a3d8 (ffff88012ca4db00) 00010000:00010000:3.0:1715330315.627233:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330315.627234:0:9397:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d7a0b40/0xd895711d66db834 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.627235:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880087726d00/0xd895711d66dab92 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a3d8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.627240:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087726d00/0xd895711d66dab92 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a3d8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000100:00100000:2.0:1715330315.627240:0:17198:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3689:x1798653942510336:12345-0@lo:6:osp-syn-0-0.0 Request processed in 163us (197us total) trans 4294969906 rc 0/0 00010000:00010000:0.0:1715330315.627240:0:9397:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d7a0b40/0xd895711d66db834 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330315.627245:0:17198:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5248 00010000:00010000:3.0:1715330315.627248:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c6c0/0xd895711d66dabb5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.627252:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c6c0/0xd895711d66dabb5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.627259:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c6c0/0xd895711d66dabb5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.627262:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093b9c6c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.627264:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c6c0/0xd895711d66dabb5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.627267:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c6c0/0xd895711d66dabb5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.627273:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ad9 (ffff88012cc48700) 00010000:00010000:3.0:1715330315.627274:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.627276:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c6c0/0xd895711d66dabb5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ad9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.627280:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c6c0/0xd895711d66dabb5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ad9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.627288:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cfc0/0xd895711d66dabd8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.627292:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cfc0/0xd895711d66dabd8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.627296:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cfc0/0xd895711d66dabd8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.627300:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093b9cfc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.627302:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cfc0/0xd895711d66dabd8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.627305:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cfc0/0xd895711d66dabd8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.627305:0:9397:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3689:x1798653942510656:12345-0@lo:6:osp-syn-0-0.0 Request processed in 150us (232us total) trans 4294969907 rc 0/0 00000100:00100000:0.0:1715330315.627310:0:9397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5249 00010000:00010000:3.0:1715330315.627312:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989bd9 (ffff88012cc48e00) 00010000:00010000:3.0:1715330315.627313:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.627315:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cfc0/0xd895711d66dabd8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989bd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.627319:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cfc0/0xd895711d66dabd8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989bd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.627319:0:9397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5250 00000100:00100000:0.0:1715330315.627323:0:9397:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:3689:x1798653942510848:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.627327:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d8c0/0xd895711d66dabfb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00002000:00080000:0.0:1715330315.627332:0:9397:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2518 count 1 00010000:00010000:3.0:1715330315.627333:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d8c0/0xd895711d66dabfb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.627337:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d8c0/0xd895711d66dabfb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.627341:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093b9d8c0 already unused, calling callback (ffffffffa0ee8730) 00002000:00010000:0.0:1715330315.627341:0:9397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1715330315.627344:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d8c0/0xd895711d66dabfb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.627344:0:9397:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d7a21c0/0xd895711d66db83b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.627348:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d8c0/0xd895711d66dabfb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.627350:0:9397:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.627351:0:9397:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.627353:0:9397:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7a21c0/0xd895711d66db83b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.627354:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989cd9 (ffff88012cc48500) 00010000:00010000:3.0:1715330315.627356:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.627358:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d8c0/0xd895711d66dabfb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989cd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.627359:0:9397:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d7a21c0/0xd895711d66db83b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.627362:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d8c0/0xd895711d66dabfb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989cd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.627365:0:9397:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d7a21c0/0xd895711d66db83b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.627371:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e1c0/0xd895711d66dac1e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.627371:0:9397:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7a21c0/0xd895711d66db83b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.627376:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e1c0/0xd895711d66dac1e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.627377:0:9397:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d7a21c0/0xd895711d66db83b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.627381:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e1c0/0xd895711d66dac1e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.627382:0:9397:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a21c0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:1.0:1715330315.627384:0:13361:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5c000 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330315.627384:0:9397:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d7a21c0/0xd895711d66db83b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.627385:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093b9e1c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330315.627386:0:13361:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091c5c000/0xd895711d66db826 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.627387:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e1c0/0xd895711d66dac1e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.627390:0:9397:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d7a21c0/0xd895711d66db83b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.627391:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e1c0/0xd895711d66dac1e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330315.627392:0:13361:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091c5c000/0xd895711d66db826 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.627397:0:9397:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d7a21c0/0xd895711d66db83b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.627398:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989dd9 (ffff88012cc48f00) 00010000:00010000:3.0:1715330315.627400:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330315.627400:0:13361:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091c5c000/0xd895711d66db826 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.627402:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e1c0/0xd895711d66dac1e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989dd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.627403:0:9397:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d7a21c0/0xd895711d66db83b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.627406:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e1c0/0xd895711d66dac1e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989dd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330315.627406:0:13361:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091c5c000/0xd895711d66db826 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.627415:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9eac0/0xd895711d66dac41 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.627419:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9eac0/0xd895711d66dac41 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.627423:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9eac0/0xd895711d66dac41 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.627427:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093b9eac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.627429:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9eac0/0xd895711d66dac41 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.627434:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9eac0/0xd895711d66dac41 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.627439:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ed9 (ffff88009ef2cc00) 00010000:00010000:3.0:1715330315.627442:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.627444:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9eac0/0xd895711d66dac41 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ed9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.627449:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9eac0/0xd895711d66dac41 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ed9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.627459:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f3c0/0xd895711d66dac64 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.627463:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f3c0/0xd895711d66dac64 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.627467:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f3c0/0xd895711d66dac64 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.627471:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093b9f3c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.627473:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f3c0/0xd895711d66dac64 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.627473:0:9397:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3689:x1798653942510848:12345-0@lo:6:osp-syn-0-0.0 Request processed in 148us (359us total) trans 4294969908 rc 0/0 00010000:00010000:3.0:1715330315.627477:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f3c0/0xd895711d66dac64 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.627478:0:9397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5250 00010000:00010000:3.0:1715330315.627484:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989fd9 (ffff88009ef2c900) 00000004:00080000:0.0:1715330315.627498:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007d636a00/2, rc 0, transno 2612 00000100:00100000:0.0:1715330315.627504:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942510848:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1715330315.627512:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880093980700/2, rc 0, transno 2610 00000100:00100000:0.0:1715330315.627514:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942510336:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1715330315.627520:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880093982300/2, rc 0, transno 2611 00000100:00100000:0.0:1715330315.627522:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093982300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942510656:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.627547:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.627550:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f3c0/0xd895711d66dac64 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989fd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.627556:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942510976:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.627559:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f3c0/0xd895711d66dac64 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989fd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.627571:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9fcc0/0xd895711d66dac87 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.627572:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1715330315.627576:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9fcc0/0xd895711d66dac87 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.627581:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9fcc0/0xd895711d66dac87 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.627586:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093b9fcc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.627588:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9fcc0/0xd895711d66dac87 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.627588:0:17200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942510976 00000100:00100000:0.0:1715330315.627590:0:17200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942510976 00010000:00010000:3.0:1715330315.627592:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9fcc0/0xd895711d66dac87 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.627598:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a0d9 (ffff88009ef2cb00) 00010000:00010000:3.0:1715330315.627600:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.627602:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9fcc0/0xd895711d66dac87 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a0d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.627602:0:17200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5251 00000100:00100000:0.0:1715330315.627605:0:17200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d62bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3691:x1798653942510976:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.627607:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9fcc0/0xd895711d66dac87 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a0d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00002000:00080000:0.0:1715330315.627613:0:17200:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2520 count 1 00010000:00010000:3.0:1715330315.627615:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2640/0xd895711d66dacaa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.627620:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2640/0xd895711d66dacaa lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00002000:00010000:0.0:1715330315.627624:0:17200:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1715330315.627627:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2640/0xd895711d66dacaa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.627627:0:17200:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d7a2ac0/0xd895711d66db842 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.627631:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a2640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.627634:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2640/0xd895711d66dacaa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.627638:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2640/0xd895711d66dacaa lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.627644:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a1d9 (ffff88012ca48700) 00010000:00010000:3.0:1715330315.627646:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.627648:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2640/0xd895711d66dacaa lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.627652:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2640/0xd895711d66dacaa lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.627652:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.627653:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.627656:0:17200:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7a2ac0/0xd895711d66db842 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.627661:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e880/0xd895711d66daccd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.627663:0:17200:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d7a2ac0/0xd895711d66db842 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.627666:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e880/0xd895711d66daccd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.627669:0:17200:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d7a2ac0/0xd895711d66db842 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.627670:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e880/0xd895711d66daccd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.627674:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093b9e880 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330315.627674:0:17200:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7a2ac0/0xd895711d66db842 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.627676:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e880/0xd895711d66daccd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.627679:0:17200:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d7a2ac0/0xd895711d66db842 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.627680:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e880/0xd895711d66daccd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.627684:0:17200:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a2ac0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330315.627686:0:17200:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d7a2ac0/0xd895711d66db842 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.627687:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a2d9 (ffff880091c70c00) 00010000:00010000:3.0:1715330315.627688:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.627690:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e880/0xd895711d66daccd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a2d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.627692:0:17200:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d7a2ac0/0xd895711d66db842 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.627694:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e880/0xd895711d66daccd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a2d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.627700:0:17200:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d7a2ac0/0xd895711d66db842 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.627703:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d680/0xd895711d66dacf0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.627706:0:17200:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d7a2ac0/0xd895711d66db842 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.627707:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d680/0xd895711d66dacf0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.627711:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d680/0xd895711d66dacf0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.627714:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093b9d680 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.627716:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d680/0xd895711d66dacf0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.627719:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d680/0xd895711d66dacf0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.627724:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a3d9 (ffff880091c70000) 00010000:00010000:3.0:1715330315.627725:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.627727:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d680/0xd895711d66dacf0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a3d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.627755:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9d680/0xd895711d66dacf0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a3d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000100:00100000:0.0:1715330315.627761:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d62a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942511104:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.627766:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c240/0xd895711d66dad0c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.627771:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c240/0xd895711d66dad0c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.627775:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c240/0xd895711d66dad0c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.627779:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093b9c240 already unused, calling callback (ffffffffa0ee8730) 00000100:00100000:0.0:1715330315.627780:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1715330315.627781:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c240/0xd895711d66dad0c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.627785:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c240/0xd895711d66dad0c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.627791:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca986ad0 (ffff880093b42700) 00010000:00010000:3.0:1715330315.627793:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330315.627795:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1715330315.627796:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c240/0xd895711d66dad0c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca986ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000100:00100000:0.0:1715330315.627799:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942511040:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.627800:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9c240/0xd895711d66dad0c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca986ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000100:00100000:0.0:1715330315.627812:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1715330315.627815:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f180/0xd895711d66dad28 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.627820:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f180/0xd895711d66dad28 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.627824:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f180/0xd895711d66dad28 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00000100:00100000:0.0:1715330315.627826:0:9397:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942511104 00000100:00100000:0.0:1715330315.627828:0:9397:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942511104 00010000:00010000:3.0:1715330315.627832:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093b9f180 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.627834:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f180/0xd895711d66dad28 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00000100:00100000:0.0:1715330315.627838:0:9397:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942511040 00010000:00010000:3.0:1715330315.627839:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f180/0xd895711d66dad28 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00000100:00100000:0.0:1715330315.627839:0:9397:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942511040 00010000:00010000:3.0:1715330315.627845:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca986ad1 (ffff880093b42200) 00010000:00010000:3.0:1715330315.627847:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330315.627847:0:9397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5252 00010000:00010000:3.0:1715330315.627849:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f180/0xd895711d66dad28 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca986ad1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000100:00100000:0.0:1715330315.627850:0:9397:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+19:3689:x1798653942511104:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.627853:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9f180/0xd895711d66dad28 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca986ad1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00002000:00080000:0.0:1715330315.627859:0:9397:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2522 count 1 00010000:00010000:3.0:1715330315.627865:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cd80/0xd895711d66dad44 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.627869:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cd80/0xd895711d66dad44 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00002000:00010000:0.0:1715330315.627869:0:9397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1715330315.627872:0:9397:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d7a1680/0xd895711d66db849 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.627873:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cd80/0xd895711d66dad44 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.627877:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093b9cd80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330315.627877:0:9397:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330315.627879:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cd80/0xd895711d66dad44 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.627879:0:9397:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.627881:0:9397:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7a1680/0xd895711d66db849 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.627884:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cd80/0xd895711d66dad44 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.627887:0:9397:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d7a1680/0xd895711d66db849 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.627890:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca986ad2 (ffff88009d618900) 00010000:00010000:3.0:1715330315.627892:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330315.627892:0:9397:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d7a1680/0xd895711d66db849 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.627895:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cd80/0xd895711d66dad44 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca986ad2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.627898:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9cd80/0xd895711d66dad44 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca986ad2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.627901:0:9397:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7a1680/0xd895711d66db849 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.627907:0:9397:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d7a1680/0xd895711d66db849 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.627909:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e640/0xd895711d66dad60 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.627911:0:9397:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a1680 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330315.627913:0:9397:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d7a1680/0xd895711d66db849 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.627914:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e640/0xd895711d66dad60 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.627918:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e640/0xd895711d66dad60 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.627918:0:9397:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d7a1680/0xd895711d66db849 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.627922:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093b9e640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.627924:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e640/0xd895711d66dad60 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.627925:0:9397:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d7a1680/0xd895711d66db849 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.627929:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e640/0xd895711d66dad60 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.627929:0:9397:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d7a1680/0xd895711d66db849 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.627934:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca986ad3 (ffff88009d618100) 00010000:00010000:3.0:1715330315.627936:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.627938:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e640/0xd895711d66dad60 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca986ad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.627942:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9e640/0xd895711d66dad60 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca986ad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.627953:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c480/0xd895711d66dad7c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00000004:00080000:0.0:1715330315.627954:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880093983b80/2, rc 0, transno 2608 00000100:00100000:0.0:1715330315.627959:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093983b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942510272:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.627961:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c480/0xd895711d66dad7c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00000004:00080000:0.0:1715330315.627965:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880093981180/2, rc 0, transno 2604 00010000:00010000:3.0:1715330315.627966:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c480/0xd895711d66dad7c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00000100:00100000:0.0:1715330315.627967:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942510528:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.627969:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5c480 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.627972:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c480/0xd895711d66dad7c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00000004:00080000:0.0:1715330315.627972:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880093981880/2, rc 0, transno 2605 00000100:00100000:0.0:1715330315.627974:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093981880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942510784:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.627976:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c480/0xd895711d66dad7c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.627982:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca986ad4 (ffff88009d618e00) 00010000:00010000:3.0:1715330315.627984:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.627986:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c480/0xd895711d66dad7c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca986ad4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.627990:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c480/0xd895711d66dad7c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca986ad4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.628002:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cd80/0xd895711d66dad98 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00000100:00100000:0.0:1715330315.628003:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942511232:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.628007:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cd80/0xd895711d66dad98 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.628010:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cd80/0xd895711d66dad98 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.628023:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5cd80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.628025:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cd80/0xd895711d66dad98 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00000100:00100000:0.0:1715330315.628027:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1715330315.628031:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cd80/0xd895711d66dad98 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00000100:00100000:0.0:1715330315.628046:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1715330315.628050:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942511168:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1715330315.628061:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330315.628070:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942511296:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1715330315.628081:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330315.628092:0:17199:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942511232 00000100:00100000:0.0:1715330315.628095:0:17199:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942511232 00000100:00100000:0.0:1715330315.628104:0:17199:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942511168 00000100:00100000:0.0:1715330315.628105:0:17199:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942511168 00000100:00100000:0.0:1715330315.628110:0:17199:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942511296 00000100:00100000:0.0:1715330315.628112:0:17199:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942511296 00000100:00100000:0.0:1715330315.628119:0:17199:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5253 00000100:00100000:0.0:1715330315.628122:0:17199:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3689:x1798653942511040:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1715330315.628130:0:17199:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2521 count 1 00002000:00010000:0.0:1715330315.628141:0:17199:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1715330315.628146:0:17199:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d7a18c0/0xd895711d66db850 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.628151:0:17199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.628152:0:17199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.628155:0:17199:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7a18c0/0xd895711d66db850 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.628161:0:17199:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d7a18c0/0xd895711d66db850 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.628170:0:17199:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d7a18c0/0xd895711d66db850 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.628175:0:17199:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7a18c0/0xd895711d66db850 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.628180:0:17199:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d7a18c0/0xd895711d66db850 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.628184:0:17199:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a18c0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330315.628186:0:17199:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d7a18c0/0xd895711d66db850 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.628191:0:17199:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d7a18c0/0xd895711d66db850 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.628198:0:17199:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d7a18c0/0xd895711d66db850 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.628202:0:17199:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d7a18c0/0xd895711d66db850 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330315.628221:0:17217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5254 00000100:00100000:0.0:1715330315.628224:0:17217:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+22:3691:x1798653942511232:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1715330315.628231:0:17217:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2524 count 1 00002000:00010000:0.0:1715330315.628240:0:17217:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1715330315.628244:0:17217:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d7a0480/0xd895711d66db857 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.628249:0:17217:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.628250:0:17217:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.628252:0:17217:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7a0480/0xd895711d66db857 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.628257:0:17217:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d7a0480/0xd895711d66db857 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.628262:0:17217:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d7a0480/0xd895711d66db857 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.628266:0:17217:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7a0480/0xd895711d66db857 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.628272:0:17217:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d7a0480/0xd895711d66db857 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.628276:0:17217:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a0480 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330315.628278:0:17217:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d7a0480/0xd895711d66db857 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.628282:0:17217:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d7a0480/0xd895711d66db857 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.628287:0:17217:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d7a0480/0xd895711d66db857 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.628293:0:17217:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d7a0480/0xd895711d66db857 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330315.628315:0:9398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5255 00000100:00100000:0.0:1715330315.628319:0:9398:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3691:x1798653942511168:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1715330315.628328:0:9398:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2523 count 1 00002000:00010000:0.0:1715330315.628339:0:9398:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1715330315.628343:0:9398:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d7a2880/0xd895711d66db85e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.628346:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca986ad5 (ffff88009d618700) 00010000:00010000:3.0:1715330315.628348:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.628350:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cd80/0xd895711d66dad98 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca986ad5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.628350:0:9398:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.628351:0:9398:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.628353:0:9398:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7a2880/0xd895711d66db85e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330315.628354:0:17206:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5256 00010000:00010000:3.0:1715330315.628355:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cd80/0xd895711d66dad98 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca986ad5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000100:00100000:1.0:1715330315.628358:0:17206:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+22:3688:x1798653942511296:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1715330315.628360:0:9398:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d7a2880/0xd895711d66db85e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.628366:0:9398:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d7a2880/0xd895711d66db85e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1715330315.628367:0:17206:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2525 count 1 00010000:00010000:3.0:1715330315.628371:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d680/0xd895711d66dadb4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.628371:0:9398:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7a2880/0xd895711d66db85e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.628376:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d680/0xd895711d66dadb4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.628376:0:9398:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d7a2880/0xd895711d66db85e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1715330315.628378:0:17206:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1715330315.628381:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d680/0xd895711d66dadb4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330315.628382:0:17206:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091c5cfc0/0xd895711d66db865 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.628386:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5d680 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330315.628386:0:9398:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a2880 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330315.628388:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d680/0xd895711d66dadb4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.628389:0:9398:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d7a2880/0xd895711d66db85e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.628392:0:17206:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330315.628393:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d680/0xd895711d66dadb4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330315.628393:0:17206:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.628394:0:9398:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d7a2880/0xd895711d66db85e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.628396:0:17206:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091c5cfc0/0xd895711d66db865 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.628399:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca986ad6 (ffff88009d618000) 00010000:00010000:3.0:1715330315.628401:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330315.628402:0:17206:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091c5cfc0/0xd895711d66db865 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.628402:0:9398:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d7a2880/0xd895711d66db85e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.628403:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d680/0xd895711d66dadb4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca986ad6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330315.628407:0:17206:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091c5cfc0/0xd895711d66db865 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.628407:0:9398:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d7a2880/0xd895711d66db85e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.628411:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d680/0xd895711d66dadb4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca986ad6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330315.628413:0:17206:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091c5cfc0/0xd895711d66db865 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.628418:0:17206:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091c5cfc0/0xd895711d66db865 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.628423:0:17206:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5cfc0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330315.628425:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66dadd0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330315.628425:0:17206:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091c5cfc0/0xd895711d66db865 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.628430:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66dadd0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330315.628430:0:17206:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091c5cfc0/0xd895711d66db865 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.628434:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66dadd0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.628438:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a1200 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330315.628439:0:17206:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091c5cfc0/0xd895711d66db865 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.628441:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66dadd0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.628446:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66dadd0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330315.628448:0:17206:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091c5cfc0/0xd895711d66db865 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.628451:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca986ad7 (ffff880093b42d00) 00010000:00010000:3.0:1715330315.628452:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.628455:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66dadd0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca986ad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.628459:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1200/0xd895711d66dadd0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca986ad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.628473:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594fc0/0xd895711d66dadec lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.628478:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594fc0/0xd895711d66dadec lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.628486:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594fc0/0xd895711d66dadec lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.628490:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d594fc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.628492:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594fc0/0xd895711d66dadec lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.628497:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594fc0/0xd895711d66dadec lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.628503:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca986ad8 (ffff880093b42500) 00010000:00010000:3.0:1715330315.628505:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.628507:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594fc0/0xd895711d66dadec lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca986ad8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.628511:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594fc0/0xd895711d66dadec lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca986ad8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.628523:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5df80/0xd895711d66dae08 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.628527:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5df80/0xd895711d66dae08 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.628531:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5df80/0xd895711d66dae08 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.628534:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5df80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.628536:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5df80/0xd895711d66dae08 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.628540:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5df80/0xd895711d66dae08 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca986ad9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.628546:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca986ad9 (ffff88009d618a00) 00010000:00010000:3.0:1715330315.628548:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.628550:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5df80/0xd895711d66dae08 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca986ad9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.628553:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5df80/0xd895711d66dae08 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca986ad9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.628565:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5958c0/0xd895711d66dae24 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.628570:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5958c0/0xd895711d66dae24 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.628573:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5958c0/0xd895711d66dae24 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.628576:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d5958c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.628578:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5958c0/0xd895711d66dae24 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.628581:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5958c0/0xd895711d66dae24 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.628585:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ad1 (ffff88009b9a4600) 00010000:00010000:3.0:1715330315.628586:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.628588:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5958c0/0xd895711d66dae24 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ad1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.628593:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5958c0/0xd895711d66dae24 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ad1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.628606:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a33c0/0xd895711d66dae40 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.628872:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a33c0/0xd895711d66dae40 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.628877:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a33c0/0xd895711d66dae40 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.628881:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a33c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.628883:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a33c0/0xd895711d66dae40 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.628887:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a33c0/0xd895711d66dae40 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.628892:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989bd1 (ffff88008b122a00) 00010000:00010000:3.0:1715330315.628894:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.628896:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a33c0/0xd895711d66dae40 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989bd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.628900:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a33c0/0xd895711d66dae40 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989bd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.628915:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5961c0/0xd895711d66dae5c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.628919:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5961c0/0xd895711d66dae5c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.628924:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5961c0/0xd895711d66dae5c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.628927:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d5961c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.628928:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5961c0/0xd895711d66dae5c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.628933:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5961c0/0xd895711d66dae5c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.628939:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989cd1 (ffff88008b122c00) 00010000:00010000:3.0:1715330315.628940:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.628942:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5961c0/0xd895711d66dae5c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989cd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.628945:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5961c0/0xd895711d66dae5c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989cd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.628953:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596400/0xd895711d66dae78 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.628957:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596400/0xd895711d66dae78 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.628960:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596400/0xd895711d66dae78 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.628963:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d596400 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.628965:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596400/0xd895711d66dae78 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.628969:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596400/0xd895711d66dae78 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.628973:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989dd1 (ffff88008b122e00) 00010000:00010000:3.0:1715330315.628974:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.628976:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596400/0xd895711d66dae78 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989dd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.628983:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596400/0xd895711d66dae78 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989dd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.628994:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596d00/0xd895711d66dae94 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.628997:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596d00/0xd895711d66dae94 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629000:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596d00/0xd895711d66dae94 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629003:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d596d00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.629005:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596d00/0xd895711d66dae94 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629008:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596d00/0xd895711d66dae94 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629012:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ed1 (ffff88008b122700) 00010000:00010000:3.0:1715330315.629023:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.629024:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596d00/0xd895711d66dae94 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ed1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629028:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596d00/0xd895711d66dae94 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ed1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629036:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597600/0xd895711d66daeb0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629039:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597600/0xd895711d66daeb0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629047:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597600/0xd895711d66daeb0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629051:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d597600 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.629052:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597600/0xd895711d66daeb0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629056:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597600/0xd895711d66daeb0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629060:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989fd1 (ffff880093b42600) 00010000:00010000:3.0:1715330315.629061:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.629063:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597600/0xd895711d66daeb0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989fd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629066:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597600/0xd895711d66daeb0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989fd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629074:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5973c0/0xd895711d66daecc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629078:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5973c0/0xd895711d66daecc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629081:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5973c0/0xd895711d66daecc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629084:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d5973c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.629086:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5973c0/0xd895711d66daecc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629090:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5973c0/0xd895711d66daecc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629096:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a0d1 (ffff880093b42800) 00010000:00010000:3.0:1715330315.629098:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.629100:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5973c0/0xd895711d66daecc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629103:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5973c0/0xd895711d66daecc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629111:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596f40/0xd895711d66daee8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629115:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596f40/0xd895711d66daee8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629118:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596f40/0xd895711d66daee8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629121:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d596f40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.629123:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596f40/0xd895711d66daee8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629126:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596f40/0xd895711d66daee8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629131:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a1d1 (ffff880093b42b00) 00010000:00010000:3.0:1715330315.629132:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.629133:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596f40/0xd895711d66daee8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a1d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629137:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596f40/0xd895711d66daee8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a1d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629144:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596880/0xd895711d66daf04 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629149:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596880/0xd895711d66daf04 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629154:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596880/0xd895711d66daf04 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629158:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d596880 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.629160:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596880/0xd895711d66daf04 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629164:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596880/0xd895711d66daf04 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629171:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a2d1 (ffff88009ef25900) 00010000:00010000:3.0:1715330315.629172:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.629175:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596880/0xd895711d66daf04 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a2d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629180:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596880/0xd895711d66daf04 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a2d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629190:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594d80/0xd895711d66daf20 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629196:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594d80/0xd895711d66daf20 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629199:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594d80/0xd895711d66daf20 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629203:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d594d80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.629206:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594d80/0xd895711d66daf20 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629211:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594d80/0xd895711d66daf20 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629217:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a3d1 (ffff88008b122300) 00010000:00010000:3.0:1715330315.629219:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.629221:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594d80/0xd895711d66daf20 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a3d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629226:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594d80/0xd895711d66daf20 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a3d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629236:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5946c0/0xd895711d66daf3c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629240:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5946c0/0xd895711d66daf3c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629245:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5946c0/0xd895711d66daf3c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629248:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d5946c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.629249:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5946c0/0xd895711d66daf3c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629253:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5946c0/0xd895711d66daf3c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629257:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ad2 (ffff88009ef25b00) 00010000:00010000:3.0:1715330315.629259:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.629260:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5946c0/0xd895711d66daf3c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ad2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629268:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d5946c0/0xd895711d66daf3c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ad2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629279:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596640/0xd895711d66daf58 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629282:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596640/0xd895711d66daf58 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629286:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596640/0xd895711d66daf58 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629290:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d596640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.629291:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596640/0xd895711d66daf58 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629295:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596640/0xd895711d66daf58 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629300:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989bd2 (ffff88012ca48100) 00010000:00010000:3.0:1715330315.629301:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.629303:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596640/0xd895711d66daf58 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629308:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596640/0xd895711d66daf58 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629321:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5440/0xd895711d66daf74 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629324:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5440/0xd895711d66daf74 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629333:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5440/0xd895711d66daf74 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629337:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b5440 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.629340:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5440/0xd895711d66daf74 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629344:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5440/0xd895711d66daf74 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629350:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989cd2 (ffff88012ca48a00) 00010000:00010000:3.0:1715330315.629352:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.629354:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5440/0xd895711d66daf74 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989cd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629359:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5440/0xd895711d66daf74 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989cd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629371:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5b00/0xd895711d66daf90 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629376:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5b00/0xd895711d66daf90 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629382:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5b00/0xd895711d66daf90 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629385:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b5b00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.629388:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5b00/0xd895711d66daf90 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629392:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5b00/0xd895711d66daf90 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629400:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989dd2 (ffff88008b122400) 00010000:00010000:3.0:1715330315.629401:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.629404:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5b00/0xd895711d66daf90 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629407:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5b00/0xd895711d66daf90 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629420:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7600/0xd895711d66dafac lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629424:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7600/0xd895711d66dafac lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629429:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7600/0xd895711d66dafac lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629433:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b7600 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.629435:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7600/0xd895711d66dafac lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629440:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7600/0xd895711d66dafac lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629446:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ed2 (ffff88009ef25f00) 00010000:00010000:3.0:1715330315.629448:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.629450:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7600/0xd895711d66dafac lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629454:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7600/0xd895711d66dafac lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629466:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6d00/0xd895711d66dafc8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629471:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6d00/0xd895711d66dafc8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629476:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6d00/0xd895711d66dafc8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629480:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b6d00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.629483:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6d00/0xd895711d66dafc8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629487:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6d00/0xd895711d66dafc8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629493:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989fd2 (ffff88012bfb5e00) 00010000:00010000:3.0:1715330315.629495:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.629497:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6d00/0xd895711d66dafc8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629501:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6d00/0xd895711d66dafc8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629512:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3600/0xd895711d66dafe4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.629517:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3600/0xd895711d66dafe4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.629522:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3600/0xd895711d66dafe4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.629525:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a3600 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.629528:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3600/0xd895711d66dafe4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.629533:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3600/0xd895711d66dafe4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.629539:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a0d2 (ffff88009ef25a00) 00010000:00010000:3.0:1715330315.629541:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.629543:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3600/0xd895711d66dafe4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.629547:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3600/0xd895711d66dafe4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.629556:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597180/0xd895711d66db000 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629560:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597180/0xd895711d66db000 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629563:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597180/0xd895711d66db000 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629567:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d597180 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.629569:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597180/0xd895711d66db000 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629573:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597180/0xd895711d66db000 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629577:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a1d2 (ffff88009ef25d00) 00010000:00010000:3.0:1715330315.629578:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.629580:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597180/0xd895711d66db000 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629587:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597180/0xd895711d66db000 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629595:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597a80/0xd895711d66db01c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629599:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597a80/0xd895711d66db01c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629602:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597a80/0xd895711d66db01c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629605:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d597a80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.629607:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597a80/0xd895711d66db01c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629610:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597a80/0xd895711d66db01c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629615:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a2d2 (ffff88009ef25600) 00010000:00010000:3.0:1715330315.629616:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.629617:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597a80/0xd895711d66db01c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a2d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629621:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d597a80/0xd895711d66db01c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a2d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629628:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594480/0xd895711d66db038 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629632:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594480/0xd895711d66db038 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629639:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594480/0xd895711d66db038 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629643:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d594480 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.629644:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594480/0xd895711d66db038 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629648:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594480/0xd895711d66db038 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629652:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a3d2 (ffff88009bbf0800) 00010000:00010000:3.0:1715330315.629654:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.629655:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594480/0xd895711d66db038 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a3d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629659:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d594480/0xd895711d66db038 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a3d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629668:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66db054 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629671:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66db054 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629675:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66db054 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629678:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d595d40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.629679:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66db054 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629683:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66db054 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629689:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ad3 (ffff88009bbf0300) 00010000:00010000:3.0:1715330315.629691:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.629692:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66db054 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629696:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595d40/0xd895711d66db054 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629704:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66db070 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629708:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66db070 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629711:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66db070 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629714:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d595680 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.629716:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66db070 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629719:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66db070 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629723:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989bd3 (ffff88009bbf0200) 00010000:00010000:3.0:1715330315.629724:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.629726:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66db070 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989bd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629751:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595680/0xd895711d66db070 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989bd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629760:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66db08c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.629765:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66db08c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.629769:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66db08c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.629772:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d595200 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.629774:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66db08c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.629778:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66db08c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.629783:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989cd3 (ffff88009bbf0700) 00010000:00010000:3.0:1715330315.629784:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.629785:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66db08c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989cd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.629789:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d595200/0xd895711d66db08c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989cd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000100:00100000:1.0:1715330315.629793:0:17206:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+25:3688:x1798653942511296:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1432us (1707us total) trans 4294969912 rc 0/0 00000100:00100000:0.0:1715330315.629793:0:17217:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+25:3691:x1798653942511232:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1565us (1762us total) trans 4294969910 rc 0/0 00010000:00010000:3.0:1715330315.629796:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66db0a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629800:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66db0a8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.629800:0:17217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5254 00010000:00010000:3.0:1715330315.629803:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66db0a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00000100:00100000:1.0:1715330315.629803:0:17206:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5256 00010000:00010000:3.0:1715330315.629806:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d596ac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.629808:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66db0a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629812:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66db0a8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629817:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989dd3 (ffff88009bbf0b00) 00010000:00010000:3.0:1715330315.629818:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.629820:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66db0a8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989dd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629823:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d596ac0/0xd895711d66db0a8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989dd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629831:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9fa80/0xd895711d66db0c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629835:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9fa80/0xd895711d66db0c4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629838:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9fa80/0xd895711d66db0c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629841:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093b9fa80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.629843:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9fa80/0xd895711d66db0c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629847:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9fa80/0xd895711d66db0c4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629851:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ed3 (ffff88009bbf0c00) 00000100:00100000:1.0:1715330315.629851:0:9398:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+24:3691:x1798653942511168:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1531us (1787us total) trans 4294969911 rc 0/0 00010000:00010000:3.0:1715330315.629852:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.629854:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9fa80/0xd895711d66db0c4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ed3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000100:00100000:1.0:1715330315.629855:0:9398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5255 00010000:00010000:3.0:1715330315.629861:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9fa80/0xd895711d66db0c4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ed3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629871:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4240/0xd895711d66db0e0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.629874:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4240/0xd895711d66db0e0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.629878:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4240/0xd895711d66db0e0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.629881:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b4240 already unused, calling callback (ffffffffa0ee8730) 00000100:00100000:0.0:1715330315.629881:0:17199:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3689:x1798653942511040:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1757us (2067us total) trans 4294969913 rc 0/0 00010000:00010000:3.0:1715330315.629882:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4240/0xd895711d66db0e0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00000004:00080000:1.0:1715330315.629884:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d4eb480/2, rc 0, transno 2616 00010000:00010000:3.0:1715330315.629886:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4240/0xd895711d66db0e0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00000100:00100000:0.0:1715330315.629886:0:17199:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5253 00010000:00010000:3.0:1715330315.629890:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989fd3 (ffff8800ad835f00) 00000100:00100000:1.0:1715330315.629890:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942511296:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.629891:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.629893:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4240/0xd895711d66db0e0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989fd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.629896:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4240/0xd895711d66db0e0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989fd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.629907:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4b40/0xd895711d66db0fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629911:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4b40/0xd895711d66db0fc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629918:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4b40/0xd895711d66db0fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629922:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b4b40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.629923:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4b40/0xd895711d66db0fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629926:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4b40/0xd895711d66db0fc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00000100:00100000:1.0:1715330315.629928:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1715330315.629931:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a0d3 (ffff88012ca48b00) 00010000:00010000:3.0:1715330315.629932:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.629933:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4b40/0xd895711d66db0fc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a0d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000100:00100000:1.0:1715330315.629934:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942511360:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.629937:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4b40/0xd895711d66db0fc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a0d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629945:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5440/0xd895711d66db118 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629949:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5440/0xd895711d66db118 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629952:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5440/0xd895711d66db118 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.629953:0:17200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d62bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3691:x1798653942510976:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2347us (2379us total) trans 4294969914 rc 0/0 00000100:00100000:1.0:1715330315.629954:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1715330315.629955:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b5440 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.629957:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5440/0xd895711d66db118 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.629958:0:17200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5251 00010000:00010000:3.0:1715330315.629960:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5440/0xd895711d66db118 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629966:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a1d3 (ffff88012bfb5100) 00010000:00010000:3.0:1715330315.629967:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330315.629967:0:17200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942511360 00010000:00010000:3.0:1715330315.629969:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5440/0xd895711d66db118 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a1d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.629971:0:17200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942511360 00010000:00010000:3.0:1715330315.629973:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5440/0xd895711d66db118 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a1d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.629981:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b61c0/0xd895711d66db134 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.629985:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b61c0/0xd895711d66db134 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00000100:00100000:0.0:1715330315.629985:0:17200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5257 00010000:00010000:3.0:1715330315.629988:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b61c0/0xd895711d66db134 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00000100:00100000:0.0:1715330315.629989:0:17200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3688:x1798653942511360:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.629991:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b61c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.629993:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b61c0/0xd895711d66db134 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.629997:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b61c0/0xd895711d66db134 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.630001:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a2d3 (ffff88012bfb5400) 00010000:00010000:3.0:1715330315.630002:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00002000:00080000:0.0:1715330315.630003:0:17200:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2526 count 1 00010000:00010000:3.0:1715330315.630004:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b61c0/0xd895711d66db134 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.630007:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b61c0/0xd895711d66db134 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.630029:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b58c0/0xd895711d66db150 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.630033:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b58c0/0xd895711d66db150 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00002000:00010000:0.0:1715330315.630033:0:17200:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1715330315.630037:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b58c0/0xd895711d66db150 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.630039:0:17200:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d7a1f80/0xd895711d66db86c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.630041:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b58c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.630042:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b58c0/0xd895711d66db150 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.630046:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b58c0/0xd895711d66db150 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.630047:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.630049:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330315.630051:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a3d3 (ffff88012bfb5500) 00010000:00010000:3.0:1715330315.630053:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330315.630053:0:17200:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7a1f80/0xd895711d66db86c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.630055:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b58c0/0xd895711d66db150 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a3d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.630059:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b58c0/0xd895711d66db150 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a3d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.630062:0:17200:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d7a1f80/0xd895711d66db86c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1715330315.630067:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330285 00010000:00010000:3.0:1715330315.630069:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4b40/0xd895711d66db16c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.630069:0:17200:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d7a1f80/0xd895711d66db86c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.630074:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4b40/0xd895711d66db16c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.630075:0:17200:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7a1f80/0xd895711d66db86c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.630078:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4b40/0xd895711d66db16c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.630082:0:17200:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d7a1f80/0xd895711d66db86c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.630086:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b4b40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.630087:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4b40/0xd895711d66db16c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.630088:0:17200:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a1f80 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330315.630091:0:17200:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d7a1f80/0xd895711d66db86c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.630092:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4b40/0xd895711d66db16c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.630097:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ad4 (ffff88008b374e00) 00010000:00010000:0.0:1715330315.630097:0:17200:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d7a1f80/0xd895711d66db86c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.630099:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.630101:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4b40/0xd895711d66db16c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ad4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.630106:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4b40/0xd895711d66db16c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ad4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.630113:0:17200:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d7a1f80/0xd895711d66db86c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.630117:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5d40/0xd895711d66db188 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.630118:0:17200:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d7a1f80/0xd895711d66db86c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.630122:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5d40/0xd895711d66db188 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.630127:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5d40/0xd895711d66db188 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.630131:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b5d40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.630133:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5d40/0xd895711d66db188 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.630137:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5d40/0xd895711d66db188 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.630143:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989bd4 (ffff88008b374a00) 00010000:00010000:3.0:1715330315.630146:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.630148:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5d40/0xd895711d66db188 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989bd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.630152:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5d40/0xd895711d66db188 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989bd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.630163:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5200/0xd895711d66db1a4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.630168:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5200/0xd895711d66db1a4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.630172:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5200/0xd895711d66db1a4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.630175:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b5200 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.630176:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5200/0xd895711d66db1a4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.630180:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5200/0xd895711d66db1a4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.630184:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989cd4 (ffff88008b374900) 00010000:00010000:3.0:1715330315.630186:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.630187:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5200/0xd895711d66db1a4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989cd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.630191:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5200/0xd895711d66db1a4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989cd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.630194:0:17200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+24:3688:x1798653942511360:12345-0@lo:6:osp-syn-0-0.0 Request processed in 204us (239us total) trans 4294969915 rc 0/0 00010000:00010000:3.0:1715330315.630199:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6640/0xd895711d66db1c0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00000100:00100000:0.0:1715330315.630200:0:17200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5257 00010000:00010000:3.0:1715330315.630206:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6640/0xd895711d66db1c0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.630211:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6640/0xd895711d66db1c0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.630215:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b6640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.630217:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6640/0xd895711d66db1c0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.630221:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6640/0xd895711d66db1c0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.630227:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989dd4 (ffff8800ab6b5500) 00010000:00010000:3.0:1715330315.630228:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.630230:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6640/0xd895711d66db1c0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.630234:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6640/0xd895711d66db1c0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989dd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.630247:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6f40/0xd895711d66db1dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.630251:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6f40/0xd895711d66db1dc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.630255:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6f40/0xd895711d66db1dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.630259:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b6f40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.630261:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6f40/0xd895711d66db1dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.630265:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6f40/0xd895711d66db1dc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00000100:00100000:0.0:1715330315.630267:0:9397:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:3689:x1798653942511104:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2416us (2486us total) trans 4294969916 rc 0/0 00010000:00010000:3.0:1715330315.630270:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ed4 (ffff88008b374000) 00010000:00010000:3.0:1715330315.630271:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330315.630272:0:9397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5252 00010000:00010000:3.0:1715330315.630273:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6f40/0xd895711d66db1dc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.630277:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6f40/0xd895711d66db1dc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.630286:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66db1f8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.630290:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66db1f8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.630294:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66db1f8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.630298:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b7840 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.630300:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66db1f8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.630304:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66db1f8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.630310:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989fd4 (ffff8800ab6b5400) 00010000:00010000:3.0:1715330315.630312:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.630314:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66db1f8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00080000:1.0:1715330315.630319:0:3691:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d4eaa00/2, rc 0, transno 2615 00000100:00100000:0.0:1715330315.630320:0:13361:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3691:x1798653942510912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3400us (3440us total) trans 4294969909 rc 0/0 00010000:00010000:3.0:1715330315.630322:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66db1f8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000100:00100000:1.0:1715330315.630325:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942511168:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1715330315.630325:0:13361:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5247 00010000:00010000:3.0:1715330315.630331:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7a80/0xd895711d66db214 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00000004:00080000:1.0:1715330315.630332:0:3691:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d4e9180/2, rc 0, transno 2614 00010000:00010000:3.0:1715330315.630335:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7a80/0xd895711d66db214 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00000100:00100000:1.0:1715330315.630335:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942511232:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.630340:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7a80/0xd895711d66db214 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00000004:00080000:1.0:1715330315.630341:0:3691:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007d635500/2, rc 0, transno 2618 00010000:00010000:3.0:1715330315.630343:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b7a80 already unused, calling callback (ffffffffa0ee8730) 00000100:00100000:1.0:1715330315.630343:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942510976:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.630345:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7a80/0xd895711d66db214 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.630348:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7a80/0xd895711d66db214 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00000004:00080000:1.0:1715330315.630349:0:3691:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007d634a80/2, rc 0, transno 2613 00010000:00010000:3.0:1715330315.630352:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a0d4 (ffff8800ab6b5f00) 00000100:00100000:1.0:1715330315.630352:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942510912:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.630354:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.630355:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7a80/0xd895711d66db214 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a0d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.630359:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7a80/0xd895711d66db214 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a0d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.630369:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5d40/0xd895711d66db230 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.630373:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5d40/0xd895711d66db230 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.630380:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5d40/0xd895711d66db230 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.630385:0:17205:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3691:x1798653942510464:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4024us (5406us total) trans 4294969903 rc 0/0 00010000:00010000:3.0:1715330315.630388:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b5d40 already unused, calling callback (ffffffffa0ee8730) 00000100:00100000:1.0:1715330315.630389:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942511488:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.630390:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5d40/0xd895711d66db230 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.630390:0:17205:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5243 00010000:00010000:3.0:1715330315.630394:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5d40/0xd895711d66db230 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.630401:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a1d4 (ffff8800ab6b5300) 00010000:00010000:3.0:1715330315.630403:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.630404:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5d40/0xd895711d66db230 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a1d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000100:00100000:1.0:1715330315.630406:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1715330315.630408:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5d40/0xd895711d66db230 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a1d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.630417:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6880/0xd895711d66db24c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.630418:0:17205:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942511488 00000004:00080000:1.0:1715330315.630420:0:3691:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880093983100/2, rc 0, transno 2607 00010000:00010000:3.0:1715330315.630421:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6880/0xd895711d66db24c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.630421:0:17205:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942511488 00010000:00010000:3.0:1715330315.630425:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6880/0xd895711d66db24c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00000100:00100000:1.0:1715330315.630425:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093983100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942510464:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.630429:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b6880 already unused, calling callback (ffffffffa0ee8730) 00000100:00100000:1.0:1715330315.630430:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1715330315.630431:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6880/0xd895711d66db24c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.630432:0:17205:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5258 00010000:00010000:3.0:1715330315.630434:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6880/0xd895711d66db24c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00000100:00100000:1.0:1715330315.630434:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942511424:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1715330315.630435:0:17205:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3691:x1798653942511488:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.630440:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a2d4 (ffff88008b374600) 00010000:00010000:3.0:1715330315.630441:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.630443:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6880/0xd895711d66db24c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a2d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00002000:00080000:0.0:1715330315.630444:0:17205:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2528 count 1 00010000:00010000:3.0:1715330315.630447:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6880/0xd895711d66db24c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a2d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000100:00100000:1.0:1715330315.630448:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1715330315.630455:0:17205:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1715330315.630457:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4480/0xd895711d66db268 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.630460:0:17205:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d7a3cc0/0xd895711d66db873 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.630462:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4480/0xd895711d66db268 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.630466:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4480/0xd895711d66db268 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.630466:0:17205:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.630468:0:17205:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330315.630469:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b4480 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330315.630470:0:17205:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7a3cc0/0xd895711d66db873 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.630471:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4480/0xd895711d66db268 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00000100:00100000:1.0:1715330315.630472:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1715330315.630475:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4480/0xd895711d66db268 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00000100:00100000:1.0:1715330315.630476:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942511680:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1715330315.630477:0:17205:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d7a3cc0/0xd895711d66db873 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.630480:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a3d4 (ffff88008b374b00) 00010000:00010000:3.0:1715330315.630482:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.630483:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4480/0xd895711d66db268 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a3d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.630484:0:17205:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d7a3cc0/0xd895711d66db873 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.630487:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4480/0xd895711d66db268 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a3d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.630489:0:17205:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7a3cc0/0xd895711d66db873 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330315.630490:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1715330315.630496:0:17205:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d7a3cc0/0xd895711d66db873 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.630498:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4900/0xd895711d66db284 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.630500:0:17205:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a3cc0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330315.630503:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4900/0xd895711d66db284 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.630503:0:17205:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d7a3cc0/0xd895711d66db873 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330315.630504:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942511616:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.630506:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4900/0xd895711d66db284 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.630508:0:17205:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d7a3cc0/0xd895711d66db873 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.630509:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b4900 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.630511:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4900/0xd895711d66db284 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.630515:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4900/0xd895711d66db284 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00000100:00100000:1.0:1715330315.630515:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1715330315.630517:0:17205:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d7a3cc0/0xd895711d66db873 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.630520:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ad5 (ffff88009ef57f00) 00010000:00010000:3.0:1715330315.630522:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.630524:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4900/0xd895711d66db284 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ad5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00080000:1.0:1715330315.630526:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007d634700/2, rc 0, transno 2617 00010000:00010000:3.0:1715330315.630527:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4900/0xd895711d66db284 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ad5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.630527:0:17205:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d7a3cc0/0xd895711d66db873 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330315.630529:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942511040:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1715330315.630535:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007d62a680/2, rc 0, transno 2620 00000100:00100000:1.0:1715330315.630537:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d62a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942511104:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.630538:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4fc0/0xd895711d66db2a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.630542:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4fc0/0xd895711d66db2a0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00000100:00100000:1.0:1715330315.630542:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1715330315.630545:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942511552:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.630546:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4fc0/0xd895711d66db2a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.630549:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b4fc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.630550:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4fc0/0xd895711d66db2a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.630554:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4fc0/0xd895711d66db2a0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.630559:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989bd5 (ffff88009ef57200) 00000100:00100000:1.0:1715330315.630559:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1715330315.630560:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.630561:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4fc0/0xd895711d66db2a0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989bd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.630565:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4fc0/0xd895711d66db2a0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989bd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000100:00100000:1.0:1715330315.630573:0:9398:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942511424 00010000:00010000:3.0:1715330315.630574:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7a80/0xd895711d66db2bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00000100:00100000:1.0:1715330315.630575:0:9398:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942511424 00010000:00010000:3.0:1715330315.630577:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7a80/0xd895711d66db2bc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.630581:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7a80/0xd895711d66db2bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.630584:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b7a80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.630586:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7a80/0xd895711d66db2bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00000100:00100000:1.0:1715330315.630587:0:9398:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942511680 00000100:00100000:1.0:1715330315.630588:0:9398:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942511680 00010000:00010000:3.0:1715330315.630590:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7a80/0xd895711d66db2bc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.630595:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989cd5 (ffff88009ef57900) 00000100:00100000:1.0:1715330315.630595:0:9398:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942511616 00010000:00010000:3.0:1715330315.630596:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330315.630596:0:9398:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942511616 00010000:00010000:3.0:1715330315.630598:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7a80/0xd895711d66db2bc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989cd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000100:00100000:0.0:1715330315.630601:0:17205:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+26:3691:x1798653942511488:12345-0@lo:6:osp-syn-0-0.0 Request processed in 165us (195us total) trans 4294969917 rc 0/0 00000100:00100000:1.0:1715330315.630603:0:9398:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942511552 00000100:00100000:1.0:1715330315.630605:0:9398:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942511552 00000100:00100000:0.0:1715330315.630606:0:17205:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5258 00010000:00010000:3.0:1715330315.630607:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7a80/0xd895711d66db2bc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989cd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000100:00100000:1.0:1715330315.630612:0:9398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5259 00000100:00100000:1.0:1715330315.630616:0:9398:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:3691:x1798653942511424:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1715330315.630616:0:17205:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5260 00010000:00010000:3.0:1715330315.630617:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5680/0xd895711d66db2d8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.630619:0:17205:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+26:3691:x1798653942511680:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.630621:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5680/0xd895711d66db2d8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.630625:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5680/0xd895711d66db2d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00002000:00080000:1.0:1715330315.630625:0:9398:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2527 count 1 00002000:00080000:0.0:1715330315.630625:0:17205:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2531 count 1 00010000:00010000:3.0:1715330315.630629:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b5680 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.630630:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5680/0xd895711d66db2d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.630635:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5680/0xd895711d66db2d8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00002000:00010000:1.0:1715330315.630636:0:9398:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1715330315.630636:0:17205:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1715330315.630640:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989dd5 (ffff88009bbb0600) 00010000:00010000:1.0:1715330315.630640:0:9398:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091c5d440/0xd895711d66db881 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.630640:0:17205:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d7a2400/0xd895711d66db87a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.630642:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.630644:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5680/0xd895711d66db2d8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989dd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330315.630646:0:9398:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.630646:0:17205:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330315.630647:0:9398:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.630647:0:17205:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330315.630648:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5680/0xd895711d66db2d8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989dd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330315.630649:0:9398:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091c5d440/0xd895711d66db881 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.630649:0:17205:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7a2400/0xd895711d66db87a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.630656:0:9398:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091c5d440/0xd895711d66db881 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.630656:0:17205:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d7a2400/0xd895711d66db87a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.630659:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4d80/0xd895711d66db2f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330315.630662:0:9398:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091c5d440/0xd895711d66db881 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.630662:0:17205:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d7a2400/0xd895711d66db87a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.630663:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4d80/0xd895711d66db2f4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330315.630668:0:9398:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091c5d440/0xd895711d66db881 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.630668:0:17205:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d7a2400/0xd895711d66db87a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.630672:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4d80/0xd895711d66db2f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330315.630673:0:9398:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091c5d440/0xd895711d66db881 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.630675:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b4d80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.630677:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4d80/0xd895711d66db2f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330315.630677:0:9398:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5d440 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330315.630677:0:17205:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d7a2400/0xd895711d66db87a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.630680:0:9398:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091c5d440/0xd895711d66db881 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.630681:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4d80/0xd895711d66db2f4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.630682:0:17205:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a2400 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330315.630684:0:17205:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d7a2400/0xd895711d66db87a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.630685:0:9398:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091c5d440/0xd895711d66db881 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.630687:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ed5 (ffff88009bbb0700) 00010000:00010000:3.0:1715330315.630689:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330315.630689:0:17205:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d7a2400/0xd895711d66db87a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.630692:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4d80/0xd895711d66db2f4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330315.630695:0:9398:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091c5d440/0xd895711d66db881 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.630695:0:17205:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d7a2400/0xd895711d66db87a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.630696:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4d80/0xd895711d66db2f4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.630700:0:17205:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d7a2400/0xd895711d66db87a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.630701:0:9398:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091c5d440/0xd895711d66db881 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.630710:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4000/0xd895711d66db310 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.630715:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4000/0xd895711d66db310 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.630721:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4000/0xd895711d66db310 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.630725:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b4000 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.630727:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4000/0xd895711d66db310 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00000100:00100000:1.0:1715330315.630753:0:12304:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5261 00010000:00010000:3.0:1715330315.630756:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4000/0xd895711d66db310 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00000100:00100000:1.0:1715330315.630757:0:12304:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+28:3689:x1798653942511616:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.630763:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989fd5 (ffff8800b2570000) 00010000:00010000:3.0:1715330315.630765:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.630767:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4000/0xd895711d66db310 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989fd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00002000:00080000:1.0:1715330315.630767:0:12304:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2530 count 1 00010000:00010000:3.0:1715330315.630771:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4000/0xd895711d66db310 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989fd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00002000:00010000:1.0:1715330315.630777:0:12304:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1715330315.630781:0:12304:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091c5db00/0xd895711d66db888 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.630784:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66db32c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330315.630787:0:12304:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330315.630788:0:12304:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330315.630789:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66db32c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330315.630790:0:12304:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091c5db00/0xd895711d66db888 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.630793:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66db32c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.630793:0:17205:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3691:x1798653942511680:12345-0@lo:6:osp-syn-0-0.0 Request processed in 173us (301us total) trans 4294969918 rc 0/0 00010000:00010000:3.0:1715330315.630797:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b5f80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330315.630797:0:12304:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091c5db00/0xd895711d66db888 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330315.630797:0:17205:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5260 00010000:00010000:3.0:1715330315.630800:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66db32c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.630804:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66db32c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330315.630804:0:12304:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091c5db00/0xd895711d66db888 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330315.630806:0:17205:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5262 00000100:00100000:0.0:1715330315.630809:0:17205:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+27:3689:x1798653942511552:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.630810:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a0d5 (ffff880093a11f00) 00010000:00010000:1.0:1715330315.630810:0:12304:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091c5db00/0xd895711d66db888 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.630812:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.630814:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66db32c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a0d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00002000:00080000:0.0:1715330315.630817:0:17205:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2529 count 1 00010000:00010000:3.0:1715330315.630818:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b5f80/0xd895711d66db32c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a0d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330315.630820:0:12304:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091c5db00/0xd895711d66db888 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.630825:0:12304:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5db00 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:1.0:1715330315.630828:0:12304:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091c5db00/0xd895711d66db888 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1715330315.630828:0:17205:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1715330315.630831:0:17205:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093bfd680/0xd895711d66db88f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.630833:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66db348 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330315.630834:0:12304:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091c5db00/0xd895711d66db888 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.630838:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66db348 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.630840:0:17205:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.630841:0:17205:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330315.630842:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66db348 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330315.630843:0:12304:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091c5db00/0xd895711d66db888 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.630844:0:17205:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093bfd680/0xd895711d66db88f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.630846:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b4240 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.630849:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66db348 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330315.630849:0:12304:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091c5db00/0xd895711d66db888 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.630850:0:17205:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093bfd680/0xd895711d66db88f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.630854:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66db348 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.630856:0:17205:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093bfd680/0xd895711d66db88f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.630860:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a1d5 (ffff880092dfde00) 00010000:00010000:0.0:1715330315.630861:0:17205:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093bfd680/0xd895711d66db88f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.630862:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.630864:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66db348 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a1d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.630866:0:17205:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093bfd680/0xd895711d66db88f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.630868:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b4240/0xd895711d66db348 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a1d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.630872:0:17205:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfd680 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330315.630874:0:17205:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093bfd680/0xd895711d66db88f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.630879:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db364 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.630880:0:17205:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093bfd680/0xd895711d66db88f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.630883:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db364 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.630887:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db364 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.630888:0:17205:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093bfd680/0xd895711d66db88f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.630891:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b6f40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.630893:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db364 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.630897:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db364 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.630897:0:17205:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093bfd680/0xd895711d66db88f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.630902:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a2d5 (ffff880092dfd500) 00010000:00010000:3.0:1715330315.630904:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.630906:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db364 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a2d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.630910:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6f40/0xd895711d66db364 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a2d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.630920:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e880/0xd895711d66db380 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00000100:00100000:1.0:1715330315.630921:0:12304:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+28:3689:x1798653942511616:12345-0@lo:6:osp-syn-0-0.0 Request processed in 163us (404us total) trans 4294969920 rc 0/0 00010000:00010000:3.0:1715330315.630925:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e880/0xd895711d66db380 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00000100:00100000:1.0:1715330315.630926:0:12304:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5261 00010000:00010000:3.0:1715330315.630930:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e880/0xd895711d66db380 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.630934:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5e880 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.630936:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e880/0xd895711d66db380 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.630939:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e880/0xd895711d66db380 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.630945:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a3d5 (ffff88008b0d2a00) 00000004:00080000:1.0:1715330315.630946:0:3691:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012fa4d180/2, rc 0, transno 2622 00010000:00010000:3.0:1715330315.630947:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.630949:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e880/0xd895711d66db380 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000100:00100000:1.0:1715330315.630949:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942511680:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1715330315.630955:0:3691:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012fa4e300/2, rc 0, transno 2621 00010000:00010000:3.0:1715330315.630956:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e880/0xd895711d66db380 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a3d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000100:00100000:1.0:1715330315.630957:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942511488:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1715330315.630962:0:17205:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3689:x1798653942511552:12345-0@lo:6:osp-syn-0-0.0 Request processed in 152us (402us total) trans 4294969921 rc 0/0 00000100:00100000:0.0:1715330315.630966:0:17205:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5262 00010000:00010000:3.0:1715330315.630967:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db39c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.630972:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db39c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.630977:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db39c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.630980:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b7180 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.630983:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db39c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.630987:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db39c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.630992:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ad6 (ffff880092dfd300) 00000100:00100000:1.0:1715330315.630993:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f57a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942511744:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.630995:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.630996:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db39c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ad6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.631001:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b7180/0xd895711d66db39c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ad6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000100:00100000:1.0:1715330315.631010:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1715330315.631012:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f180/0xd895711d66db3b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.631027:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f180/0xd895711d66db3b8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00000100:00100000:0.0:1715330315.631041:0:9398:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+27:3691:x1798653942511424:12345-0@lo:6:osp-syn-0-0.0 Request processed in 424us (591us total) trans 4294969919 rc 0/0 00000004:00080000:1.0:1715330315.631042:0:3691:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012fa4ce00/2, rc 0, transno 2623 00000100:00100000:1.0:1715330315.631047:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942511424:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1715330315.631047:0:9398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5259 00000100:00100000:1.0:1715330315.631050:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1715330315.631053:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f57bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942511936:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1715330315.631055:0:9398:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942511744 00000100:00100000:0.0:1715330315.631057:0:9398:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942511744 00000100:00100000:1.0:1715330315.631068:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330315.631068:0:9398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5263 00000100:00100000:0.0:1715330315.631071:0:9398:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+27:3691:x1798653942511744:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1715330315.631079:0:17199:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942511936 00002000:00080000:0.0:1715330315.631081:0:9398:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2532 count 1 00000100:00100000:1.0:1715330315.631082:0:17199:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942511936 00000100:00100000:1.0:1715330315.631092:0:17199:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5264 00002000:00010000:0.0:1715330315.631092:0:9398:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1715330315.631095:0:17199:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3691:x1798653942511936:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1715330315.631096:0:9398:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093bffcc0/0xd895711d66db896 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.631101:0:9398:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1715330315.631103:0:17199:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2535 count 1 00010000:00010000:0.0:1715330315.631103:0:9398:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.631105:0:9398:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093bffcc0/0xd895711d66db896 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.631111:0:9398:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093bffcc0/0xd895711d66db896 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1715330315.631112:0:17199:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1715330315.631115:0:17199:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091c5cb40/0xd895711d66db89d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.631117:0:9398:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093bffcc0/0xd895711d66db896 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.631121:0:17199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330315.631122:0:17199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.631123:0:9398:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093bffcc0/0xd895711d66db896 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.631124:0:17199:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091c5cb40/0xd895711d66db89d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.631129:0:9398:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093bffcc0/0xd895711d66db896 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.631130:0:17199:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091c5cb40/0xd895711d66db89d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.631133:0:9398:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bffcc0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330315.631135:0:9398:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093bffcc0/0xd895711d66db896 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.631136:0:17199:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091c5cb40/0xd895711d66db89d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.631141:0:9398:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093bffcc0/0xd895711d66db896 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.631142:0:17199:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091c5cb40/0xd895711d66db89d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.631148:0:9398:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093bffcc0/0xd895711d66db896 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.631152:0:17199:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091c5cb40/0xd895711d66db89d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.631154:0:9398:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093bffcc0/0xd895711d66db896 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.631157:0:17199:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5cb40 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:1.0:1715330315.631159:0:17199:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091c5cb40/0xd895711d66db89d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.631163:0:17199:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091c5cb40/0xd895711d66db89d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.631170:0:17199:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091c5cb40/0xd895711d66db89d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.631176:0:17199:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091c5cb40/0xd895711d66db89d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330315.631228:0:9398:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3691:x1798653942511744:12345-0@lo:6:osp-syn-0-0.0 Request processed in 155us (216us total) trans 4294969922 rc 0/0 00000100:00100000:0.0:1715330315.631233:0:9398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5263 00000100:00100000:1.0:1715330315.631234:0:17199:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:3691:x1798653942511936:12345-0@lo:6:osp-syn-0-0.0 Request processed in 137us (165us total) trans 4294969923 rc 0/0 00000100:00100000:1.0:1715330315.631238:0:17199:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5264 00000004:00080000:0.0:1715330315.631256:0:3691:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012f57bb80/2, rc 0, transno 2627 00000100:00100000:0.0:1715330315.631261:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f57bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942511936:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1715330315.631262:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f57b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942511872:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1715330315.631268:0:3691:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012f57a300/2, rc 0, transno 2626 00000100:00100000:0.0:1715330315.631270:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f57a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942511744:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1715330315.631277:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330315.631277:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f579c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942512000:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1715330315.631289:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012fa4dc00/2, rc 0, transno 2625 00000100:00100000:1.0:1715330315.631291:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942511552:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1715330315.631292:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1715330315.631297:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012fa4fb80/2, rc 0, transno 2624 00000100:00100000:1.0:1715330315.631300:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942511616:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1715330315.631305:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1715330315.631305:0:13361:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942511872 00000100:00100000:0.0:1715330315.631308:0:13361:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942511872 00000100:00100000:1.0:1715330315.631309:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f578000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942511808:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1715330315.631317:0:13361:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942512000 00000100:00100000:0.0:1715330315.631318:0:13361:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942512000 00000100:00100000:1.0:1715330315.631322:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330315.631325:0:13361:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942511808 00000100:00100000:0.0:1715330315.631327:0:13361:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942511808 00000100:00100000:0.0:1715330315.631334:0:13361:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5265 00000100:00100000:1.0:1715330315.631337:0:12304:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5266 00000100:00100000:0.0:1715330315.631337:0:13361:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f579f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3689:x1798653942511872:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1715330315.631340:0:12304:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3691:x1798653942512000:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1715330315.631346:0:12304:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2536 count 1 00002000:00080000:0.0:1715330315.631346:0:13361:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2534 count 1 00002000:00010000:1.0:1715330315.631356:0:12304:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1715330315.631357:0:13361:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1715330315.631360:0:12304:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091c5ed00/0xd895711d66db8a4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.631360:0:13361:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093bfd8c0/0xd895711d66db8ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.631366:0:12304:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.631366:0:13361:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330315.631367:0:12304:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.631367:0:13361:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330315.631370:0:12304:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091c5ed00/0xd895711d66db8a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.631370:0:13361:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093bfd8c0/0xd895711d66db8ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.631376:0:12304:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091c5ed00/0xd895711d66db8a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.631376:0:13361:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093bfd8c0/0xd895711d66db8ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.631382:0:12304:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091c5ed00/0xd895711d66db8a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.631383:0:13361:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093bfd8c0/0xd895711d66db8ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.631388:0:12304:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091c5ed00/0xd895711d66db8a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.631389:0:13361:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093bfd8c0/0xd895711d66db8ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.631393:0:12304:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091c5ed00/0xd895711d66db8a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.631397:0:12304:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5ed00 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330315.631399:0:13361:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093bfd8c0/0xd895711d66db8ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.631401:0:12304:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091c5ed00/0xd895711d66db8a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.631403:0:13361:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfd8c0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330315.631405:0:13361:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093bfd8c0/0xd895711d66db8ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.631407:0:12304:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091c5ed00/0xd895711d66db8a4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.631410:0:13361:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093bfd8c0/0xd895711d66db8ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.631415:0:12304:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091c5ed00/0xd895711d66db8a4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.631417:0:13361:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093bfd8c0/0xd895711d66db8ab lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.631420:0:12304:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091c5ed00/0xd895711d66db8a4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.631422:0:13361:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093bfd8c0/0xd895711d66db8ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330315.631454:0:17217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5267 00000100:00100000:0.0:1715330315.631458:0:17217:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+33:3689:x1798653942511808:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1715330315.631467:0:17217:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2533 count 1 00002000:00010000:0.0:1715330315.631477:0:17217:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1715330315.631481:0:17217:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093bfe1c0/0xd895711d66db8b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.631487:0:17217:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.631489:0:17217:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1715330315.631491:0:12304:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+33:3691:x1798653942512000:12345-0@lo:6:osp-syn-0-0.0 Request processed in 149us (197us total) trans 4294969925 rc 0/0 00010000:00010000:0.0:1715330315.631491:0:17217:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093bfe1c0/0xd895711d66db8b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330315.631496:0:12304:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5266 00010000:00010000:0.0:1715330315.631498:0:17217:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093bfe1c0/0xd895711d66db8b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.631504:0:17217:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093bfe1c0/0xd895711d66db8b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.631509:0:17217:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093bfe1c0/0xd895711d66db8b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.631514:0:17217:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093bfe1c0/0xd895711d66db8b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715330315.631515:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012fa4d880/2, rc 0, transno 2619 00000100:00100000:1.0:1715330315.631518:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942511360:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1715330315.631519:0:17217:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfe1c0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330315.631522:0:17217:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093bfe1c0/0xd895711d66db8b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.631527:0:17217:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093bfe1c0/0xd895711d66db8b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.631535:0:17217:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093bfe1c0/0xd895711d66db8b2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.631540:0:17217:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093bfe1c0/0xd895711d66db8b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330315.631613:0:17217:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+33:3689:x1798653942511808:12345-0@lo:6:osp-syn-0-0.0 Request processed in 153us (289us total) trans 4294969926 rc 0/0 00000100:00100000:0.0:1715330315.631618:0:17217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5267 00000100:00100000:0.0:1715330315.631672:0:13361:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f579f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+32:3689:x1798653942511872:12345-0@lo:6:osp-syn-0-0.0 Request processed in 334us (394us total) trans 4294969924 rc 0/0 00000100:00100000:0.0:1715330315.631678:0:13361:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5265 00000100:00100000:0.0:1715330315.631722:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942512256:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1715330315.631757:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1715330315.631773:0:3691:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012f579c00/2, rc 0, transno 2629 00000100:00100000:0.0:1715330315.631777:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f579c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942512000:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1715330315.631783:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1715330315.631786:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942512192:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1715330315.631801:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330315.631813:0:13361:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942512256 00000100:00100000:0.0:1715330315.631815:0:13361:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942512256 00000100:00100000:0.0:1715330315.631824:0:13361:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942512192 00000100:00100000:0.0:1715330315.631825:0:13361:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942512192 00000100:00100000:0.0:1715330315.631832:0:13361:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5268 00000100:00100000:0.0:1715330315.631835:0:13361:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+33:3691:x1798653942512256:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1715330315.631843:0:13361:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2540 count 1 00002000:00010000:0.0:1715330315.631855:0:13361:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1715330315.631859:0:13361:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093bff3c0/0xd895711d66db8b9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.631865:0:13361:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.631866:0:13361:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.631869:0:13361:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093bff3c0/0xd895711d66db8b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.631880:0:13361:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093bff3c0/0xd895711d66db8b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.631886:0:13361:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093bff3c0/0xd895711d66db8b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.631892:0:13361:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093bff3c0/0xd895711d66db8b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.631898:0:13361:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093bff3c0/0xd895711d66db8b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.631904:0:13361:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bff3c0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330315.631907:0:13361:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093bff3c0/0xd895711d66db8b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.631913:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f180/0xd895711d66db3b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.631913:0:13361:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093bff3c0/0xd895711d66db8b9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.631919:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5f180 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330315.631922:0:13361:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093bff3c0/0xd895711d66db8b9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.631923:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f180/0xd895711d66db3b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.631928:0:13361:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093bff3c0/0xd895711d66db8b9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.631929:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f180/0xd895711d66db3b8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.631939:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989bd6 (ffff88008b0d2600) 00010000:00010000:3.0:1715330315.631941:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.631944:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f180/0xd895711d66db3b8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989bd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.631949:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f180/0xd895711d66db3b8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989bd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.631969:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db3d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.631973:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db3d4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.631979:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db3d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.631983:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b6400 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.631985:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db3d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.631989:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db3d4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.631997:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989cd6 (ffff880092dfd200) 00010000:00010000:3.0:1715330315.631998:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.632001:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db3d4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989cd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.632001:0:13361:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+34:3691:x1798653942512256:12345-0@lo:6:osp-syn-0-0.0 Request processed in 164us (242us total) trans 4294969927 rc 0/0 00010000:00010000:3.0:1715330315.632005:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6400/0xd895711d66db3d4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989cd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.632007:0:13361:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5268 00000100:00100000:0.0:1715330315.632027:0:13361:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5269 00000100:00100000:0.0:1715330315.632031:0:13361:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+33:3691:x1798653942512192:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1715330315.632040:0:13361:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2539 count 1 00002000:00010000:0.0:1715330315.632052:0:13361:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1715330315.632056:0:13361:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093bfed00/0xd895711d66db8c0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.632061:0:13361:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.632062:0:13361:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.632064:0:13361:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093bfed00/0xd895711d66db8c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.632071:0:13361:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093bfed00/0xd895711d66db8c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.632077:0:13361:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093bfed00/0xd895711d66db8c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.632082:0:13361:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093bfed00/0xd895711d66db8c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.632089:0:13361:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093bfed00/0xd895711d66db8c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.632094:0:13361:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfed00 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330315.632096:0:13361:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093bfed00/0xd895711d66db8c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.632101:0:13361:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093bfed00/0xd895711d66db8c0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.632109:0:13361:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093bfed00/0xd895711d66db8c0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.632114:0:13361:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093bfed00/0xd895711d66db8c0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330315.632184:0:13361:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+34:3691:x1798653942512192:12345-0@lo:6:osp-syn-0-0.0 Request processed in 152us (382us total) trans 4294969928 rc 0/0 00000100:00100000:0.0:1715330315.632188:0:13361:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5269 00010000:00010000:3.0:1715330315.632504:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5fa80/0xd895711d66db3f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.632510:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5fa80/0xd895711d66db3f0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.632515:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5fa80/0xd895711d66db3f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.632520:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5fa80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.632522:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5fa80/0xd895711d66db3f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.632527:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5fa80/0xd895711d66db3f0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.632535:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989dd6 (ffff880092dfd800) 00010000:00010000:3.0:1715330315.632537:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.632540:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5fa80/0xd895711d66db3f0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989dd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.632544:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5fa80/0xd895711d66db3f0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989dd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.632560:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db40c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.632564:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db40c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.632568:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db40c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.632572:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b46c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.632574:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db40c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.632579:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db40c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.632584:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ed6 (ffff880092dfd900) 00010000:00010000:3.0:1715330315.632585:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.632587:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db40c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.632591:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b46c0/0xd895711d66db40c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.632602:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f600/0xd895711d66db428 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.632607:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f600/0xd895711d66db428 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.632611:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f600/0xd895711d66db428 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.632617:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5f600 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.632619:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f600/0xd895711d66db428 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.632624:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f600/0xd895711d66db428 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.632630:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989fd6 (ffff88008d699700) 00010000:00010000:3.0:1715330315.632632:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.632633:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f600/0xd895711d66db428 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989fd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.632638:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f600/0xd895711d66db428 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989fd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.632646:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db444 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.632650:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db444 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.632654:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db444 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.632657:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7b6ac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.632659:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db444 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.632663:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db444 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.632668:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a0d6 (ffff88008d699e00) 00010000:00010000:3.0:1715330315.632671:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.632673:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db444 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a0d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.632677:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7b6ac0/0xd895711d66db444 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a0d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.632686:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880087725440/0xd895711d66db460 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.632691:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880087725440/0xd895711d66db460 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.632695:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880087725440/0xd895711d66db460 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.632699:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087725440 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.632701:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087725440/0xd895711d66db460 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.632705:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087725440/0xd895711d66db460 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.632710:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a1d6 (ffff88008d699400) 00010000:00010000:3.0:1715330315.632712:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.632714:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880087725440/0xd895711d66db460 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a1d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.632718:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087725440/0xd895711d66db460 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a1d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.632750:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5dd40/0xd895711d66db47c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.632760:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5dd40/0xd895711d66db47c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.632765:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5dd40/0xd895711d66db47c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.632769:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5dd40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.632771:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5dd40/0xd895711d66db47c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.632775:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5dd40/0xd895711d66db47c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00000004:00080000:0.0:1715330315.632780:0:3691:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d4e8e00/2, rc 0, transno 2632 00010000:00010000:3.0:1715330315.632782:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a2d6 (ffff88008b0d2900) 00010000:00010000:3.0:1715330315.632784:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.632786:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5dd40/0xd895711d66db47c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a2d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000100:00100000:0.0:1715330315.632786:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942512192:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.632790:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5dd40/0xd895711d66db47c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a2d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00080000:0.0:1715330315.632792:0:3691:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d4ea680/2, rc 0, transno 2631 00000100:00100000:0.0:1715330315.632794:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942512256:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.632803:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66db498 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.632808:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66db498 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.632812:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66db498 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.632816:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfd440 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.632817:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66db498 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.632819:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942512512:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.632822:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66db498 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.632827:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a3d6 (ffff88008d699200) 00010000:00010000:3.0:1715330315.632828:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.632830:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66db498 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a3d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.632835:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfd440/0xd895711d66db498 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a3d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.632837:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330315.632847:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1715330315.632848:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d8c0/0xd895711d66db4b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00000100:00100000:0.0:1715330315.632850:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942512448:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.632852:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d8c0/0xd895711d66db4b4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.632856:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d8c0/0xd895711d66db4b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.632860:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5d8c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.632862:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d8c0/0xd895711d66db4b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00000100:00100000:0.0:1715330315.632862:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1715330315.632867:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d8c0/0xd895711d66db4b4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.632873:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ad7 (ffff88012ca48900) 00010000:00010000:3.0:1715330315.632874:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330315.632875:0:9397:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942512512 00010000:00010000:3.0:1715330315.632876:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d8c0/0xd895711d66db4b4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000100:00100000:0.0:1715330315.632878:0:9397:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942512512 00010000:00010000:3.0:1715330315.632884:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d8c0/0xd895711d66db4b4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.632898:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66db4d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.632902:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66db4d0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.632904:0:9397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5270 00010000:00010000:3.0:1715330315.632907:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66db4d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.632909:0:9397:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+34:3691:x1798653942512512:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.632911:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfc240 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.632913:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66db4d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.632917:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66db4d0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00002000:00080000:0.0:1715330315.632920:0:9397:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2544 count 1 00010000:00010000:3.0:1715330315.632923:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989bd7 (ffff88008b0d2d00) 00010000:00010000:3.0:1715330315.632925:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.632928:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66db4d0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989bd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.632932:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfc240/0xd895711d66db4d0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989bd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00002000:00010000:0.0:1715330315.632932:0:9397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1715330315.632937:0:9397:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093bfdd40/0xd895711d66db8c7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.632943:0:9397:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330315.632945:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab61c0/0xd895711d66db4ec lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.632945:0:9397:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.632948:0:9397:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093bfdd40/0xd895711d66db8c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.632949:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab61c0/0xd895711d66db4ec lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.632955:0:9397:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093bfdd40/0xd895711d66db8c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.632957:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab61c0/0xd895711d66db4ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.632961:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078ab61c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330315.632961:0:9397:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093bfdd40/0xd895711d66db8c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.632963:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab61c0/0xd895711d66db4ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.632965:0:9397:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093bfdd40/0xd895711d66db8c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.632968:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab61c0/0xd895711d66db4ec lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.632971:0:9397:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093bfdd40/0xd895711d66db8c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.632974:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989cd7 (ffff88008b0d2200) 00010000:00010000:0.0:1715330315.632975:0:9397:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfdd40 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330315.632976:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.632978:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab61c0/0xd895711d66db4ec lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989cd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.632978:0:9397:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093bfdd40/0xd895711d66db8c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.632982:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab61c0/0xd895711d66db4ec lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989cd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.632983:0:9397:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093bfdd40/0xd895711d66db8c7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.632993:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab7a80/0xd895711d66db508 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.632997:0:9397:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093bfdd40/0xd895711d66db8c7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.632998:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab7a80/0xd895711d66db508 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.633002:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab7a80/0xd895711d66db508 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.633003:0:9397:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093bfdd40/0xd895711d66db8c7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.633007:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078ab7a80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.633009:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab7a80/0xd895711d66db508 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.633027:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab7a80/0xd895711d66db508 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.633035:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989dd7 (ffff88012ca48f00) 00010000:00010000:3.0:1715330315.633037:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.633039:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab7a80/0xd895711d66db508 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989dd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.633043:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab7a80/0xd895711d66db508 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989dd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.633054:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d200/0xd895711d66db524 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633058:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d200/0xd895711d66db524 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633063:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d200/0xd895711d66db524 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00000100:00100000:1.0:1715330315.633063:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942512064:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.633067:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5d200 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.633069:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d200/0xd895711d66db524 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633074:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d200/0xd895711d66db524 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633080:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ed7 (ffff88008d699900) 00010000:00010000:3.0:1715330315.633082:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.633084:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d200/0xd895711d66db524 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ed7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000100:00100000:1.0:1715330315.633087:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1715330315.633089:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d200/0xd895711d66db524 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ed7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000100:00100000:1.0:1715330315.633097:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942512320:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.633102:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6f40/0xd895711d66db540 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.633107:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6f40/0xd895711d66db540 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.633107:0:9397:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+35:3691:x1798653942512512:12345-0@lo:6:osp-syn-0-0.0 Request processed in 197us (268us total) trans 4294969929 rc 0/0 00000100:00100000:1.0:1715330315.633108:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1715330315.633111:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6f40/0xd895711d66db540 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.633112:0:9397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5270 00010000:00010000:3.0:1715330315.633115:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078ab6f40 already unused, calling callback (ffffffffa0ee8730) 00000100:00100000:1.0:1715330315.633116:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00010000:00010000:3.0:1715330315.633117:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6f40/0xd895711d66db540 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00000100:00100000:1.0:1715330315.633118:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942512128:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1715330315.633120:0:9397:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942512448 00010000:00010000:3.0:1715330315.633122:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6f40/0xd895711d66db540 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.633122:0:9397:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942512448 00000100:00100000:1.0:1715330315.633126:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1715330315.633128:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989fd7 (ffff88012ca48600) 00010000:00010000:3.0:1715330315.633130:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330315.633131:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942512384:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.633132:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6f40/0xd895711d66db540 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989fd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.633132:0:9397:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942512064 00000100:00100000:0.0:1715330315.633134:0:9397:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942512064 00010000:00010000:3.0:1715330315.633137:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6f40/0xd895711d66db540 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989fd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000100:00100000:1.0:1715330315.633138:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330315.633142:0:9397:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942512320 00000100:00100000:0.0:1715330315.633143:0:9397:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942512320 00010000:00010000:3.0:1715330315.633149:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4fc0/0xd895711d66db55c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.633149:0:9397:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942512128 00000100:00100000:1.0:1715330315.633150:0:12304:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942512384 00000100:00100000:0.0:1715330315.633151:0:9397:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942512128 00000100:00100000:1.0:1715330315.633152:0:12304:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942512384 00010000:00010000:3.0:1715330315.633154:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4fc0/0xd895711d66db55c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.633158:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4fc0/0xd895711d66db55c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330315.633160:0:9397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5271 00000100:00100000:0.0:1715330315.633163:0:9397:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:3691:x1798653942512448:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1715330315.633164:0:12304:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5272 00010000:00010000:3.0:1715330315.633166:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078ab4fc0 already unused, calling callback (ffffffffa0ee8730) 00000100:00100000:1.0:1715330315.633167:0:12304:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+39:3688:x1798653942512064:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.633168:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4fc0/0xd895711d66db55c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00002000:00080000:0.0:1715330315.633172:0:9397:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2543 count 1 00010000:00010000:3.0:1715330315.633173:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4fc0/0xd895711d66db55c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00002000:00080000:1.0:1715330315.633175:0:12304:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2537 count 1 00010000:00010000:3.0:1715330315.633179:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a0d7 (ffff88008d699b00) 00010000:00010000:3.0:1715330315.633181:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00002000:00010000:0.0:1715330315.633182:0:9397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1715330315.633183:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4fc0/0xd895711d66db55c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a0d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00002000:00010000:1.0:1715330315.633185:0:12304:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1715330315.633185:0:9397:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093bfeac0/0xd895711d66db8ce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.633187:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4fc0/0xd895711d66db55c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a0d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330315.633188:0:12304:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091c5e1c0/0xd895711d66db8d5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.633191:0:9397:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330315.633193:0:12304:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.633193:0:9397:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330315.633194:0:12304:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.633195:0:9397:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093bfeac0/0xd895711d66db8ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.633196:0:12304:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091c5e1c0/0xd895711d66db8d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.633197:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6400/0xd895711d66db578 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.633202:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6400/0xd895711d66db578 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330315.633202:0:12304:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091c5e1c0/0xd895711d66db8d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.633205:0:12304:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091c5e1c0/0xd895711d66db8d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.633206:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6400/0xd895711d66db578 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.633206:0:9397:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093bfeac0/0xd895711d66db8ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.633209:0:12304:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091c5e1c0/0xd895711d66db8d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.633210:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078ab6400 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.633212:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6400/0xd895711d66db578 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.633212:0:9397:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093bfeac0/0xd895711d66db8ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.633213:0:12304:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091c5e1c0/0xd895711d66db8d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.633216:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6400/0xd895711d66db578 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330315.633216:0:12304:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5e1c0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:1.0:1715330315.633218:0:12304:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091c5e1c0/0xd895711d66db8d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.633218:0:9397:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093bfeac0/0xd895711d66db8ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.633222:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a1d7 (ffff88008d699100) 00010000:00010000:0.0:1715330315.633223:0:9397:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093bfeac0/0xd895711d66db8ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.633225:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330315.633225:0:12304:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091c5e1c0/0xd895711d66db8d5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.633227:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6400/0xd895711d66db578 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a1d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.633229:0:9397:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfeac0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330315.633231:0:9397:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093bfeac0/0xd895711d66db8ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.633232:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6400/0xd895711d66db578 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a1d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330315.633232:0:12304:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091c5e1c0/0xd895711d66db8d5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.633235:0:12304:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091c5e1c0/0xd895711d66db8d5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.633237:0:9397:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093bfeac0/0xd895711d66db8ce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.633242:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4900/0xd895711d66db594 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.633245:0:9397:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093bfeac0/0xd895711d66db8ce lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.633246:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4900/0xd895711d66db594 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.633250:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4900/0xd895711d66db594 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.633250:0:9397:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093bfeac0/0xd895711d66db8ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.633254:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078ab4900 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.633256:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4900/0xd895711d66db594 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.633261:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4900/0xd895711d66db594 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.633267:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a2d7 (ffff8800b4184000) 00010000:00010000:3.0:1715330315.633269:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.633271:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4900/0xd895711d66db594 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a2d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.633276:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4900/0xd895711d66db594 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a2d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.633288:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66db5b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633297:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66db5b0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00000100:00100000:1.0:1715330315.633298:0:12304:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3688:x1798653942512064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 130us (209us total) trans 4294969930 rc 0/0 00000100:00100000:1.0:1715330315.633301:0:12304:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5272 00010000:00010000:3.0:1715330315.633302:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66db5b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633306:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a0900 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.633308:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66db5b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00000100:00100000:1.0:1715330315.633308:0:12304:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5273 00000100:00100000:1.0:1715330315.633310:0:12304:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f578e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3688:x1798653942512320:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.633313:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66db5b0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00002000:00080000:1.0:1715330315.633316:0:12304:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2541 count 1 00010000:00010000:3.0:1715330315.633320:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a3d7 (ffff8800b4184d00) 00010000:00010000:3.0:1715330315.633322:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.633324:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66db5b0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a3d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00002000:00010000:1.0:1715330315.633324:0:12304:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1715330315.633326:0:12304:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091c5e400/0xd895711d66db8dc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330315.633327:0:9397:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3691:x1798653942512448:12345-0@lo:6:osp-syn-0-0.0 Request processed in 162us (463us total) trans 4294969931 rc 0/0 00010000:00010000:3.0:1715330315.633328:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a0900/0xd895711d66db5b0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a3d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330315.633330:0:12304:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330315.633331:0:12304:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1715330315.633332:0:9397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5271 00010000:00010000:1.0:1715330315.633333:0:12304:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091c5e400/0xd895711d66db8dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.633337:0:12304:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091c5e400/0xd895711d66db8dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.633340:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c6c0/0xd895711d66db5cc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330315.633344:0:12304:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091c5e400/0xd895711d66db8dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.633345:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c6c0/0xd895711d66db5cc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330315.633347:0:12304:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091c5e400/0xd895711d66db8dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.633348:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c6c0/0xd895711d66db5cc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330315.633351:0:12304:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091c5e400/0xd895711d66db8dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.633352:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5c6c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330315.633353:0:12304:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5e400 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330315.633354:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c6c0/0xd895711d66db5cc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330315.633355:0:12304:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091c5e400/0xd895711d66db8dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330315.633358:0:17215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5274 00010000:00010000:1.0:1715330315.633358:0:12304:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091c5e400/0xd895711d66db8dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.633360:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c6c0/0xd895711d66db5cc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00000100:00100000:2.0:1715330315.633362:0:17215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+39:3688:x1798653942512128:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1715330315.633363:0:12304:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091c5e400/0xd895711d66db8dc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.633365:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ad8 (ffff88009d5faa00) 00010000:00010000:1.0:1715330315.633366:0:12304:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091c5e400/0xd895711d66db8dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.633367:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.633369:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c6c0/0xd895711d66db5cc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ad8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633373:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c6c0/0xd895711d66db5cc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ad8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00002000:00080000:2.0:1715330315.633373:0:17215:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2538 count 1 00002000:00010000:2.0:1715330315.633385:0:17215:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1715330315.633386:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b73c0/0xd895711d66db5e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.633389:0:17215:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800938b7180/0xd895711d66db8e3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.633391:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b73c0/0xd895711d66db5e8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633395:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b73c0/0xd895711d66db5e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.633395:0:17215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330315.633396:0:17215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1715330315.633396:0:9397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5275 00010000:00010000:2.0:1715330315.633398:0:17215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800938b7180/0xd895711d66db8e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.633399:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b73c0 already unused, calling callback (ffffffffa0ee8730) 00000100:00100000:0.0:1715330315.633400:0:9397:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3688:x1798653942512384:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.633402:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b73c0/0xd895711d66db5e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.633405:0:17215:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800938b7180/0xd895711d66db8e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.633406:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b73c0/0xd895711d66db5e8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00002000:00080000:0.0:1715330315.633407:0:9397:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2542 count 1 00010000:00010000:2.0:1715330315.633411:0:17215:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800938b7180/0xd895711d66db8e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.633412:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989bd8 (ffff88008b0d2300) 00010000:00010000:3.0:1715330315.633414:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330315.633415:0:12304:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f578e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3688:x1798653942512320:12345-0@lo:6:osp-syn-0-0.0 Request processed in 103us (305us total) trans 4294969932 rc 0/0 00010000:00010000:3.0:1715330315.633416:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b73c0/0xd895711d66db5e8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989bd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00002000:00010000:0.0:1715330315.633416:0:9397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1715330315.633417:0:17215:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800938b7180/0xd895711d66db8e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330315.633418:0:12304:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5273 00010000:00010000:0.0:1715330315.633419:0:9397:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093bfdf80/0xd895711d66db8ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330315.633423:0:17215:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800938b7180/0xd895711d66db8e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.633424:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b73c0/0xd895711d66db5e8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989bd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.633424:0:9397:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.633426:0:9397:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330315.633428:0:17215:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b7180 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330315.633428:0:9397:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093bfdf80/0xd895711d66db8ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330315.633430:0:17215:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800938b7180/0xd895711d66db8e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.633435:0:9397:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093bfdf80/0xd895711d66db8ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330315.633436:0:17215:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800938b7180/0xd895711d66db8e3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.633438:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6d00/0xd895711d66db604 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00000004:00080000:1.0:1715330315.633438:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d4ead80/2, rc 0, transno 2634 00010000:00010000:0.0:1715330315.633440:0:9397:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093bfdf80/0xd895711d66db8ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.633442:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6d00/0xd895711d66db604 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00000100:00100000:1.0:1715330315.633444:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942512064:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1715330315.633444:0:9397:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093bfdf80/0xd895711d66db8ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.633448:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6d00/0xd895711d66db604 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00000004:00080000:1.0:1715330315.633448:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d4e9500/2, rc 0, transno 2636 00010000:00010000:2.0:1715330315.633450:0:17215:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800938b7180/0xd895711d66db8e3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330315.633450:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942512320:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1715330315.633450:0:9397:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093bfdf80/0xd895711d66db8ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.633452:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078ab6d00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.633454:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6d00/0xd895711d66db604 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.633454:0:9397:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfdf80 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330315.633455:0:17215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800938b7180/0xd895711d66db8e3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.633457:0:9397:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093bfdf80/0xd895711d66db8ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.633458:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6d00/0xd895711d66db604 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.633462:0:9397:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093bfdf80/0xd895711d66db8ea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.633464:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989cd8 (ffff88008b0d2100) 00010000:00010000:3.0:1715330315.633465:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.633468:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6d00/0xd895711d66db604 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989cd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000100:00100000:1.0:1715330315.633469:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f579500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942512576:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1715330315.633470:0:9397:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093bfdf80/0xd895711d66db8ea lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.633472:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6d00/0xd895711d66db604 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989cd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.633475:0:9397:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093bfdf80/0xd895711d66db8ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330315.633479:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1715330315.633482:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4b40/0xd895711d66db620 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00000100:00100000:1.0:1715330315.633484:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1715330315.633487:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4b40/0xd895711d66db620 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00000100:00100000:1.0:1715330315.633487:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f57aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942512640:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1715330315.633494:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1715330315.633495:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4b40/0xd895711d66db620 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633499:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078ab4b40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.633500:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4b40/0xd895711d66db620 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00000100:00100000:1.0:1715330315.633501:0:17217:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942512576 00000100:00100000:1.0:1715330315.633503:0:17217:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942512576 00010000:00010000:3.0:1715330315.633504:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4b40/0xd895711d66db620 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633510:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989dd8 (ffff88008b0d2b00) 00000100:00100000:1.0:1715330315.633510:0:17217:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942512640 00010000:00010000:3.0:1715330315.633511:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330315.633511:0:17217:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942512640 00010000:00010000:3.0:1715330315.633513:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4b40/0xd895711d66db620 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000100:00100000:1.0:1715330315.633515:0:17217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5276 00010000:00010000:3.0:1715330315.633518:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab4b40/0xd895711d66db620 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000100:00100000:1.0:1715330315.633518:0:17217:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+43:3688:x1798653942512576:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1715330315.633524:0:17217:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2545 count 1 00010000:00010000:3.0:1715330315.633527:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6ac0/0xd895711d66db63c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00002000:00010000:1.0:1715330315.633531:0:17217:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1715330315.633532:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6ac0/0xd895711d66db63c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330315.633534:0:17217:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091c5f3c0/0xd895711d66db8f1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.633536:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6ac0/0xd895711d66db63c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00000100:00100000:2.0:1715330315.633537:0:17215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+43:3688:x1798653942512128:12345-0@lo:6:osp-syn-0-0.0 Request processed in 173us (408us total) trans 4294969933 rc 0/0 00000100:00100000:0.0:1715330315.633537:0:9397:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+43:3688:x1798653942512384:12345-0@lo:6:osp-syn-0-0.0 Request processed in 135us (396us total) trans 4294969934 rc 0/0 00010000:00010000:1.0:1715330315.633538:0:17217:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330315.633539:0:17217:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330315.633540:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880078ab6ac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330315.633540:0:17217:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091c5f3c0/0xd895711d66db8f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.633542:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6ac0/0xd895711d66db63c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00000100:00100000:0.0:1715330315.633542:0:9397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5275 00010000:00010000:1.0:1715330315.633545:0:17217:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091c5f3c0/0xd895711d66db8f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.633546:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6ac0/0xd895711d66db63c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330315.633548:0:17217:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091c5f3c0/0xd895711d66db8f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330315.633550:0:17215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5274 00010000:00010000:3.0:1715330315.633552:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ed8 (ffff880093a11200) 00010000:00010000:3.0:1715330315.633553:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330315.633553:0:17217:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091c5f3c0/0xd895711d66db8f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330315.633553:0:9397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5277 00010000:00010000:3.0:1715330315.633556:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6ac0/0xd895711d66db63c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ed8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330315.633556:0:17217:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091c5f3c0/0xd895711d66db8f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330315.633556:0:9397:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:3688:x1798653942512640:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.633559:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880078ab6ac0/0xd895711d66db63c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ed8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330315.633559:0:17217:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5f3c0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:1.0:1715330315.633560:0:17217:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091c5f3c0/0xd895711d66db8f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.633563:0:17217:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091c5f3c0/0xd895711d66db8f1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1715330315.633564:0:9397:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2546 count 1 00010000:00010000:1.0:1715330315.633569:0:17217:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091c5f3c0/0xd895711d66db8f1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715330315.633572:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d4ebb80/2, rc 0, transno 2637 00010000:00010000:1.0:1715330315.633572:0:17217:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091c5f3c0/0xd895711d66db8f1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.633573:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82f40/0xd895711d66db658 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00002000:00010000:0.0:1715330315.633574:0:9397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1715330315.633576:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942512128:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1715330315.633577:0:9397:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093bfdb00/0xd895711d66db8f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.633578:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82f40/0xd895711d66db658 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633582:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82f40/0xd895711d66db658 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00000004:00080000:2.0:1715330315.633582:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008b0c1c00/2, rc 0, transno 2638 00010000:00010000:0.0:1715330315.633583:0:9397:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.633584:0:9397:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1715330315.633585:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942512384:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.633586:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da82f40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330315.633587:0:9397:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093bfdb00/0xd895711d66db8f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.633588:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82f40/0xd895711d66db658 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633592:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82f40/0xd895711d66db658 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.633593:0:9397:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093bfdb00/0xd895711d66db8f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.633597:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989fd8 (ffff880093a11900) 00010000:00010000:3.0:1715330315.633598:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.633600:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82f40/0xd895711d66db658 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989fd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633604:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82f40/0xd895711d66db658 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989fd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330315.633604:0:9397:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093bfdb00/0xd895711d66db8f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.633610:0:9397:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093bfdb00/0xd895711d66db8f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.633616:0:9397:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093bfdb00/0xd895711d66db8f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.633617:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3a80/0xd895711d66db674 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.633621:0:9397:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880093bfdb00 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330315.633622:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3a80/0xd895711d66db674 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00000100:00100000:1.0:1715330315.633623:0:17217:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+42:3688:x1798653942512576:12345-0@lo:6:osp-syn-0-0.0 Request processed in 104us (143us total) trans 4294969935 rc 0/0 00010000:00010000:0.0:1715330315.633624:0:9397:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093bfdb00/0xd895711d66db8f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.633626:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3a80/0xd895711d66db674 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00000100:00100000:1.0:1715330315.633626:0:17217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5276 00010000:00010000:3.0:1715330315.633629:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a3a80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330315.633629:0:9397:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093bfdb00/0xd895711d66db8f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.633631:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3a80/0xd895711d66db674 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.633634:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3a80/0xd895711d66db674 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330315.633638:0:9397:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093bfdb00/0xd895711d66db8f8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.633640:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a0d8 (ffff88009d5fa600) 00010000:00010000:3.0:1715330315.633642:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330315.633643:0:9397:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093bfdb00/0xd895711d66db8f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.633644:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3a80/0xd895711d66db674 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a0d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.633649:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a3a80/0xd895711d66db674 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a0d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.633660:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5b00/0xd895711d66db690 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.633665:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5b00/0xd895711d66db690 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.633669:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5b00/0xd895711d66db690 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.633675:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b5b00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.633677:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5b00/0xd895711d66db690 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.633682:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5b00/0xd895711d66db690 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.633687:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a1d8 (ffff88012ca4dc00) 00010000:00010000:3.0:1715330315.633688:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.633690:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5b00/0xd895711d66db690 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a1d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.633695:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5b00/0xd895711d66db690 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a1d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.633706:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83cc0/0xd895711d66db6ac lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633710:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83cc0/0xd895711d66db6ac lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633714:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83cc0/0xd895711d66db6ac lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633717:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da83cc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.633718:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83cc0/0xd895711d66db6ac lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633722:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83cc0/0xd895711d66db6ac lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633726:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a2d8 (ffff88012ca4df00) 00010000:00010000:3.0:1715330315.633754:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.633757:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83cc0/0xd895711d66db6ac lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a2d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633760:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83cc0/0xd895711d66db6ac lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a2d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633773:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82400/0xd895711d66db6c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633778:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82400/0xd895711d66db6c8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633782:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82400/0xd895711d66db6c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633786:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da82400 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.633788:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82400/0xd895711d66db6c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633791:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82400/0xd895711d66db6c8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633797:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a3d8 (ffff88012ca4db00) 00010000:00010000:3.0:1715330315.633800:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.633802:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82400/0xd895711d66db6c8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a3d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633806:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82400/0xd895711d66db6c8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a3d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633815:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80900/0xd895711d66db6e4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633823:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80900/0xd895711d66db6e4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633826:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80900/0xd895711d66db6e4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633829:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da80900 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.633832:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80900/0xd895711d66db6e4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633837:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80900/0xd895711d66db6e4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ad9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633843:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ad9 (ffff88012cc48700) 00010000:00010000:3.0:1715330315.633844:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.633846:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80900/0xd895711d66db6e4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ad9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633851:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80900/0xd895711d66db6e4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ad9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633862:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66db700 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.633866:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66db700 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.633870:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66db700 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.633873:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a2f40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.633875:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66db700 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.633880:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66db700 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989bd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.633886:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989bd9 (ffff88012cc48e00) 00010000:00010000:3.0:1715330315.633888:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.633890:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66db700 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989bd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.633895:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a2f40/0xd895711d66db700 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989bd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.633908:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82880/0xd895711d66db71c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633911:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82880/0xd895711d66db71c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633916:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82880/0xd895711d66db71c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633919:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da82880 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.633920:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82880/0xd895711d66db71c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633924:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82880/0xd895711d66db71c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989cd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633930:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989cd9 (ffff88012cc48500) 00010000:00010000:3.0:1715330315.633931:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.633933:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82880/0xd895711d66db71c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989cd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633941:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82880/0xd895711d66db71c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989cd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633949:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82ac0/0xd895711d66db738 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633954:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82ac0/0xd895711d66db738 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633957:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82ac0/0xd895711d66db738 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633961:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da82ac0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.633963:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82ac0/0xd895711d66db738 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633968:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82ac0/0xd895711d66db738 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989dd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633974:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989dd9 (ffff88012cc48f00) 00010000:00010000:3.0:1715330315.633976:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.633977:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82ac0/0xd895711d66db738 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989dd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633982:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82ac0/0xd895711d66db738 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989dd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633993:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81d40/0xd895711d66db754 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.633997:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81d40/0xd895711d66db754 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.634005:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81d40/0xd895711d66db754 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.634009:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da81d40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.634012:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81d40/0xd895711d66db754 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.634027:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81d40/0xd895711d66db754 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989ed9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.634034:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989ed9 (ffff88009ef2cc00) 00010000:00010000:3.0:1715330315.634036:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.634038:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81d40/0xd895711d66db754 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ed9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.634042:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81d40/0xd895711d66db754 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989ed9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.634054:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81200/0xd895711d66db770 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.634058:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81200/0xd895711d66db770 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.634063:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81200/0xd895711d66db770 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.634066:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da81200 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.634068:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81200/0xd895711d66db770 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.634072:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81200/0xd895711d66db770 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca989fd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.634078:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca989fd9 (ffff88009ef2c900) 00010000:00010000:3.0:1715330315.634080:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.634082:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81200/0xd895711d66db770 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989fd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00080000:2.0:1715330315.634083:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012f579500/2, rc 0, transno 2639 00010000:00010000:3.0:1715330315.634087:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81200/0xd895711d66db770 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca989fd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000100:00100000:2.0:1715330315.634089:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f579500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942512576:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1715330315.634090:0:9397:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+42:3688:x1798653942512640:12345-0@lo:6:osp-syn-0-0.0 Request processed in 532us (594us total) trans 4294969936 rc 0/0 00000100:00100000:0.0:1715330315.634095:0:9397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5277 00000004:00080000:2.0:1715330315.634098:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012f57aa00/2, rc 0, transno 2640 00010000:00010000:3.0:1715330315.634099:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5680/0xd895711d66db78c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00000100:00100000:2.0:1715330315.634100:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f57aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942512640:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.634104:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5680/0xd895711d66db78c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00000100:00100000:0.0:1715330315.634116:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093b59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942512768:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.634119:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5680/0xd895711d66db78c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.634123:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b5680 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.634125:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5680/0xd895711d66db78c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00000100:00100000:2.0:1715330315.634127:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942512832:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.634129:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5680/0xd895711d66db78c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a0d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00000100:00100000:0.0:1715330315.634134:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1715330315.634136:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a0d9 (ffff88009ef2cb00) 00010000:00010000:3.0:1715330315.634138:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.634141:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5680/0xd895711d66db78c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a0d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330315.634145:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5680/0xd895711d66db78c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a0d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000100:00100000:2.0:1715330315.634160:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1715330315.634161:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66db7a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00000004:00080000:0.0:1715330315.634162:0:3691:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008b0c1180/2, rc 0, transno 2635 00010000:00010000:3.0:1715330315.634165:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66db7a8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00000100:00100000:0.0:1715330315.634167:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942512448:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.634169:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66db7a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00000100:00100000:2.0:1715330315.634169:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1715330315.634173:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942512896:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1715330315.634173:0:9398:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942512768 00000004:00080000:0.0:1715330315.634173:0:3691:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008b0c3100/2, rc 0, transno 2633 00010000:00010000:3.0:1715330315.634174:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009d7a1d40 already unused, calling callback (ffffffffa0ee8730) 00000100:00100000:0.0:1715330315.634175:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942512512:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.634176:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66db7a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00000100:00100000:1.0:1715330315.634177:0:9398:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942512768 00010000:00010000:3.0:1715330315.634180:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66db7a8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00000100:00100000:0.0:1715330315.634181:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1715330315.634184:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942512704:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.634186:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a1d9 (ffff88012ca48700) 00010000:00010000:3.0:1715330315.634187:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.634188:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66db7a8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000100:00100000:2.0:1715330315.634188:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1715330315.634192:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d7a1d40/0xd895711d66db7a8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000100:00100000:1.0:1715330315.634196:0:9398:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942512832 00000100:00100000:0.0:1715330315.634196:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330315.634197:0:9398:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942512832 00000100:00100000:1.0:1715330315.634204:0:9398:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942512896 00010000:00010000:3.0:1715330315.634205:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4d80/0xd895711d66db7c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00000100:00100000:1.0:1715330315.634205:0:9398:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942512896 00000100:00100000:1.0:1715330315.634209:0:9398:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942512704 00010000:00010000:3.0:1715330315.634210:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4d80/0xd895711d66db7c4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00000100:00100000:1.0:1715330315.634211:0:9398:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942512704 00010000:00010000:3.0:1715330315.634213:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4d80/0xd895711d66db7c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00000100:00100000:2.0:1715330315.634214:0:9399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5278 00000004:00080000:0.0:1715330315.634215:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012f578000/2, rc 0, transno 2630 00000100:00100000:0.0:1715330315.634218:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f578000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942511808:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1715330315.634219:0:9399:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3691:x1798653942512768:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1715330315.634220:0:9398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5279 00010000:00010000:3.0:1715330315.634221:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b4d80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330315.634223:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4d80/0xd895711d66db7c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00000100:00100000:1.0:1715330315.634224:0:9398:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3688:x1798653942512832:12345-0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1715330315.634225:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012f57b100/2, rc 0, transno 2628 00000100:00100000:0.0:1715330315.634227:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f57b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942511872:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1715330315.634229:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4d80/0xd895711d66db7c4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a2d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00002000:00080000:2.0:1715330315.634229:0:9399:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2548 count 1 00002000:00080000:1.0:1715330315.634232:0:9398:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2549 count 1 00010000:00010000:3.0:1715330315.634234:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a2d9 (ffff880091c70c00) 00010000:00010000:3.0:1715330315.634236:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330315.634238:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4d80/0xd895711d66db7c4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a2d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330315.634242:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4d80/0xd895711d66db7c4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a2d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00002000:00010000:2.0:1715330315.634242:0:9399:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1715330315.634242:0:9398:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1715330315.634246:0:9399:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800938b6400/0xd895711d66db8ff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.634246:0:9398:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091c5e640/0xd895711d66db906 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330315.634251:0:9399:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330315.634251:0:9398:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330315.634252:0:9399:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330315.634252:0:9398:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330315.634254:0:9398:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091c5e640/0xd895711d66db906 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330315.634255:0:9399:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800938b6400/0xd895711d66db8ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.634257:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b46c0/0xd895711d66db7e0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330315.634259:0:9398:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091c5e640/0xd895711d66db906 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.634262:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b46c0/0xd895711d66db7e0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.634262:0:9399:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800938b6400/0xd895711d66db8ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.634263:0:9398:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091c5e640/0xd895711d66db906 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.634266:0:9398:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091c5e640/0xd895711d66db906 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.634267:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b46c0/0xd895711d66db7e0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.634268:0:9399:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800938b6400/0xd895711d66db8ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.634270:0:9398:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091c5e640/0xd895711d66db906 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.634272:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b46c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330315.634273:0:9399:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800938b6400/0xd895711d66db8ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.634273:0:9398:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5e640 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330315.634274:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b46c0/0xd895711d66db7e0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330315.634275:0:9398:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091c5e640/0xd895711d66db906 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330315.634278:0:9399:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800938b6400/0xd895711d66db8ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.634279:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b46c0/0xd895711d66db7e0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0xca98a3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:1.0:1715330315.634279:0:9398:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091c5e640/0xd895711d66db906 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330315.634283:0:9399:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b6400 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330315.634284:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0xca98a3d9 (ffff880091c70000) 00010000:00010000:2.0:1715330315.634286:0:9399:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800938b6400/0xd895711d66db8ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.634286:0:9398:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091c5e640/0xd895711d66db906 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.634287:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330315.634289:0:9398:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091c5e640/0xd895711d66db906 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.634290:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b46c0/0xd895711d66db7e0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.634292:0:9399:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800938b6400/0xd895711d66db8ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330315.634295:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b46c0/0xd895711d66db7e0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x152a:0x0].0xca98a3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330315.634300:0:9399:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800938b6400/0xd895711d66db8ff lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330315.634305:0:9399:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800938b6400/0xd895711d66db8ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330315.634361:0:9398:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+47:3688:x1798653942512832:12345-0@lo:6:osp-syn-0-0.0 Request processed in 137us (201us total) trans 4294969937 rc 0/0 00000100:00100000:1.0:1715330315.634365:0:9398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5279 00000100:00100000:1.0:1715330315.634373:0:9398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5280 00000100:00100000:1.0:1715330315.634375:0:9398:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+46:3688:x1798653942512896:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1715330315.634381:0:9398:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2550 count 1 00002000:00010000:1.0:1715330315.634389:0:9398:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1715330315.634392:0:9398:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091c5eac0/0xd895711d66db90d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.634396:0:9398:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330315.634397:0:9398:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330315.634398:0:9398:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091c5eac0/0xd895711d66db90d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330315.634403:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880093b5a680/2, rc 0, transno 2641 00010000:00010000:1.0:1715330315.634403:0:9398:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091c5eac0/0xd895711d66db90d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.634410:0:9398:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091c5eac0/0xd895711d66db90d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330315.634412:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942512832:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1715330315.634413:0:9398:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091c5eac0/0xd895711d66db90d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.634417:0:9398:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091c5eac0/0xd895711d66db90d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.634419:0:9398:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5eac0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:1.0:1715330315.634421:0:9398:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091c5eac0/0xd895711d66db90d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.634424:0:9398:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091c5eac0/0xd895711d66db90d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.634428:0:9398:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091c5eac0/0xd895711d66db90d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.634431:0:9398:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091c5eac0/0xd895711d66db90d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330315.634505:0:13361:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5281 00000100:00100000:0.0:1715330315.634509:0:13361:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+47:3691:x1798653942512704:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1715330315.634520:0:13361:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2547 count 1 00002000:00010000:0.0:1715330315.634533:0:13361:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1715330315.634537:0:13361:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880087727600/0xd895711d66db914 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.634543:0:13361:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.634545:0:13361:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.634547:0:13361:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880087727600/0xd895711d66db914 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.634554:0:13361:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880087727600/0xd895711d66db914 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.634565:0:13361:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880087727600/0xd895711d66db914 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.634572:0:13361:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880087727600/0xd895711d66db914 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.634577:0:13361:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880087727600/0xd895711d66db914 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.634581:0:13361:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087727600 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330315.634583:0:13361:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880087727600/0xd895711d66db914 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.634588:0:13361:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880087727600/0xd895711d66db914 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.634596:0:13361:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880087727600/0xd895711d66db914 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.634602:0:13361:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880087727600/0xd895711d66db914 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330315.634701:0:9398:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+48:3688:x1798653942512896:12345-0@lo:6:osp-syn-0-0.0 Request processed in 324us (511us total) trans 4294969939 rc 0/0 00000100:00100000:2.0:1715330315.634704:0:9399:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+48:3691:x1798653942512768:12345-0@lo:6:osp-syn-0-0.0 Request processed in 484us (568us total) trans 4294969938 rc 0/0 00000100:00100000:1.0:1715330315.634704:0:9398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5280 00000100:00100000:2.0:1715330315.634710:0:9399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5278 00000100:00100000:0.0:1715330315.634883:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093b5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942513024:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1715330315.634902:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1715330315.634917:0:3691:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880093b59c00/2, rc 0, transno 2642 00000100:00100000:0.0:1715330315.634922:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093b59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942512768:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1715330315.634928:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1715330315.634933:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093b59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942512960:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1715330315.634947:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330315.634955:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942513216:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1715330315.634966:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330315.634978:0:17206:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942513024 00000100:00100000:0.0:1715330315.634981:0:17206:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942513024 00000100:00100000:0.0:1715330315.634992:0:17206:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942512960 00000100:00100000:0.0:1715330315.634994:0:17206:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942512960 00000100:00100000:0.0:1715330315.635001:0:17206:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942513216 00000100:00100000:0.0:1715330315.635003:0:17206:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942513216 00000100:00100000:0.0:1715330315.635011:0:17206:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5282 00000100:00100000:0.0:1715330315.635026:0:17206:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+49:3691:x1798653942513024:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1715330315.635036:0:17206:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2552 count 1 00002000:00010000:0.0:1715330315.635050:0:17206:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1715330315.635055:0:17206:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880087724000/0xd895711d66db91b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.635061:0:17206:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.635062:0:17206:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.635064:0:17206:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880087724000/0xd895711d66db91b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.635071:0:17206:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880087724000/0xd895711d66db91b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.635077:0:17206:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880087724000/0xd895711d66db91b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.635087:0:17206:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880087724000/0xd895711d66db91b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.635092:0:17206:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880087724000/0xd895711d66db91b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.635098:0:17206:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087724000 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330315.635100:0:17206:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880087724000/0xd895711d66db91b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.635106:0:17206:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880087724000/0xd895711d66db91b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.635115:0:17206:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880087724000/0xd895711d66db91b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.635120:0:17206:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880087724000/0xd895711d66db91b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330315.635195:0:17206:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+50:3691:x1798653942513024:12345-0@lo:6:osp-syn-0-0.0 Request processed in 179us (292us total) trans 4294969941 rc 0/0 00000100:00100000:0.0:1715330315.635201:0:17206:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5282 00000100:00100000:0.0:1715330315.635210:0:17206:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5283 00000100:00100000:0.0:1715330315.635214:0:17206:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+49:3691:x1798653942512960:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1715330315.635223:0:17206:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2551 count 1 00002000:00010000:0.0:1715330315.635233:0:17206:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1715330315.635237:0:17206:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880087724b40/0xd895711d66db922 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.635243:0:17206:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.635244:0:17206:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.635246:0:17206:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880087724b40/0xd895711d66db922 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.635253:0:17206:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880087724b40/0xd895711d66db922 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.635259:0:17206:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880087724b40/0xd895711d66db922 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.635264:0:17206:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880087724b40/0xd895711d66db922 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.635269:0:17206:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880087724b40/0xd895711d66db922 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.635275:0:17206:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087724b40 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330315.635277:0:17206:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880087724b40/0xd895711d66db922 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.635283:0:17206:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880087724b40/0xd895711d66db922 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.635290:0:17206:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880087724b40/0xd895711d66db922 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.635296:0:17206:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880087724b40/0xd895711d66db922 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330315.635364:0:17206:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+50:3691:x1798653942512960:12345-0@lo:6:osp-syn-0-0.0 Request processed in 148us (415us total) trans 4294969942 rc 0/0 00000100:00100000:0.0:1715330315.635369:0:17206:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5283 00000100:00100000:0.0:1715330315.635378:0:17206:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5284 00000100:00100000:0.0:1715330315.635381:0:17206:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+49:3691:x1798653942513216:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1715330315.635390:0:17206:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2555 count 1 00002000:00010000:0.0:1715330315.635401:0:17206:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1715330315.635404:0:17206:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800877273c0/0xd895711d66db929 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.635411:0:17206:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.635412:0:17206:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.635415:0:17206:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800877273c0/0xd895711d66db929 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.635422:0:17206:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800877273c0/0xd895711d66db929 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.635428:0:17206:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800877273c0/0xd895711d66db929 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.635433:0:17206:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800877273c0/0xd895711d66db929 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.635443:0:17206:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800877273c0/0xd895711d66db929 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.635447:0:17206:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800877273c0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330315.635450:0:17206:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800877273c0/0xd895711d66db929 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.635454:0:17206:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800877273c0/0xd895711d66db929 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.635462:0:17206:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800877273c0/0xd895711d66db929 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.635467:0:17206:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800877273c0/0xd895711d66db929 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330315.635538:0:17206:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+50:3691:x1798653942513216:12345-0@lo:6:osp-syn-0-0.0 Request processed in 155us (570us total) trans 4294969943 rc 0/0 00000100:00100000:0.0:1715330315.635543:0:17206:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5284 00000004:00080000:0.0:1715330315.635564:0:3691:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880093b59f80/2, rc 0, transno 2646 00000100:00100000:0.0:1715330315.635568:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093b59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942512960:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1715330315.635573:0:3691:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880093b58380/2, rc 0, transno 2647 00000100:00100000:0.0:1715330315.635576:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942513216:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1715330315.635581:0:3691:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880093b5b100/2, rc 0, transno 2645 00000100:00100000:0.0:1715330315.635583:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093b5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942513024:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1715330315.635606:0:13361:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+49:3691:x1798653942512704:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1096us (1408us total) trans 4294969940 rc 0/0 00000100:00100000:0.0:1715330315.635610:0:13361:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5281 00000004:00080000:0.0:1715330315.635626:0:3691:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880093b59500/2, rc 0, transno 2644 00000100:00100000:0.0:1715330315.635629:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942512704:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1715330315.635725:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942513152:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1715330315.635764:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330315.635776:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1715330315.635780:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942513088:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1715330315.635794:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330315.635803:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942513408:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1715330315.635812:0:9399:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942513152 00000100:00100000:2.0:1715330315.635814:0:9399:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942513152 00000100:00100000:1.0:1715330315.635815:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330315.635822:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1715330315.635825:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093b58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942513344:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1715330315.635826:0:9399:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942513088 00000100:00100000:2.0:1715330315.635828:0:9399:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942513088 00000100:00100000:2.0:1715330315.635834:0:9399:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942513408 00000100:00100000:2.0:1715330315.635836:0:9399:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942513408 00000100:00100000:1.0:1715330315.635837:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330315.635843:0:9399:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942513344 00000100:00100000:2.0:1715330315.635845:0:9399:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942513344 00000100:00100000:1.0:1715330315.635851:0:12304:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5285 00000100:00100000:2.0:1715330315.635854:0:9399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5286 00000100:00100000:1.0:1715330315.635855:0:12304:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f579f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+52:3689:x1798653942513152:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1715330315.635857:0:9399:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d644380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+52:3689:x1798653942513088:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1715330315.635863:0:9399:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2553 count 1 00002000:00080000:1.0:1715330315.635864:0:12304:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2554 count 1 00002000:00010000:2.0:1715330315.635875:0:9399:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1715330315.635875:0:12304:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1715330315.635878:0:9399:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800938b6880/0xd895711d66db930 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.635878:0:12304:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091c5f840/0xd895711d66db937 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330315.635885:0:9399:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330315.635885:0:12304:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330315.635886:0:9399:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330315.635886:0:12304:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330315.635889:0:9399:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800938b6880/0xd895711d66db930 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.635889:0:12304:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091c5f840/0xd895711d66db937 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330315.635896:0:9399:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800938b6880/0xd895711d66db930 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.635896:0:12304:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091c5f840/0xd895711d66db937 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330315.635902:0:9399:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800938b6880/0xd895711d66db930 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.635902:0:12304:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091c5f840/0xd895711d66db937 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330315.635907:0:9399:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800938b6880/0xd895711d66db930 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.635912:0:12304:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091c5f840/0xd895711d66db937 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330315.635913:0:9399:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800938b6880/0xd895711d66db930 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330315.635917:0:9399:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b6880 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:1.0:1715330315.635917:0:12304:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091c5f840/0xd895711d66db937 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330315.635920:0:9399:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800938b6880/0xd895711d66db930 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.635921:0:12304:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5f840 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:1.0:1715330315.635924:0:12304:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091c5f840/0xd895711d66db937 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330315.635925:0:9399:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800938b6880/0xd895711d66db930 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.635929:0:12304:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091c5f840/0xd895711d66db937 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330315.635933:0:9399:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800938b6880/0xd895711d66db930 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.635936:0:12304:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091c5f840/0xd895711d66db937 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330315.635939:0:9399:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800938b6880/0xd895711d66db930 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.635941:0:12304:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091c5f840/0xd895711d66db937 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330315.635978:0:17199:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5287 00000100:00100000:1.0:1715330315.635981:0:17199:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d647b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+54:3689:x1798653942513408:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1715330315.635991:0:17199:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2558 count 1 00002000:00010000:1.0:1715330315.636002:0:17199:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1715330315.636005:0:17199:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091c5fcc0/0xd895711d66db93e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.636029:0:17199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330315.636030:0:17199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1715330315.636033:0:9399:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d644380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+54:3689:x1798653942513088:12345-0@lo:6:osp-syn-0-0.0 Request processed in 174us (238us total) trans 4294969945 rc 0/0 00010000:00010000:1.0:1715330315.636033:0:17199:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091c5fcc0/0xd895711d66db93e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330315.636038:0:9399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5286 00010000:00010000:1.0:1715330315.636040:0:17199:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091c5fcc0/0xd895711d66db93e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.636045:0:17199:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091c5fcc0/0xd895711d66db93e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330315.636047:0:9399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5288 00000100:00100000:2.0:1715330315.636050:0:9399:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d645880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3689:x1798653942513344:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1715330315.636051:0:17199:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091c5fcc0/0xd895711d66db93e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.636056:0:17199:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091c5fcc0/0xd895711d66db93e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1715330315.636059:0:9399:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2557 count 1 00010000:00010000:1.0:1715330315.636060:0:17199:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5fcc0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:1.0:1715330315.636063:0:17199:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091c5fcc0/0xd895711d66db93e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.636068:0:17199:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091c5fcc0/0xd895711d66db93e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1715330315.636070:0:9399:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1715330315.636073:0:9399:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800938b7600/0xd895711d66db945 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.636076:0:17199:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091c5fcc0/0xd895711d66db93e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330315.636078:0:9399:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330315.636079:0:9399:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330315.636081:0:9399:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800938b7600/0xd895711d66db945 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.636086:0:17199:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091c5fcc0/0xd895711d66db93e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330315.636088:0:9399:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800938b7600/0xd895711d66db945 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330315.636093:0:9399:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800938b7600/0xd895711d66db945 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330315.636097:0:9399:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800938b7600/0xd895711d66db945 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330315.636107:0:9399:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800938b7600/0xd895711d66db945 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330315.636111:0:9399:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b7600 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330315.636113:0:9399:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800938b7600/0xd895711d66db945 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330315.636119:0:9399:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800938b7600/0xd895711d66db945 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330315.636127:0:9399:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800938b7600/0xd895711d66db945 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330315.636132:0:9399:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800938b7600/0xd895711d66db945 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330315.636153:0:17199:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d647b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+54:3689:x1798653942513408:12345-0@lo:6:osp-syn-0-0.0 Request processed in 170us (336us total) trans 4294969946 rc 0/0 00000100:00100000:1.0:1715330315.636157:0:17199:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5287 00000100:00100000:2.0:1715330315.636198:0:9399:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d645880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+54:3689:x1798653942513344:12345-0@lo:6:osp-syn-0-0.0 Request processed in 146us (359us total) trans 4294969947 rc 0/0 00000100:00100000:1.0:1715330315.636200:0:12304:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f579f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+54:3689:x1798653942513152:12345-0@lo:6:osp-syn-0-0.0 Request processed in 345us (435us total) trans 4294969944 rc 0/0 00000100:00100000:2.0:1715330315.636202:0:9399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5288 00000100:00100000:1.0:1715330315.636204:0:12304:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5285 00000004:00080000:2.0:1715330315.636221:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880093b58a80/2, rc 0, transno 2651 00000100:00100000:2.0:1715330315.636224:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093b58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942513344:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1715330315.636228:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880093b5bb80/2, rc 0, transno 2650 00000100:00100000:2.0:1715330315.636230:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942513408:0@lo:6:osp-syn-0-0.0 00000001:00080000:1.0:1715330315.636233:0:9395:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0000: transno 4294969909 is committed 00000004:00080000:2.0:1715330315.636235:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880093b58e00/2, rc 0, transno 2649 00000100:00100000:2.0:1715330315.636237:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942513088:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1715330315.636242:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880093b59880/2, rc 0, transno 2648 00000100:00100000:2.0:1715330315.636244:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942513152:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1715330315.636295:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942513280:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1715330315.636315:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330315.636325:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1715330315.636329:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942513472:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1715330315.636341:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330315.636354:0:17200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942513280 00000100:00100000:0.0:1715330315.636357:0:17200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942513280 00000100:00100000:0.0:1715330315.636367:0:17200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942513472 00000100:00100000:0.0:1715330315.636368:0:17200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942513472 00000100:00100000:0.0:1715330315.636376:0:17200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5289 00000100:00100000:0.0:1715330315.636379:0:17200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+44:3691:x1798653942513280:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1715330315.636389:0:17200:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2556 count 1 00002000:00010000:0.0:1715330315.636402:0:17200:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1715330315.636405:0:17200:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880087724240/0xd895711d66db94c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.636411:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.636413:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.636415:0:17200:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880087724240/0xd895711d66db94c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330315.636418:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5290 00010000:00010000:0.0:1715330315.636422:0:17200:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880087724240/0xd895711d66db94c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330315.636423:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+44:3691:x1798653942513472:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1715330315.636429:0:17200:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880087724240/0xd895711d66db94c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1715330315.636432:0:9633:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2559 count 1 00010000:00010000:0.0:1715330315.636435:0:17200:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880087724240/0xd895711d66db94c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.636440:0:17200:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880087724240/0xd895711d66db94c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1715330315.636442:0:9633:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0x9ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1715330315.636445:0:17200:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087724240 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:1.0:1715330315.636446:0:9633:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091c5ef40/0xd895711d66db953 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.636448:0:17200:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880087724240/0xd895711d66db94c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.636451:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330315.636453:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330315.636454:0:17200:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880087724240/0xd895711d66db94c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.636455:0:9633:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091c5ef40/0xd895711d66db953 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.636462:0:9633:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091c5ef40/0xd895711d66db953 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.636462:0:17200:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880087724240/0xd895711d66db94c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.636467:0:9633:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091c5ef40/0xd895711d66db953 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330315.636467:0:17200:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880087724240/0xd895711d66db94c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.636474:0:9633:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091c5ef40/0xd895711d66db953 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.636479:0:9633:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091c5ef40/0xd895711d66db953 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.636483:0:9633:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5ef40 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:1.0:1715330315.636486:0:9633:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091c5ef40/0xd895711d66db953 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.636491:0:9633:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091c5ef40/0xd895711d66db953 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.636499:0:9633:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091c5ef40/0xd895711d66db953 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330315.636505:0:9633:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091c5ef40/0xd895711d66db953 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330315.636537:0:17200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+46:3691:x1798653942513280:12345-0@lo:6:osp-syn-0-0.0 Request processed in 157us (221us total) trans 4294969948 rc 0/0 00000100:00100000:0.0:1715330315.636543:0:17200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5289 00000100:00100000:0.0:1715330315.636560:0:3691:0:(client.c:2956:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969909 gen 2 00000004:00080000:0.0:1715330315.636564:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880093981180, transno 4294969900 00000004:00080000:0.0:1715330315.636569:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880093981880, transno 4294969901 00000100:00100000:1.0:1715330315.636570:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+45:3691:x1798653942513472:12345-0@lo:6:osp-syn-0-0.0 Request processed in 146us (227us total) trans 4294969949 rc 0/0 00000004:00080000:0.0:1715330315.636571:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880093982d80, transno 4294969902 00000004:00080000:0.0:1715330315.636573:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880093983100, transno 4294969903 00000100:00100000:1.0:1715330315.636574:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5290 00000004:00080000:0.0:1715330315.636576:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880093983b80, transno 4294969904 00000004:00080000:0.0:1715330315.636578:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880093983800, transno 4294969905 00000004:00080000:0.0:1715330315.636581:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880093980700, transno 4294969906 00000004:00080000:0.0:1715330315.636583:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880093982300, transno 4294969907 00000004:00080000:0.0:1715330315.636585:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007d636a00, transno 4294969908 00000004:00080000:0.0:1715330315.636588:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007d634a80, transno 4294969909 00000100:00100000:0.0:1715330315.636594:0:3691:0:(client.c:3000:ptlrpc_free_committed()) @@@ stopping search req@ffff88008d4e9180 x1798653942511232/t4294969910(4294969910) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715330331 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:0.0:1715330315.636602:0:3691:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880093b5a300/2, rc 0, transno 2652 00000100:00100000:0.0:1715330315.636604:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942513280:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1715330315.636613:0:3691:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880093b5aa00/2, rc 0, transno 2653 00000100:00100000:0.0:1715330315.636616:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942513472:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1715330315.637088:0:9629:0:(osp_sync.c:1105:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 40 in progress, 1 in flight, 10 done 00000001:00080000:0.0:1715330315.637485:0:10666:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4294969901 is committed 00000004:00080000:3.0:1715330315.638189:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880093b5ad80/2, rc 0, transno 2643 00000100:00100000:3.0:1715330315.638202:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942512896:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1715330316.222863:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330316.594913:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3691:1798653942513536:0@lo:400:kworker.0 00000100:00100000:1.0:1715330316.594984:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330316.595042:0:7129:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942513536 00000100:00100000:1.0:1715330316.595048:0:7129:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942513536 00000100:00100000:0.0:1715330316.595561:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3690:1798653942513728:0@lo:400:kworker.0 00000100:00100000:0.0:1715330316.595599:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330316.595622:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093a8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942513984:0@lo:400:kworker.0 00000100:00100000:0.0:1715330316.595643:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330316.595655:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942514240:0@lo:400:kworker.0 00000100:00100000:0.0:1715330316.595672:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330316.595693:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1715330316.595697:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942513792:0@lo:400:kworker.0 00000100:00100000:0.0:1715330316.595717:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330316.595745:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942514048:0@lo:400:kworker.0 00000100:00100000:0.0:1715330316.595761:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330316.595770:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942514304:0@lo:400:kworker.0 00000100:00100000:0.0:1715330316.595784:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330316.595800:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3688:1798653942513600:0@lo:400:kworker.0 00000100:00100000:0.0:1715330316.595819:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330316.595828:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d62bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3688:1798653942513856:0@lo:400:kworker.0 00000100:00100000:0.0:1715330316.595841:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330316.595849:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3688:1798653942514112:0@lo:400:kworker.0 00000100:00100000:0.0:1715330316.595862:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330316.595873:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1715330316.595877:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942513664:0@lo:400:kworker.0 00000100:00100000:0.0:1715330316.595891:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330316.595899:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093a8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3688:1798653942513920:0@lo:400:kworker.0 00000100:00100000:0.0:1715330316.595914:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330316.595922:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3688:1798653942514176:0@lo:400:kworker.0 00000100:00100000:0.0:1715330316.595938:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330316.595960:0:9397:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942513984 00000100:00100000:0.0:1715330316.595963:0:9397:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942513984 00000100:00100000:2.0:1715330316.595964:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942513728 00000100:00100000:2.0:1715330316.595970:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942513728 00000100:00100000:2.0:1715330316.595987:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942513600 00000100:00100000:2.0:1715330316.595989:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942513600 00000100:00100000:0.0:1715330316.595990:0:9397:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942514240 00000100:00100000:0.0:1715330316.595991:0:9397:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942514240 00000100:00100000:2.0:1715330316.595995:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942513856 00000100:00100000:2.0:1715330316.596005:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942513856 00000100:00100000:3.0:1715330316.596758:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942513792 00000100:00100000:3.0:1715330316.596762:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942513792 00000100:00100000:3.0:1715330316.596784:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942513664 00000100:00100000:3.0:1715330316.596786:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942513664 00000100:00100000:3.0:1715330316.596800:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3046 00000100:00100000:3.0:1715330316.596806:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942513792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330316.596853:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942513792:12345-0@lo:400:kworker.0 Request processed in 47us (1134us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330316.596859:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3046 00000100:00100000:3.0:1715330316.596870:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3047 00000100:00100000:3.0:1715330316.596874:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942513664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330316.596894:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942513664:12345-0@lo:400:kworker.0 Request processed in 20us (1002us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330316.596898:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3047 00000100:00100000:3.0:1715330316.596924:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942513664:0@lo:400:kworker.0 00000100:00100000:3.0:1715330316.596944:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942513792:0@lo:400:kworker.0 00000100:00100000:1.0:1715330316.597553:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1715330316.597559:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007666fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3691:x1798653942513536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330316.597587:0:7129:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007666fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3691:x1798653942513536:12345-0@lo:400:kworker.0 Request processed in 29us (2604us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330316.597593:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1715330316.597617:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942514048 00000100:00100000:1.0:1715330316.597620:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942514048 00000100:00100000:1.0:1715330316.597633:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942514304 00000100:00100000:1.0:1715330316.597635:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942514304 00000100:00100000:1.0:1715330316.597644:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1715330316.597648:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942513984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330316.597680:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942513984:12345-0@lo:400:kworker.0 Request processed in 31us (2035us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330316.597684:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1715330316.597692:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1715330316.597695:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093a8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942513984:0@lo:400:kworker.0 00000100:00100000:1.0:1715330316.597695:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+45:3690:x1798653942514048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330316.597720:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+45:3690:x1798653942514048:12345-0@lo:400:kworker.0 Request processed in 25us (1958us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330316.597725:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942514048:0@lo:400:kworker.0 00000100:00100000:1.0:1715330316.597725:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1715330316.597744:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1715330316.597748:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942514304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330316.597775:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942514304:12345-0@lo:400:kworker.0 Request processed in 27us (1990us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330316.597780:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1715330316.597781:0:3690:0:(client.c:2956:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969901 gen 2 00000004:00080000:3.0:1715330316.597786:0:3690:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880093b59180, transno 4294969901 00000100:00100000:3.0:1715330316.597793:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942514304:0@lo:400:kworker.0 00000100:00100000:1.0:1715330316.597807:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3691:1798653942513536:0@lo:400:kworker.0 00000100:00100000:1.0:1715330316.597833:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942514112 00000100:00100000:1.0:1715330316.597836:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942514112 00000100:00100000:0.0:1715330316.597962:0:9397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1715330316.597966:0:9397:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942514240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330316.598062:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942513920 00000100:00100000:1.0:1715330316.598064:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942513920 00000100:00100000:1.0:1715330316.598071:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942514176 00000100:00100000:1.0:1715330316.598072:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942514176 00000100:00100000:1.0:1715330316.598079:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1715330316.598083:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3690:x1798653942513728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330316.598106:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3690:x1798653942513728:12345-0@lo:400:kworker.0 Request processed in 22us (2507us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330316.598110:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1715330316.598117:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1715330316.598120:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3688:x1798653942513600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330316.598137:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3688:x1798653942513600:12345-0@lo:400:kworker.0 Request processed in 17us (2318us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330316.598141:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1715330316.598148:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1715330316.598151:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3688:x1798653942514112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330316.598153:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1715330316.598158:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3688:x1798653942513920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330316.598165:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3688:x1798653942514112:12345-0@lo:400:kworker.0 Request processed in 13us (2302us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330316.598169:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1715330316.598174:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1715330316.598176:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3688:x1798653942514176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330316.598190:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3688:x1798653942513920:12345-0@lo:400:kworker.0 Request processed in 31us (2274us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330316.598193:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3688:x1798653942514176:12345-0@lo:400:kworker.0 Request processed in 16us (2255us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330316.598195:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1715330316.598197:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1715330316.598203:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1715330316.598206:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1798653942513856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330316.598220:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1798653942513856:12345-0@lo:400:kworker.0 Request processed in 14us (2379us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330316.598224:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00080000:2.0:1715330316.598225:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330286 00000100:00080000:2.0:1715330316.598228:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330286 00000100:00080000:2.0:1715330316.598230:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330286 00000100:00080000:2.0:1715330316.598232:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330286 00000100:00100000:2.0:1715330316.598262:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093a8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3688:1798653942513920:0@lo:400:kworker.0 00000100:00100000:2.0:1715330316.598273:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3688:1798653942514176:0@lo:400:kworker.0 00000100:00100000:2.0:1715330316.598284:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3688:1798653942513600:0@lo:400:kworker.0 00000100:00100000:2.0:1715330316.598294:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d62bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3688:1798653942513856:0@lo:400:kworker.0 00000100:00100000:2.0:1715330316.598311:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3688:1798653942514112:0@lo:400:kworker.0 00000100:00100000:3.0:1715330316.598599:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3690:1798653942513728:0@lo:400:kworker.0 00000100:00100000:3.0:1715330316.598608:0:3690:0:(client.c:2956:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294969898 gen 2 00000004:00080000:3.0:1715330316.598612:0:3690:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ba64000, transno 4294969894 00000004:00080000:3.0:1715330316.598619:0:3690:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ba67100, transno 4294969895 00000004:00080000:3.0:1715330316.598622:0:3690:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ba67b80, transno 4294969896 00000004:00080000:3.0:1715330316.598624:0:3690:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b4c3800, transno 4294969897 00000004:00080000:3.0:1715330316.598626:0:3690:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b4c3100, transno 4294969898 00000100:00100000:3.0:1715330316.598629:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942514240:0@lo:400:kworker.0 00000004:00080000:2.0:1715330316.598823:0:10800:0:(osp_sync.c:1105:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 0 in progress, 0 in flight, 5 done 00000100:00100000:0.0:1715330316.599652:0:9397:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942514240:12345-0@lo:400:kworker.0 Request processed in 1683us (3977us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330316.599659:0:9397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1715330316.611015:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942514368:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1715330316.611070:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330316.611273:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942514368 00000100:00100000:3.0:1715330316.611280:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942514368 00000100:00100000:3.0:1715330316.611306:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1715330316.611311:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942514368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1715330316.611334:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 67507904 pending 0 free 3923546112 avail 3692023808 00000100:00100000:3.0:1715330316.611365:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942514368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330316.611370:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1715330316.611384:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942514368:0@lo:13:osp-pre-1-1.0 00000004:00080000:2.0:1715330316.627229:0:10805:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 291103496167ns, next at 292103494112ns, rc = 0 00000100:00100000:3.0:1715330316.627280:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942514432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1715330316.627473:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330316.627549:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942514432 00000100:00100000:2.0:1715330316.627555:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942514432 00000100:00100000:2.0:1715330316.627714:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1715330316.627720:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942514432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1715330316.627754:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 67507904 pending 0 free 3923546112 avail 3692023808 00000100:00100000:2.0:1715330316.627789:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942514432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330316.627794:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1715330316.628038:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942514432:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1715330316.977408:0:29112:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_60j path oi.1/0x1:0xc:0x0 is not in 'O/1/d/' format 00010000:00010000:1.0:1715330317.224935:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330318.034864:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942514496:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1715330318.035198:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330318.035947:0:7139:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942514496 00000100:00100000:1.0:1715330318.035954:0:7139:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942514496 00000100:00100000:1.0:1715330318.036003:0:7139:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3048 00000100:00100000:1.0:1715330318.036010:0:7139:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942514496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1715330318.036040:0:7139:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444089856 avail 1314627584 00000100:00100000:1.0:1715330318.036080:0:7139:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942514496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330318.036086:0:7139:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3048 00000100:00100000:3.0:1715330318.036215:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942514496:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1715330318.061773:0:29241:0:(llog.c:735:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1715330318.061778:0:29241:0:(llog_cat.c:796:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:3.0:1715330318.061797:0:29241:0:(llog.c:792:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1715330318.061804:0:29241:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:0.0:1715330318.132071:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330318.132108:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330318.132126:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330318.132141:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330318.132162:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330318.132186:0:9397:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938111872 00000100:00100000:0.0:1715330318.132193:0:9397:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938111872 00000100:00100000:0.0:1715330318.132242:0:9397:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938111808 00000100:00100000:0.0:1715330318.132244:0:9397:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938111808 00000100:00100000:0.0:1715330318.132260:0:9397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 207 00000100:00100000:0.0:1715330318.132265:0:9397:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:72de1896-1df4-4b3a-930a-9116d2c66168+6:2011:x1798653938111872:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:0.0:1715330318.132319:0:9397:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:72de1896-1df4-4b3a-930a-9116d2c66168+6:2011:x1798653938111872:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 53us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330318.132325:0:9397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 207 00000100:00100000:0.0:1715330318.132337:0:9397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 208 00000100:00100000:0.0:1715330318.132341:0:9397:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d777800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:72de1896-1df4-4b3a-930a-9116d2c66168+7:2011:x1798653938111808:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:0.0:1715330318.132360:0:9397:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d777800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:72de1896-1df4-4b3a-930a-9116d2c66168+7:2011:x1798653938111808:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 18us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330318.132365:0:9397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 208 00000100:00100000:0.0:1715330318.132456:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938111744 00000100:00100000:0.0:1715330318.132459:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938111744 00000100:00100000:0.0:1715330318.132477:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938111680 00000100:00100000:0.0:1715330318.132479:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938111680 00000100:00100000:0.0:1715330318.132491:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 290 00000100:00100000:0.0:1715330318.132495:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+6:2011:x1798653938111744:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:0.0:1715330318.132520:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+6:2011:x1798653938111744:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 24us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330318.132525:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 290 00000100:00100000:0.0:1715330318.132534:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 291 00000100:00100000:0.0:1715330318.132537:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d775880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+11:2011:x1798653938111680:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:0.0:1715330318.132557:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d775880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+11:2011:x1798653938111680:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 20us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330318.132562:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 291 00000100:00080000:2.0:1715330318.132767:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330288 00000100:00080000:2.0:1715330318.132771:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330288 00000100:00080000:2.0:1715330318.132772:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330288 00000100:00080000:2.0:1715330318.132774:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330288 00000100:00100000:1.0:1715330318.132980:0:7130:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938111616 00000100:00100000:1.0:1715330318.132984:0:7130:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938111616 00000100:00080000:2.0:1715330318.133559:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330288 00000100:00100000:1.0:1715330318.133773:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 341 00000100:00100000:1.0:1715330318.133780:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007666f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2011:x1798653938111616:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:1.0:1715330318.134437:0:7130:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007666f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2011:x1798653938111616:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 656us (2371us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330318.134443:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 341 00000100:00100000:0.0:1715330318.151813:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330318.151838:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938111936 00000100:00100000:0.0:1715330318.151846:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938111936 00000100:00100000:2.0:1715330318.151915:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23800 00000100:00100000:2.0:1715330318.151923:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d775180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+6:19088:x1798653938111936:12345-192.168.204.49@tcp:46:lfs.0 00000004:00000080:2.0:1715330318.152003:0:7133:0:(mdt_handler.c:7835:mdt_iocontrol()) lustre-MDT0001: cmd=424066b3 len=12 karg=ffff880072d93038 uarg=0000000000000000 00000004:00000080:2.0:1715330318.152049:0:7133:0:(mdd_device.c:2268:mdd_iocontrol()) lustre-MDD0001: cmd=424066b3 len=12 karg=ffff880072d93038 00000004:00000080:2.0:1715330318.152057:0:7133:0:(mdd_device.c:2138:mdd_changelog_clear()) lustre-MDD0001: Purge request: id=1, endrec=0 00000040:00080000:2.0:1715330318.152096:0:7133:0:(llog.c:735:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1715330318.152100:0:7133:0:(llog_cat.c:796:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:2.0:1715330318.152117:0:7133:0:(mdd_device.c:2110:mdd_changelog_clear_cb()) lustre-MDD0001: update changelog user cl1 endrec = 0 00000040:00080000:2.0:1715330318.152278:0:7133:0:(llog.c:792:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1715330318.152285:0:7133:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:2.0:1715330318.152290:0:7133:0:(mdd_device.c:2187:mdd_changelog_clear()) lustre-MDD0001: purge changelog user cl1 entries up to 18446744073709551615 00000040:00080000:2.0:1715330318.153221:0:7133:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:2.0:1715330318.153309:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d775180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+6:19088:x1798653938111936:12345-192.168.204.49@tcp:46:lfs.0 Request processed in 1384us (1500us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330318.153317:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23800 00010000:00010000:1.0:1715330318.227031:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1715330318.632677:0:29305:0:(class_obd.c:334:class_handle_ioctl()) obdclass: cmd=424066b2 len=0 uarg=00007ffc6f9b6640 00000004:00000080:0.0:1715330318.632693:0:29305:0:(mdt_handler.c:7835:mdt_iocontrol()) lustre-MDT0001: cmd=424066b2 len=576 karg=ffff88009ba71400 uarg=0000000000000000 00000004:00000080:0.0:1715330318.632751:0:29305:0:(mdd_device.c:2268:mdd_iocontrol()) lustre-MDD0001: cmd=424066b2 len=576 karg=ffff88009ba71400 00000004:00000080:0.0:1715330318.632807:0:29305:0:(mdd_device.c:2138:mdd_changelog_clear()) lustre-MDD0001: Purge request: id=1, endrec=0 00000040:00080000:0.0:1715330318.632842:0:29305:0:(llog.c:735:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1715330318.632847:0:29305:0:(llog_cat.c:796:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:0.0:1715330318.632863:0:29305:0:(mdd_device.c:2110:mdd_changelog_clear_cb()) lustre-MDD0001: update changelog user cl1 endrec = 0 00000040:00080000:0.0:1715330318.632903:0:29305:0:(llog.c:792:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1715330318.632909:0:29305:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:0.0:1715330318.632913:0:29305:0:(mdd_device.c:2187:mdd_changelog_clear()) lustre-MDD0001: purge changelog user cl1 entries up to 18446744073709551615 00000040:00080000:0.0:1715330318.633254:0:29305:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000004:00000080:0.0:1715330318.633262:0:29305:0:(mdd_device.c:1998:mdd_changelog_user_purge()) lustre-MDD0001: Purge request: id=1 00000040:00080000:0.0:1715330318.633271:0:29305:0:(llog.c:735:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1715330318.633273:0:29305:0:(llog_cat.c:796:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:0.0:1715330318.634357:0:29305:0:(llog.c:792:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:0.0:1715330318.634362:0:29305:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:0.0:1715330318.634368:0:29305:0:(mdd_device.c:2020:mdd_changelog_user_purge()) turning off changelogs 00000004:02000000:0.0:1715330318.634370:0:29305:0:(mdd_device.c:508:mdd_changelog_off()) lustre-MDD0001: changelog off 00000004:00000080:0.0:1715330318.636044:0:29305:0:(mdd_device.c:2030:mdd_changelog_user_purge()) lustre-MDD0001: Purge changelog entries for user cl1 record=18446744073709551615 00000040:00080000:0.0:1715330318.636453:0:29305:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1715330318.636485:0:29305:0:(llog.c:735:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1715330318.636490:0:29305:0:(llog_cat.c:796:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:0.0:1715330318.640722:0:29305:0:(llog.c:792:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1715330318.640826:0:29305:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000040:00080000:3.0:1715330319.172598:0:29370:0:(llog.c:735:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1715330319.172604:0:29370:0:(llog_cat.c:796:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:3.0:1715330319.172923:0:29370:0:(llog.c:792:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1715330319.172930:0:29370:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00010000:00010000:1.0:1715330319.228928:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330319.490827:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d646d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942514560:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1715330319.490881:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330319.490916:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942514560 00000100:00100000:1.0:1715330319.490922:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942514560 00000100:00100000:1.0:1715330319.492706:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3049 00000100:00100000:1.0:1715330319.492727:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942514560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1715330319.492791:0:19960:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445060608 avail 1315598336 00000100:00100000:1.0:1715330319.492839:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942514560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (1958us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330319.492846:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3049 00000100:00100000:1.0:1715330319.493812:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d646d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942514560:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1715330319.625900:0:29434:0:(llog.c:735:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1715330319.625906:0:29434:0:(llog_cat.c:796:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:3.0:1715330319.625922:0:29434:0:(llog.c:792:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 2 00000040:00080000:3.0:1715330319.625928:0:29434:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:0.0:1715330319.672183:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330319.672242:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938112000 00000100:00100000:3.0:1715330319.672249:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938112000 00000100:00100000:3.0:1715330319.672287:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23801 00000100:00100000:3.0:1715330319.672294:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d775500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+11:19119:x1798653938112000:12345-192.168.204.49@tcp:46:lfs.0 00000004:00000080:3.0:1715330319.672326:0:7133:0:(mdt_handler.c:7835:mdt_iocontrol()) lustre-MDT0000: cmd=424066b3 len=12 karg=ffff880072d93218 uarg=0000000000000000 00000004:00000080:3.0:1715330319.672357:0:7133:0:(mdd_device.c:2268:mdd_iocontrol()) lustre-MDD0000: cmd=424066b3 len=12 karg=ffff880072d93218 00000004:00000080:3.0:1715330319.672361:0:7133:0:(mdd_device.c:2138:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=1, endrec=0 00000040:00080000:3.0:1715330319.672386:0:7133:0:(llog.c:735:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1715330319.672389:0:7133:0:(llog_cat.c:796:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:3.0:1715330319.672404:0:7133:0:(mdd_device.c:2110:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl1 endrec = 400 00000040:00080000:3.0:1715330319.672438:0:7133:0:(llog.c:792:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 2 00000040:00080000:3.0:1715330319.672443:0:7133:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:3.0:1715330319.672448:0:7133:0:(mdd_device.c:2187:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl1 entries up to 18446744073709551615 00000040:00080000:3.0:1715330319.672460:0:7133:0:(llog.c:735:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1715330319.672462:0:7133:0:(llog_cat.c:796:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:3.0:1715330319.674407:0:7133:0:(llog.c:792:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 408 count 1 00000040:00080000:3.0:1715330319.674416:0:7133:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000100:00100000:3.0:1715330319.674512:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d775500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+11:19119:x1798653938112000:12345-192.168.204.49@tcp:46:lfs.0 Request processed in 2215us (2333us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330319.674523:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23801 00000020:00000080:3.0:1715330320.105128:0:29499:0:(class_obd.c:334:class_handle_ioctl()) obdclass: cmd=424066b2 len=0 uarg=00007ffe77aa83a0 00000004:00000080:3.0:1715330320.105144:0:29499:0:(mdt_handler.c:7835:mdt_iocontrol()) lustre-MDT0000: cmd=424066b2 len=576 karg=ffff88009d4da800 uarg=0000000000000000 00000004:00000080:3.0:1715330320.105180:0:29499:0:(mdd_device.c:2268:mdd_iocontrol()) lustre-MDD0000: cmd=424066b2 len=576 karg=ffff88009d4da800 00000004:00000080:3.0:1715330320.105185:0:29499:0:(mdd_device.c:2138:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=1, endrec=0 00000040:00080000:3.0:1715330320.105213:0:29499:0:(llog.c:735:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1715330320.105216:0:29499:0:(llog_cat.c:796:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:3.0:1715330320.105229:0:29499:0:(mdd_device.c:2110:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl1 endrec = 400 00000040:00080000:3.0:1715330320.105258:0:29499:0:(llog.c:792:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 2 00000040:00080000:3.0:1715330320.105262:0:29499:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:3.0:1715330320.105266:0:29499:0:(mdd_device.c:2187:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl1 entries up to 18446744073709551615 00000040:00080000:3.0:1715330320.105276:0:29499:0:(llog.c:735:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1715330320.105278:0:29499:0:(llog_cat.c:796:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:3.0:1715330320.105582:0:29499:0:(llog.c:792:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 64768 count 1 00000040:00080000:3.0:1715330320.105586:0:29499:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000004:00000080:3.0:1715330320.105590:0:29499:0:(mdd_device.c:1998:mdd_changelog_user_purge()) lustre-MDD0000: Purge request: id=1 00000040:00080000:3.0:1715330320.105597:0:29499:0:(llog.c:735:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1715330320.105599:0:29499:0:(llog_cat.c:796:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:3.0:1715330320.105626:0:29499:0:(llog.c:792:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:3.0:1715330320.105629:0:29499:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:3.0:1715330320.105631:0:29499:0:(mdd_device.c:2020:mdd_changelog_user_purge()) turning off changelogs 00000004:02000000:3.0:1715330320.105632:0:29499:0:(mdd_device.c:508:mdd_changelog_off()) lustre-MDD0000: changelog off 00000004:00000080:3.0:1715330320.109053:0:29499:0:(mdd_device.c:2030:mdd_changelog_user_purge()) lustre-MDD0000: Purge changelog entries for user cl1 record=18446744073709551615 00000040:00080000:2.0:1715330320.109178:0:29499:0:(llog.c:735:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1715330320.109183:0:29499:0:(llog_cat.c:796:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:2.0:1715330320.109560:0:29499:0:(llog.c:792:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 64768 count 1 00000040:00080000:2.0:1715330320.109565:0:29499:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000040:00080000:2.0:1715330320.109578:0:29499:0:(llog.c:735:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1715330320.109579:0:29499:0:(llog_cat.c:796:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:2.0:1715330320.112508:0:29499:0:(llog.c:792:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 64768 count 1 00000040:00080000:2.0:1715330320.112524:0:29499:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00010000:00010000:2.0:1715330320.231419:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330320.327179:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d646d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942514624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1715330320.327273:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330320.327348:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942514624 00000100:00100000:3.0:1715330320.327356:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942514624 00000100:00100000:3.0:1715330320.327394:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1715330320.327400:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+45:3688:x1798653942514624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1715330320.327426:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 67475136 pending 0 free 3923513344 avail 3691991040 00000100:00080000:1.0:1715330320.328472:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330290 00000100:00100000:3.0:1715330320.328634:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+45:3688:x1798653942514624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1233us (1360us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330320.328642:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1715330320.328699:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d646d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942514624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1715330320.359535:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1715330320.359552:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d62bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942514688:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1715330320.359610:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330320.359646:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942514688 00000100:00100000:2.0:1715330320.359652:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942514688 00000100:00100000:2.0:1715330320.359684:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1715330320.359689:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942514688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1715330320.359707:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 67475136 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1715330320.359757:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942514688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330320.359763:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1715330320.359798:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d62bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942514688:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1715330320.359818:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330290 00000040:00080000:2.0:1715330320.560061:0:29563:0:(llog.c:735:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1715330320.560066:0:29563:0:(llog_cat.c:796:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:2.0:1715330320.560375:0:29563:0:(llog.c:792:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 64768 count 1 00000040:00080000:2.0:1715330320.560381:0:29563:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00010000:00010000:1.0:1715330321.234293:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1715330321.241103:0:9395:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0000: transno 4294969949 is committed 00000004:00080000:3.0:1715330321.241475:0:7116:0:(osp_sync.c:1604:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 34 committed 00000100:00100000:2.0:1715330321.241844:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a7ec3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942514880:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1715330321.241895:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330321.241922:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b4c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942515136:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1715330321.241937:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330321.241952:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1715330321.241957:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942514944:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1715330321.241968:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330321.241976:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b4c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942515200:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1715330321.241988:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330321.242005:0:12304:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942514880 00000100:00100000:2.0:1715330321.242010:0:12304:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942514880 00000100:00100000:2.0:1715330321.242035:0:12304:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942515136 00000100:00100000:2.0:1715330321.242037:0:12304:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942515136 00000100:00100000:2.0:1715330321.242044:0:12304:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942514944 00000100:00100000:2.0:1715330321.242046:0:12304:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942514944 00000100:00100000:2.0:1715330321.242052:0:12304:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942515200 00000100:00100000:2.0:1715330321.242053:0:12304:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942515200 00000100:00100000:2.0:1715330321.242063:0:12304:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5291 00000100:00100000:2.0:1715330321.242068:0:12304:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3688:x1798653942514880:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1715330321.242087:0:12304:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2513 count 1 00002000:00010000:2.0:1715330321.242111:0:12304:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1715330321.242118:0:12304:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800938b7cc0/0xd895711d66db95a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.242133:0:12304:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330321.242134:0:12304:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330321.242139:0:12304:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800938b7cc0/0xd895711d66db95a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.242149:0:12304:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800938b7cc0/0xd895711d66db95a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.242156:0:12304:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800938b7cc0/0xd895711d66db95a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.242163:0:12304:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800938b7cc0/0xd895711d66db95a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.242169:0:12304:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800938b7cc0/0xd895711d66db95a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.242175:0:12304:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b7cc0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330321.242178:0:12304:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800938b7cc0/0xd895711d66db95a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.242185:0:12304:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800938b7cc0/0xd895711d66db95a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.242198:0:12304:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800938b7cc0/0xd895711d66db95a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.242208:0:12304:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800938b7cc0/0xd895711d66db95a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330321.242320:0:17200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5292 00000100:00100000:1.0:1715330321.242326:0:17200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3688:x1798653942515136:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1715330321.242339:0:17200:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2517 count 1 00002000:00010000:1.0:1715330321.242353:0:17200:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1715330321.242357:0:17200:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091c5ef40/0xd895711d66db961 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.242365:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330321.242366:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330321.242369:0:17200:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091c5ef40/0xd895711d66db961 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.242377:0:17200:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091c5ef40/0xd895711d66db961 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.242383:0:17200:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091c5ef40/0xd895711d66db961 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330321.242387:0:12304:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3688:x1798653942514880:12345-0@lo:6:osp-syn-1-0.0 Request processed in 318us (492us total) trans 4294969902 rc 0/0 00000100:00100000:2.0:1715330321.242393:0:12304:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5291 00010000:00010000:1.0:1715330321.242393:0:17200:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091c5ef40/0xd895711d66db961 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.242398:0:17200:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091c5ef40/0xd895711d66db961 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.242402:0:17200:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5ef40 already unused, calling callback (ffffffffa07e2af0) 00000100:00100000:2.0:1715330321.242405:0:12304:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5293 00010000:00010000:1.0:1715330321.242405:0:17200:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091c5ef40/0xd895711d66db961 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330321.242408:0:12304:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3688:x1798653942514944:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1715330321.242410:0:17200:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091c5ef40/0xd895711d66db961 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.242419:0:17200:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091c5ef40/0xd895711d66db961 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.242424:0:17200:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091c5ef40/0xd895711d66db961 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330321.242592:0:17200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3688:x1798653942515136:12345-0@lo:6:osp-syn-1-0.0 Request processed in 266us (653us total) trans 4294969903 rc 0/0 00000100:00100000:1.0:1715330321.242598:0:17200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5292 00000100:00100000:1.0:1715330321.242614:0:17200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5294 00000100:00100000:1.0:1715330321.242618:0:17200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3688:x1798653942515200:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1715330321.242626:0:17200:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2518 count 1 00002000:00010000:1.0:1715330321.242637:0:17200:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1715330321.242641:0:17200:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091c5fcc0/0xd895711d66db968 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.242647:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330321.242649:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330321.242651:0:17200:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091c5fcc0/0xd895711d66db968 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330321.242655:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b160000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942514816:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1715330321.242658:0:17200:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091c5fcc0/0xd895711d66db968 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.242665:0:17200:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091c5fcc0/0xd895711d66db968 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.242670:0:17200:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091c5fcc0/0xd895711d66db968 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.242676:0:17200:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091c5fcc0/0xd895711d66db968 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330321.242677:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1715330321.242681:0:17200:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5fcc0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:1.0:1715330321.242683:0:17200:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091c5fcc0/0xd895711d66db968 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.242689:0:17200:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091c5fcc0/0xd895711d66db968 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330321.242690:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d608a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942515072:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1715330321.242697:0:17200:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091c5fcc0/0xd895711d66db968 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.242702:0:17200:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091c5fcc0/0xd895711d66db968 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330321.242703:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330321.242713:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1715330321.242717:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d62bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942514752:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1715330321.242745:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330321.242756:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942515008:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1715330321.242772:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330321.242791:0:13361:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942514816 00000100:00100000:0.0:1715330321.242793:0:13361:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942514816 00000100:00100000:0.0:1715330321.242807:0:13361:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942515072 00000100:00100000:0.0:1715330321.242809:0:13361:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942515072 00000100:00100000:0.0:1715330321.242815:0:13361:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942514752 00000100:00100000:0.0:1715330321.242817:0:13361:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942514752 00000100:00100000:0.0:1715330321.242824:0:13361:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942515008 00000100:00100000:0.0:1715330321.242825:0:13361:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942515008 00000100:00100000:0.0:1715330321.242832:0:13361:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5295 00000100:00100000:0.0:1715330321.242836:0:13361:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d775c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3691:x1798653942514816:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1715330321.242845:0:13361:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2512 count 1 00002000:00010000:0.0:1715330321.242858:0:13361:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1715330321.242861:0:13361:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880087725f80/0xd895711d66db96f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.242868:0:13361:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330321.242869:0:13361:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330321.242871:0:13361:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880087725f80/0xd895711d66db96f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.242879:0:13361:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880087725f80/0xd895711d66db96f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330321.242908:0:17200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3688:x1798653942515200:12345-0@lo:6:osp-syn-1-0.0 Request processed in 289us (918us total) trans 4294969904 rc 0/0 00000100:00100000:1.0:1715330321.242925:0:17200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5294 00010000:00010000:0.0:1715330321.242929:0:13361:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880087725f80/0xd895711d66db96f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.242935:0:13361:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880087725f80/0xd895711d66db96f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330321.242936:0:17200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5296 00000100:00100000:1.0:1715330321.242940:0:17200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d776300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3691:x1798653942515072:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1715330321.242940:0:13361:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880087725f80/0xd895711d66db96f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.242945:0:13361:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087725f80 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330321.242947:0:13361:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880087725f80/0xd895711d66db96f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1715330321.242949:0:17200:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2516 count 1 00010000:00010000:0.0:1715330321.242952:0:13361:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880087725f80/0xd895711d66db96f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1715330321.242959:0:17200:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1715330321.242961:0:13361:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880087725f80/0xd895711d66db96f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.242963:0:17200:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091c5f840/0xd895711d66db976 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.242967:0:13361:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880087725f80/0xd895711d66db96f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.242968:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330321.242970:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330321.242972:0:17200:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091c5f840/0xd895711d66db976 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.242979:0:17200:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091c5f840/0xd895711d66db976 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.242985:0:17200:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091c5f840/0xd895711d66db976 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.242990:0:17200:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091c5f840/0xd895711d66db976 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.243000:0:17200:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091c5f840/0xd895711d66db976 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.243004:0:17200:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5f840 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:1.0:1715330321.243007:0:17200:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091c5f840/0xd895711d66db976 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.243012:0:17200:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091c5f840/0xd895711d66db976 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.243020:0:17200:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091c5f840/0xd895711d66db976 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.243026:0:17200:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091c5f840/0xd895711d66db976 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330321.243051:0:13361:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d775c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3691:x1798653942514816:12345-0@lo:6:osp-syn-1-0.0 Request processed in 213us (372us total) trans 4294969905 rc 0/0 00000100:00100000:0.0:1715330321.243057:0:13361:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5295 00000100:00100000:0.0:1715330321.243067:0:13361:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5297 00000100:00100000:0.0:1715330321.243070:0:13361:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d774700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3691:x1798653942514752:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1715330321.243079:0:13361:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2511 count 1 00002000:00010000:0.0:1715330321.243089:0:13361:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1715330321.243093:0:13361:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800877246c0/0xd895711d66db97d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.243098:0:13361:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330321.243099:0:13361:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330321.243101:0:13361:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800877246c0/0xd895711d66db97d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.243108:0:13361:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800877246c0/0xd895711d66db97d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.243114:0:13361:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800877246c0/0xd895711d66db97d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330321.243117:0:17200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d776300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3691:x1798653942515072:12345-0@lo:6:osp-syn-1-0.0 Request processed in 176us (412us total) trans 4294969906 rc 0/0 00000100:00100000:1.0:1715330321.243122:0:17200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5296 00010000:00010000:0.0:1715330321.243123:0:13361:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800877246c0/0xd895711d66db97d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.243129:0:13361:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800877246c0/0xd895711d66db97d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330321.243130:0:17200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5298 00000100:00100000:1.0:1715330321.243133:0:17200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3691:x1798653942515008:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1715330321.243133:0:13361:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800877246c0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330321.243135:0:13361:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800877246c0/0xd895711d66db97d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.243140:0:13361:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800877246c0/0xd895711d66db97d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1715330321.243141:0:17200:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2515 count 1 00010000:00010000:0.0:1715330321.243147:0:13361:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800877246c0/0xd895711d66db97d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1715330321.243149:0:17200:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1715330321.243151:0:13361:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800877246c0/0xd895711d66db97d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.243153:0:17200:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091c5eac0/0xd895711d66db984 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.243162:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330321.243164:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330321.243166:0:17200:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091c5eac0/0xd895711d66db984 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.243173:0:17200:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091c5eac0/0xd895711d66db984 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.243179:0:17200:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091c5eac0/0xd895711d66db984 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330321.243214:0:13361:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d774700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3691:x1798653942514752:12345-0@lo:6:osp-syn-1-0.0 Request processed in 143us (484us total) trans 4294969907 rc 0/0 00000100:00100000:0.0:1715330321.243219:0:13361:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5297 00000004:00080000:0.0:1715330321.243252:0:3691:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007d62bb80/2, rc 0, transno 2611 00000100:00100000:0.0:1715330321.243259:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d62bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942514752:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1715330321.243265:0:3691:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008b160000/2, rc 0, transno 2609 00000100:00100000:0.0:1715330321.243267:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b160000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942514816:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1715330321.243273:0:3691:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d608a80/2, rc 0, transno 2610 00000100:00100000:0.0:1715330321.243275:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d608a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942515072:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1715330321.243305:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1715330321.243325:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d776d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942515392:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1715330321.243341:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330321.243354:0:17197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942515392 00000100:00100000:0.0:1715330321.243356:0:17197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942515392 00000100:00100000:0.0:1715330321.243366:0:17197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5299 00000100:00100000:0.0:1715330321.243369:0:17197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3689:x1798653942515392:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1715330321.243377:0:17197:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2521 count 1 00002000:00010000:0.0:1715330321.243386:0:17197:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1715330321.243390:0:17197:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880087726f40/0xd895711d66db98b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.243395:0:17197:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330321.243396:0:17197:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330321.243399:0:17197:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880087726f40/0xd895711d66db98b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.243405:0:17197:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880087726f40/0xd895711d66db98b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.243411:0:17197:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880087726f40/0xd895711d66db98b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.243416:0:17197:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880087726f40/0xd895711d66db98b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.243421:0:17200:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091c5eac0/0xd895711d66db984 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.243425:0:17197:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880087726f40/0xd895711d66db98b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.243427:0:17200:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091c5eac0/0xd895711d66db984 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.243429:0:17197:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087726f40 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330321.243431:0:17197:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880087726f40/0xd895711d66db98b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.243432:0:17200:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5eac0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:1.0:1715330321.243434:0:17200:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091c5eac0/0xd895711d66db984 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.243436:0:17197:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880087726f40/0xd895711d66db98b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.243440:0:17200:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091c5eac0/0xd895711d66db984 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.243443:0:17197:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880087726f40/0xd895711d66db98b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.243448:0:17197:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880087726f40/0xd895711d66db98b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.243450:0:17200:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091c5eac0/0xd895711d66db984 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.243459:0:17200:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091c5eac0/0xd895711d66db984 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330321.243526:0:17197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+15:3689:x1798653942515392:12345-0@lo:6:osp-syn-1-0.0 Request processed in 155us (183us total) trans 4294969908 rc 0/0 00000100:00100000:1.0:1715330321.243529:0:17200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+15:3691:x1798653942515008:12345-0@lo:6:osp-syn-1-0.0 Request processed in 394us (755us total) trans 4294969909 rc 0/0 00000100:00100000:0.0:1715330321.243530:0:17197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5299 00000100:00100000:1.0:1715330321.243534:0:17200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5298 00000004:00080000:0.0:1715330321.243546:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d776d80/2, rc 0, transno 2612 00000100:00100000:0.0:1715330321.243550:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d776d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942515392:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1715330321.243567:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942515456:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1715330321.243580:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330321.243598:0:17217:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942515456 00000100:00100000:0.0:1715330321.243600:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d777100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942515328:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1715330321.243601:0:17217:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942515456 00000100:00100000:0.0:1715330321.243611:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330321.243615:0:17217:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942515328 00000100:00100000:1.0:1715330321.243617:0:17217:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942515328 00000004:00080000:0.0:1715330321.243621:0:3691:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d608380/2, rc 0, transno 2613 00000100:00100000:0.0:1715330321.243625:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942515008:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1715330321.243626:0:17217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5300 00000100:00100000:0.0:1715330321.243628:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1715330321.243630:0:17217:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+15:3689:x1798653942515456:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1715330321.243631:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d774a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942515264:0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1715330321.243638:0:17217:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2522 count 1 00000100:00100000:0.0:1715330321.243642:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1715330321.243650:0:17217:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1715330321.243653:0:17217:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091c5e640/0xd895711d66db992 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330321.243653:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942515264 00000100:00100000:0.0:1715330321.243655:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942515264 00010000:00010000:1.0:1715330321.243659:0:17217:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330321.243660:0:17217:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330321.243663:0:17217:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091c5e640/0xd895711d66db992 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330321.243665:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5301 00000100:00100000:0.0:1715330321.243668:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+16:3691:x1798653942515328:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1715330321.243669:0:17217:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091c5e640/0xd895711d66db992 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.243675:0:17217:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091c5e640/0xd895711d66db992 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1715330321.243676:0:9633:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2520 count 1 00010000:00010000:1.0:1715330321.243684:0:17217:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091c5e640/0xd895711d66db992 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1715330321.243686:0:9633:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1715330321.243689:0:9633:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880087727840/0xd895711d66db999 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.243690:0:17217:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091c5e640/0xd895711d66db992 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.243694:0:17217:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5e640 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330321.243695:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330321.243696:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330321.243697:0:17217:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091c5e640/0xd895711d66db992 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.243699:0:9633:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880087727840/0xd895711d66db999 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.243702:0:17217:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091c5e640/0xd895711d66db992 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.243706:0:9633:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880087727840/0xd895711d66db999 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.243710:0:17217:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091c5e640/0xd895711d66db992 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.243712:0:9633:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880087727840/0xd895711d66db999 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.243715:0:17217:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091c5e640/0xd895711d66db992 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.243717:0:9633:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880087727840/0xd895711d66db999 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.243727:0:9633:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880087727840/0xd895711d66db999 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.243745:0:9633:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087727840 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330321.243747:0:9633:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880087727840/0xd895711d66db999 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.243752:0:9633:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880087727840/0xd895711d66db999 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.243759:0:9633:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880087727840/0xd895711d66db999 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.243764:0:9633:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880087727840/0xd895711d66db999 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330321.243812:0:17217:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+18:3689:x1798653942515456:12345-0@lo:6:osp-syn-1-0.0 Request processed in 181us (230us total) trans 4294969910 rc 0/0 00000100:00100000:1.0:1715330321.243817:0:17217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5300 00000100:00100000:1.0:1715330321.243825:0:17217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5302 00000100:00100000:1.0:1715330321.243828:0:17217:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+17:3691:x1798653942515264:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1715330321.243838:0:17217:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2519 count 1 00002000:00010000:1.0:1715330321.243849:0:17217:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1715330321.243852:0:17217:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091c5f3c0/0xd895711d66db9a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.243858:0:17217:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330321.243859:0:17217:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330321.243861:0:17217:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091c5f3c0/0xd895711d66db9a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.243868:0:17217:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091c5f3c0/0xd895711d66db9a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.243873:0:17217:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091c5f3c0/0xd895711d66db9a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.243878:0:17217:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091c5f3c0/0xd895711d66db9a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.243883:0:17217:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091c5f3c0/0xd895711d66db9a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.243888:0:17217:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5f3c0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:1.0:1715330321.243890:0:17217:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091c5f3c0/0xd895711d66db9a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.243895:0:17217:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091c5f3c0/0xd895711d66db9a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.243903:0:17217:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091c5f3c0/0xd895711d66db9a0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.243908:0:17217:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091c5f3c0/0xd895711d66db9a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00000100:00080000:3.0:1715330321.244065:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330291 00002000:00080000:2.0:1715330321.244152:0:12304:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2514 count 1 00002000:00010000:2.0:1715330321.244164:0:12304:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1715330321.244168:0:12304:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800938b6d00/0xd895711d66db9a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.244174:0:12304:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330321.244175:0:12304:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330321.244177:0:12304:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800938b6d00/0xd895711d66db9a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.244184:0:12304:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800938b6d00/0xd895711d66db9a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.244190:0:12304:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800938b6d00/0xd895711d66db9a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.244194:0:12304:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800938b6d00/0xd895711d66db9a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.244203:0:12304:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800938b6d00/0xd895711d66db9a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.244208:0:12304:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b6d00 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330321.244210:0:12304:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800938b6d00/0xd895711d66db9a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.244216:0:12304:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800938b6d00/0xd895711d66db9a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.244223:0:12304:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800938b6d00/0xd895711d66db9a7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.244228:0:12304:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800938b6d00/0xd895711d66db9a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330321.244292:0:12304:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3688:x1798653942514944:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1882us (2322us total) trans 4294969912 rc 0/0 00000100:00100000:2.0:1715330321.244297:0:12304:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5293 00000004:00080000:2.0:1715330321.244376:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d609500/2, rc 0, transno 2616 00000100:00100000:2.0:1715330321.244379:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942514944:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1715330321.244385:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009b4c3100/2, rc 0, transno 2608 00000100:00100000:2.0:1715330321.244387:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b4c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942515200:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1715330321.244393:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a7ec3b80/2, rc 0, transno 2606 00000100:00100000:2.0:1715330321.244395:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a7ec3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942514880:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1715330321.244401:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009b4c3800/2, rc 0, transno 2607 00000100:00100000:2.0:1715330321.244403:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b4c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942515136:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1715330321.244781:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3691:x1798653942515328:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1110us (1167us total) trans 4294969911 rc 0/0 00000100:00100000:0.0:1715330321.244785:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5301 00000004:00080000:0.0:1715330321.244803:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012b55d500/2, rc 0, transno 2614 00000100:00100000:0.0:1715330321.244805:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942515456:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1715330321.244841:0:17217:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+17:3691:x1798653942515264:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1010us (1197us total) trans 4294969913 rc 0/0 00000100:00100000:1.0:1715330321.244846:0:17217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5302 00000004:00080000:2.0:1715330321.244878:0:3691:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d774a80/2, rc 0, transno 2617 00000100:00100000:2.0:1715330321.244882:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d774a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942515264:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1715330321.244887:0:3691:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d777100/2, rc 0, transno 2615 00000100:00100000:2.0:1715330321.244890:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d777100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942515328:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1715330321.245473:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942515520:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1715330321.245495:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330321.245885:0:17200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942515520 00000100:00100000:1.0:1715330321.245889:0:17200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942515520 00000100:00100000:1.0:1715330321.245905:0:17200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5303 00000100:00100000:1.0:1715330321.245909:0:17200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3690:x1798653942515520:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1715330321.245922:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942515584:0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1715330321.245929:0:17200:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2523 count 1 00000100:00100000:2.0:1715330321.245942:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1715330321.245943:0:17200:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1715330321.245948:0:17200:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091c5e400/0xd895711d66db9ae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.245956:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330321.245958:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1715330321.245961:0:17217:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942515584 00010000:00010000:1.0:1715330321.245961:0:17200:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091c5e400/0xd895711d66db9ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330321.245964:0:17217:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942515584 00010000:00010000:1.0:1715330321.245970:0:17200:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091c5e400/0xd895711d66db9ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330321.245977:0:17217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5304 00010000:00010000:1.0:1715330321.245977:0:17200:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091c5e400/0xd895711d66db9ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330321.245980:0:17217:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+18:3691:x1798653942515584:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1715330321.245982:0:17200:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091c5e400/0xd895711d66db9ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.245988:0:17200:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091c5e400/0xd895711d66db9ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1715330321.245989:0:17217:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2524 count 1 00010000:00010000:1.0:1715330321.245994:0:17200:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5e400 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:1.0:1715330321.245997:0:17200:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091c5e400/0xd895711d66db9ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1715330321.246002:0:17217:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1715330321.246003:0:17200:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091c5e400/0xd895711d66db9ae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.246006:0:17217:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800938b7600/0xd895711d66db9b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.246012:0:17217:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330321.246013:0:17217:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330321.246013:0:17200:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091c5e400/0xd895711d66db9ae lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.246015:0:17217:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800938b7600/0xd895711d66db9b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.246018:0:17200:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091c5e400/0xd895711d66db9ae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.246022:0:17217:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800938b7600/0xd895711d66db9b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.246027:0:17217:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800938b7600/0xd895711d66db9b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.246033:0:17217:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800938b7600/0xd895711d66db9b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.246037:0:17217:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800938b7600/0xd895711d66db9b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.246041:0:17217:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b7600 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330321.246043:0:17217:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800938b7600/0xd895711d66db9b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.246047:0:17217:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800938b7600/0xd895711d66db9b5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.246055:0:17217:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800938b7600/0xd895711d66db9b5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.246059:0:17217:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800938b7600/0xd895711d66db9b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330321.246142:0:17217:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+20:3691:x1798653942515584:12345-0@lo:6:osp-syn-1-0.0 Request processed in 160us (198us total) trans 4294969915 rc 0/0 00000100:00100000:2.0:1715330321.246147:0:17217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5304 00000004:00080000:2.0:1715330321.246164:0:3691:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012b55ea00/2, rc 0, transno 2619 00000100:00100000:2.0:1715330321.246167:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942515584:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1715330321.246564:0:17200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+19:3690:x1798653942515520:12345-0@lo:6:osp-syn-1-0.0 Request processed in 654us (1067us total) trans 4294969914 rc 0/0 00000100:00100000:1.0:1715330321.246570:0:17200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5303 00000100:00100000:0.0:1715330321.246599:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942515712:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1715330321.246617:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330321.246631:0:17199:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942515712 00000100:00100000:0.0:1715330321.246631:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942515968:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1715330321.246633:0:17199:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942515712 00000100:00100000:0.0:1715330321.246643:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330321.246645:0:17199:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5305 00000100:00100000:1.0:1715330321.246649:0:17199:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+19:3689:x1798653942515712:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1715330321.246650:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1715330321.246654:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942515648:0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1715330321.246658:0:17199:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2526 count 1 00000100:00100000:0.0:1715330321.246664:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1715330321.246669:0:17199:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1715330321.246669:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942515904:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1715330321.246673:0:17199:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091c5e1c0/0xd895711d66db9bc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330321.246678:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1715330321.246679:0:17199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330321.246680:0:17199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330321.246682:0:17199:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091c5e1c0/0xd895711d66db9bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.246689:0:17199:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091c5e1c0/0xd895711d66db9bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330321.246689:0:17215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942515968 00000100:00100000:0.0:1715330321.246691:0:17215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942515968 00010000:00010000:1.0:1715330321.246694:0:17199:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091c5e1c0/0xd895711d66db9bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.246699:0:17199:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091c5e1c0/0xd895711d66db9bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330321.246701:0:17215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942515648 00000100:00100000:0.0:1715330321.246703:0:17215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942515648 00010000:00010000:1.0:1715330321.246704:0:17199:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091c5e1c0/0xd895711d66db9bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.246708:0:17199:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5e1c0 already unused, calling callback (ffffffffa07e2af0) 00000100:00100000:0.0:1715330321.246709:0:17215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942515904 00010000:00010000:1.0:1715330321.246710:0:17199:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091c5e1c0/0xd895711d66db9bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330321.246710:0:17215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942515904 00010000:00010000:1.0:1715330321.246715:0:17199:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091c5e1c0/0xd895711d66db9bc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330321.246717:0:17215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5306 00000100:00100000:0.0:1715330321.246720:0:17215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+22:3689:x1798653942515968:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1715330321.246722:0:17199:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091c5e1c0/0xd895711d66db9bc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1715330321.246728:0:17215:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2530 count 1 00002000:00010000:0.0:1715330321.246753:0:17215:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1715330321.246756:0:17199:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091c5e1c0/0xd895711d66db9bc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.246756:0:17215:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880087727180/0xd895711d66db9c3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.246762:0:17215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330321.246763:0:17215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330321.246765:0:17215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880087727180/0xd895711d66db9c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.246772:0:17215:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880087727180/0xd895711d66db9c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.246777:0:17215:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880087727180/0xd895711d66db9c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.246785:0:17215:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880087727180/0xd895711d66db9c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.246790:0:17215:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880087727180/0xd895711d66db9c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.246794:0:17215:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087727180 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330321.246796:0:17215:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880087727180/0xd895711d66db9c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330321.246834:0:17199:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3689:x1798653942515712:12345-0@lo:6:osp-syn-1-0.0 Request processed in 183us (215us total) trans 4294969916 rc 0/0 00000100:00100000:1.0:1715330321.246839:0:17199:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5305 00000100:00100000:1.0:1715330321.246848:0:17199:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5307 00000100:00100000:1.0:1715330321.246851:0:17199:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3689:x1798653942515648:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1715330321.246859:0:17199:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2525 count 1 00002000:00010000:1.0:1715330321.246869:0:17199:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1715330321.246873:0:17199:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091c5ed00/0xd895711d66db9ca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.246879:0:17199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330321.246880:0:17199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330321.246882:0:17199:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091c5ed00/0xd895711d66db9ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.246888:0:17199:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091c5ed00/0xd895711d66db9ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.246893:0:17199:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091c5ed00/0xd895711d66db9ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.246898:0:17199:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091c5ed00/0xd895711d66db9ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330321.246899:0:17217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5308 00000100:00100000:2.0:1715330321.246903:0:17217:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+22:3689:x1798653942515904:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1715330321.246907:0:17199:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091c5ed00/0xd895711d66db9ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1715330321.246921:0:17217:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2529 count 1 00010000:00010000:1.0:1715330321.246922:0:17199:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5ed00 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:1.0:1715330321.246925:0:17199:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091c5ed00/0xd895711d66db9ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.246931:0:17199:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091c5ed00/0xd895711d66db9ca lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1715330321.246933:0:17217:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1715330321.246937:0:17217:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800938b6880/0xd895711d66db9d1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.246939:0:17199:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091c5ed00/0xd895711d66db9ca lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.246942:0:17217:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330321.246944:0:17217:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330321.246944:0:17199:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091c5ed00/0xd895711d66db9ca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.246946:0:17217:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800938b6880/0xd895711d66db9d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.246953:0:17217:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800938b6880/0xd895711d66db9d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.246958:0:17217:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800938b6880/0xd895711d66db9d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.246964:0:17217:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800938b6880/0xd895711d66db9d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.246969:0:17217:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800938b6880/0xd895711d66db9d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.246975:0:17217:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b6880 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330321.246978:0:17217:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800938b6880/0xd895711d66db9d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.246983:0:17217:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800938b6880/0xd895711d66db9d1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.246996:0:17217:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800938b6880/0xd895711d66db9d1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.247002:0:17217:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800938b6880/0xd895711d66db9d1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330321.247022:0:17199:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3689:x1798653942515648:12345-0@lo:6:osp-syn-1-0.0 Request processed in 169us (356us total) trans 4294969917 rc 0/0 00000100:00100000:1.0:1715330321.247027:0:17199:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5307 00000100:00100000:2.0:1715330321.247078:0:17217:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+23:3689:x1798653942515904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 175us (398us total) trans 4294969918 rc 0/0 00000100:00100000:2.0:1715330321.247084:0:17217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5308 00000100:00100000:2.0:1715330321.247101:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942515840:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1715330321.247114:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330321.247123:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1715330321.247126:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942515776:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1715330321.247138:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330321.247145:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942516032:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1715330321.247156:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330321.247172:0:17200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942515840 00000100:00100000:2.0:1715330321.247176:0:17217:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942515776 00000100:00100000:1.0:1715330321.247176:0:17200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942515840 00000100:00100000:2.0:1715330321.247178:0:17217:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942515776 00000100:00100000:1.0:1715330321.247187:0:17200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942516032 00000100:00100000:1.0:1715330321.247189:0:17200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942516032 00000100:00100000:2.0:1715330321.247196:0:17217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5309 00000100:00100000:2.0:1715330321.247200:0:17217:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+25:3691:x1798653942515840:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1715330321.247200:0:17200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5310 00000100:00100000:1.0:1715330321.247203:0:17200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+25:3691:x1798653942515776:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1715330321.247209:0:17217:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2528 count 1 00002000:00080000:1.0:1715330321.247212:0:17200:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2527 count 1 00000004:00080000:3.0:1715330321.247215:0:3690:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012b55f480/2, rc 0, transno 2618 00002000:00010000:2.0:1715330321.247219:0:17217:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1715330321.247221:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942515520:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1715330321.247223:0:17217:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800938b46c0/0xd895711d66db9d8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1715330321.247223:0:17200:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1715330321.247227:0:17200:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091c5cb40/0xd895711d66db9df lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.247233:0:17217:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330321.247233:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1715330321.247234:0:17206:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5311 00010000:00010000:1.0:1715330321.247234:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330321.247235:0:17217:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330321.247236:0:17200:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091c5cb40/0xd895711d66db9df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.247237:0:17217:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800938b46c0/0xd895711d66db9d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330321.247238:0:17206:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+25:3691:x1798653942516032:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1715330321.247243:0:17200:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091c5cb40/0xd895711d66db9df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.247244:0:17217:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800938b46c0/0xd895711d66db9d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1715330321.247247:0:17206:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2531 count 1 00010000:00010000:1.0:1715330321.247248:0:17200:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091c5cb40/0xd895711d66db9df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.247250:0:17217:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800938b46c0/0xd895711d66db9d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.247253:0:17200:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091c5cb40/0xd895711d66db9df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.247255:0:17217:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800938b46c0/0xd895711d66db9d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1715330321.247258:0:17206:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1715330321.247259:0:17200:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091c5cb40/0xd895711d66db9df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.247260:0:17217:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800938b46c0/0xd895711d66db9d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.247261:0:17206:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011da81200/0xd895711d66db9e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.247263:0:17200:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5cb40 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330321.247265:0:17217:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b46c0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:1.0:1715330321.247266:0:17200:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091c5cb40/0xd895711d66db9df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.247267:0:17206:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330321.247267:0:17217:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800938b46c0/0xd895711d66db9d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.247268:0:17206:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330321.247270:0:17206:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011da81200/0xd895711d66db9e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.247271:0:17200:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091c5cb40/0xd895711d66db9df lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.247273:0:17217:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800938b46c0/0xd895711d66db9d8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.247279:0:17200:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091c5cb40/0xd895711d66db9df lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.247280:0:17217:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800938b46c0/0xd895711d66db9d8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.247282:0:17206:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011da81200/0xd895711d66db9e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.247284:0:17200:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091c5cb40/0xd895711d66db9df lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.247288:0:17206:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011da81200/0xd895711d66db9e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.247290:0:17217:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800938b46c0/0xd895711d66db9d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.247293:0:17206:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88011da81200/0xd895711d66db9e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.247298:0:17206:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88011da81200/0xd895711d66db9e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.247302:0:17206:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da81200 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330321.247304:0:17206:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88011da81200/0xd895711d66db9e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.247310:0:17206:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88011da81200/0xd895711d66db9e6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.247318:0:17206:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88011da81200/0xd895711d66db9e6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.247323:0:17206:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011da81200/0xd895711d66db9e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330321.247368:0:17200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:3691:x1798653942515776:12345-0@lo:6:osp-syn-1-0.0 Request processed in 163us (228us total) trans 4294969919 rc 0/0 00000100:00100000:2.0:1715330321.247373:0:17217:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+28:3691:x1798653942515840:12345-0@lo:6:osp-syn-1-0.0 Request processed in 171us (256us total) trans 4294969920 rc 0/0 00000100:00100000:1.0:1715330321.247373:0:17200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5310 00000100:00100000:2.0:1715330321.247378:0:17217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5309 00000004:00080000:2.0:1715330321.247399:0:3691:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012b55c000/2, rc 0, transno 2623 00000100:00100000:3.0:1715330321.247400:0:17206:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+26:3691:x1798653942516032:12345-0@lo:6:osp-syn-1-0.0 Request processed in 161us (242us total) trans 4294969921 rc 0/0 00000100:00100000:2.0:1715330321.247402:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942515776:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1715330321.247405:0:17206:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5311 00000004:00080000:2.0:1715330321.247407:0:3691:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012b55df80/2, rc 0, transno 2625 00000100:00100000:2.0:1715330321.247410:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942516032:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1715330321.247415:0:3691:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012b55f800/2, rc 0, transno 2624 00000100:00100000:2.0:1715330321.247417:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942515840:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1715330321.247453:0:17215:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880087727180/0xd895711d66db9c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.247467:0:17215:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880087727180/0xd895711d66db9c3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.247472:0:17215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880087727180/0xd895711d66db9c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330321.247552:0:17215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+26:3689:x1798653942515968:12345-0@lo:6:osp-syn-1-0.0 Request processed in 831us (908us total) trans 4294969922 rc 0/0 00000100:00100000:0.0:1715330321.247558:0:17215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5306 00000004:00080000:0.0:1715330321.247580:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012b55d880/2, rc 0, transno 2621 00000100:00100000:0.0:1715330321.247583:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942515648:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1715330321.247588:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012b55c700/2, rc 0, transno 2622 00000100:00100000:0.0:1715330321.247590:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942515904:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1715330321.247596:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012b55fb80/2, rc 0, transno 2620 00000100:00100000:0.0:1715330321.247598:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942515712:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1715330321.247603:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012b55e680/2, rc 0, transno 2626 00000100:00100000:0.0:1715330321.247606:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942515968:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1715330321.247692:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091cc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942516224:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1715330321.247709:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330321.247718:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091cca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942516480:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1715330321.247746:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330321.247756:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1715330321.247759:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091cc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942516160:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1715330321.247773:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330321.247780:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091cc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942516416:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1715330321.247791:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330321.247805:0:17197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942516224 00000100:00100000:0.0:1715330321.247807:0:17197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942516224 00000100:00100000:0.0:1715330321.247817:0:17197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942516480 00000100:00100000:0.0:1715330321.247818:0:17197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942516480 00000100:00100000:0.0:1715330321.247824:0:17197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942516160 00000100:00100000:0.0:1715330321.247825:0:17197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942516160 00000100:00100000:0.0:1715330321.247830:0:17197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942516416 00000100:00100000:0.0:1715330321.247832:0:17197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942516416 00000100:00100000:0.0:1715330321.247838:0:17197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5312 00000100:00100000:0.0:1715330321.247841:0:17197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:3689:x1798653942516224:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1715330321.247849:0:17197:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2534 count 1 00002000:00010000:0.0:1715330321.247861:0:17197:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1715330321.247864:0:17197:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880087724240/0xd895711d66db9ed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.247870:0:17197:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330321.247871:0:17197:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330321.247873:0:17197:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880087724240/0xd895711d66db9ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.247879:0:17197:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880087724240/0xd895711d66db9ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.247884:0:17197:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880087724240/0xd895711d66db9ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.247889:0:17197:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880087724240/0xd895711d66db9ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.247895:0:17197:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880087724240/0xd895711d66db9ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.247899:0:17197:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087724240 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330321.247901:0:17197:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880087724240/0xd895711d66db9ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.247907:0:17197:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880087724240/0xd895711d66db9ed lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.247929:0:17197:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880087724240/0xd895711d66db9ed lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.247937:0:17197:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880087724240/0xd895711d66db9ed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330321.248012:0:17197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+30:3689:x1798653942516224:12345-0@lo:6:osp-syn-1-0.0 Request processed in 170us (302us total) trans 4294969923 rc 0/0 00000100:00100000:0.0:1715330321.248017:0:17197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5312 00000100:00100000:0.0:1715330321.248024:0:17197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5313 00000100:00100000:0.0:1715330321.248027:0:17197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:3689:x1798653942516480:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1715330321.248035:0:17197:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2538 count 1 00002000:00010000:0.0:1715330321.248045:0:17197:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1715330321.248048:0:17197:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880087725440/0xd895711d66db9f4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.248054:0:17197:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330321.248055:0:17197:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330321.248058:0:17197:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880087725440/0xd895711d66db9f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.248121:0:17197:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880087725440/0xd895711d66db9f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.248127:0:17197:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880087725440/0xd895711d66db9f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.248133:0:17197:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880087725440/0xd895711d66db9f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330321.248141:0:9398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5314 00010000:00010000:0.0:1715330321.248142:0:17197:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880087725440/0xd895711d66db9f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330321.248145:0:9398:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3689:x1798653942516160:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1715330321.248147:0:17197:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087725440 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330321.248149:0:17197:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880087725440/0xd895711d66db9f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.248154:0:17197:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880087725440/0xd895711d66db9f4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1715330321.248155:0:9398:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2533 count 1 00010000:00010000:0.0:1715330321.248163:0:17197:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880087725440/0xd895711d66db9f4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1715330321.248164:0:9398:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1715330321.248168:0:9398:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800938b4d80/0xd895711d66db9fb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.248168:0:17197:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880087725440/0xd895711d66db9f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.248173:0:9398:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330321.248175:0:9398:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330321.248177:0:9398:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800938b4d80/0xd895711d66db9fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.248184:0:9398:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800938b4d80/0xd895711d66db9fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.248190:0:9398:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800938b4d80/0xd895711d66db9fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.248195:0:9398:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800938b4d80/0xd895711d66db9fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.248206:0:9398:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800938b4d80/0xd895711d66db9fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.248211:0:9398:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b4d80 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330321.248213:0:9398:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800938b4d80/0xd895711d66db9fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.248219:0:9398:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800938b4d80/0xd895711d66db9fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.248226:0:9398:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800938b4d80/0xd895711d66db9fb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.248231:0:9398:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800938b4d80/0xd895711d66db9fb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330321.248242:0:17197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+30:3689:x1798653942516480:12345-0@lo:6:osp-syn-1-0.0 Request processed in 213us (495us total) trans 4294969924 rc 0/0 00000100:00100000:0.0:1715330321.248246:0:17197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5313 00000100:00100000:0.0:1715330321.248255:0:17197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5315 00000100:00100000:0.0:1715330321.248258:0:17197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134567b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+30:3689:x1798653942516416:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1715330321.248266:0:17197:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2537 count 1 00002000:00010000:0.0:1715330321.248275:0:17197:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1715330321.248279:0:17197:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800877273c0/0xd895711d66dba02 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.248288:0:17197:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330321.248289:0:17197:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330321.248291:0:17197:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800877273c0/0xd895711d66dba02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.248298:0:17197:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800877273c0/0xd895711d66dba02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330321.248299:0:9398:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3689:x1798653942516160:12345-0@lo:6:osp-syn-1-0.0 Request processed in 153us (525us total) trans 4294969925 rc 0/0 00000100:00100000:2.0:1715330321.248303:0:9398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5314 00010000:00010000:0.0:1715330321.248304:0:17197:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800877273c0/0xd895711d66dba02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.248310:0:17197:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800877273c0/0xd895711d66dba02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.248315:0:17197:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800877273c0/0xd895711d66dba02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330321.248318:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091ccb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942516096:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1715330321.248320:0:17197:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800877273c0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330321.248322:0:17197:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800877273c0/0xd895711d66dba02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.248328:0:17197:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800877273c0/0xd895711d66dba02 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330321.248333:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1715330321.248336:0:17197:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800877273c0/0xd895711d66dba02 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330321.248341:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091cc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942516352:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1715330321.248346:0:17197:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800877273c0/0xd895711d66dba02 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330321.248352:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330321.248358:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1715330321.248362:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942516288:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1715330321.248375:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330321.248383:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942516544:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1715330321.248395:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330321.248409:0:17197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134567b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+30:3689:x1798653942516416:12345-0@lo:6:osp-syn-1-0.0 Request processed in 150us (616us total) trans 4294969926 rc 0/0 00000100:00100000:2.0:1715330321.248414:0:9398:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942516096 00000100:00100000:0.0:1715330321.248414:0:17197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5315 00000100:00100000:2.0:1715330321.248417:0:9398:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942516096 00000100:00100000:0.0:1715330321.248421:0:17197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942516352 00000100:00100000:0.0:1715330321.248423:0:17197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942516352 00000100:00100000:2.0:1715330321.248426:0:9398:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942516288 00000100:00100000:2.0:1715330321.248428:0:9398:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942516288 00000100:00100000:0.0:1715330321.248431:0:17197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942516544 00000100:00100000:0.0:1715330321.248433:0:17197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942516544 00000100:00100000:2.0:1715330321.248437:0:9398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5316 00000100:00100000:2.0:1715330321.248440:0:9398:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+33:3691:x1798653942516096:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1715330321.248443:0:17197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5317 00000100:00100000:0.0:1715330321.248446:0:17197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+33:3691:x1798653942516352:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1715330321.248449:0:9398:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2532 count 1 00002000:00080000:0.0:1715330321.248452:0:17197:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2536 count 1 00002000:00010000:2.0:1715330321.248460:0:9398:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1715330321.248460:0:17197:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1715330321.248463:0:9398:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800938b5680/0xd895711d66dba09 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.248463:0:17197:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880087724b40/0xd895711d66dba10 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.248468:0:9398:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330321.248468:0:17197:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330321.248470:0:9398:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330321.248470:0:17197:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330321.248472:0:9398:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800938b5680/0xd895711d66dba09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.248472:0:17197:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880087724b40/0xd895711d66dba10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.248479:0:9398:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800938b5680/0xd895711d66dba09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.248479:0:17197:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880087724b40/0xd895711d66dba10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.248484:0:9398:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800938b5680/0xd895711d66dba09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.248485:0:17197:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880087724b40/0xd895711d66dba10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.248491:0:9398:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800938b5680/0xd895711d66dba09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.248494:0:17197:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880087724b40/0xd895711d66dba10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.248497:0:9398:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800938b5680/0xd895711d66dba09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.248500:0:17197:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880087724b40/0xd895711d66dba10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.248501:0:9398:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b5680 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330321.248503:0:9398:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800938b5680/0xd895711d66dba09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.248504:0:17197:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087724b40 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330321.248506:0:17197:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880087724b40/0xd895711d66dba10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.248509:0:9398:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800938b5680/0xd895711d66dba09 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.248511:0:17197:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880087724b40/0xd895711d66dba10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.248516:0:9398:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800938b5680/0xd895711d66dba09 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.248518:0:17197:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880087724b40/0xd895711d66dba10 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.248521:0:9398:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800938b5680/0xd895711d66dba09 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.248523:0:17197:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880087724b40/0xd895711d66dba10 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330321.248555:0:17205:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5318 00000100:00100000:2.0:1715330321.248559:0:17205:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f578e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+35:3691:x1798653942516288:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1715330321.248568:0:17205:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2535 count 1 00002000:00010000:2.0:1715330321.248578:0:17205:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1715330321.248581:0:17205:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800938b5b00/0xd895711d66dba17 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330321.248591:0:17197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+35:3691:x1798653942516352:12345-0@lo:6:osp-syn-1-0.0 Request processed in 144us (238us total) trans 4294969927 rc 0/0 00010000:00010000:2.0:1715330321.248592:0:17205:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330321.248593:0:17205:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330321.248595:0:17205:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800938b5b00/0xd895711d66dba17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330321.248596:0:17197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5317 00010000:00010000:2.0:1715330321.248602:0:17205:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800938b5b00/0xd895711d66dba17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330321.248603:0:17197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5319 00000100:00100000:0.0:1715330321.248606:0:17197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+34:3691:x1798653942516544:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1715330321.248608:0:17205:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800938b5b00/0xd895711d66dba17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.248614:0:17205:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800938b5b00/0xd895711d66dba17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1715330321.248614:0:17197:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2539 count 1 00010000:00010000:2.0:1715330321.248619:0:17205:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800938b5b00/0xd895711d66dba17 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1715330321.248622:0:17197:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1715330321.248623:0:17205:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b5b00 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330321.248625:0:17197:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880087724000/0xd895711d66dba1e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.248626:0:17205:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800938b5b00/0xd895711d66dba17 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.248630:0:17197:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330321.248631:0:17205:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800938b5b00/0xd895711d66dba17 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.248631:0:17197:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330321.248633:0:17197:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880087724000/0xd895711d66dba1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.248639:0:17205:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800938b5b00/0xd895711d66dba17 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.248639:0:17197:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880087724000/0xd895711d66dba1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.248645:0:17197:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880087724000/0xd895711d66dba1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.248648:0:17205:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800938b5b00/0xd895711d66dba17 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.248650:0:17197:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880087724000/0xd895711d66dba1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.248656:0:17197:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880087724000/0xd895711d66dba1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.248660:0:17197:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087724000 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330321.248662:0:17197:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880087724000/0xd895711d66dba1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.248668:0:17197:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880087724000/0xd895711d66dba1e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.248676:0:17197:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880087724000/0xd895711d66dba1e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.248681:0:17197:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880087724000/0xd895711d66dba1e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330321.248712:0:17205:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f578e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+36:3691:x1798653942516288:12345-0@lo:6:osp-syn-1-0.0 Request processed in 152us (335us total) trans 4294969929 rc 0/0 00000100:00100000:2.0:1715330321.248716:0:17205:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5318 00000100:00100000:0.0:1715330321.248756:0:17197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+35:3691:x1798653942516544:12345-0@lo:6:osp-syn-1-0.0 Request processed in 148us (359us total) trans 4294969930 rc 0/0 00000100:00100000:0.0:1715330321.248761:0:17197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5319 00000004:00080000:0.0:1715330321.248784:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880091cc9180/2, rc 0, transno 2629 00000100:00100000:0.0:1715330321.248790:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091cc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942516160:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1715330321.248797:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880091cc9f80/2, rc 0, transno 2630 00000100:00100000:0.0:1715330321.248799:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091cc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942516416:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1715330321.248804:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880091cc8000/2, rc 0, transno 2627 00000100:00100000:0.0:1715330321.248807:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091cc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942516224:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1715330321.248812:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880091cca300/2, rc 0, transno 2628 00000100:00100000:0.0:1715330321.248814:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091cca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942516480:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1715330321.248858:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134565f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942516736:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1715330321.248882:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330321.248891:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1715330321.248895:0:9399:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942516736 00000100:00100000:0.0:1715330321.248895:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134564700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942516672:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1715330321.248900:0:9399:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942516736 00000100:00100000:0.0:1715330321.248908:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330321.249015:0:9399:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942516672 00000100:00100000:3.0:1715330321.249019:0:9399:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942516672 00000100:00100000:0.0:1715330321.249020:0:9397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5320 00000100:00100000:0.0:1715330321.249024:0:9397:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134566d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3689:x1798653942516736:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1715330321.249033:0:9397:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2542 count 1 00000100:00100000:3.0:1715330321.249035:0:9399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5321 00000100:00100000:3.0:1715330321.249039:0:9399:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134565c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3689:x1798653942516672:12345-0@lo:6:osp-syn-1-0.0 00002000:00010000:0.0:1715330321.249043:0:9397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1715330321.249047:0:9397:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880087727600/0xd895711d66dba25 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1715330321.249050:0:9399:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2541 count 1 00010000:00010000:0.0:1715330321.249052:0:9397:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330321.249053:0:9397:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330321.249055:0:9397:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880087727600/0xd895711d66dba25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1715330321.249062:0:9399:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1715330321.249062:0:9397:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880087727600/0xd895711d66dba25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.249066:0:9399:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011da81d40/0xd895711d66dba2c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.249068:0:9397:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880087727600/0xd895711d66dba25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.249072:0:9399:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330321.249074:0:9399:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330321.249074:0:9397:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880087727600/0xd895711d66dba25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.249076:0:9399:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011da81d40/0xd895711d66dba2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.249079:0:9397:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880087727600/0xd895711d66dba25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.249083:0:9399:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011da81d40/0xd895711d66dba2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.249084:0:9397:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087727600 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330321.249087:0:9397:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880087727600/0xd895711d66dba25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.249089:0:9399:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011da81d40/0xd895711d66dba2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.249092:0:9397:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880087727600/0xd895711d66dba25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.249094:0:9399:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88011da81d40/0xd895711d66dba2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.249099:0:9399:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88011da81d40/0xd895711d66dba2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.249100:0:9397:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880087727600/0xd895711d66dba25 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.249108:0:9399:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da81d40 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330321.249109:0:9397:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880087727600/0xd895711d66dba25 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.249110:0:9399:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88011da81d40/0xd895711d66dba2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.249116:0:9399:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88011da81d40/0xd895711d66dba2c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.249123:0:9399:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88011da81d40/0xd895711d66dba2c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.249128:0:9399:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011da81d40/0xd895711d66dba2c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330321.249184:0:9397:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134566d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+38:3689:x1798653942516736:12345-0@lo:6:osp-syn-1-0.0 Request processed in 158us (300us total) trans 4294969931 rc 0/0 00000100:00100000:0.0:1715330321.249189:0:9397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5320 00000100:00100000:3.0:1715330321.249206:0:9399:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134565c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3689:x1798653942516672:12345-0@lo:6:osp-syn-1-0.0 Request processed in 166us (297us total) trans 4294969932 rc 0/0 00000004:00080000:0.0:1715330321.249210:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880134564700/2, rc 0, transno 2636 00000100:00100000:3.0:1715330321.249211:0:9399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5321 00000100:00100000:0.0:1715330321.249216:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880134564700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942516672:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1715330321.249222:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880134565f80/2, rc 0, transno 2635 00000100:00100000:0.0:1715330321.249225:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880134565f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942516736:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1715330321.249254:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134564380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942516800:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1715330321.249270:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330321.249279:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1715330321.249280:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942516800 00000100:00100000:3.0:1715330321.249283:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134565500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942516608:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1715330321.249283:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942516800 00000100:00100000:3.0:1715330321.249293:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330321.249297:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942516608 00000100:00100000:0.0:1715330321.249299:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942516608 00000100:00100000:0.0:1715330321.249308:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5322 00000100:00100000:0.0:1715330321.249311:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+38:3690:x1798653942516800:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1715330321.249319:0:9633:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2543 count 1 00002000:00010000:0.0:1715330321.249328:0:9633:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1715330321.249332:0:9633:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880087726d00/0xd895711d66dba33 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.249337:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330321.249339:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330321.249341:0:9633:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880087726d00/0xd895711d66dba33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.249351:0:9633:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880087726d00/0xd895711d66dba33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.249357:0:9633:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880087726d00/0xd895711d66dba33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.249361:0:9633:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880087726d00/0xd895711d66dba33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.249366:0:9633:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880087726d00/0xd895711d66dba33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.249371:0:9633:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087726d00 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330321.249373:0:9633:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880087726d00/0xd895711d66dba33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.249378:0:9633:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880087726d00/0xd895711d66dba33 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.249386:0:9633:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880087726d00/0xd895711d66dba33 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.249391:0:9633:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880087726d00/0xd895711d66dba33 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330321.249464:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+39:3690:x1798653942516800:12345-0@lo:6:osp-syn-1-0.0 Request processed in 151us (192us total) trans 4294969933 rc 0/0 00000100:00100000:0.0:1715330321.249469:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5322 00000100:00100000:0.0:1715330321.249477:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5323 00000100:00100000:0.0:1715330321.249481:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+38:3690:x1798653942516608:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1715330321.249489:0:9633:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2540 count 1 00002000:00010000:0.0:1715330321.249498:0:9633:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1715330321.249502:0:9633:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880087725680/0xd895711d66dba3a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.249507:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330321.249508:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330321.249511:0:9633:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880087725680/0xd895711d66dba3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.249516:0:9633:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880087725680/0xd895711d66dba3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.249522:0:9633:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880087725680/0xd895711d66dba3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.249527:0:9633:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880087725680/0xd895711d66dba3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.249532:0:9633:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880087725680/0xd895711d66dba3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.249536:0:9633:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087725680 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330321.249539:0:9633:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880087725680/0xd895711d66dba3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.249544:0:9633:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880087725680/0xd895711d66dba3a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.249552:0:9633:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880087725680/0xd895711d66dba3a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.249558:0:9633:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880087725680/0xd895711d66dba3a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330321.249622:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+39:3690:x1798653942516608:12345-0@lo:6:osp-syn-1-0.0 Request processed in 139us (326us total) trans 4294969934 rc 0/0 00000100:00100000:0.0:1715330321.249626:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5323 00000004:00080000:3.0:1715330321.249763:0:3690:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880134565500/2, rc 0, transno 2638 00000100:00100000:3.0:1715330321.249768:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880134565500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942516608:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1715330321.249774:0:3690:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880134564380/2, rc 0, transno 2637 00000100:00100000:3.0:1715330321.249777:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880134564380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942516800:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1715330321.249782:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1715330321.249786:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134566300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942516864:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1715330321.249796:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942516992:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1715330321.249801:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330321.249813:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942517056:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1715330321.249814:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330321.249824:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330321.249825:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1715330321.249829:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134567800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942516928:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1715330321.249835:0:17206:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942516864 00000100:00100000:3.0:1715330321.249837:0:17206:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942516864 00000100:00100000:0.0:1715330321.249849:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330321.249854:0:17206:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942516992 00000100:00100000:3.0:1715330321.249855:0:17206:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942516992 00000100:00100000:3.0:1715330321.249862:0:17206:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942517056 00000100:00100000:3.0:1715330321.249863:0:17206:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942517056 00000100:00100000:0.0:1715330321.249864:0:9399:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942516928 00000100:00100000:0.0:1715330321.249866:0:9399:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942516928 00000100:00100000:3.0:1715330321.249870:0:17206:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5324 00000100:00100000:3.0:1715330321.249874:0:17206:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+42:3690:x1798653942516864:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1715330321.249877:0:9399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5325 00000100:00100000:0.0:1715330321.249881:0:9399:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+42:3689:x1798653942516992:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1715330321.249882:0:17206:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2544 count 1 00002000:00080000:0.0:1715330321.249889:0:9399:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2546 count 1 00002000:00010000:3.0:1715330321.249892:0:17206:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1715330321.249896:0:17206:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011da82ac0/0xd895711d66dba41 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1715330321.249899:0:9399:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1715330321.249902:0:17206:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330321.249902:0:9399:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800877258c0/0xd895711d66dba48 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.249903:0:17206:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330321.249906:0:17206:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011da82ac0/0xd895711d66dba41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.249921:0:9399:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330321.249922:0:17206:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011da82ac0/0xd895711d66dba41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.249923:0:9399:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330321.249925:0:9399:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800877258c0/0xd895711d66dba48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.249928:0:17206:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011da82ac0/0xd895711d66dba41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.249932:0:9399:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800877258c0/0xd895711d66dba48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.249938:0:17206:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88011da82ac0/0xd895711d66dba41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.249938:0:9399:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800877258c0/0xd895711d66dba48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.249943:0:17206:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88011da82ac0/0xd895711d66dba41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.249944:0:9399:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800877258c0/0xd895711d66dba48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.249947:0:17206:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da82ac0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330321.249949:0:17206:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88011da82ac0/0xd895711d66dba41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.249949:0:9399:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800877258c0/0xd895711d66dba48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.249954:0:17206:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88011da82ac0/0xd895711d66dba41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.249954:0:9399:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800877258c0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330321.249956:0:9399:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800877258c0/0xd895711d66dba48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.249961:0:17206:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88011da82ac0/0xd895711d66dba41 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.249962:0:9399:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800877258c0/0xd895711d66dba48 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.249965:0:17206:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011da82ac0/0xd895711d66dba41 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.249970:0:9399:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800877258c0/0xd895711d66dba48 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.249980:0:9399:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800877258c0/0xd895711d66dba48 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9399 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330321.249990:0:17200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5326 00000100:00100000:1.0:1715330321.249996:0:17200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+43:3690:x1798653942517056:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1715330321.250008:0:17200:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2547 count 1 00002000:00010000:1.0:1715330321.250019:0:17200:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1715330321.250023:0:17200:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091c5db00/0xd895711d66dba4f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.250030:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330321.250032:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330321.250034:0:17200:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091c5db00/0xd895711d66dba4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330321.250035:0:17206:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+44:3690:x1798653942516864:12345-0@lo:6:osp-syn-1-0.0 Request processed in 159us (231us total) trans 4294969935 rc 0/0 00000100:00100000:3.0:1715330321.250040:0:17206:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5324 00010000:00010000:1.0:1715330321.250042:0:17200:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091c5db00/0xd895711d66dba4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330321.250048:0:17206:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5327 00010000:00010000:1.0:1715330321.250048:0:17200:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091c5db00/0xd895711d66dba4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330321.250051:0:17206:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+43:3689:x1798653942516928:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1715330321.250053:0:17200:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091c5db00/0xd895711d66dba4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330321.250056:0:9399:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+43:3689:x1798653942516992:12345-0@lo:6:osp-syn-1-0.0 Request processed in 174us (241us total) trans 4294969936 rc 0/0 00002000:00080000:3.0:1715330321.250058:0:17206:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2545 count 1 00000100:00100000:0.0:1715330321.250061:0:9399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5325 00010000:00010000:1.0:1715330321.250062:0:17200:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091c5db00/0xd895711d66dba4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.250066:0:17200:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5db00 already unused, calling callback (ffffffffa07e2af0) 00002000:00010000:3.0:1715330321.250067:0:17206:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1715330321.250069:0:17200:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091c5db00/0xd895711d66dba4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.250070:0:17206:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011da82880/0xd895711d66dba56 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.250074:0:17200:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091c5db00/0xd895711d66dba4f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.250075:0:17206:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330321.250076:0:17206:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330321.250078:0:17206:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011da82880/0xd895711d66dba56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.250082:0:17200:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091c5db00/0xd895711d66dba4f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1715330321.250082:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d4f8000/2, rc 0, transno 2640 00010000:00010000:3.0:1715330321.250084:0:17206:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011da82880/0xd895711d66dba56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.250087:0:17200:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091c5db00/0xd895711d66dba4f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330321.250088:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942516992:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1715330321.250089:0:17206:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011da82880/0xd895711d66dba56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.250093:0:17206:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88011da82880/0xd895711d66dba56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.250098:0:17206:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88011da82880/0xd895711d66dba56 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.250103:0:17206:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da82880 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330321.250105:0:17206:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88011da82880/0xd895711d66dba56 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.250109:0:17206:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88011da82880/0xd895711d66dba56 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.250116:0:17206:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88011da82880/0xd895711d66dba56 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.250122:0:17206:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011da82880/0xd895711d66dba56 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330321.250161:0:17200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+44:3690:x1798653942517056:12345-0@lo:6:osp-syn-1-0.0 Request processed in 165us (336us total) trans 4294969937 rc 0/0 00000100:00100000:1.0:1715330321.250166:0:17200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5326 00000100:00100000:3.0:1715330321.250196:0:17206:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+43:3689:x1798653942516928:12345-0@lo:6:osp-syn-1-0.0 Request processed in 143us (345us total) trans 4294969938 rc 0/0 00000100:00100000:3.0:1715330321.250201:0:17206:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5327 00000004:00080000:0.0:1715330321.250221:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880134567800/2, rc 0, transno 2642 00000004:00080000:3.0:1715330321.250223:0:3690:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d4f8380/2, rc 0, transno 2641 00000100:00100000:3.0:1715330321.250226:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942517056:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1715330321.250227:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880134567800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942516928:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1715330321.250232:0:3690:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880134566300/2, rc 0, transno 2639 00000100:00100000:3.0:1715330321.250235:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880134566300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942516864:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1715330321.250240:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1715330321.250243:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942517120:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1715330321.250255:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942517184:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1715330321.250259:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330321.250272:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942517312:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1715330321.250272:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330321.250281:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1715330321.250284:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942517248:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1715330321.250286:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330321.250296:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1715330321.250326:0:3691:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880091ccb480/2, rc 0, transno 2633 00000100:00100000:0.0:1715330321.250331:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942516288:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1715330321.250335:0:9398:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+42:3691:x1798653942516096:12345-0@lo:6:osp-syn-1-0.0 Request processed in 347us (454us total) trans 4294969928 rc 0/0 00000004:00080000:0.0:1715330321.250337:0:3691:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880091cc8700/2, rc 0, transno 2634 00000100:00100000:0.0:1715330321.250340:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942516544:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1715330321.250342:0:9398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5316 00000004:00080000:0.0:1715330321.250345:0:3691:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880091ccb800/2, rc 0, transno 2632 00000100:00100000:0.0:1715330321.250347:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091ccb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942516096:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1715330321.250352:0:3691:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880091cc8380/2, rc 0, transno 2631 00000100:00100000:0.0:1715330321.250354:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091cc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942516352:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1715330321.250359:0:17199:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942517120 00000100:00100000:3.0:1715330321.250360:0:17216:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942517184 00000100:00100000:1.0:1715330321.250362:0:17199:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942517120 00000100:00100000:3.0:1715330321.250364:0:17216:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942517184 00000100:00100000:1.0:1715330321.250373:0:17199:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942517312 00000100:00100000:1.0:1715330321.250374:0:17199:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942517312 00000100:00100000:3.0:1715330321.250379:0:17216:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942517248 00000100:00100000:3.0:1715330321.250381:0:17216:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942517248 00000100:00100000:1.0:1715330321.250381:0:17199:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5328 00000100:00100000:1.0:1715330321.250384:0:17199:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+45:3690:x1798653942517120:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1715330321.250389:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942517440:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1715330321.250391:0:17216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5329 00002000:00080000:1.0:1715330321.250391:0:17199:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2548 count 1 00000100:00100000:2.0:1715330321.250400:0:9398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5330 00002000:00010000:1.0:1715330321.250400:0:17199:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1715330321.250402:0:17199:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091c5d440/0xd895711d66dba5d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330321.250403:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330321.250404:0:9398:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3690:x1798653942517312:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1715330321.250407:0:17216:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+45:3688:x1798653942517184:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1715330321.250407:0:17199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330321.250407:0:17199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330321.250409:0:17199:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091c5d440/0xd895711d66dba5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330321.250411:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00002000:00080000:2.0:1715330321.250413:0:9398:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2551 count 1 00010000:00010000:1.0:1715330321.250414:0:17199:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091c5d440/0xd895711d66dba5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330321.250415:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942517504:0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1715330321.250418:0:17216:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2549 count 1 00010000:00010000:1.0:1715330321.250418:0:17199:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091c5d440/0xd895711d66dba5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.250421:0:17199:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091c5d440/0xd895711d66dba5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1715330321.250423:0:9398:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1715330321.250424:0:17199:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091c5d440/0xd895711d66dba5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330321.250426:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1715330321.250427:0:9398:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800938b73c0/0xd895711d66dba64 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.250427:0:17199:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5d440 already unused, calling callback (ffffffffa07e2af0) 00002000:00010000:3.0:1715330321.250429:0:17216:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1715330321.250429:0:17199:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091c5d440/0xd895711d66dba5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.250432:0:17199:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091c5d440/0xd895711d66dba5d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.250433:0:17216:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011da80900/0xd895711d66dba6b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.250434:0:9398:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330321.250435:0:9398:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330321.250437:0:9398:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800938b73c0/0xd895711d66dba64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.250437:0:17199:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091c5d440/0xd895711d66dba5d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330321.250437:0:9397:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942517440 00010000:00010000:1.0:1715330321.250440:0:17199:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091c5d440/0xd895711d66dba5d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330321.250440:0:9397:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942517440 00010000:00010000:3.0:1715330321.250443:0:17216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330321.250444:0:17216:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330321.250444:0:9398:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800938b73c0/0xd895711d66dba64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.250447:0:17216:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011da80900/0xd895711d66dba6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.250450:0:9398:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800938b73c0/0xd895711d66dba64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.250454:0:17216:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011da80900/0xd895711d66dba6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330321.250455:0:9397:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942517504 00000100:00100000:0.0:1715330321.250457:0:9397:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942517504 00010000:00010000:2.0:1715330321.250459:0:9398:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800938b73c0/0xd895711d66dba64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.250460:0:17216:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011da80900/0xd895711d66dba6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330321.250464:0:9397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5331 00010000:00010000:3.0:1715330321.250465:0:17216:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88011da80900/0xd895711d66dba6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.250465:0:9398:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800938b73c0/0xd895711d66dba64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330321.250468:0:9397:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+48:3688:x1798653942517248:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1715330321.250470:0:17216:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88011da80900/0xd895711d66dba6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.250470:0:9398:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b73c0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330321.250472:0:9398:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800938b73c0/0xd895711d66dba64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.250475:0:17216:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da80900 already unused, calling callback (ffffffffa07e2af0) 00002000:00080000:0.0:1715330321.250476:0:9397:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2550 count 1 00010000:00010000:3.0:1715330321.250477:0:17216:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88011da80900/0xd895711d66dba6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.250478:0:9398:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800938b73c0/0xd895711d66dba64 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.250483:0:17216:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88011da80900/0xd895711d66dba6b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1715330321.250484:0:9397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1715330321.250486:0:9398:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800938b73c0/0xd895711d66dba64 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.250487:0:9397:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880087727a80/0xd895711d66dba72 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.250491:0:17216:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88011da80900/0xd895711d66dba6b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.250492:0:9398:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800938b73c0/0xd895711d66dba64 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.250493:0:9397:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330321.250494:0:9397:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330321.250496:0:9397:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880087727a80/0xd895711d66dba72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.250502:0:17216:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011da80900/0xd895711d66dba6b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.250503:0:9397:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880087727a80/0xd895711d66dba72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330321.250508:0:17199:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+48:3690:x1798653942517120:12345-0@lo:6:osp-syn-1-0.0 Request processed in 122us (247us total) trans 4294969939 rc 0/0 00010000:00010000:0.0:1715330321.250508:0:9397:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880087727a80/0xd895711d66dba72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330321.250512:0:17199:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5328 00010000:00010000:0.0:1715330321.250513:0:9397:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880087727a80/0xd895711d66dba72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.250519:0:9397:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880087727a80/0xd895711d66dba72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330321.250521:0:17199:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5332 00000100:00100000:1.0:1715330321.250524:0:17199:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+48:3688:x1798653942517440:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1715330321.250524:0:9397:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087727a80 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330321.250526:0:9397:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880087727a80/0xd895711d66dba72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.250532:0:9397:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880087727a80/0xd895711d66dba72 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1715330321.250533:0:17199:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2553 count 1 00010000:00010000:0.0:1715330321.250540:0:9397:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880087727a80/0xd895711d66dba72 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1715330321.250543:0:17199:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1715330321.250546:0:17199:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091c5cfc0/0xd895711d66dba79 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.250546:0:9397:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880087727a80/0xd895711d66dba72 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.250552:0:17199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330321.250554:0:17199:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330321.250556:0:17199:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091c5cfc0/0xd895711d66dba79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330321.250561:0:9398:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3690:x1798653942517312:12345-0@lo:6:osp-syn-1-0.0 Request processed in 156us (274us total) trans 4294969940 rc 0/0 00010000:00010000:1.0:1715330321.250563:0:17199:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091c5cfc0/0xd895711d66dba79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330321.250565:0:9398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5330 00010000:00010000:1.0:1715330321.250568:0:17199:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091c5cfc0/0xd895711d66dba79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.250572:0:17199:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091c5cfc0/0xd895711d66dba79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330321.250574:0:9398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5333 00000100:00100000:2.0:1715330321.250578:0:9398:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3688:x1798653942517504:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1715330321.250581:0:17199:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091c5cfc0/0xd895711d66dba79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330321.250585:0:17216:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+49:3688:x1798653942517184:12345-0@lo:6:osp-syn-1-0.0 Request processed in 188us (311us total) trans 4294969941 rc 0/0 00002000:00080000:2.0:1715330321.250585:0:9398:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2554 count 1 00010000:00010000:1.0:1715330321.250585:0:17199:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5cfc0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:1.0:1715330321.250587:0:17199:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091c5cfc0/0xd895711d66dba79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330321.250590:0:17216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5329 00002000:00010000:2.0:1715330321.250595:0:9398:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1715330321.250598:0:9398:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800938b7a80/0xd895711d66dba80 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.250604:0:9398:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330321.250605:0:9398:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330321.250607:0:9398:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800938b7a80/0xd895711d66dba80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330321.250609:0:9397:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+48:3688:x1798653942517248:12345-0@lo:6:osp-syn-1-0.0 Request processed in 141us (312us total) trans 4294969942 rc 0/0 00000004:00080000:3.0:1715330321.250610:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d4f8e00/2, rc 0, transno 2645 00010000:00010000:2.0:1715330321.250614:0:9398:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800938b7a80/0xd895711d66dba80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330321.250614:0:9397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5331 00000100:00100000:3.0:1715330321.250616:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942517184:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1715330321.250620:0:9398:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800938b7a80/0xd895711d66dba80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715330321.250624:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d4f9180/2, rc 0, transno 2646 00010000:00010000:2.0:1715330321.250625:0:9398:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800938b7a80/0xd895711d66dba80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330321.250627:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942517248:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1715330321.250630:0:9398:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800938b7a80/0xd895711d66dba80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330321.250633:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942517376:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1715330321.250635:0:9398:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b7a80 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330321.250637:0:9398:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800938b7a80/0xd895711d66dba80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.250643:0:9398:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800938b7a80/0xd895711d66dba80 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.250650:0:9398:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800938b7a80/0xd895711d66dba80 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330321.250654:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1715330321.250656:0:9398:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800938b7a80/0xd895711d66dba80 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330321.250663:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1715330321.250667:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942517568:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1715330321.250679:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330321.250691:0:17215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942517376 00010000:00010000:1.0:1715330321.250693:0:17199:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091c5cfc0/0xd895711d66dba79 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330321.250694:0:17215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942517376 00010000:00010000:1.0:1715330321.250703:0:17199:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091c5cfc0/0xd895711d66dba79 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330321.250703:0:17215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942517568 00000100:00100000:0.0:1715330321.250704:0:17215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942517568 00010000:00010000:1.0:1715330321.250708:0:17199:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091c5cfc0/0xd895711d66dba79 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330321.250711:0:17215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5334 00000100:00100000:0.0:1715330321.250715:0:17215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+50:3691:x1798653942517376:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1715330321.250721:0:9398:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+50:3688:x1798653942517504:12345-0@lo:6:osp-syn-1-0.0 Request processed in 143us (294us total) trans 4294969943 rc 0/0 00002000:00080000:0.0:1715330321.250723:0:17215:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2552 count 1 00000100:00100000:2.0:1715330321.250726:0:9398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5333 00002000:00010000:0.0:1715330321.250748:0:17215:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1715330321.250749:0:9398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5335 00010000:00010000:0.0:1715330321.250751:0:17215:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880087724900/0xd895711d66dba87 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330321.250752:0:9398:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+50:3691:x1798653942517568:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1715330321.250757:0:17215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330321.250758:0:17215:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00002000:00080000:2.0:1715330321.250760:0:9398:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2555 count 1 00010000:00010000:0.0:1715330321.250761:0:17215:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880087724900/0xd895711d66dba87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.250767:0:17215:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880087724900/0xd895711d66dba87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1715330321.250768:0:9398:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1715330321.250771:0:9398:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800938b7840/0xd895711d66dba8e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.250773:0:17215:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880087724900/0xd895711d66dba87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.250776:0:9398:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330321.250777:0:9398:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330321.250778:0:17215:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880087724900/0xd895711d66dba87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.250780:0:9398:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800938b7840/0xd895711d66dba8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.250783:0:17215:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880087724900/0xd895711d66dba87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.250785:0:9398:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800938b7840/0xd895711d66dba8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.250787:0:17215:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087724900 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330321.250790:0:17215:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880087724900/0xd895711d66dba87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.250791:0:9398:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800938b7840/0xd895711d66dba8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.250796:0:9398:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800938b7840/0xd895711d66dba8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.250796:0:17215:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880087724900/0xd895711d66dba87 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330321.250797:0:17199:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+50:3688:x1798653942517440:12345-0@lo:6:osp-syn-1-0.0 Request processed in 271us (392us total) trans 4294969944 rc 0/0 00000100:00100000:1.0:1715330321.250802:0:17199:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5332 00010000:00010000:0.0:1715330321.250803:0:17215:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880087724900/0xd895711d66dba87 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.250806:0:9398:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800938b7840/0xd895711d66dba8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.250808:0:17215:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880087724900/0xd895711d66dba87 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330321.250810:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942517696:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1715330321.250810:0:9398:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b7840 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330321.250812:0:9398:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800938b7840/0xd895711d66dba8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.250817:0:9398:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800938b7840/0xd895711d66dba8e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.250824:0:9398:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800938b7840/0xd895711d66dba8e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330321.250828:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1715330321.250829:0:9398:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800938b7840/0xd895711d66dba8e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330321.250848:0:17200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942517696 00000004:00080000:3.0:1715330321.250850:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d4fa680/2, rc 0, transno 2647 00000100:00100000:1.0:1715330321.250852:0:17200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942517696 00000100:00100000:3.0:1715330321.250854:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942517504:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1715330321.250861:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d4fa300/2, rc 0, transno 2648 00000100:00100000:3.0:1715330321.250863:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942517440:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1715330321.250864:0:17200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5336 00000100:00100000:1.0:1715330321.250867:0:17200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+52:3688:x1798653942517696:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1715330321.250871:0:17215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+52:3691:x1798653942517376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 155us (216us total) trans 4294969945 rc 0/0 00002000:00080000:1.0:1715330321.250876:0:17200:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2557 count 1 00000100:00100000:0.0:1715330321.250877:0:17215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5334 00000100:00100000:2.0:1715330321.250880:0:9398:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+52:3691:x1798653942517568:12345-0@lo:6:osp-syn-1-0.0 Request processed in 127us (200us total) trans 4294969946 rc 0/0 00000100:00100000:2.0:1715330321.250884:0:9398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5335 00002000:00010000:1.0:1715330321.250887:0:17200:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1715330321.250889:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942517760:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1715330321.250890:0:17200:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091c5c000/0xd895711d66dba95 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330321.250893:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942517824:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1715330321.250896:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330321.250897:0:17200:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330321.250900:0:17200:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091c5c000/0xd895711d66dba95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330321.250904:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1715330321.250906:0:17200:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091c5c000/0xd895711d66dba95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.250922:0:17200:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091c5c000/0xd895711d66dba95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330321.250928:0:17200:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091c5c000/0xd895711d66dba95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330321.250929:0:12304:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942517760 00000100:00100000:3.0:1715330321.250930:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330321.250932:0:12304:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942517760 00010000:00010000:1.0:1715330321.250933:0:17200:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091c5c000/0xd895711d66dba95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330321.250937:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942517824 00010000:00010000:1.0:1715330321.250938:0:17200:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5c000 already unused, calling callback (ffffffffa07e2af0) 00000100:00100000:0.0:1715330321.250939:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942517824 00010000:00010000:1.0:1715330321.250940:0:17200:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091c5c000/0xd895711d66dba95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330321.250944:0:12304:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5337 00000004:00080000:3.0:1715330321.250945:0:3690:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d4f9500/2, rc 0, transno 2644 00010000:00010000:1.0:1715330321.250946:0:17200:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091c5c000/0xd895711d66dba95 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330321.250947:0:12304:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+52:3689:x1798653942517760:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1715330321.250948:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942517312:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1715330321.250950:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5338 00000100:00100000:0.0:1715330321.250953:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+52:3690:x1798653942517824:12345-0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1715330321.250954:0:3690:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d4f8a80/2, rc 0, transno 2643 00002000:00080000:2.0:1715330321.250955:0:12304:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2558 count 1 00010000:00010000:1.0:1715330321.250955:0:17200:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091c5c000/0xd895711d66dba95 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330321.250956:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942517120:0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1715330321.250959:0:9633:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2559 count 1 00000100:00100000:3.0:1715330321.250961:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1715330321.250964:0:17200:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091c5c000/0xd895711d66dba95 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330321.250965:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942517632:0@lo:6:osp-syn-1-0.0 00002000:00010000:2.0:1715330321.250965:0:12304:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1715330321.250966:0:9633:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1715330321.250969:0:12304:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800938b6f40/0xd895711d66dba9c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.250969:0:9633:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880087727cc0/0xd895711d66dbaa3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.250975:0:12304:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330321.250975:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330321.250976:0:12304:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330321.250976:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1715330321.250978:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1715330321.250978:0:12304:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800938b6f40/0xd895711d66dba9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.250978:0:9633:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880087727cc0/0xd895711d66dbaa3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.250985:0:12304:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800938b6f40/0xd895711d66dba9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.250985:0:9633:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880087727cc0/0xd895711d66dbaa3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330321.250991:0:17197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942517632 00010000:00010000:2.0:1715330321.250991:0:12304:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800938b6f40/0xd895711d66dba9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.250991:0:9633:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880087727cc0/0xd895711d66dbaa3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330321.250994:0:17197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942517632 00010000:00010000:2.0:1715330321.250996:0:12304:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800938b6f40/0xd895711d66dba9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.250996:0:9633:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880087727cc0/0xd895711d66dbaa3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.251001:0:12304:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800938b6f40/0xd895711d66dba9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.251001:0:9633:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880087727cc0/0xd895711d66dbaa3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330321.251006:0:12304:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b6f40 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330321.251006:0:9633:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087727cc0 already unused, calling callback (ffffffffa07e2af0) 00000100:00100000:3.0:1715330321.251007:0:17197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5339 00010000:00010000:2.0:1715330321.251008:0:12304:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800938b6f40/0xd895711d66dba9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.251008:0:9633:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880087727cc0/0xd895711d66dbaa3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330321.251010:0:17197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+54:3690:x1798653942517632:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1715330321.251014:0:12304:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800938b6f40/0xd895711d66dba9c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.251014:0:9633:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880087727cc0/0xd895711d66dbaa3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1715330321.251021:0:17197:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2556 count 1 00010000:00010000:2.0:1715330321.251021:0:12304:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800938b6f40/0xd895711d66dba9c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.251021:0:9633:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880087727cc0/0xd895711d66dbaa3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330321.251026:0:9633:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880087727cc0/0xd895711d66dbaa3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1715330321.251031:0:17197:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0x9fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1715330321.251031:0:12304:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800938b6f40/0xd895711d66dba9c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12304 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.251034:0:17197:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011da82400/0xd895711d66dbaaa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330321.251036:0:17200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+54:3688:x1798653942517696:12345-0@lo:6:osp-syn-1-0.0 Request processed in 167us (207us total) trans 4294969947 rc 0/0 00010000:00010000:3.0:1715330321.251040:0:17197:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1715330321.251041:0:17200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5336 00010000:00010000:3.0:1715330321.251042:0:17197:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330321.251044:0:17197:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011da82400/0xd895711d66dbaaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.251052:0:17197:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011da82400/0xd895711d66dbaaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.251058:0:17197:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011da82400/0xd895711d66dbaaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.251063:0:17197:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88011da82400/0xd895711d66dbaaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.251067:0:17197:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88011da82400/0xd895711d66dbaaa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.251072:0:17197:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da82400 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:3.0:1715330321.251075:0:17197:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88011da82400/0xd895711d66dbaaa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.251081:0:17197:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88011da82400/0xd895711d66dbaaa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.251088:0:17197:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88011da82400/0xd895711d66dbaaa lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330321.251094:0:17197:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011da82400/0xd895711d66dbaaa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330321.251098:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+55:3690:x1798653942517824:12345-0@lo:6:osp-syn-1-0.0 Request processed in 143us (167us total) trans 4294969948 rc 0/0 00000100:00100000:0.0:1715330321.251103:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5338 00000100:00100000:2.0:1715330321.251107:0:12304:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+55:3689:x1798653942517760:12345-0@lo:6:osp-syn-1-0.0 Request processed in 159us (203us total) trans 4294969949 rc 0/0 00000100:00100000:2.0:1715330321.251111:0:12304:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5337 00000004:00080000:0.0:1715330321.251122:0:3691:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d4faa00/2, rc 0, transno 2650 00000004:00080000:2.0:1715330321.251123:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d48f100/2, rc 0, transno 2653 00000100:00100000:0.0:1715330321.251125:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942517568:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1715330321.251126:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942517760:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1715330321.251131:0:3691:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d4f9f80/2, rc 0, transno 2649 00000100:00100000:0.0:1715330321.251133:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942517376:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1715330321.251167:0:17197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+54:3690:x1798653942517632:12345-0@lo:6:osp-syn-1-0.0 Request processed in 155us (187us total) trans 4294969950 rc 0/0 00000100:00100000:3.0:1715330321.251172:0:17197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5339 00000004:00080000:3.0:1715330321.251189:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d48c700/2, rc 0, transno 2651 00000100:00100000:3.0:1715330321.251192:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942517696:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1715330321.251202:0:3690:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d48e300/2, rc 0, transno 2654 00000100:00100000:3.0:1715330321.251204:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942517632:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1715330321.251209:0:3690:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d48f480/2, rc 0, transno 2652 00000100:00100000:3.0:1715330321.251212:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942517824:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1715330321.603147:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3688:1798653942517952:0@lo:400:kworker.0 00000100:00100000:3.0:1715330321.603204:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330321.603204:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3691:1798653942517888:0@lo:400:kworker.0 00000100:00100000:3.0:1715330321.603223:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3688:1798653942518208:0@lo:400:kworker.0 00000100:00100000:0.0:1715330321.603236:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330321.603239:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330321.603249:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3688:1798653942518464:0@lo:400:kworker.0 00000100:00100000:0.0:1715330321.603262:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942518144:0@lo:400:kworker.0 00000100:00100000:3.0:1715330321.603263:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330321.603283:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330321.603303:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1715330321.603308:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942518016:0@lo:400:kworker.0 00000100:00100000:0.0:1715330321.603315:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093a8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942518400:0@lo:400:kworker.0 00000100:00100000:3.0:1715330321.603325:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330321.603334:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3688:1798653942518272:0@lo:400:kworker.0 00000100:00100000:0.0:1715330321.603344:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330321.603345:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330321.603352:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3688:1798653942518528:0@lo:400:kworker.0 00000100:00100000:0.0:1715330321.603359:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942518656:0@lo:400:kworker.0 00000100:00100000:3.0:1715330321.603363:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330321.603375:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330321.603382:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942517952 00000100:00100000:3.0:1715330321.603386:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942517952 00000100:00100000:0.0:1715330321.603387:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1715330321.603391:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3691:1798653942518080:0@lo:400:kworker.0 00000100:00100000:0.0:1715330321.603405:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330321.603413:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942518208 00000100:00100000:0.0:1715330321.603413:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093a8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942518336:0@lo:400:kworker.0 00000100:00100000:3.0:1715330321.603415:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942518208 00000100:00100000:0.0:1715330321.603425:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330321.603428:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942518464 00000100:00100000:3.0:1715330321.603430:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942518464 00000100:00100000:0.0:1715330321.603434:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942518592:0@lo:400:kworker.0 00000100:00100000:3.0:1715330321.603436:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942518272 00000100:00100000:3.0:1715330321.603438:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942518272 00000100:00100000:3.0:1715330321.603445:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942518528 00000100:00100000:3.0:1715330321.603446:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942518528 00000100:00100000:0.0:1715330321.603446:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330321.603452:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942518080 00000100:00100000:3.0:1715330321.603453:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942518080 00000100:00100000:3.0:1715330321.603461:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1715330321.603466:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3688:x1798653942517952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330321.603466:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1715330321.603471:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1798653942518208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330321.603502:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1798653942518208:12345-0@lo:400:kworker.0 Request processed in 31us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330321.603508:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1715330321.603522:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1715330321.603525:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3688:x1798653942518464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330321.603527:0:7129:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942517888 00000100:00100000:1.0:1715330321.603532:0:7129:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942517888 00000100:00100000:2.0:1715330321.603548:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1715330321.603551:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1715330321.603553:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3688:x1798653942518272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330321.603555:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007666f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3691:x1798653942517888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330321.603582:0:7129:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007666f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3691:x1798653942517888:12345-0@lo:400:kworker.0 Request processed in 26us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330321.603586:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1715330321.603603:0:7139:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942518144 00000100:00100000:1.0:1715330321.603605:0:7139:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942518144 00000100:00100000:1.0:1715330321.603616:0:7139:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942518016 00000100:00100000:1.0:1715330321.603618:0:7139:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942518016 00000100:00100000:3.0:1715330321.603619:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3688:x1798653942517952:12345-0@lo:400:kworker.0 Request processed in 151us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330321.603624:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1715330321.603627:0:7139:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3050 00000100:00100000:1.0:1715330321.603630:0:7139:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942518144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330321.603634:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1715330321.603638:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3688:x1798653942518528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330321.603646:0:7139:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942518144:12345-0@lo:400:kworker.0 Request processed in 16us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330321.603650:0:7139:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3050 00000100:00100000:1.0:1715330321.603656:0:7139:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3051 00000100:00100000:1.0:1715330321.603659:0:7139:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942518016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330321.603667:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3688:x1798653942518528:12345-0@lo:400:kworker.0 Request processed in 28us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330321.603672:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1715330321.603672:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3688:x1798653942518464:12345-0@lo:400:kworker.0 Request processed in 146us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330321.603674:0:7139:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942518016:12345-0@lo:400:kworker.0 Request processed in 14us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330321.603678:0:7139:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3051 00000100:00100000:0.0:1715330321.603678:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1715330321.603681:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1715330321.603684:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b318700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3691:x1798653942518080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330321.603696:0:9398:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942518400 00000100:00100000:0.0:1715330321.603698:0:9398:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942518400 00000100:00100000:1.0:1715330321.603701:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3691:1798653942517888:0@lo:400:kworker.0 00000100:00100000:3.0:1715330321.603705:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b318700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3691:x1798653942518080:12345-0@lo:400:kworker.0 Request processed in 20us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330321.603710:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1715330321.603710:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942518144:0@lo:400:kworker.0 00000100:00100000:0.0:1715330321.603714:0:9398:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942518656 00000100:00100000:0.0:1715330321.603716:0:9398:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942518656 00000100:00100000:0.0:1715330321.603724:0:9398:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942518336 00000100:00100000:3.0:1715330321.603726:0:17197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942518592 00000100:00100000:1.0:1715330321.603726:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3691:1798653942518080:0@lo:400:kworker.0 00000100:00100000:0.0:1715330321.603726:0:9398:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942518336 00000100:00100000:3.0:1715330321.603746:0:17197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942518592 00000100:00100000:0.0:1715330321.603747:0:9398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1715330321.603750:0:9398:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b318000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942518400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330321.603764:0:17197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1715330321.603769:0:17197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b318380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+54:3691:x1798653942518656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330321.603769:0:17198:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1715330321.603773:0:9398:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b318000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942518400:12345-0@lo:400:kworker.0 Request processed in 22us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330321.603777:0:9398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1715330321.603784:0:9398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1715330321.603787:0:9398:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b318e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942518592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330321.603791:0:17197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b318380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+54:3691:x1798653942518656:12345-0@lo:400:kworker.0 Request processed in 22us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330321.603796:0:17197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1715330321.603800:0:9398:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b318e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942518592:12345-0@lo:400:kworker.0 Request processed in 12us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330321.603804:0:9398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00080000:3.0:1715330321.603807:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330291 00000100:00080000:3.0:1715330321.603810:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330291 00000100:00080000:3.0:1715330321.603812:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330291 00000100:00080000:3.0:1715330321.603813:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330291 00000100:00100000:3.0:1715330321.603828:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942518016:0@lo:400:kworker.0 00000100:00100000:1.0:1715330321.603836:0:17198:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b318a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942518336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330321.603862:0:17198:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b318a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942518336:12345-0@lo:400:kworker.0 Request processed in 88us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330321.603867:0:17198:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1715330321.603876:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3688:x1798653942518272:12345-0@lo:400:kworker.0 Request processed in 322us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330321.603881:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1715330321.603886:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093a8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942518336:0@lo:400:kworker.0 00000100:00100000:1.0:1715330321.603894:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942518592:0@lo:400:kworker.0 00000100:00100000:1.0:1715330321.603900:0:3691:0:(client.c:2956:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969949 gen 2 00000004:00080000:1.0:1715330321.603904:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d4e9180, transno 4294969910 00000004:00080000:1.0:1715330321.603934:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d4eaa00, transno 4294969911 00000004:00080000:1.0:1715330321.603936:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d4eb480, transno 4294969912 00000004:00080000:1.0:1715330321.603938:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007d634700, transno 4294969913 00000004:00080000:1.0:1715330321.603940:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007d635500, transno 4294969914 00000100:00100000:3.0:1715330321.603942:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3688:1798653942518272:0@lo:400:kworker.0 00000004:00080000:1.0:1715330321.603942:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fa4d880, transno 4294969915 00000004:00080000:1.0:1715330321.603944:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007d62a680, transno 4294969916 00000004:00080000:1.0:1715330321.603946:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fa4e300, transno 4294969917 00000004:00080000:1.0:1715330321.603947:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fa4d180, transno 4294969918 00000004:00080000:1.0:1715330321.603949:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fa4ce00, transno 4294969919 00000004:00080000:1.0:1715330321.603951:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fa4fb80, transno 4294969920 00000004:00080000:1.0:1715330321.603953:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fa4dc00, transno 4294969921 00000004:00080000:1.0:1715330321.603955:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f57a300, transno 4294969922 00000004:00080000:1.0:1715330321.603957:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f57bb80, transno 4294969923 00000100:00100000:3.0:1715330321.603958:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3688:1798653942518528:0@lo:400:kworker.0 00000004:00080000:1.0:1715330321.603959:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f57b100, transno 4294969924 00000004:00080000:1.0:1715330321.603961:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f579c00, transno 4294969925 00000004:00080000:1.0:1715330321.603964:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f578000, transno 4294969926 00000004:00080000:1.0:1715330321.603966:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d4ea680, transno 4294969927 00000004:00080000:1.0:1715330321.603967:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d4e8e00, transno 4294969928 00000100:00100000:3.0:1715330321.603968:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3688:1798653942517952:0@lo:400:kworker.0 00000004:00080000:1.0:1715330321.603969:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008b0c3100, transno 4294969929 00000004:00080000:1.0:1715330321.603971:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d4ead80, transno 4294969930 00000004:00080000:1.0:1715330321.603973:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008b0c1180, transno 4294969931 00000004:00080000:1.0:1715330321.603975:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d4e9500, transno 4294969932 00000004:00080000:1.0:1715330321.603977:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d4ebb80, transno 4294969933 00000100:00100000:3.0:1715330321.603979:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3688:1798653942518208:0@lo:400:kworker.0 00000004:00080000:1.0:1715330321.603979:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008b0c1c00, transno 4294969934 00000004:00080000:1.0:1715330321.603981:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f579500, transno 4294969935 00000004:00080000:1.0:1715330321.603983:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f57aa00, transno 4294969936 00000004:00080000:1.0:1715330321.603985:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880093b5a680, transno 4294969937 00000004:00080000:1.0:1715330321.603987:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880093b59c00, transno 4294969938 00000100:00100000:3.0:1715330321.603989:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3688:1798653942518464:0@lo:400:kworker.0 00000004:00080000:1.0:1715330321.603989:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880093b5ad80, transno 4294969939 00000004:00080000:1.0:1715330321.603991:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880093b59500, transno 4294969940 00000004:00080000:1.0:1715330321.603993:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880093b5b100, transno 4294969941 00000004:00080000:1.0:1715330321.603995:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880093b59f80, transno 4294969942 00000004:00080000:1.0:1715330321.603997:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880093b58380, transno 4294969943 00000004:00080000:1.0:1715330321.603999:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880093b59880, transno 4294969944 00000004:00080000:1.0:1715330321.604000:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880093b58e00, transno 4294969945 00000004:00080000:1.0:1715330321.604002:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880093b5bb80, transno 4294969946 00000004:00080000:1.0:1715330321.604004:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880093b58a80, transno 4294969947 00000004:00080000:1.0:1715330321.604005:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880093b5a300, transno 4294969948 00000004:00080000:1.0:1715330321.604007:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880093b5aa00, transno 4294969949 00000100:00100000:1.0:1715330321.604010:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093a8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942518400:0@lo:400:kworker.0 00000100:00100000:1.0:1715330321.604022:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942518656:0@lo:400:kworker.0 00000004:00080000:2.0:1715330321.604218:0:9629:0:(osp_sync.c:1105:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 40 done 00000100:00100000:3.0:1715330321.620064:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1715330321.620083:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b319180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942518720:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1715330321.620136:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330321.620636:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942518720 00000100:00100000:0.0:1715330321.620642:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942518720 00000100:00100000:0.0:1715330321.620672:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1715330321.620679:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942518720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1715330321.620707:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 67507904 pending 0 free 3923546112 avail 3692023808 00000100:00100000:0.0:1715330321.620770:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942518720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330321.620775:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1715330321.620847:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b319180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942518720:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1715330321.635574:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1715330321.635593:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942518784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1715330321.635652:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330321.635689:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942518784 00000100:00100000:3.0:1715330321.635694:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942518784 00000100:00100000:3.0:1715330321.635761:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1715330321.635767:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+54:3688:x1798653942518784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1715330321.635790:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 67507904 pending 0 free 3923546112 avail 3692023808 00000100:00100000:3.0:1715330321.635822:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+54:3688:x1798653942518784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330321.635837:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1715330321.635870:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942518784:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1715330322.236083:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330323.043138:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1715330323.043154:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b319500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942518848:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1715330323.043205:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330323.043236:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942518848 00000100:00100000:0.0:1715330323.043242:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942518848 00000100:00100000:0.0:1715330323.043316:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3052 00000100:00100000:0.0:1715330323.043322:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b319880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:3691:x1798653942518848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1715330323.043351:0:7138:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444089856 avail 1314627584 00000100:00100000:0.0:1715330323.043382:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b319880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:3691:x1798653942518848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330323.043388:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3052 00000100:00100000:0.0:1715330323.043417:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b319500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942518848:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1715330323.136691:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330323.143162:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330323.143209:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330323.143226:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330323.143250:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330323.143281:0:12304:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938112256 00000100:00100000:0.0:1715330323.143289:0:12304:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938112256 00000100:00100000:0.0:1715330323.143331:0:12304:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938112320 00000100:00100000:0.0:1715330323.143333:0:12304:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938112320 00000100:00100000:0.0:1715330323.143351:0:12304:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 213 00000100:00100000:0.0:1715330323.143359:0:12304:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b319c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:72de1896-1df4-4b3a-930a-9116d2c66168+7:2014:x1798653938112256:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:0.0:1715330323.143429:0:12304:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b319c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:72de1896-1df4-4b3a-930a-9116d2c66168+7:2014:x1798653938112256:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 71us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330323.143436:0:12304:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 213 00000100:00100000:0.0:1715330323.143451:0:12304:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 214 00000100:00100000:0.0:1715330323.143454:0:12304:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b31a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938112320:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:0.0:1715330323.143472:0:12304:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b31a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938112320:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 17us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330323.143477:0:12304:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 214 00000100:00080000:3.0:1715330323.143994:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330293 00000100:00080000:3.0:1715330323.143998:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330293 00000100:00100000:3.0:1715330323.144072:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938112128 00000100:00100000:3.0:1715330323.144076:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938112128 00000100:00100000:3.0:1715330323.144099:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938112192 00000100:00100000:3.0:1715330323.144102:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938112192 00000100:00100000:3.0:1715330323.144115:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 298 00000100:00100000:3.0:1715330323.144119:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b319500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+11:2014:x1798653938112128:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:3.0:1715330323.144146:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b319500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+11:2014:x1798653938112128:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 26us (7463us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330323.144151:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 298 00000100:00100000:3.0:1715330323.144161:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 299 00000100:00100000:3.0:1715330323.144164:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b319f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938112192:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:3.0:1715330323.144177:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b319f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938112192:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 13us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330323.144182:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 299 00000100:00080000:3.0:1715330323.144192:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330293 00000100:00080000:3.0:1715330323.144194:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330293 00000100:00100000:2.0:1715330323.149771:0:7130:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938112064 00000100:00100000:2.0:1715330323.149781:0:7130:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938112064 00000100:00100000:2.0:1715330323.149817:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 343 00000100:00100000:2.0:1715330323.149823:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007666f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2014:x1798653938112064:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:2.0:1715330323.149892:0:7130:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007666f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2014:x1798653938112064:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 56us (6669us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330323.149898:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 343 00000100:00080000:2.0:1715330323.149927:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330293 00010000:00010000:1.0:1715330323.238984:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330324.242957:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330324.499820:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1715330324.499840:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d646a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942518912:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1715330324.499915:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330324.499957:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942518912 00000100:00100000:3.0:1715330324.499968:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942518912 00000100:00100000:3.0:1715330324.500018:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3053 00000100:00100000:3.0:1715330324.500024:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942518912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1715330324.500058:0:8592:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445060608 avail 1315598336 00000100:00100000:3.0:1715330324.500100:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942518912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330324.500108:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3053 00000100:00100000:3.0:1715330324.500154:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d646a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942518912:0@lo:41:osp-pre-1-0.0 00000001:02000400:3.0:1715330324.847464:0:30018:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 61a: mmap() writes don't make sync hang ========================================================================== 04:38:44 (1715330324) 00000100:00100000:0.0:1715330324.888217:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330324.888344:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938112448 00000100:00100000:3.0:1715330324.888352:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938112448 00000100:00100000:3.0:1715330324.888390:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23802 00000100:00100000:3.0:1715330324.888396:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b31a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+11:19414:x1798653938112448:12345-192.168.204.49@tcp:101:dd.0 00010000:00010000:3.0:1715330324.888413:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330324.888417:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1715330324.888442:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db66640/0xd895711d66d9f36 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb5c expref: 11 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330324.888455:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:3.0:1715330324.888458:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330324.888496:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83cc0/0xd895711d66dbab1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbe26 expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330324.888924:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82f40/0xd895711d66dbab8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330324.888936:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82f40/0xd895711d66dbab8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330324.888944:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82f40/0xd895711d66dbab8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330324.888973:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80d80/0xd895711d66dbabf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x313666 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330324.888978:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80d80/0xd895711d66dbabf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x313666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330324.888983:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80d80/0xd895711d66dbabf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x313666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00080000:3.0:1715330324.889224:0:7133:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa00:0x0], index 0: 0 00010000:00010000:3.0:1715330324.889341:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da821c0/0xd895711d66dbac6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x158f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330324.889347:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da821c0/0xd895711d66dbac6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330324.889356:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da821c0/0xd895711d66dbac6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330324.889379:0:7133:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82f40/0xd895711d66dbab8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330324.889384:0:7133:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82f40/0xd895711d66dbab8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330324.889388:0:7133:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82f40/0xd895711d66dbab8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330324.889392:0:7133:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82f40/0xd895711d66dbab8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330324.889397:0:7133:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da82f40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330324.889399:0:7133:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82f40/0xd895711d66dbab8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330324.889403:0:7133:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82f40/0xd895711d66dbab8 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330324.889409:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:3.0:1715330324.889411:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330324.889414:0:7133:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82f40/0xd895711d66dbab8 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330324.889418:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82f40/0xd895711d66dbab8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000004:00010000:3.0:1715330324.889426:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008b31a680 reply state ffff88009d6e0000 transno 4294984065 ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80d80/0xd895711d66dbabf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x313666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330324.889432:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80d80/0xd895711d66dbabf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x313666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330324.889437:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x313666 (ffff8800b4207500) 00010000:00010000:3.0:1715330324.889439:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330324.889441:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330324.889457:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83cc0/0xd895711d66dbab1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe26 expref: 13 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330324.889466:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da821c0/0xd895711d66dbac6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x158f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe26 expref: 12 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330324.889471:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158f:0x0].0x0 (ffff8800b4207c00) 00010000:00010000:3.0:1715330324.889473:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330324.889474:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011da821c0, rc 0) 00000100:00100000:3.0:1715330324.889530:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b31a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+13:19414:x1798653938112448:12345-192.168.204.49@tcp:101:dd.0 Request processed in 1134us (1325us total) trans 4294984065 rc 0/0 00000100:00100000:3.0:1715330324.889536:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23802 00000100:00100000:3.0:1715330324.893125:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330324.893168:0:17198:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938112512 00000100:00100000:3.0:1715330324.893178:0:17198:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938112512 00000100:00100000:3.0:1715330324.893217:0:17198:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5340 00000100:00100000:3.0:1715330324.893224:0:17198:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:72de1896-1df4-4b3a-930a-9116d2c66168+7:19414:x1798653938112512:12345-192.168.204.49@tcp:101:dd.0 00010000:00010000:3.0:1715330324.893243:0:17198:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330324.893265:0:17198:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011da82d00/0xd895711d66dbad4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbe2d expref: -99 pid: 17198 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1715330324.893287:0:17198:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0xa00:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1715330324.893304:0:17198:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330324.893307:0:17198:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330324.893317:0:17198:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011da82d00/0xd895711d66dbad4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe2d expref: 8 pid: 17198 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330324.893332:0:17198:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011da82d00/0xd895711d66dbad4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe2d expref: 8 pid: 17198 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330324.893341:0:17198:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011da82d00, rc 0) 00000100:00100000:3.0:1715330324.893383:0:17198:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:72de1896-1df4-4b3a-930a-9116d2c66168+8:19414:x1798653938112512:12345-192.168.204.49@tcp:101:dd.0 Request processed in 158us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330324.893389:0:17198:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5340 00000100:00100000:0.0:1715330324.897482:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330324.897575:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938112640 00000100:00100000:3.0:1715330324.897583:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938112640 00000100:00100000:1.0:1715330324.898856:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5207 00000100:00100000:1.0:1715330324.898864:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b31aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+13:19414:x1798653938112640:12345-192.168.204.49@tcp:35:dd.0 00000100:00100000:1.0:1715330324.899883:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b31aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+14:19414:x1798653938112640:12345-192.168.204.49@tcp:35:dd.0 Request processed in 222us (1613us total) trans 4294984066 rc 0/0 00000100:00100000:1.0:1715330324.899891:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5207 00000100:00100000:0.0:1715330324.907697:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330324.907755:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330324.907780:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938112768 00000100:00100000:0.0:1715330324.907786:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938112768 00000100:00100000:0.0:1715330324.907826:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1419 00000100:00100000:0.0:1715330324.907832:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b31b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:72de1896-1df4-4b3a-930a-9116d2c66168+6:5380:x1798653938112768:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1715330324.907844:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1715330324.907870:0:10674:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0x9c7:0x0] updating lvb size from disk: 0 -> 2 00002000:00010000:0.0:1715330324.907873:0:10674:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x9c7:0x0] updating lvb mtime from disk: 0 -> 1715330235 00002000:00010000:0.0:1715330324.907875:0:10674:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000401:0x9c7:0x0] updating lvb atime from disk: 0 -> 1715330235 00002000:00010000:0.0:1715330324.907877:0:10674:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0x9c7:0x0] updating lvb ctime from disk: 0 -> 1715330235 00002000:00010000:0.0:1715330324.907878:0:10674:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0x9c7:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1715330324.907906:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011db658c0/0xd895711d66c51cf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bf7bc2 expref: 6 pid: 17197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330324.907933:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330324.907969:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b31b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:72de1896-1df4-4b3a-930a-9116d2c66168+5:5380:x1798653938112768:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 137us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330324.907976:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1419 00000100:00100000:3.0:1715330324.908125:0:9403:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938112704 00000100:00100000:3.0:1715330324.908129:0:9403:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938112704 00002000:00100000:3.0:1715330324.908154:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa00:0x0] (0->4095) req@ffff88008b31ad80 x1798653938112704/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:535/0 lens 4584/0 e 0 to 0 dl 1715330335 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330324.908161:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b31ad80 with x1798653938112704 ext(0->4095) 00002000:00010000:3.0:1715330324.908165:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008b31ad80 00000100:00100000:3.0:1715330324.908176:0:9403:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 14 00000100:00100000:3.0:1715330324.908180:0:9403:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b31ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+8:2013:x1798653938112704:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330324.908815:0:9403:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b31ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+10:2013:x1798653938112704:12345-192.168.204.49@tcp:4:dd.0 Request processed in 632us (1122us total) trans 4294969950 rc 0/0 00000100:00100000:0.0:1715330324.908822:0:9403:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 14 00002000:00100000:0.0:1715330324.908828:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa00:0x0] (0->4095) req@ffff88008b31ad80 x1798653938112704/t4294969950(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:535/0 lens 4584/448 e 0 to 0 dl 1715330335 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330324.908834:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b31ad80 with x1798653938112704 ext(0->4095) 00002000:00010000:0.0:1715330324.908837:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008b31ad80 00000100:00100000:2.0:1715330324.918690:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330324.918759:0:10673:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938112832 00000100:00100000:3.0:1715330324.918767:0:10673:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938112832 00000100:00100000:3.0:1715330324.918802:0:10673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1420 00000100:00100000:3.0:1715330324.918808:0:10673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:72de1896-1df4-4b3a-930a-9116d2c66168+10:15864:x1798653938112832:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1715330324.918820:0:10673:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00002000:00010000:3.0:1715330324.918836:0:10673:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:3.0:1715330324.918839:0:10673:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb mtime from disk: 0 -> 1715330325 00002000:00010000:3.0:1715330324.918842:0:10673:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb ctime from disk: 0 -> 1715330325 00002000:00010000:3.0:1715330324.918843:0:10673:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1715330324.919028:0:10673:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011da82d00/0xd895711d66dbad4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe2d expref: 10 pid: 17198 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330324.919057:0:10673:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011db65680/0xd895711d66c50ef lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bf7b8a expref: 9 pid: 17200 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1715330324.919070:0:10673:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 33875 00002000:00010000:3.0:1715330324.919072:0:10673:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1715330162 00002000:00010000:3.0:1715330324.919074:0:10673:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1715330162 00002000:00010000:3.0:1715330324.919076:0:10673:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 72 00010000:00010000:3.0:1715330324.919082:0:10673:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d7a0240/0xd895711d664d66f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bde138 expref: 8 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330324.919093:0:10673:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715330324.919239:0:10673:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:72de1896-1df4-4b3a-930a-9116d2c66168+7:15864:x1798653938112832:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 429us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330324.919246:0:10673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1420 00000100:00100000:0.0:1715330324.967218:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330324.967311:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938112896 00000100:00100000:3.0:1715330324.967324:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938112896 00000100:00100000:3.0:1715330324.967379:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23803 00000100:00100000:3.0:1715330324.967385:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b31b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+14:19420:x1798653938112896:12345-192.168.204.49@tcp:101:multiop.0 00010000:00010000:3.0:1715330324.967406:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330324.967424:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82d00/0xd895711d66dbadb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbe34 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330324.967474:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da806c0/0xd895711d66dbae2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330324.967486:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da806c0/0xd895711d66dbae2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330324.967495:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da806c0/0xd895711d66dbae2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000004:00200000:3.0:1715330324.967525:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 270336 00000004:00200000:3.0:1715330324.967528:0:7134:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1715330324.967554:0:7134:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88011da806c0/0xd895711d66dbae2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330324.967571:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82d00/0xd895711d66dbadb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe34 expref: 16 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330324.967602:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da806c0/0xd895711d66dbae2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe34 expref: 15 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330324.967609:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:3.0:1715330324.967611:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1715330324.967614:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011da806c0, rc 0) 00000100:00100000:3.0:1715330324.967669:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b31b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+15:19420:x1798653938112896:12345-192.168.204.49@tcp:101:multiop.0 Request processed in 283us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330324.967674:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23803 00000100:00100000:0.0:1715330324.971161:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330324.971403:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938113024 00000100:00100000:2.0:1715330324.971418:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938113024 00000100:00100000:2.0:1715330324.971678:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23804 00000100:00100000:2.0:1715330324.971688:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b31b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+15:19420:x1798653938113024:12345-192.168.204.49@tcp:101:multiop.0 00010000:00010000:2.0:1715330324.971829:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330324.971833:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1715330324.971879:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da806c0/0xd895711d66dbae2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe34 expref: 15 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330324.971909:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:2.0:1715330324.971913:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330324.971930:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6f40/0xd895711d66dbae9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbe3b expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330324.972054:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66dbaf0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x158f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330324.972069:0:7133:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da821c0/0xd895711d66dbac6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x158f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe26 expref: 15 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330324.972076:0:7133:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66dbaf0 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x158f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330324.972114:0:7133:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011da821c0/0xd895711d66dbac6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x158f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe26 expref: 15 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330324.972127:0:7133:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da821c0/0xd895711d66dbac6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x158f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe26 expref: 15 pid: 7133 timeout: 399 lvb_type: 0 00000100:00100000:2.0:1715330324.972141:0:7133:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f57bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7133:1798653942518976:192.168.204.49@tcp:104: 00000100:00100000:2.0:1715330324.972996:0:7133:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008b04c600 going to sleep for 11 seconds 00000100:00100000:0.0:1715330324.975247:0:7133:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f57bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7133:1798653942518976:192.168.204.49@tcp:104: 00010000:00010000:0.0:1715330324.975268:0:7133:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66dbaf0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x158f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330324.976887:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330324.976947:0:10673:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938113088 00000100:00100000:3.0:1715330324.976954:0:10673:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938113088 00010000:00010000:3.0:1715330324.976978:0:10673:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da821c0/0xd895711d66dbac6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x158f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe26 expref: 16 pid: 7133 timeout: 399 lvb_type: 0 00000100:00100000:3.0:1715330324.977010:0:10673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1587 00000100:00100000:3.0:1715330324.977016:0:10673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b31bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:72de1896-1df4-4b3a-930a-9116d2c66168+16:2012:x1798653938113088:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1715330324.977027:0:10673:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330324.977032:0:10673:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011da821c0/0xd895711d66dbac6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x158f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe26 expref: 16 pid: 7133 timeout: 399 lvb_type: 0 00010000:00010000:3.0:1715330324.977041:0:10673:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011da821c0/0xd895711d66dbac6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x158f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe26 expref: 16 pid: 7133 timeout: 399 lvb_type: 0 00010000:00010000:3.0:1715330324.977058:0:10673:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da821c0/0xd895711d66dbac6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x158f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe26 expref: 16 pid: 7133 timeout: 399 lvb_type: 0 00010000:00010000:3.0:1715330324.977073:0:10673:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158f:0x0].0x0 (ffff8800b4207c00) 00010000:00010000:3.0:1715330324.977077:0:10673:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66dbaf0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x158f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330324.977083:0:10673:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66dbaf0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x158f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330324.977088:0:10673:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66dbaf0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x158f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330324.977110:0:10673:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715330324.977125:0:7133:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66dbaf0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x158f:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330324.977132:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66dbaf0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x158f:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000100:00100000:3.0:1715330324.977139:0:10673:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b31bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:72de1896-1df4-4b3a-930a-9116d2c66168+15:2012:x1798653938113088:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 123us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330324.977144:0:10673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1587 00000004:00200000:0.0:1715330324.977148:0:7133:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x158f:0x0]: returning size 4096 00010000:00010000:0.0:1715330324.977256:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6f40/0xd895711d66dbae9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe3b expref: 16 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330324.977272:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66dbaf0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x158f:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe3b expref: 15 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330324.977277:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158f:0x0].0x0 (ffff8800b4207c00) 00010000:00010000:0.0:1715330324.977280:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1715330324.977282:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938b7840, rc 0) 00000100:00100000:0.0:1715330324.977300:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b31b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+15:19420:x1798653938113024:12345-192.168.204.49@tcp:101:multiop.0 Request processed in 5615us (6155us total) trans 4294984067 rc 0/0 00000100:00100000:0.0:1715330324.977306:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23804 00000100:00100000:2.0:1715330324.982305:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330324.982379:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938113152 00000100:00100000:0.0:1715330324.982387:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938113152 00000100:00100000:0.0:1715330324.983576:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23805 00000100:00100000:0.0:1715330324.983584:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+15:19420:x1798653938113152:12345-192.168.204.49@tcp:101:multiop.0 00010000:00010000:0.0:1715330324.983606:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330324.983623:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087724480/0xd895711d66dbafe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbe42 expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330324.983672:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880087724fc0/0xd895711d66dbb05 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x158f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330324.983684:0:7133:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66dbaf0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x158f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe3b expref: 16 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330324.983690:0:7133:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880087724fc0/0xd895711d66dbb05 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x158f:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330324.983717:0:7133:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66dbaf0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x158f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe3b expref: 16 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330324.983743:0:7133:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66dbaf0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x158f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe3b expref: 16 pid: 7133 timeout: 399 lvb_type: 0 00000100:00100000:0.0:1715330324.983755:0:7133:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b319180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7133:1798653942519040:192.168.204.49@tcp:104: 00000100:00100000:0.0:1715330324.983809:0:7133:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa300 going to sleep for 11 seconds 00000100:00100000:0.0:1715330324.987272:0:7133:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b319180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7133:1798653942519040:192.168.204.49@tcp:104: 00010000:00010000:0.0:1715330324.987306:0:7133:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880087724fc0/0xd895711d66dbb05 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x158f:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000100:00100000:2.0:1715330324.988197:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330324.988362:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938113216 00000100:00100000:0.0:1715330324.988372:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938113216 00010000:00010000:0.0:1715330324.988407:0:10674:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66dbaf0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x158f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe3b expref: 17 pid: 7133 timeout: 399 lvb_type: 0 00000100:00100000:0.0:1715330324.988444:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1588 00000100:00100000:0.0:1715330324.988451:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f579c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:72de1896-1df4-4b3a-930a-9116d2c66168+17:2011:x1798653938113216:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1715330324.988470:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330324.988476:0:10674:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66dbaf0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x158f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe3b expref: 17 pid: 7133 timeout: 399 lvb_type: 0 00010000:00010000:0.0:1715330324.988487:0:10674:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66dbaf0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x158f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe3b expref: 17 pid: 7133 timeout: 399 lvb_type: 0 00010000:00010000:0.0:1715330324.988511:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66dbaf0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x158f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe3b expref: 17 pid: 7133 timeout: 399 lvb_type: 0 00010000:00010000:0.0:1715330324.988536:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158f:0x0].0x0 (ffff8800b4207c00) 00010000:00010000:0.0:1715330324.988542:0:10674:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880087724fc0/0xd895711d66dbb05 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x158f:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330324.988551:0:10674:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880087724fc0/0xd895711d66dbb05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330324.988559:0:10674:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087724fc0/0xd895711d66dbb05 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x158f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330324.988581:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330324.988637:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f579c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:72de1896-1df4-4b3a-930a-9116d2c66168+16:2011:x1798653938113216:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 185us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330324.988644:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1588 00010000:00010000:0.0:1715330324.988665:0:7133:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880087724fc0/0xd895711d66dbb05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330324.988671:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087724fc0/0xd895711d66dbb05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00200000:0.0:1715330324.988727:0:7133:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x158f:0x0]: returning size 4096 00000004:00200000:0.0:1715330324.988758:0:7133:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1715330324.988778:0:7133:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880087724fc0/0xd895711d66dbb05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330324.988788:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087724fc0/0xd895711d66dbb05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:0.0:1715330324.988814:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087724480/0xd895711d66dbafe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe42 expref: 16 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330324.988826:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880087724fc0/0xd895711d66dbb05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x158f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe42 expref: 15 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330324.989270:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158f:0x0].0x0 (ffff8800b4207c00) 00010000:00010000:0.0:1715330324.989274:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715330324.989276:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880087724fc0, rc 0) 00000100:00100000:0.0:1715330324.989532:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+15:19420:x1798653938113152:12345-192.168.204.49@tcp:101:multiop.0 Request processed in 5948us (7235us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330324.989540:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23805 00000100:00100000:2.0:1715330324.993945:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330324.994009:0:17217:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938113280 00000100:00100000:1.0:1715330324.994019:0:17217:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938113280 00000100:00100000:1.0:1715330324.994075:0:17217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5341 00000100:00100000:1.0:1715330324.994083:0:17217:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f578000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:72de1896-1df4-4b3a-930a-9116d2c66168+7:2011:x1798653938113280:12345-192.168.204.49@tcp:101:multiop.0 00010000:00010000:1.0:1715330324.994105:0:17217:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330324.994133:0:17217:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091c5c900/0xd895711d66dbb0c lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbe49 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1715330324.994160:0:17217:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0xa00:0x0] initial LVB size: 4096, mtime: 0x663ddd15, atime: 0x0, ctime: 0x663ddd15, blocks: 0x8 00010000:00010000:1.0:1715330324.994181:0:17217:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330324.994183:0:17217:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330324.994193:0:17217:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091c5c900/0xd895711d66dbb0c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe49 expref: 8 pid: 17217 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1715330324.994209:0:17217:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091c5c900/0xd895711d66dbb0c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe49 expref: 8 pid: 17217 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1715330324.994229:0:17217:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091c5c900, rc 0) 00000100:00100000:1.0:1715330324.994301:0:17217:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f578000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:72de1896-1df4-4b3a-930a-9116d2c66168+8:2011:x1798653938113280:12345-192.168.204.49@tcp:101:multiop.0 Request processed in 217us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330324.994310:0:17217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5341 00000100:00100000:1.0:1715330324.999338:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330325.000589:0:17217:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938113344 00000100:00100000:2.0:1715330325.000601:0:17217:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938113344 00000100:00100000:2.0:1715330325.000678:0:17217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5342 00000100:00100000:2.0:1715330325.000686:0:17217:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d645c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:72de1896-1df4-4b3a-930a-9116d2c66168+8:19420:x1798653938113344:12345-192.168.204.49@tcp:101:multiop.0 00010000:00010000:2.0:1715330325.000706:0:17217:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330325.000745:0:17217:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800938b7a80/0xd895711d66dbb13 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbe50 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330325.000778:0:17217:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091c5c900/0xd895711d66dbb0c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe49 expref: 9 pid: 17217 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1715330325.000785:0:17217:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330325.000788:0:17217:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715330325.000791:0:17217:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800938b7a80/0xd895711d66dbb13 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe50 expref: 9 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330325.000825:0:17217:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091c5c900/0xd895711d66dbb0c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe49 expref: 9 pid: 17217 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1715330325.000837:0:17217:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091c5c900/0xd895711d66dbb0c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe49 expref: 9 pid: 17217 timeout: 399 lvb_type: 1 00000100:00100000:2.0:1715330325.000863:0:17217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f579500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:17217:1798653942519104:192.168.204.49@tcp:104: 00000100:00100000:2.0:1715330325.000932:0:17217:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008b04c480 going to sleep for 11 seconds 00000100:00080000:0.0:1715330325.001090:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330295 00000100:00100000:2.0:1715330325.004036:0:17217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f579500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:17217:1798653942519104:192.168.204.49@tcp:104: 00010000:00010000:2.0:1715330325.004073:0:17217:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800938b7a80/0xd895711d66dbb13 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe50 expref: 9 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330325.004096:0:17217:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938b7a80, rc 0) 00000100:00100000:2.0:1715330325.004155:0:17217:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d645c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:72de1896-1df4-4b3a-930a-9116d2c66168+9:19420:x1798653938113344:12345-192.168.204.49@tcp:101:multiop.0 Request processed in 3468us (4826us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330325.004164:0:17217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5342 00000100:00100000:2.0:1715330325.005311:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330325.005366:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938113408 00000100:00100000:0.0:1715330325.005374:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938113408 00010000:00010000:0.0:1715330325.005407:0:10674:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091c5c900/0xd895711d66dbb0c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe49 expref: 9 pid: 17217 timeout: 399 lvb_type: 1 00000100:00100000:0.0:1715330325.006035:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1589 00000100:00100000:0.0:1715330325.006041:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ab788050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:72de1896-1df4-4b3a-930a-9116d2c66168+9:2012:x1798653938113408:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1715330325.006054:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330325.006072:0:10674:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091c5c900/0xd895711d66dbb0c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe49 expref: 9 pid: 17217 timeout: 399 lvb_type: 1 00010000:00010000:0.0:1715330325.006082:0:10674:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091c5c900/0xd895711d66dbb0c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe49 expref: 9 pid: 17217 timeout: 399 lvb_type: 1 00010000:00010000:0.0:1715330325.006108:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091c5c900/0xd895711d66dbb0c lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe49 expref: 9 pid: 17217 timeout: 399 lvb_type: 1 00010000:00010000:0.0:1715330325.006128:0:10674:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330325.006130:0:10674:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330325.006136:0:10674:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800938b7a80/0xd895711d66dbb13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe50 expref: 8 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330325.006143:0:10674:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800938b7a80/0xd895711d66dbb13 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe50 expref: 8 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330325.006172:0:10674:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800938b7a80/0xd895711d66dbb13 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe50 expref: 8 pid: 17217 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330325.006183:0:10674:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b319180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10674:1798653942519168:192.168.204.49@tcp:105: 00000100:00100000:0.0:1715330325.006237:0:10674:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091ffa300 going to sleep for 11 seconds 00000100:00100000:0.0:1715330325.010046:0:10674:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b319180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10674:1798653942519168:192.168.204.49@tcp:105: 00010000:00010000:0.0:1715330325.010075:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715330325.010215:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ab788050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:72de1896-1df4-4b3a-930a-9116d2c66168+8:2012:x1798653938113408:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 4170us (4905us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330325.010230:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1589 00000100:00100000:2.0:1715330325.010282:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330325.010310:0:9403:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938113536 00000100:00100000:0.0:1715330325.010318:0:9403:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938113536 00002000:00100000:0.0:1715330325.010355:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa00:0x0] (0->4095) req@ffff88012f579500 x1798653938113536/t0(0) o3->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:536/0 lens 488/0 e 0 to 0 dl 1715330336 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330325.010365:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f579500 with x1798653938113536 ext(0->4095) 00002000:00010000:0.0:1715330325.010369:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f579500 00000100:00100000:0.0:1715330325.010398:0:9403:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 15 00000100:00100000:0.0:1715330325.010403:0:9403:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f579500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+8:2012:x1798653938113536:12345-192.168.204.49@tcp:3:dd.0 00000100:00100000:0.0:1715330325.011072:0:9403:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f579500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+8:2012:x1798653938113536:12345-192.168.204.49@tcp:3:dd.0 Request processed in 666us (790us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1715330325.011081:0:9403:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 15 00002000:00100000:0.0:1715330325.011087:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa00:0x0] (0->4095) req@ffff88012f579500 x1798653938113536/t0(0) o3->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:536/0 lens 488/4536 e 0 to 0 dl 1715330336 ref 1 fl Complete:/200/0 rc 4096/4096 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330325.011094:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f579500 with x1798653938113536 ext(0->4095) 00002000:00010000:0.0:1715330325.011097:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f579500 00000100:00100000:0.0:1715330325.017613:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330325.017811:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938113664 00000100:00100000:1.0:1715330325.017828:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938113664 00000100:00100000:1.0:1715330325.017924:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5208 00000100:00100000:1.0:1715330325.017932:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b31b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+15:19420:x1798653938113664:12345-192.168.204.49@tcp:35:multiop.0 00000100:00100000:1.0:1715330325.018315:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b31b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+16:19420:x1798653938113664:12345-192.168.204.49@tcp:35:multiop.0 Request processed in 384us (708us total) trans 4294984068 rc 0/0 00000100:00100000:1.0:1715330325.018322:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5208 00000100:00080000:0.0:1715330325.018910:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330295 00000100:00100000:1.0:1715330325.043916:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330325.045456:0:9403:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938113728 00000100:00100000:0.0:1715330325.045464:0:9403:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938113728 00002000:00100000:0.0:1715330325.045500:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa00:0x0] (0->4095) req@ffff88009d644700 x1798653938113728/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:536/0 lens 4584/0 e 0 to 0 dl 1715330336 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330325.045509:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d644700 with x1798653938113728 ext(0->4095) 00002000:00010000:0.0:1715330325.045514:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d644700 00000100:00100000:0.0:1715330325.045542:0:9403:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 16 00000100:00100000:0.0:1715330325.045548:0:9403:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d644700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+8:2012:x1798653938113728:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330325.047841:0:9403:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d644700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+10:2012:x1798653938113728:12345-192.168.204.49@tcp:4:dd.0 Request processed in 2284us (3924us total) trans 4294969951 rc 0/0 00000100:00100000:0.0:1715330325.047862:0:9403:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 16 00002000:00100000:0.0:1715330325.047872:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa00:0x0] (0->4095) req@ffff88009d644700 x1798653938113728/t4294969951(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:536/0 lens 4584/448 e 0 to 0 dl 1715330336 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330325.047881:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d644700 with x1798653938113728 ext(0->4095) 00002000:00010000:0.0:1715330325.047886:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d644700 00010000:00010000:1.0:1715330325.243280:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330325.331104:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b31bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942519232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1715330325.331187:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330325.331603:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942519232 00000100:00100000:0.0:1715330325.331613:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942519232 00000100:00100000:0.0:1715330325.331716:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1715330325.331723:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942519232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1715330325.331763:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84350656 pending 57344 free 3923513344 avail 3691991040 00000100:00080000:2.0:1715330325.331906:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330295 00000100:00100000:0.0:1715330325.331986:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942519232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 263us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330325.331994:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1715330325.332086:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b31bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942519232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1715330325.364066:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b319180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942519296:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1715330325.364123:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330325.364169:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942519296 00000100:00100000:1.0:1715330325.364174:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942519296 00000100:00100000:1.0:1715330325.364212:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1715330325.364217:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d646300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942519296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1715330325.364235:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84350656 pending 57344 free 3923513344 avail 3691991040 00000100:00100000:1.0:1715330325.364262:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d646300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942519296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330325.364268:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1715330325.364301:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b319180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942519296:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1715330325.364677:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330295 00010000:00010000:0.0:1715330326.245056:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330326.611793:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091eec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942519488:0@lo:400:kworker.0 00000100:00100000:0.0:1715330326.611862:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330326.611880:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091eece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3688:1798653942519744:0@lo:400:kworker.0 00000100:00100000:0.0:1715330326.611898:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330326.611908:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091eedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3688:1798653942520000:0@lo:400:kworker.0 00000100:00100000:0.0:1715330326.611920:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330326.611933:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1715330326.611937:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091eec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3688:1798653942519552:0@lo:400:kworker.0 00000100:00100000:0.0:1715330326.611949:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330326.611957:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091eed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942519808:0@lo:400:kworker.0 00000100:00100000:0.0:1715330326.611970:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330326.611978:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091eedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942520064:0@lo:400:kworker.0 00000100:00100000:0.0:1715330326.611990:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330326.612012:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942519744 00000100:00100000:0.0:1715330326.612017:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942519744 00000100:00100000:0.0:1715330326.612049:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942520000 00000100:00100000:0.0:1715330326.612051:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942520000 00000100:00100000:0.0:1715330326.612061:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942519552 00000100:00100000:0.0:1715330326.612062:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942519552 00000100:00100000:0.0:1715330326.612073:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1715330326.612080:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091eeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3688:x1798653942519744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330326.612114:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091eeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3688:x1798653942519744:12345-0@lo:400:kworker.0 Request processed in 33us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330326.612119:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1715330326.612131:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1715330326.612135:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091eeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3688:x1798653942520000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330326.612151:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091eeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3688:x1798653942520000:12345-0@lo:400:kworker.0 Request processed in 16us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330326.612156:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1715330326.612162:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1715330326.612165:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3688:x1798653942519552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330326.612179:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3688:x1798653942519552:12345-0@lo:400:kworker.0 Request processed in 14us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330326.612184:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1715330326.612196:0:17198:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942519808 00000100:00100000:0.0:1715330326.612198:0:17198:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942519808 00000100:00100000:0.0:1715330326.612211:0:17198:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942520064 00000100:00100000:0.0:1715330326.612213:0:17198:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942520064 00000100:00100000:0.0:1715330326.612223:0:17198:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1715330326.612227:0:17198:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091eef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942519808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330326.612245:0:17198:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091eef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942519808:12345-0@lo:400:kworker.0 Request processed in 18us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330326.612250:0:17198:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1715330326.612256:0:17198:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1715330326.612259:0:17198:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091eef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942520064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330326.612274:0:17198:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091eef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942520064:12345-0@lo:400:kworker.0 Request processed in 14us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330326.612278:0:17198:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1715330326.612315:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091eec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3688:1798653942519552:0@lo:400:kworker.0 00000100:00100000:0.0:1715330326.612322:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091eed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942519808:0@lo:400:kworker.0 00000100:00100000:0.0:1715330326.612328:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091eedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942520064:0@lo:400:kworker.0 00000100:00100000:0.0:1715330326.612334:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091eece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3688:1798653942519744:0@lo:400:kworker.0 00000100:00100000:0.0:1715330326.612340:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091eedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3688:1798653942520000:0@lo:400:kworker.0 00000100:00100000:0.0:1715330326.612379:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942519488 00000100:00100000:0.0:1715330326.612382:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942519488 00000100:00100000:0.0:1715330326.612400:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3054 00000100:00100000:0.0:1715330326.612403:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091eee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942519488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330326.612429:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091eee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942519488:12345-0@lo:400:kworker.0 Request processed in 25us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330326.612434:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3054 00000100:00100000:0.0:1715330326.612454:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091eec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942519488:0@lo:400:kworker.0 00000100:00080000:0.0:1715330326.612474:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330296 00000100:00080000:0.0:1715330326.612477:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330296 00000100:00100000:2.0:1715330326.612536:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b31bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3691:1798653942519424:0@lo:400:kworker.0 00000100:00100000:2.0:1715330326.612560:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330326.612571:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091eeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3691:1798653942519680:0@lo:400:kworker.0 00000100:00100000:2.0:1715330326.612584:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330326.612591:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3691:1798653942519936:0@lo:400:kworker.0 00000100:00100000:2.0:1715330326.612604:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330326.612615:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1715330326.612620:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b319180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3691:1798653942519360:0@lo:400:kworker.0 00000100:00100000:2.0:1715330326.612642:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330326.612651:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091eec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942519616:0@lo:400:kworker.0 00000100:00100000:2.0:1715330326.612666:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330326.612673:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091eed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942519872:0@lo:400:kworker.0 00000100:00100000:2.0:1715330326.612688:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330326.612695:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091eee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942520128:0@lo:400:kworker.0 00000100:00100000:2.0:1715330326.612707:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330326.612724:0:7129:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942519360 00000100:00100000:2.0:1715330326.612726:0:7129:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942519360 00000100:00100000:2.0:1715330326.612772:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1715330326.612776:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007666ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3691:x1798653942519360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330326.612799:0:7129:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007666ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3691:x1798653942519360:12345-0@lo:400:kworker.0 Request processed in 23us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330326.612804:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1715330326.612834:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942519424 00000100:00100000:2.0:1715330326.612837:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942519424 00000100:00100000:2.0:1715330326.612851:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942519680 00000100:00100000:2.0:1715330326.612853:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942519680 00000100:00100000:2.0:1715330326.612862:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942519936 00000100:00100000:2.0:1715330326.612863:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942519936 00000100:00100000:2.0:1715330326.612874:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1715330326.612877:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3691:x1798653942519424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330326.612899:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3691:x1798653942519424:12345-0@lo:400:kworker.0 Request processed in 21us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330326.612903:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1715330326.612911:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1715330326.612914:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f578e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3691:x1798653942519680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330326.612931:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f578e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3691:x1798653942519680:12345-0@lo:400:kworker.0 Request processed in 16us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330326.612935:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1715330326.613251:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1715330326.613256:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3691:x1798653942519936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330326.613278:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3691:x1798653942519936:12345-0@lo:400:kworker.0 Request processed in 22us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330326.613282:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1715330326.613295:0:12304:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942519872 00000100:00100000:2.0:1715330326.613297:0:12304:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942519872 00000100:00100000:2.0:1715330326.613309:0:12304:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942520128 00000100:00100000:2.0:1715330326.613311:0:12304:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942520128 00000100:00100000:2.0:1715330326.613319:0:12304:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1715330326.613323:0:12304:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942519872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330326.613342:0:12304:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942519872:12345-0@lo:400:kworker.0 Request processed in 18us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330326.613345:0:12304:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1715330326.613352:0:12304:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1715330326.613354:0:12304:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+54:3691:x1798653942520128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330326.613368:0:12304:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+54:3691:x1798653942520128:12345-0@lo:400:kworker.0 Request processed in 13us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330326.613372:0:12304:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00080000:2.0:1715330326.613383:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330296 00000100:00080000:2.0:1715330326.613385:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330296 00000100:00080000:2.0:1715330326.613386:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330296 00000100:00100000:2.0:1715330326.613400:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b319180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3691:1798653942519360:0@lo:400:kworker.0 00000100:00100000:2.0:1715330326.613408:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091eed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942519872:0@lo:400:kworker.0 00000100:00100000:2.0:1715330326.613414:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091eee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942520128:0@lo:400:kworker.0 00000100:00100000:2.0:1715330326.613420:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b31bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3691:1798653942519424:0@lo:400:kworker.0 00000100:00100000:2.0:1715330326.613427:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091eeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3691:1798653942519680:0@lo:400:kworker.0 00000100:00100000:2.0:1715330326.613432:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3691:1798653942519936:0@lo:400:kworker.0 00000100:00100000:0.0:1715330326.613552:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942519616 00000100:00100000:0.0:1715330326.613555:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942519616 00000100:00100000:0.0:1715330326.613720:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3055 00000100:00100000:0.0:1715330326.613724:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942519616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330326.614742:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942519616:12345-0@lo:400:kworker.0 Request processed in 1004us (2061us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330326.614749:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3055 00000100:00100000:3.0:1715330326.614807:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091eec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942519616:0@lo:400:kworker.0 00000100:00100000:3.0:1715330326.627918:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d647100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942520192:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1715330326.627985:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330326.628156:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942520192 00000100:00100000:1.0:1715330326.628163:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942520192 00000100:00100000:1.0:1715330326.628193:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1715330326.628198:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942520192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1715330326.628225:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 67507904 pending 0 free 3923546112 avail 3692023808 00000100:00100000:1.0:1715330326.628257:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942520192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330326.628267:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1715330326.628329:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d647100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942520192:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1715330326.644621:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1715330326.644640:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942520256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1715330326.644693:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330326.645940:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942520256 00000100:00100000:2.0:1715330326.645948:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942520256 00000100:00100000:2.0:1715330326.645999:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1715330326.646005:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d645500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+54:3689:x1798653942520256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1715330326.646028:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 67507904 pending 0 free 3923546112 avail 3692023808 00000100:00100000:2.0:1715330326.646088:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d645500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+54:3689:x1798653942520256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (1393us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330326.646094:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1715330326.646183:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942520256:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1715330327.240910:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984068 is committed 00010000:00010000:2.0:1715330327.240983:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80d80/0xd895711d66dbabf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x313666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330327.241002:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80d80/0xd895711d66dbabf lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x313666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330327.241009:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80d80/0xd895711d66dbabf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x313666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330327.241015:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da80d80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330327.241019:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80d80/0xd895711d66dbabf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x313666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330327.241026:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80d80/0xd895711d66dbabf lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x313666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00000001:00080000:0.0:1715330327.241028:0:10666:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4294969950 is committed 00010000:00010000:2.0:1715330327.241045:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x313666 (ffff8800b4207500) 00010000:00010000:2.0:1715330327.241049:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330327.241053:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80d80/0xd895711d66dbabf lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x313666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330327.241059:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80d80/0xd895711d66dbabf lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x313666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:1.0:1715330327.247185:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330328.051014:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1715330328.051035:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091eec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942520320:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1715330328.051097:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330328.051128:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942520320 00000100:00100000:0.0:1715330328.051135:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942520320 00000100:00100000:0.0:1715330328.051581:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3056 00000100:00100000:0.0:1715330328.051590:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091eedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942520320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1715330328.051623:0:8592:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444089856 avail 1314627584 00000100:00100000:0.0:1715330328.051670:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091eedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942520320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330328.051676:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3056 00000100:00100000:1.0:1715330328.051769:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091eec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942520320:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1715330328.154567:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330328.155540:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330328.155581:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330328.155607:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330328.155629:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330328.155704:0:7130:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938113792 00000100:00100000:3.0:1715330328.155711:0:7130:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938113792 00000100:00100000:2.0:1715330328.155859:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938113856 00000100:00100000:2.0:1715330328.155863:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938113856 00000100:00100000:1.0:1715330328.156012:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938113920 00000100:00100000:1.0:1715330328.156015:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938113920 00000100:00100000:3.0:1715330328.156069:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 345 00000100:00100000:3.0:1715330328.156075:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007666e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2014:x1798653938113792:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:3.0:1715330328.156124:0:7130:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007666e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2014:x1798653938113792:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 49us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330328.156130:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 345 00000100:00100000:0.0:1715330328.156256:0:17217:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938113984 00000100:00100000:0.0:1715330328.156261:0:17217:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938113984 00000100:00100000:2.0:1715330328.156515:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 306 00000100:00100000:2.0:1715330328.156521:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+11:2014:x1798653938113856:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:2.0:1715330328.156550:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+11:2014:x1798653938113856:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 29us (1992us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330328.156555:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 306 00000100:00080000:2.0:1715330328.156575:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330298 00000100:00080000:2.0:1715330328.156578:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330298 00000100:00080000:2.0:1715330328.156579:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330298 00000100:00080000:2.0:1715330328.156581:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330298 00000100:00100000:3.0:1715330328.157306:0:17198:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938114048 00000100:00100000:3.0:1715330328.157311:0:17198:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938114048 00000100:00100000:3.0:1715330328.157341:0:17198:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 219 00000100:00100000:3.0:1715330328.157346:0:17198:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d644a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:72de1896-1df4-4b3a-930a-9116d2c66168+5:2014:x1798653938114048:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:3.0:1715330328.157373:0:17198:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d644a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:72de1896-1df4-4b3a-930a-9116d2c66168+5:2014:x1798653938114048:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 27us (1743us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330328.157377:0:17198:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 219 00000100:00080000:2.0:1715330328.157485:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330298 00000100:00100000:1.0:1715330328.158136:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 307 00000100:00100000:1.0:1715330328.158141:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d645180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938113920:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:1.0:1715330328.158171:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d645180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938113920:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 30us (2563us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330328.158176:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 307 00000100:00100000:0.0:1715330328.158400:0:17217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 220 00000100:00100000:0.0:1715330328.158406:0:17217:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d644e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:72de1896-1df4-4b3a-930a-9116d2c66168+10:2014:x1798653938113984:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:0.0:1715330328.158516:0:17217:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d644e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:72de1896-1df4-4b3a-930a-9116d2c66168+10:2014:x1798653938113984:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 110us (2977us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330328.158521:0:17217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 220 00010000:00010000:2.0:1715330328.248967:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330329.251378:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330329.508548:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942520384:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1715330329.508611:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330329.508703:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942520384 00000100:00100000:0.0:1715330329.508711:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942520384 00000100:00100000:0.0:1715330329.508793:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3057 00000100:00100000:0.0:1715330329.508799:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f579f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942520384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1715330329.508832:0:7138:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445060608 avail 1315598336 00000100:00100000:0.0:1715330329.510896:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f579f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942520384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2091us (2279us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330329.510909:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3057 00000100:00100000:2.0:1715330329.511054:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942520384:0@lo:41:osp-pre-1-0.0 00000001:00080000:2.0:1715330330.233340:0:9395:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0000: transno 4294969951 is committed 00010000:00010000:2.0:1715330330.253001:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330330.339420:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1715330330.339442:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d645f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942520448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1715330330.339502:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330330.339593:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942520448 00000100:00100000:1.0:1715330330.339602:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942520448 00000100:00100000:1.0:1715330330.339646:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1715330330.339651:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942520448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1715330330.339677:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1715330330.339709:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942520448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330330.339715:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1715330330.339772:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d645f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942520448:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1715330330.339815:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330300 00000100:00100000:1.0:1715330330.371948:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d645f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942520512:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1715330330.372005:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330330.374796:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942520512 00000100:00100000:1.0:1715330330.374808:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942520512 00000100:00100000:1.0:1715330330.374864:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1715330330.374870:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d647100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942520512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1715330330.374893:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1715330330.374949:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d647100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942520512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (2944us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330330.374954:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1715330330.375003:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d645f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942520512:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1715330330.375137:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330300 00010000:00010000:0.0:1715330331.255112:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330331.619792:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3690:1798653942520640:0@lo:400:kworker.0 00000100:00100000:3.0:1715330331.619874:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330331.619903:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3690:1798653942520896:0@lo:400:kworker.0 00000100:00100000:3.0:1715330331.619922:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330331.619933:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3690:1798653942521152:0@lo:400:kworker.0 00000100:00100000:3.0:1715330331.619953:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330331.619981:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1715330331.619986:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942520704:0@lo:400:kworker.0 00000100:00100000:3.0:1715330331.620014:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330331.620028:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3690:1798653942520960:0@lo:400:kworker.0 00000100:00100000:3.0:1715330331.620046:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330331.620055:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3690:1798653942521216:0@lo:400:kworker.0 00000100:00100000:3.0:1715330331.620070:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330331.620103:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942520640 00000100:00100000:3.0:1715330331.620111:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942520640 00000100:00100000:3.0:1715330331.620149:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942520896 00000100:00100000:3.0:1715330331.620152:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942520896 00000100:00100000:3.0:1715330331.620164:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942521152 00000100:00100000:3.0:1715330331.620166:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942521152 00000100:00100000:3.0:1715330331.620172:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942520960 00000100:00100000:3.0:1715330331.620174:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942520960 00000100:00100000:3.0:1715330331.620182:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942521216 00000100:00100000:3.0:1715330331.620184:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942521216 00000100:00100000:3.0:1715330331.620194:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1715330331.620199:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3690:x1798653942520640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330331.620244:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3690:x1798653942520640:12345-0@lo:400:kworker.0 Request processed in 44us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330331.620251:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1715330331.620266:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1715330331.620269:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3690:x1798653942520896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330331.620288:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3690:x1798653942520896:12345-0@lo:400:kworker.0 Request processed in 19us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330331.620292:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1715330331.620300:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1715330331.620303:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3690:x1798653942521152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330331.620319:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3690:x1798653942521152:12345-0@lo:400:kworker.0 Request processed in 16us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330331.620324:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1715330331.620330:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1715330331.620333:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3690:x1798653942520960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330331.620351:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3690:x1798653942520960:12345-0@lo:400:kworker.0 Request processed in 18us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330331.620356:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1715330331.620363:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1715330331.620365:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3690:x1798653942521216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330331.620382:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3690:x1798653942521216:12345-0@lo:400:kworker.0 Request processed in 16us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330331.620386:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00080000:3.0:1715330331.620403:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330301 00000100:00080000:3.0:1715330331.620408:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330301 00000100:00100000:3.0:1715330331.620440:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3690:1798653942520960:0@lo:400:kworker.0 00000100:00100000:3.0:1715330331.620449:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3690:1798653942521216:0@lo:400:kworker.0 00000100:00100000:3.0:1715330331.620457:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3690:1798653942520640:0@lo:400:kworker.0 00000100:00100000:3.0:1715330331.620463:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3690:1798653942520896:0@lo:400:kworker.0 00000100:00100000:3.0:1715330331.620470:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3690:1798653942521152:0@lo:400:kworker.0 00000100:00100000:3.0:1715330331.620531:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942520704 00000100:00100000:3.0:1715330331.620534:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942520704 00000100:00100000:3.0:1715330331.620557:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3058 00000100:00100000:3.0:1715330331.620562:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942520704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330331.620586:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942520704:12345-0@lo:400:kworker.0 Request processed in 25us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330331.620592:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3058 00000100:00100000:3.0:1715330331.620614:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942520704:0@lo:400:kworker.0 00000100:00100000:3.0:1715330331.620631:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3688:1798653942520768:0@lo:400:kworker.0 00000100:00100000:3.0:1715330331.620649:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330331.620658:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942521024:0@lo:400:kworker.0 00000100:00100000:3.0:1715330331.620675:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330331.620685:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942521280:0@lo:400:kworker.0 00000100:00100000:3.0:1715330331.620697:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330331.620707:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1715330331.620712:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3688:1798653942520576:0@lo:400:kworker.0 00000100:00100000:3.0:1715330331.620784:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330331.620797:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942520832:0@lo:400:kworker.0 00000100:00100000:3.0:1715330331.620814:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330331.620821:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942521088:0@lo:400:kworker.0 00000100:00100000:3.0:1715330331.620834:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330331.620842:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942521344:0@lo:400:kworker.0 00000100:00100000:3.0:1715330331.620855:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330331.620872:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942520768 00000100:00100000:3.0:1715330331.620875:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942520768 00000100:00100000:3.0:1715330331.620892:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1715330331.620897:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3688:x1798653942520768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330331.620922:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3688:x1798653942520768:12345-0@lo:400:kworker.0 Request processed in 24us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330331.620926:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1715330331.620942:0:17205:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942521024 00000100:00100000:3.0:1715330331.620945:0:17205:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942521024 00000100:00100000:3.0:1715330331.620961:0:17205:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942521280 00000100:00100000:3.0:1715330331.620963:0:17205:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942521280 00000100:00100000:3.0:1715330331.620974:0:17205:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942521088 00000100:00100000:3.0:1715330331.620976:0:17205:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942521088 00000100:00100000:3.0:1715330331.620984:0:17205:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942521344 00000100:00100000:3.0:1715330331.620986:0:17205:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942521344 00000100:00100000:3.0:1715330331.620994:0:17205:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1715330331.620997:0:17205:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942521024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330331.621022:0:17205:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942521024:12345-0@lo:400:kworker.0 Request processed in 24us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330331.621027:0:17205:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1715330331.621035:0:17205:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1715330331.621037:0:17205:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942521280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330331.621054:0:17205:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942521280:12345-0@lo:400:kworker.0 Request processed in 16us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330331.621058:0:17205:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1715330331.621064:0:17205:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1715330331.621066:0:17205:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942521088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330331.621083:0:17205:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942521088:12345-0@lo:400:kworker.0 Request processed in 16us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330331.621087:0:17205:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1715330331.621094:0:17205:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1715330331.621096:0:17205:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942521344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330331.621112:0:17205:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942521344:12345-0@lo:400:kworker.0 Request processed in 15us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330331.621116:0:17205:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1715330331.621130:0:7129:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942520576 00000100:00100000:3.0:1715330331.621132:0:7129:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942520576 00000100:00100000:3.0:1715330331.621152:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1715330331.621155:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007666e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3688:x1798653942520576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330331.621173:0:7129:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007666e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3688:x1798653942520576:12345-0@lo:400:kworker.0 Request processed in 18us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330331.621179:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1715330331.621207:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942520832 00000100:00100000:3.0:1715330331.621209:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942520832 00000100:00100000:3.0:1715330331.621222:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3059 00000100:00100000:3.0:1715330331.621225:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942520832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330331.621245:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942520832:12345-0@lo:400:kworker.0 Request processed in 19us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330331.621249:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3059 00000100:00080000:3.0:1715330331.621259:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330301 00000100:00080000:3.0:1715330331.621261:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330301 00000100:00100000:3.0:1715330331.621272:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3688:1798653942520576:0@lo:400:kworker.0 00000100:00100000:3.0:1715330331.621279:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942520832:0@lo:400:kworker.0 00000100:00100000:3.0:1715330331.621285:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942521088:0@lo:400:kworker.0 00000100:00100000:3.0:1715330331.621291:0:3688:0:(client.c:2956:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969950 gen 2 00000004:00080000:3.0:1715330331.621296:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a7ec3b80, transno 4294969902 00000004:00080000:3.0:1715330331.621303:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b4c3800, transno 4294969903 00000004:00080000:3.0:1715330331.621306:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b4c3100, transno 4294969904 00000004:00080000:3.0:1715330331.621307:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008b160000, transno 4294969905 00000004:00080000:3.0:1715330331.621310:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d608a80, transno 4294969906 00000004:00080000:3.0:1715330331.621313:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007d62bb80, transno 4294969907 00000004:00080000:3.0:1715330331.621315:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d776d80, transno 4294969908 00000004:00080000:3.0:1715330331.621318:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d608380, transno 4294969909 00000004:00080000:3.0:1715330331.621320:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b55d500, transno 4294969910 00000004:00080000:3.0:1715330331.621323:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d777100, transno 4294969911 00000004:00080000:3.0:1715330331.621325:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d609500, transno 4294969912 00000004:00080000:3.0:1715330331.621327:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d774a80, transno 4294969913 00000004:00080000:3.0:1715330331.621330:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b55f480, transno 4294969914 00000004:00080000:3.0:1715330331.621332:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b55ea00, transno 4294969915 00000004:00080000:3.0:1715330331.621334:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b55fb80, transno 4294969916 00000004:00080000:3.0:1715330331.621336:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b55d880, transno 4294969917 00000004:00080000:3.0:1715330331.621338:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b55c700, transno 4294969918 00000004:00080000:3.0:1715330331.621340:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b55c000, transno 4294969919 00000004:00080000:3.0:1715330331.621342:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b55f800, transno 4294969920 00000004:00080000:3.0:1715330331.621345:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b55df80, transno 4294969921 00000004:00080000:3.0:1715330331.621347:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b55e680, transno 4294969922 00000004:00080000:3.0:1715330331.621350:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091cc8000, transno 4294969923 00000004:00080000:3.0:1715330331.621352:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091cca300, transno 4294969924 00000004:00080000:3.0:1715330331.621354:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091cc9180, transno 4294969925 00000004:00080000:3.0:1715330331.621357:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091cc9f80, transno 4294969926 00000004:00080000:3.0:1715330331.621359:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091cc8380, transno 4294969927 00000004:00080000:3.0:1715330331.621361:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091ccb800, transno 4294969928 00000004:00080000:3.0:1715330331.621364:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091ccb480, transno 4294969929 00000004:00080000:3.0:1715330331.621366:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091cc8700, transno 4294969930 00000004:00080000:3.0:1715330331.621367:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134565f80, transno 4294969931 00000004:00080000:3.0:1715330331.621372:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134564700, transno 4294969932 00000004:00080000:3.0:1715330331.621374:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134564380, transno 4294969933 00000004:00080000:3.0:1715330331.621377:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134565500, transno 4294969934 00000004:00080000:3.0:1715330331.621379:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134566300, transno 4294969935 00000004:00080000:3.0:1715330331.621381:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d4f8000, transno 4294969936 00000004:00080000:3.0:1715330331.621383:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d4f8380, transno 4294969937 00000004:00080000:3.0:1715330331.621384:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134567800, transno 4294969938 00000004:00080000:3.0:1715330331.621386:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d4f8a80, transno 4294969939 00000004:00080000:3.0:1715330331.621388:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d4f9500, transno 4294969940 00000004:00080000:3.0:1715330331.621390:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d4f8e00, transno 4294969941 00000004:00080000:3.0:1715330331.621391:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d4f9180, transno 4294969942 00000004:00080000:3.0:1715330331.621393:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d4fa680, transno 4294969943 00000004:00080000:3.0:1715330331.621395:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d4fa300, transno 4294969944 00000004:00080000:3.0:1715330331.621396:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d4f9f80, transno 4294969945 00000004:00080000:3.0:1715330331.621398:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d4faa00, transno 4294969946 00000004:00080000:3.0:1715330331.621400:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d48c700, transno 4294969947 00000004:00080000:3.0:1715330331.621402:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d48f480, transno 4294969948 00000004:00080000:3.0:1715330331.621404:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d48f100, transno 4294969949 00000004:00080000:3.0:1715330331.621406:0:3688:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d48e300, transno 4294969950 00000100:00100000:3.0:1715330331.621408:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942521344:0@lo:400:kworker.0 00000100:00100000:3.0:1715330331.621417:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3688:1798653942520768:0@lo:400:kworker.0 00000100:00100000:3.0:1715330331.621423:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942521024:0@lo:400:kworker.0 00000100:00100000:3.0:1715330331.621428:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942521280:0@lo:400:kworker.0 00000004:00080000:3.0:1715330331.621773:0:10804:0:(osp_sync.c:1105:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 49 done 00000100:00100000:3.0:1715330331.637616:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d645f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942521408:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1715330331.637704:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330331.637757:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942521408 00000100:00100000:1.0:1715330331.637768:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942521408 00000100:00100000:1.0:1715330331.637813:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1715330331.637819:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942521408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1715330331.637856:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 67507904 pending 0 free 3923546112 avail 3692023808 00000100:00100000:1.0:1715330331.637912:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942521408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330331.637919:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1715330331.638257:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d645f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942521408:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1715330331.651288:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f579c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942521472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1715330331.651856:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330331.651884:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942521472 00000100:00100000:0.0:1715330331.651895:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942521472 00000100:00100000:0.0:1715330331.651936:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1715330331.651942:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942521472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1715330331.651965:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 67507904 pending 0 free 3923546112 avail 3692023808 00000100:00100000:0.0:1715330331.652390:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942521472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 447us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330331.652397:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1715330331.652410:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f579c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942521472:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1715330332.275042:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1715330332.834781:0:30671:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 61b: mmap() of unstriped file is successful ========================================================== 04:38:52 (1715330332) 00000100:00100000:2.0:1715330332.876102:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330332.877040:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938114112 00000100:00100000:3.0:1715330332.877054:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938114112 00000100:00080000:0.0:1715330332.877271:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330302 00000100:00100000:3.0:1715330332.877474:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23806 00000100:00100000:3.0:1715330332.877481:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+11:20162:x1798653938114112:12345-192.168.204.49@tcp:101:mmap_mknod_test.0 00010000:00010000:3.0:1715330332.877498:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330332.877515:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da821c0/0xd895711d66dbb1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbe57 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330332.877560:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81440/0xd895711d66dbb21 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330332.877571:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81440/0xd895711d66dbb21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330332.877580:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81440/0xd895711d66dbb21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00200000:3.0:1715330332.877612:0:11283:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 270336 00000004:00200000:3.0:1715330332.877615:0:11283:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1715330332.877634:0:11283:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81440/0xd895711d66dbb21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330332.877647:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da821c0/0xd895711d66dbb1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe57 expref: 13 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330332.877659:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81440/0xd895711d66dbb21 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe57 expref: 12 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330332.877666:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:3.0:1715330332.877668:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1715330332.877670:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011da81440, rc 0) 00000100:00100000:3.0:1715330332.878571:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+12:20162:x1798653938114112:12345-192.168.204.49@tcp:101:mmap_mknod_test.0 Request processed in 1086us (2475us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330332.878578:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23806 00000100:00100000:0.0:1715330332.883832:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330332.883968:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938114240 00000100:00100000:3.0:1715330332.883977:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938114240 00000100:00100000:3.0:1715330332.884013:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23807 00000100:00100000:3.0:1715330332.884020:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091eedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+12:20162:x1798653938114240:12345-192.168.204.49@tcp:36:mmap_mknod_test.0 00010000:00010000:3.0:1715330332.884176:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330332.884203:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81440/0xd895711d66dbb21 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe57 expref: 12 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330332.884218:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:3.0:1715330332.884222:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330332.884289:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da818c0/0xd895711d66dbb28 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330332.884299:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da818c0/0xd895711d66dbb28 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330332.884305:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da818c0/0xd895711d66dbb28 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330332.884316:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80b40/0xd895711d66dbb2f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x55a16aa0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330332.884324:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80b40/0xd895711d66dbb2f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x55a16aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330332.884329:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80b40/0xd895711d66dbb2f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x55a16aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330332.885679:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da818c0/0xd895711d66dbb28 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330332.885688:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da818c0/0xd895711d66dbb28 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330332.885694:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da818c0/0xd895711d66dbb28 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330332.885699:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da818c0/0xd895711d66dbb28 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330332.885715:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da818c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330332.885719:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da818c0/0xd895711d66dbb28 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330332.885726:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da818c0/0xd895711d66dbb28 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330332.885752:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:3.0:1715330332.885755:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330332.885758:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da818c0/0xd895711d66dbb28 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330332.885763:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da818c0/0xd895711d66dbb28 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:3.0:1715330332.885773:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880091eedf80 reply state ffff88008d560000 transno 4294984069 ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80b40/0xd895711d66dbb2f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x55a16aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330332.885781:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80b40/0xd895711d66dbb2f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x55a16aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330332.885786:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x55a16aa0 (ffff88012ca48d00) 00010000:00010000:3.0:1715330332.885788:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330332.885790:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330332.885889:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091eedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+13:20162:x1798653938114240:12345-192.168.204.49@tcp:36:mmap_mknod_test.0 Request processed in 1866us (2063us total) trans 4294984069 rc 0/0 00000100:00100000:3.0:1715330332.885898:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23807 00000100:00100000:0.0:1715330332.890882:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330332.891065:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938114304 00000100:00100000:3.0:1715330332.891073:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938114304 00000100:00100000:2.0:1715330332.892333:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23808 00000100:00100000:2.0:1715330332.892342:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+13:20162:x1798653938114304:12345-192.168.204.49@tcp:101:mmap_mknod_test.0 00010000:00010000:2.0:1715330332.892368:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330332.892389:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b73c0/0xd895711d66dbb36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbe5e expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330332.892442:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5b00/0xd895711d66dbb3d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330332.892453:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5b00/0xd895711d66dbb3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330332.892462:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5b00/0xd895711d66dbb3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00000004:00200000:2.0:1715330332.892501:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 270336 00000004:00200000:2.0:1715330332.892504:0:9622:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1715330332.892523:0:9622:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5b00/0xd895711d66dbb3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330332.892542:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b73c0/0xd895711d66dbb36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe5e expref: 15 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330332.892554:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5b00/0xd895711d66dbb3d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe5e expref: 14 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330332.892561:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:2.0:1715330332.892564:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1715330332.892566:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938b5b00, rc 0) 00000100:00100000:2.0:1715330332.892631:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+14:20162:x1798653938114304:12345-192.168.204.49@tcp:101:mmap_mknod_test.0 Request processed in 290us (1755us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330332.892637:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23808 00000100:00100000:2.0:1715330332.900838:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330332.900900:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938114368 00000100:00100000:3.0:1715330332.900910:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938114368 00000100:00100000:3.0:1715330332.900960:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23809 00000100:00100000:3.0:1715330332.900967:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f579c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+14:20162:x1798653938114368:12345-192.168.204.49@tcp:101:mmap_mknod_test.0 00010000:00010000:3.0:1715330332.900982:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330332.900998:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da821c0/0xd895711d66dbb44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbe65 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330332.901045:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81b00/0xd895711d66dbb4b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330332.901056:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81b00/0xd895711d66dbb4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330332.901065:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81b00/0xd895711d66dbb4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330332.901073:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83840/0xd895711d66dbb52 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x55a16aa0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330332.901082:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83840/0xd895711d66dbb52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55a16aa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330332.901087:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83840/0xd895711d66dbb52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55a16aa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330332.901132:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81680/0xd895711d66dbb59 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1590:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330332.901138:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81680/0xd895711d66dbb59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1590:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330332.901143:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81680/0xd895711d66dbb59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1590:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00200000:3.0:1715330332.901170:0:11283:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1590:0x0]: returning size 0 00000004:00200000:3.0:1715330332.901173:0:11283:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1715330332.901186:0:11283:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81680/0xd895711d66dbb59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1590:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330332.901194:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81680/0xd895711d66dbb59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1590:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330332.901201:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81b00/0xd895711d66dbb4b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330332.901206:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81b00/0xd895711d66dbb4b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330332.901211:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81b00/0xd895711d66dbb4b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330332.901216:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81b00/0xd895711d66dbb4b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330332.901224:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da81b00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330332.901227:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81b00/0xd895711d66dbb4b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330332.901233:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81b00/0xd895711d66dbb4b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330332.901241:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:3.0:1715330332.901243:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330332.901246:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81b00/0xd895711d66dbb4b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330332.901251:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81b00/0xd895711d66dbb4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330332.901260:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83840/0xd895711d66dbb52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55a16aa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330332.901264:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83840/0xd895711d66dbb52 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55a16aa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330332.901269:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83840/0xd895711d66dbb52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55a16aa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330332.901272:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da83840 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330332.901274:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83840/0xd895711d66dbb52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55a16aa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330332.901278:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83840/0xd895711d66dbb52 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55a16aa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330332.901283:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x55a16aa0 (ffff88012ca48d00) 00010000:00010000:3.0:1715330332.901285:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330332.901287:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83840/0xd895711d66dbb52 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x55a16aa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330332.901291:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83840/0xd895711d66dbb52 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x55a16aa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330332.901307:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da821c0/0xd895711d66dbb44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe65 expref: 16 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330332.901316:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81680/0xd895711d66dbb59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1590:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe65 expref: 15 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330332.901322:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1590:0x0].0x0 (ffff88012ca48000) 00010000:00010000:3.0:1715330332.901323:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330332.901325:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011da81680, rc 0) 00000100:00100000:3.0:1715330332.901384:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f579c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+15:20162:x1798653938114368:12345-192.168.204.49@tcp:101:mmap_mknod_test.0 Request processed in 417us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330332.901390:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23809 00000100:00100000:0.0:1715330332.909382:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330332.909501:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938114432 00000100:00100000:2.0:1715330332.909509:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938114432 00000100:00100000:2.0:1715330332.909553:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23810 00000100:00100000:2.0:1715330332.909560:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091eec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+15:20162:x1798653938114432:12345-192.168.204.49@tcp:101:mmap_mknod_test.0 00010000:00010000:2.0:1715330332.909576:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330332.909593:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5680/0xd895711d66dbb60 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1590:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbe6c expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330332.909621:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4d80/0xd895711d66dbb67 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1590:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330332.909632:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4d80/0xd895711d66dbb67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1590:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330332.909640:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4d80/0xd895711d66dbb67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1590:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330332.909748:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5680/0xd895711d66dbb60 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1590:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe6c expref: 17 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330332.909761:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4d80/0xd895711d66dbb67 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1590:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe6c expref: 16 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330332.909767:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1590:0x0].0x0 (ffff88012ca48000) 00010000:00010000:2.0:1715330332.909769:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1715330332.909772:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938b4d80, rc 0) 00000100:00100000:2.0:1715330332.909809:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091eec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+16:20162:x1798653938114432:12345-192.168.204.49@tcp:101:mmap_mknod_test.0 Request processed in 249us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330332.909815:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23810 00000100:00100000:0.0:1715330332.917927:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330332.918075:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938114560 00000100:00100000:3.0:1715330332.918083:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938114560 00000100:00100000:3.0:1715330332.918131:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23811 00000100:00100000:3.0:1715330332.918138:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091eefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+16:20162:x1798653938114560:12345-192.168.204.49@tcp:36:mmap_mknod_test.0 00010000:00010000:3.0:1715330332.918179:0:9622:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330332.918200:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81680/0xd895711d66dbb59 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1590:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe65 expref: 16 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330332.918213:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1590:0x0].0x0 (ffff88012ca48000) 00010000:00010000:3.0:1715330332.918217:0:9622:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330332.918264:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da821c0/0xd895711d66dbb6e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1590:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330332.918275:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da821c0/0xd895711d66dbb6e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1590:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330332.918284:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da821c0/0xd895711d66dbb6e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1590:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00000004:00010000:3.0:1715330332.918363:0:9622:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880091eefb80 reply state ffff880073bda000 transno 4294984070 ns: mdt-lustre-MDT0000_UUID lock: ffff88011da821c0/0xd895711d66dbb6e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1590:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330332.918402:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da821c0/0xd895711d66dbb6e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1590:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330332.918408:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1590:0x0].0x0 (ffff88012ca48000) 00010000:00010000:3.0:1715330332.918410:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330332.918413:0:9622:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330332.919116:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091eefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+17:20162:x1798653938114560:12345-192.168.204.49@tcp:36:mmap_mknod_test.0 Request processed in 977us (1193us total) trans 4294984070 rc 0/0 00000100:00100000:3.0:1715330332.919124:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23811 00000100:00100000:0.0:1715330332.921240:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330332.921487:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938114624 00000100:00100000:3.0:1715330332.921495:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938114624 00000100:00100000:3.0:1715330332.921713:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23812 00000100:00100000:3.0:1715330332.921719:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091eec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+17:20162:x1798653938114624:12345-192.168.204.49@tcp:101:mmap_mknod_test.0 00010000:00010000:3.0:1715330332.921752:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330332.921769:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83840/0xd895711d66dbb75 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1590:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbe73 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330332.921824:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83840/0xd895711d66dbb75 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1590:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe73 expref: 18 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330332.921836:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83840/0xd895711d66dbb75 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1590:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe73 expref: 18 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330332.921846:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1590:0x0].0x0 (ffff88012ca48000) 00010000:00010000:3.0:1715330332.921848:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1715330332.921851:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011da83840, rc 0) 00000100:00100000:3.0:1715330332.921893:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091eec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+18:20162:x1798653938114624:12345-192.168.204.49@tcp:101:mmap_mknod_test.0 Request processed in 174us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330332.921899:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23812 00000100:00100000:1.0:1715330332.926718:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330332.926791:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938114688 00000100:00100000:0.0:1715330332.926799:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938114688 00000100:00100000:0.0:1715330332.926829:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5209 00000100:00100000:0.0:1715330332.926835:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d646a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+18:20162:x1798653938114688:12345-192.168.204.49@tcp:49:mmap_mknod_test.0 00000100:00100000:0.0:1715330332.927273:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d646a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+18:20162:x1798653938114688:12345-192.168.204.49@tcp:49:mmap_mknod_test.0 Request processed in 436us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330332.927280:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5209 00000100:00100000:1.0:1715330332.933823:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330332.933901:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938114816 00000100:00100000:2.0:1715330332.933910:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938114816 00000100:00100000:2.0:1715330332.933945:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23813 00000100:00100000:2.0:1715330332.933952:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d644380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+18:20162:x1798653938114816:12345-192.168.204.49@tcp:101:mmap_mknod_test.0 00010000:00010000:2.0:1715330332.933969:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330332.933985:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b46c0/0xd895711d66dbb7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbe7a expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330332.934176:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6880/0xd895711d66dbb83 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330332.934188:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6880/0xd895711d66dbb83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330332.934197:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6880/0xd895711d66dbb83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330332.934204:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7600/0xd895711d66dbb8a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x55a16aa0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330332.934209:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7600/0xd895711d66dbb8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55a16aa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330332.934212:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7600/0xd895711d66dbb8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55a16aa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330332.934278:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6d00/0xd895711d66dbb91 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1590:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330332.934286:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6d00/0xd895711d66dbb91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1590:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330332.934292:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6d00/0xd895711d66dbb91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1590:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00000004:00200000:2.0:1715330332.934299:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1590:0x0]: returning size 4096 00010000:00010000:2.0:1715330332.934359:0:9622:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6880/0xd895711d66dbb83 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330332.934364:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6880/0xd895711d66dbb83 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330332.934369:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6880/0xd895711d66dbb83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330332.934373:0:9622:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6880/0xd895711d66dbb83 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330332.934378:0:9622:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b6880 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330332.934381:0:9622:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6880/0xd895711d66dbb83 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330332.934385:0:9622:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6880/0xd895711d66dbb83 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330332.934394:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:2.0:1715330332.934396:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330332.934399:0:9622:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6880/0xd895711d66dbb83 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330332.934403:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6880/0xd895711d66dbb83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330332.934410:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7600/0xd895711d66dbb8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55a16aa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330332.934417:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7600/0xd895711d66dbb8a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55a16aa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330332.934422:0:9622:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7600/0xd895711d66dbb8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55a16aa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330332.934425:0:9622:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b7600 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330332.934427:0:9622:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7600/0xd895711d66dbb8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55a16aa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330332.934431:0:9622:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7600/0xd895711d66dbb8a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55a16aa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330332.934436:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x55a16aa0 (ffff88012ca48d00) 00010000:00010000:2.0:1715330332.934438:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330332.934440:0:9622:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7600/0xd895711d66dbb8a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x55a16aa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330332.934444:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7600/0xd895711d66dbb8a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x55a16aa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330332.934469:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b46c0/0xd895711d66dbb7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe7a expref: 21 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330332.934480:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6d00/0xd895711d66dbb91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1590:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe7a expref: 20 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330332.934485:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1590:0x0].0x0 (ffff88012ca48000) 00010000:00010000:2.0:1715330332.934486:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330332.934488:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938b6d00, rc 0) 00000100:00100000:2.0:1715330332.935950:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d644380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+20:20162:x1798653938114816:12345-192.168.204.49@tcp:101:mmap_mknod_test.0 Request processed in 1991us (2128us total) trans 4294984071 rc 0/0 00000100:00100000:2.0:1715330332.935959:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23813 00000100:00100000:2.0:1715330332.940471:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330332.940540:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938114944 00000100:00100000:0.0:1715330332.940547:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938114944 00000100:00100000:0.0:1715330332.940592:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5210 00000100:00100000:0.0:1715330332.940598:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b31bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+20:20162:x1798653938114944:12345-192.168.204.49@tcp:35:mmap_mknod_test.0 00000100:00100000:0.0:1715330332.940810:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b31bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+21:20162:x1798653938114944:12345-192.168.204.49@tcp:35:mmap_mknod_test.0 Request processed in 211us (343us total) trans 4294984072 rc 0/0 00000100:00100000:0.0:1715330332.940816:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5210 00000100:00100000:3.0:1715330333.059137:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d647b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942521536:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1715330333.059201:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330333.059260:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942521536 00000100:00100000:2.0:1715330333.059309:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942521536 00000100:00100000:2.0:1715330333.059353:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3060 00000100:00100000:2.0:1715330333.059361:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942521536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1715330333.059391:0:7138:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444089856 avail 1314627584 00000100:00100000:2.0:1715330333.059424:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942521536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330333.059429:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3060 00000100:00100000:3.0:1715330333.059443:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d647b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942521536:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1715330333.156049:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330333.157239:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330333.157357:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938115072 00000100:00100000:2.0:1715330333.157367:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938115072 00000100:00100000:2.0:1715330333.157424:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 314 00000100:00100000:2.0:1715330333.157432:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938115072:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:2.0:1715330333.157493:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938115072:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 61us (1452us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330333.157499:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 314 00000100:00080000:0.0:1715330333.157648:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330303 00000100:00100000:1.0:1715330333.157722:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330333.157767:0:17217:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938115200 00000100:00100000:3.0:1715330333.157773:0:17217:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938115200 00000100:00100000:3.0:1715330333.157940:0:17217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 225 00000100:00100000:3.0:1715330333.157945:0:17217:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d646d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:72de1896-1df4-4b3a-930a-9116d2c66168+5:2013:x1798653938115200:12345-192.168.204.49@tcp:400:kworker.0 00000100:00080000:0.0:1715330333.157965:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330303 00000100:00100000:1.0:1715330333.159218:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330333.159269:0:7130:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938115008 00000100:00100000:1.0:1715330333.159274:0:7130:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938115008 00000100:00100000:1.0:1715330333.159317:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 347 00000100:00100000:1.0:1715330333.159323:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007666e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2013:x1798653938115008:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:1.0:1715330333.159361:0:7130:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007666e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2013:x1798653938115008:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 38us (1639us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330333.159366:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 347 00000100:00080000:1.0:1715330333.159389:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330303 00000100:00100000:3.0:1715330333.159506:0:17217:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d646d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:72de1896-1df4-4b3a-930a-9116d2c66168+5:2013:x1798653938115200:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 1560us (2270us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330333.159514:0:17217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 225 00000100:00100000:3.0:1715330333.159524:0:17217:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938115136 00000100:00100000:3.0:1715330333.159526:0:17217:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938115136 00000100:00100000:3.0:1715330333.159543:0:17217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 226 00000100:00100000:3.0:1715330333.159547:0:17217:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d647b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938115136:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:3.0:1715330333.159564:0:17217:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d647b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938115136:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 16us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330333.159568:0:17217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 226 00000100:00080000:1.0:1715330333.159768:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330303 00010000:00010000:1.0:1715330333.277155:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330334.280050:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330334.517206:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1715330334.517226:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b319180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942521600:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1715330334.517282:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330334.517314:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942521600 00000100:00100000:2.0:1715330334.517320:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942521600 00000100:00100000:2.0:1715330334.517350:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3061 00000100:00100000:2.0:1715330334.517356:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d62bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942521600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1715330334.517383:0:7138:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445060608 avail 1315598336 00000100:00100000:2.0:1715330334.517410:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d62bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942521600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330334.517416:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3061 00000100:00100000:2.0:1715330334.517446:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b319180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942521600:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1715330335.283465:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330335.352259:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1715330335.352295:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d62a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942521664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1715330335.352391:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330335.352850:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942521664 00000100:00100000:1.0:1715330335.352859:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942521664 00000100:00080000:2.0:1715330335.352903:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330305 00000100:00100000:1.0:1715330335.352926:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1715330335.352934:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b160000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942521664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1715330335.352980:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1715330335.353044:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b160000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942521664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330335.353052:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1715330335.353081:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d62a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942521664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1715330335.380812:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1715330335.380846:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d645f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942521728:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1715330335.380946:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330335.381113:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942521728 00000100:00100000:1.0:1715330335.381122:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942521728 00000100:00080000:2.0:1715330335.381183:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330305 00000100:00100000:1.0:1715330335.382332:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1715330335.382344:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091eec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942521728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1715330335.382389:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1715330335.384593:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091eec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942521728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2240us (3636us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330335.384608:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1715330335.384913:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d645f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942521728:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1715330336.286359:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330336.627770:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3691:1798653942521984:0@lo:400:kworker.0 00000100:00100000:2.0:1715330336.627783:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d608a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3688:1798653942521792:0@lo:400:kworker.0 00000100:00100000:1.0:1715330336.627857:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942521920:0@lo:400:kworker.0 00000100:00100000:0.0:1715330336.627917:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3689:1798653942521856:0@lo:400:kworker.0 00000100:00100000:2.0:1715330336.627966:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330336.627968:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330336.627984:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942522048:0@lo:400:kworker.0 00000100:00100000:3.0:1715330336.627987:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942522240:0@lo:400:kworker.0 00000100:00100000:2.0:1715330336.628002:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330336.628007:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330336.628009:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942522304:0@lo:400:kworker.0 00000100:00100000:3.0:1715330336.628017:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942522496:0@lo:400:kworker.0 00000100:00100000:2.0:1715330336.628019:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330336.628025:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942522560:0@lo:400:kworker.0 00000100:00100000:3.0:1715330336.628031:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330336.628042:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942521984 00000100:00100000:2.0:1715330336.628046:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942521984 00000100:00100000:3.0:1715330336.628059:0:7129:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942521792 00000100:00100000:3.0:1715330336.628062:0:7129:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942521792 00000100:00100000:2.0:1715330336.628069:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1715330336.628073:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3691:x1798653942521984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330336.628087:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1715330336.628091:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007666dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3688:x1798653942521792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330336.628099:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3691:x1798653942521984:12345-0@lo:400:kworker.0 Request processed in 25us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330336.628102:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1715330336.628115:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942522048 00000100:00100000:2.0:1715330336.628116:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942522048 00000100:00100000:3.0:1715330336.628117:0:7129:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007666dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3688:x1798653942521792:12345-0@lo:400:kworker.0 Request processed in 25us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330336.628121:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1715330336.628127:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3062 00000100:00100000:2.0:1715330336.628129:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d62a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942522048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330336.628144:0:17215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942522240 00000100:00100000:2.0:1715330336.628144:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d62a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942522048:12345-0@lo:400:kworker.0 Request processed in 14us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330336.628146:0:17215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942522240 00000100:00100000:2.0:1715330336.628147:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3062 00000100:00100000:2.0:1715330336.628155:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942522304 00000100:00100000:2.0:1715330336.628156:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942522304 00000100:00100000:3.0:1715330336.628161:0:17215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942522496 00000100:00100000:3.0:1715330336.628163:0:17215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942522496 00000100:00100000:2.0:1715330336.628165:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1715330336.628167:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942522240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330336.628176:0:17215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1715330336.628178:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942522240:12345-0@lo:400:kworker.0 Request processed in 10us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330336.628180:0:17215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b319180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942522304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330336.628182:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1715330336.628186:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1715330336.628188:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942522496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330336.628198:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942522496:12345-0@lo:400:kworker.0 Request processed in 10us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330336.628201:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1715330336.628206:0:17215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b319180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942522304:12345-0@lo:400:kworker.0 Request processed in 24us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330336.628210:0:17215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1715330336.628212:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330336.628219:0:17215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942522560 00000100:00100000:3.0:1715330336.628221:0:17215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942522560 00000100:00100000:2.0:1715330336.628228:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d608a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3688:1798653942521792:0@lo:400:kworker.0 00000100:00100000:3.0:1715330336.628234:0:17215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1715330336.628234:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942522048:0@lo:400:kworker.0 00000100:00100000:3.0:1715330336.628238:0:17215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942522560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330336.628239:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942522304:0@lo:400:kworker.0 00000100:00100000:3.0:1715330336.628261:0:17215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942522560:12345-0@lo:400:kworker.0 Request processed in 22us (47us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330336.628265:0:17215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1715330336.628268:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942522560:0@lo:400:kworker.0 00000100:00080000:3.0:1715330336.628276:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330306 00000100:00080000:3.0:1715330336.628280:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330306 00000100:00100000:3.0:1715330336.628293:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3691:1798653942521984:0@lo:400:kworker.0 00000100:00100000:3.0:1715330336.628300:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942522240:0@lo:400:kworker.0 00000100:00100000:3.0:1715330336.628306:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942522496:0@lo:400:kworker.0 00000100:00100000:1.0:1715330336.628357:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330336.628376:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3690:1798653942522176:0@lo:400:kworker.0 00000100:00100000:2.0:1715330336.628385:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942521920 00000100:00100000:2.0:1715330336.628387:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942521920 00000100:00100000:1.0:1715330336.628392:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330336.628406:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3063 00000100:00100000:2.0:1715330336.628408:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d645f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942521920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330336.628427:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d645f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942521920:12345-0@lo:400:kworker.0 Request processed in 18us (71us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330336.628430:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3063 00000100:00100000:1.0:1715330336.628457:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3690:1798653942522432:0@lo:400:kworker.0 00000100:00100000:1.0:1715330336.628476:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330336.628488:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942522176 00000100:00100000:2.0:1715330336.628489:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942522176 00000100:00100000:1.0:1715330336.628495:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942521920:0@lo:400:kworker.0 00000100:00100000:2.0:1715330336.628502:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942522432 00000100:00100000:2.0:1715330336.628504:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942522432 00000100:00100000:2.0:1715330336.628515:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1715330336.628518:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3690:x1798653942522176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330336.628540:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3690:x1798653942522176:12345-0@lo:400:kworker.0 Request processed in 21us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330336.628540:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330336.628544:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1715330336.628549:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942521856 00000100:00100000:2.0:1715330336.628551:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942521856 00000100:00100000:0.0:1715330336.628556:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3689:1798653942522112:0@lo:400:kworker.0 00000100:00100000:2.0:1715330336.628558:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1715330336.628560:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3690:x1798653942522432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330336.628572:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330336.628573:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3690:x1798653942522432:12345-0@lo:400:kworker.0 Request processed in 12us (97us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330336.628575:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1715330336.628578:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3689:1798653942522368:0@lo:400:kworker.0 00000100:00100000:2.0:1715330336.628579:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942522112 00000100:00100000:2.0:1715330336.628580:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942522112 00000100:00100000:2.0:1715330336.628585:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1715330336.628586:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091eed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1798653942521856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330336.628591:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330336.628597:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091eed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1798653942521856:12345-0@lo:400:kworker.0 Request processed in 10us (59us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330336.628600:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1715330336.628603:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942522368 00000100:00100000:2.0:1715330336.628604:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942522368 00000100:00100000:0.0:1715330336.628608:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3689:1798653942521856:0@lo:400:kworker.0 00000100:00100000:2.0:1715330336.628609:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1715330336.628610:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091eeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1798653942522112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330336.628624:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091eeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1798653942522112:12345-0@lo:400:kworker.0 Request processed in 13us (52us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330336.628628:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1715330336.628631:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1715330336.628632:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091eee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3689:x1798653942522368:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1715330336.628652:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330306 00000100:00080000:2.0:1715330336.628653:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330306 00000100:00100000:0.0:1715330336.628668:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091eee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3689:x1798653942522368:12345-0@lo:400:kworker.0 Request processed in 35us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330336.628673:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1715330336.628695:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3689:1798653942522112:0@lo:400:kworker.0 00000100:00100000:0.0:1715330336.628710:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3689:1798653942522368:0@lo:400:kworker.0 00000100:00100000:1.0:1715330336.628796:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3690:1798653942522176:0@lo:400:kworker.0 00000100:00100000:1.0:1715330336.628802:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3690:1798653942522432:0@lo:400:kworker.0 00000100:00100000:2.0:1715330336.643977:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1715330336.644000:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942522624:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1715330336.644051:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330336.644116:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942522624 00000100:00100000:1.0:1715330336.644123:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942522624 00000100:00100000:1.0:1715330336.644167:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1715330336.644174:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942522624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1715330336.644203:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 67507904 pending 0 free 3923546112 avail 3692023808 00000100:00100000:1.0:1715330336.644237:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942522624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330336.644247:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1715330336.644379:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942522624:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1715330336.660591:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1715330336.660608:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942522688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1715330336.660680:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330336.660921:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942522688 00000100:00100000:0.0:1715330336.660927:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942522688 00000100:00100000:0.0:1715330336.660968:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1715330336.660974:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942522688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1715330336.660993:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 67507904 pending 0 free 3923546112 avail 3692023808 00000100:00100000:0.0:1715330336.661028:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942522688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330336.661033:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1715330336.661745:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942522688:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1715330337.236717:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984072 is committed 00010000:00010000:3.0:1715330337.236803:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80b40/0xd895711d66dbb2f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x55a16aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330337.236817:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80b40/0xd895711d66dbb2f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x55a16aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330337.236824:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80b40/0xd895711d66dbb2f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x55a16aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330337.236829:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da80b40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330337.236835:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80b40/0xd895711d66dbb2f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x55a16aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330337.236841:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80b40/0xd895711d66dbb2f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x55a16aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330337.236861:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x55a16aa0 (ffff88012ca48d00) 00010000:00010000:3.0:1715330337.236864:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330337.236868:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80b40/0xd895711d66dbb2f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x55a16aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330337.236872:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80b40/0xd895711d66dbb2f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x55a16aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330337.236896:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da821c0/0xd895711d66dbb6e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1590:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330337.236901:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da821c0/0xd895711d66dbb6e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1590:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330337.236906:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da821c0/0xd895711d66dbb6e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1590:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330337.236909:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da821c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330337.236910:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da821c0/0xd895711d66dbb6e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1590:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330337.236914:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da821c0/0xd895711d66dbb6e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1590:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330337.236919:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1590:0x0].0x0 (ffff88012ca48000) 00010000:00010000:3.0:1715330337.236920:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330337.236922:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da821c0/0xd895711d66dbb6e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1590:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330337.236925:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da821c0/0xd895711d66dbb6e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1590:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:1.0:1715330337.289410:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330338.067099:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1715330338.067125:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942522752:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1715330338.067205:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330338.067262:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942522752 00000100:00100000:3.0:1715330338.067273:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942522752 00000100:00100000:3.0:1715330338.067317:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3064 00000100:00100000:3.0:1715330338.067323:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942522752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1715330338.067358:0:8592:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444089856 avail 1314627584 00000100:00100000:3.0:1715330338.067396:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942522752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330338.067402:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3064 00000100:00100000:1.0:1715330338.069399:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942522752:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1715330338.159647:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330338.159693:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330338.159728:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330338.159757:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330338.159776:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330338.159800:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938115328 00000100:00100000:0.0:1715330338.159811:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938115328 00000100:00100000:0.0:1715330338.159855:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938115392 00000100:00100000:0.0:1715330338.159856:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938115392 00000100:00100000:0.0:1715330338.159870:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 321 00000100:00100000:0.0:1715330338.159875:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091eed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+15:2013:x1798653938115328:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:0.0:1715330338.159949:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091eed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+15:2013:x1798653938115328:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 74us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330338.159955:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 321 00000100:00100000:0.0:1715330338.159969:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 322 00000100:00100000:0.0:1715330338.159971:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938115392:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:0.0:1715330338.159986:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938115392:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 14us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330338.159990:0:9398:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938115456 00000100:00100000:0.0:1715330338.159990:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 322 00000100:00100000:2.0:1715330338.159995:0:9398:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938115456 00000100:00080000:0.0:1715330338.160001:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330308 00000100:00080000:0.0:1715330338.160005:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330308 00000100:00080000:0.0:1715330338.160006:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330308 00000100:00100000:2.0:1715330338.160031:0:9398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 231 00000100:00100000:2.0:1715330338.160036:0:9398:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938115456:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:3.0:1715330338.160055:0:17215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938115520 00000100:00100000:3.0:1715330338.160059:0:17215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938115520 00000100:00100000:2.0:1715330338.160068:0:9398:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938115456:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 32us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330338.160074:0:9398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 231 00000100:00100000:3.0:1715330338.160080:0:17215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 232 00000100:00100000:3.0:1715330338.160083:0:17215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:72de1896-1df4-4b3a-930a-9116d2c66168+5:2013:x1798653938115520:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:2.0:1715330338.160094:0:7130:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938115264 00000100:00100000:2.0:1715330338.160097:0:7130:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938115264 00000100:00100000:3.0:1715330338.160104:0:17215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:72de1896-1df4-4b3a-930a-9116d2c66168+5:2013:x1798653938115520:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 20us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330338.160109:0:17215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 232 00000100:00100000:2.0:1715330338.160123:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 349 00000100:00100000:2.0:1715330338.160127:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007666d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2013:x1798653938115264:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:2.0:1715330338.160151:0:7130:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007666d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2013:x1798653938115264:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 24us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330338.160157:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 349 00000100:00080000:0.0:1715330338.162435:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330308 00000100:00080000:0.0:1715330338.162443:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330308 00010000:00010000:2.0:1715330338.294633:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715330339.306331:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330339.522890:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1715330339.522918:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ae8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942522816:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1715330339.523001:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330339.523101:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942522816 00000100:00100000:0.0:1715330339.523111:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942522816 00000100:00100000:0.0:1715330339.523149:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3065 00000100:00100000:0.0:1715330339.523155:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942522816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1715330339.523192:0:8592:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445060608 avail 1315598336 00000100:00100000:0.0:1715330339.523229:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942522816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330339.523236:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3065 00000100:00100000:0.0:1715330339.523275:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ae8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942522816:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1715330340.304849:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330340.372184:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1715330340.372213:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942522880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1715330340.372289:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330340.372329:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942522880 00000100:00100000:3.0:1715330340.372336:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942522880 00000100:00100000:3.0:1715330340.372381:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1715330340.372387:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942522880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1715330340.372418:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1715330340.372447:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942522880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330340.372452:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00080000:3.0:1715330340.372470:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330310 00000100:00100000:3.0:1715330340.372495:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942522880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1715330340.402964:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ae8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942522944:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1715330340.403029:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330340.404140:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942522944 00000100:00100000:3.0:1715330340.404148:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942522944 00000100:00100000:3.0:1715330340.404241:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1715330340.404248:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942522944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1715330340.404270:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1715330340.404306:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942522944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (1278us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330340.404312:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1715330340.404391:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ae8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942522944:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1715330340.404440:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330310 00000001:02000400:1.0:1715330340.728249:0:31324:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 63a: Verify oig_wait interruption does not crash ================================================================= 04:39:00 (1715330340) 00000100:00100000:1.0:1715330340.806692:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330340.807660:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938115648 00000100:00100000:3.0:1715330340.807669:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938115648 00000100:00100000:3.0:1715330340.807714:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23814 00000100:00100000:3.0:1715330340.807720:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+15:20908:x1798653938115648:12345-192.168.204.49@tcp:101:dd.0 00010000:00010000:3.0:1715330340.807745:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330340.807747:0:7135:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1715330340.807768:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5b00/0xd895711d66dbb3d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe5e expref: 15 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330340.807780:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:3.0:1715330340.807783:0:7135:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330340.807793:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81b00/0xd895711d66dbb9f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbe81 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330340.807871:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da818c0/0xd895711d66dbba6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330340.807880:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da818c0/0xd895711d66dbba6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330340.807890:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da818c0/0xd895711d66dbba6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330340.807899:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81440/0xd895711d66dbbad lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x333666 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330340.807903:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81440/0xd895711d66dbbad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330340.807907:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81440/0xd895711d66dbbad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00080000:3.0:1715330340.808123:0:7135:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa00:0x0], index 1: 0 00010000:00010000:3.0:1715330340.808227:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da821c0/0xd895711d66dbbb4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330340.808234:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da821c0/0xd895711d66dbbb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330340.808239:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da821c0/0xd895711d66dbbb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330340.808262:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da818c0/0xd895711d66dbba6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330340.808267:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da818c0/0xd895711d66dbba6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330340.808271:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da818c0/0xd895711d66dbba6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330340.808276:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da818c0/0xd895711d66dbba6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330340.808281:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da818c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330340.808284:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da818c0/0xd895711d66dbba6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330340.808290:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da818c0/0xd895711d66dbba6 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330340.808296:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:3.0:1715330340.808298:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330340.808301:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da818c0/0xd895711d66dbba6 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330340.808305:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da818c0/0xd895711d66dbba6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00000004:00010000:3.0:1715330340.808313:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007d634e00 reply state ffff880073bd9000 transno 4294984073 ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81440/0xd895711d66dbbad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330340.808319:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81440/0xd895711d66dbbad lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330340.808323:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x333666 (ffff88008b0d2000) 00010000:00010000:3.0:1715330340.808325:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330340.808327:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330340.808344:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81b00/0xd895711d66dbb9f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe81 expref: 17 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330340.808353:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da821c0/0xd895711d66dbbb4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe81 expref: 16 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330340.808359:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff88008b0d2c00) 00010000:00010000:3.0:1715330340.808361:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330340.808362:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011da821c0, rc 0) 00000100:00100000:3.0:1715330340.808402:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:20908:x1798653938115648:12345-192.168.204.49@tcp:101:dd.0 Request processed in 681us (1716us total) trans 4294984073 rc 0/0 00000100:00100000:3.0:1715330340.808408:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23814 00000100:00080000:0.0:1715330340.808480:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330310 00000100:00100000:1.0:1715330340.816917:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330340.818484:0:17217:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938115712 00000100:00100000:3.0:1715330340.818494:0:17217:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938115712 00000100:00100000:3.0:1715330340.818547:0:17217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5343 00000100:00100000:3.0:1715330340.818555:0:17217:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:72de1896-1df4-4b3a-930a-9116d2c66168+5:20908:x1798653938115712:12345-192.168.204.49@tcp:101:dd.0 00010000:00010000:3.0:1715330340.818576:0:17217:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330340.818593:0:17217:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011da80b40/0xd895711d66dbbc2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbe88 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1715330340.818613:0:17217:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0xa00:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1715330340.818630:0:17217:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330340.818632:0:17217:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330340.818641:0:17217:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011da80b40/0xd895711d66dbbc2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe88 expref: 6 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330340.818654:0:17217:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011da80b40/0xd895711d66dbbc2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe88 expref: 6 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330340.818663:0:17217:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011da80b40, rc 0) 00000100:00100000:3.0:1715330340.818707:0:17217:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:72de1896-1df4-4b3a-930a-9116d2c66168+6:20908:x1798653938115712:12345-192.168.204.49@tcp:101:dd.0 Request processed in 153us (1798us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330340.818713:0:17217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5343 00000100:00080000:1.0:1715330340.818862:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330310 00010000:00010000:2.0:1715330341.308093:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330341.524223:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330341.525711:0:9403:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938115840 00000100:00100000:2.0:1715330341.525720:0:9403:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938115840 00002000:00100000:2.0:1715330341.525826:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa00:0x0] (0->4194303) req@ffff88009ae8d180 x1798653938115840/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:552/0 lens 488/0 e 0 to 0 dl 1715330352 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330341.525836:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae8d180 with x1798653938115840 ext(0->4194303) 00002000:00010000:2.0:1715330341.525841:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ae8d180 00000100:00100000:2.0:1715330341.525867:0:9403:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 17 00000100:00100000:2.0:1715330341.525874:0:9403:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938115840:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330341.595651:0:9403:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+8:2014:x1798653938115840:12345-192.168.204.49@tcp:4:dd.0 Request processed in 69767us (71434us total) trans 4294969951 rc 0/0 00000100:00100000:2.0:1715330341.595664:0:9403:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 17 00002000:00100000:2.0:1715330341.595675:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa00:0x0] (0->4194303) req@ffff88009ae8d180 x1798653938115840/t4294969951(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:552/0 lens 488/448 e 0 to 0 dl 1715330352 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330341.595684:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae8d180 with x1798653938115840 ext(0->4194303) 00002000:00010000:2.0:1715330341.595689:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ae8d180 00000100:00100000:3.0:1715330341.635269:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3688:1798653942523072:0@lo:400:kworker.0 00000100:00100000:3.0:1715330341.635320:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330341.635338:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3688:1798653942523328:0@lo:400:kworker.0 00000100:00100000:3.0:1715330341.635351:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330341.635359:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3688:1798653942523584:0@lo:400:kworker.0 00000100:00100000:3.0:1715330341.635372:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330341.635388:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1715330341.635392:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942523136:0@lo:400:kworker.0 00000100:00100000:3.0:1715330341.635408:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330341.635416:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3688:1798653942523392:0@lo:400:kworker.0 00000100:00100000:3.0:1715330341.635428:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330341.635436:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3688:1798653942523648:0@lo:400:kworker.0 00000100:00100000:3.0:1715330341.635447:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330341.635469:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942523072 00000100:00100000:3.0:1715330341.635475:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942523072 00000100:00100000:2.0:1715330341.635478:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3691:1798653942523008:0@lo:400:kworker.0 00000100:00100000:3.0:1715330341.635502:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942523328 00000100:00100000:3.0:1715330341.635504:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942523328 00000100:00100000:2.0:1715330341.635526:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330341.635542:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942523264:0@lo:400:kworker.0 00000100:00100000:1.0:1715330341.635570:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3690:1798653942523200:0@lo:400:kworker.0 00000100:00100000:2.0:1715330341.635571:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330341.635583:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942523520:0@lo:400:kworker.0 00000100:00100000:1.0:1715330341.635593:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330341.635601:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330341.635601:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942523456:0@lo:400:kworker.0 00000100:00100000:2.0:1715330341.635613:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942523776:0@lo:400:kworker.0 00000100:00100000:1.0:1715330341.635616:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330341.635628:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942523712:0@lo:400:kworker.0 00000100:00100000:2.0:1715330341.635634:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330341.635647:0:17217:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942523520 00000100:00100000:1.0:1715330341.635649:0:17217:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942523520 00000100:00100000:2.0:1715330341.635661:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942523584 00000100:00100000:2.0:1715330341.635664:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942523584 00000100:00100000:1.0:1715330341.635667:0:17217:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942523456 00000100:00100000:1.0:1715330341.635669:0:17217:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942523456 00000100:00100000:1.0:1715330341.635678:0:17217:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942523776 00000100:00100000:1.0:1715330341.635680:0:17217:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942523776 00000100:00100000:0.0:1715330341.638663:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942523392 00000100:00100000:0.0:1715330341.638674:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942523392 00000100:00100000:3.0:1715330341.638790:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942523648 00000100:00100000:3.0:1715330341.638794:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942523648 00000100:00100000:2.0:1715330341.638974:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942523200 00000100:00100000:2.0:1715330341.638978:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942523200 00000100:00100000:2.0:1715330341.638991:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1715330341.638997:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3688:x1798653942523072:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1715330341.639057:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330311 00000100:00080000:1.0:1715330341.639061:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330311 00000100:00080000:1.0:1715330341.639064:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330311 00000100:00100000:2.0:1715330341.639081:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3688:x1798653942523072:12345-0@lo:400:kworker.0 Request processed in 83us (3760us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330341.639081:0:9398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1715330341.639087:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1715330341.639087:0:9398:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942523520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330341.639100:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1715330341.639104:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1798653942523328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330341.639126:0:9398:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942523520:12345-0@lo:400:kworker.0 Request processed in 39us (3523us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330341.639129:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1798653942523328:12345-0@lo:400:kworker.0 Request processed in 24us (3777us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330341.639132:0:9398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1715330341.639134:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1715330341.639141:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1715330341.639144:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3688:x1798653942523584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330341.639146:0:9398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1715330341.639149:0:9398:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942523456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330341.639165:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3688:x1798653942523584:12345-0@lo:400:kworker.0 Request processed in 20us (3792us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330341.639170:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1715330341.639172:0:9398:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942523456:12345-0@lo:400:kworker.0 Request processed in 22us (3555us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330341.639177:0:9398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1715330341.639178:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1715330341.639181:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3690:x1798653942523200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330341.639192:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330341.639199:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3690:x1798653942523200:12345-0@lo:400:kworker.0 Request processed in 17us (3606us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330341.639204:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1715330341.639227:0:7130:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942523008 00000100:00100000:2.0:1715330341.639231:0:7130:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942523008 00000100:00100000:1.0:1715330341.639232:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3690:1798653942523200:0@lo:400:kworker.0 00000100:00100000:1.0:1715330341.639242:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942523456:0@lo:400:kworker.0 00000100:00100000:2.0:1715330341.639252:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1715330341.639256:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007666d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3691:x1798653942523008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330341.639261:0:9398:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942523712 00000100:00100000:1.0:1715330341.639263:0:9398:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942523712 00000100:00100000:1.0:1715330341.639277:0:9398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1715330341.639279:0:7130:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007666d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3691:x1798653942523008:12345-0@lo:400:kworker.0 Request processed in 23us (3753us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330341.639281:0:9398:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942523712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330341.639284:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1715330341.639303:0:9398:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942523712:12345-0@lo:400:kworker.0 Request processed in 21us (111us total) trans 0 rc 0/0 00000100:00080000:2.0:1715330341.639307:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330311 00000100:00100000:1.0:1715330341.639307:0:9398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00080000:2.0:1715330341.639309:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330311 00000100:00100000:1.0:1715330341.639327:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3691:1798653942523008:0@lo:400:kworker.0 00000100:00100000:2.0:1715330341.639342:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3688:1798653942523072:0@lo:400:kworker.0 00000100:00100000:1.0:1715330341.639346:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942523520:0@lo:400:kworker.0 00000100:00100000:2.0:1715330341.639353:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3688:1798653942523328:0@lo:400:kworker.0 00000100:00100000:2.0:1715330341.639362:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3688:1798653942523584:0@lo:400:kworker.0 00000100:00100000:1.0:1715330341.639363:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942523712:0@lo:400:kworker.0 00000100:00100000:1.0:1715330341.639384:0:17217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1715330341.639387:0:17217:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942523776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330341.639406:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942523136 00000100:00100000:2.0:1715330341.639409:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942523136 00000100:00100000:1.0:1715330341.639410:0:17217:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942523776:12345-0@lo:400:kworker.0 Request processed in 22us (3776us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330341.639414:0:17217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1715330341.639426:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942523264 00000100:00100000:2.0:1715330341.639428:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942523264 00000100:00100000:1.0:1715330341.639430:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942523776:0@lo:400:kworker.0 00000100:00100000:2.0:1715330341.639440:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3066 00000100:00100000:2.0:1715330341.639443:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942523136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330341.639444:0:7139:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3067 00000100:00100000:1.0:1715330341.639447:0:7139:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942523264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330341.639473:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942523136:12345-0@lo:400:kworker.0 Request processed in 28us (4063us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330341.639473:0:7139:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942523264:12345-0@lo:400:kworker.0 Request processed in 25us (3902us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330341.639477:0:7139:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3067 00000100:00100000:2.0:1715330341.639480:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3066 00000100:00100000:1.0:1715330341.639495:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942523264:0@lo:400:kworker.0 00000100:00100000:2.0:1715330341.639503:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942523136:0@lo:400:kworker.0 00000100:00100000:3.0:1715330341.639623:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1715330341.639628:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3688:x1798653942523648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330341.639642:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1715330341.639646:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3688:x1798653942523392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330341.639655:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3688:x1798653942523648:12345-0@lo:400:kworker.0 Request processed in 27us (4207us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330341.639660:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1715330341.639674:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3688:x1798653942523392:12345-0@lo:400:kworker.0 Request processed in 28us (4244us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330341.639679:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1715330341.639786:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3688:1798653942523392:0@lo:400:kworker.0 00000100:00100000:2.0:1715330341.639796:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3688:1798653942523648:0@lo:400:kworker.0 00000100:00100000:0.0:1715330341.650931:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1715330341.650948:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942523840:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1715330341.651002:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330341.651080:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942523840 00000100:00100000:1.0:1715330341.651086:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942523840 00000100:00100000:1.0:1715330341.651122:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1715330341.651127:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942523840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1715330341.651145:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 114688 granted 75945664 pending 4218880 free 3923546112 avail 3692023808 00000100:00100000:1.0:1715330341.655707:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942523840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 4568us (4693us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330341.655720:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1715330341.655854:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942523840:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1715330341.666988:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942523904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1715330341.667045:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330341.669289:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942523904 00000100:00100000:1.0:1715330341.669298:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942523904 00000100:00100000:1.0:1715330341.669345:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1715330341.669351:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942523904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1715330341.669373:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 114688 granted 75945664 pending 4218880 free 3923546112 avail 3692023808 00000100:00100000:1.0:1715330341.670157:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942523904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 805us (3110us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330341.670164:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1715330341.670452:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942523904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1715330342.176847:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330342.177872:0:9403:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938115968 00000100:00100000:2.0:1715330342.177884:0:9403:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938115968 00002000:00100000:2.0:1715330342.177952:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa00:0x0] (4194304->8388607) req@ffff88009ae8dc00 x1798653938115968/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:553/0 lens 488/0 e 0 to 0 dl 1715330353 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330342.177962:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae8dc00 with x1798653938115968 ext(4194304->8388607) 00002000:00010000:2.0:1715330342.177967:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ae8dc00 00000100:00100000:2.0:1715330342.177986:0:9403:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 18 00000100:00100000:2.0:1715330342.177992:0:9403:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+8:2011:x1798653938115968:12345-192.168.204.49@tcp:4:dd.0 00000100:00080000:0.0:1715330342.178917:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330312 00000100:00100000:0.0:1715330342.257353:0:9403:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+10:2011:x1798653938115968:12345-192.168.204.49@tcp:4:dd.0 Request processed in 79350us (80504us total) trans 4294969952 rc 0/0 00000100:00100000:0.0:1715330342.257366:0:9403:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 18 00002000:00100000:0.0:1715330342.257377:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa00:0x0] (4194304->8388607) req@ffff88009ae8dc00 x1798653938115968/t4294969952(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:553/0 lens 488/448 e 0 to 0 dl 1715330353 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330342.257386:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae8dc00 with x1798653938115968 ext(4194304->8388607) 00002000:00010000:0.0:1715330342.257391:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ae8dc00 00010000:00010000:2.0:1715330342.312316:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330342.944677:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330342.944780:0:9403:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938116160 00000100:00100000:2.0:1715330342.944788:0:9403:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938116160 00002000:00100000:2.0:1715330342.944826:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa00:0x0] (8388608->12582911) req@ffff88009ae8df80 x1798653938116160/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:553/0 lens 488/0 e 0 to 0 dl 1715330353 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330342.944836:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae8df80 with x1798653938116160 ext(8388608->12582911) 00002000:00010000:2.0:1715330342.944841:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ae8df80 00000100:00100000:2.0:1715330342.944931:0:9403:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 19 00000100:00100000:2.0:1715330342.944937:0:9403:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+10:2013:x1798653938116160:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330343.014441:0:9403:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+12:2013:x1798653938116160:12345-192.168.204.49@tcp:4:dd.0 Request processed in 69494us (69762us total) trans 4294969953 rc 0/0 00000100:00100000:2.0:1715330343.014453:0:9403:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 19 00002000:00100000:2.0:1715330343.014464:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa00:0x0] (8388608->12582911) req@ffff88009ae8df80 x1798653938116160/t4294969953(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:553/0 lens 488/448 e 0 to 0 dl 1715330353 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330343.014478:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae8df80 with x1798653938116160 ext(8388608->12582911) 00002000:00010000:2.0:1715330343.014484:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ae8df80 00000100:00100000:2.0:1715330343.075379:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942523968:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1715330343.075444:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330343.075506:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942523968 00000100:00100000:2.0:1715330343.075512:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942523968 00000100:00100000:2.0:1715330343.075600:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3068 00000100:00100000:2.0:1715330343.075606:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942523968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1715330343.075641:0:7138:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444089856 avail 1314627584 00000100:00100000:2.0:1715330343.075676:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942523968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330343.075683:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3068 00000100:00100000:2.0:1715330343.075721:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942523968:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1715330343.172406:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330343.172451:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330343.172488:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330343.172537:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330343.172573:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938116288 00000100:00100000:0.0:1715330343.172580:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938116288 00000100:00100000:0.0:1715330343.172616:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938116352 00000100:00100000:0.0:1715330343.172618:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938116352 00000100:00100000:0.0:1715330343.172631:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 329 00000100:00100000:0.0:1715330343.172637:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+17:2014:x1798653938116288:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:0.0:1715330343.172697:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+17:2014:x1798653938116288:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 59us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330343.172704:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 329 00000100:00100000:0.0:1715330343.172716:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 330 00000100:00100000:0.0:1715330343.172720:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938116352:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:0.0:1715330343.172763:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938116352:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 42us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330343.172769:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 330 00000100:00080000:0.0:1715330343.172781:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330313 00000100:00080000:0.0:1715330343.172784:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330313 00000100:00100000:1.0:1715330343.173080:0:17217:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938116416 00000100:00100000:1.0:1715330343.173084:0:17217:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938116416 00000100:00100000:1.0:1715330343.173118:0:17217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 237 00000100:00100000:1.0:1715330343.173122:0:17217:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938116416:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:1.0:1715330343.173146:0:17217:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938116416:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 23us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330343.173151:0:17217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 237 00000100:00100000:1.0:1715330343.173174:0:7129:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938116224 00000100:00100000:1.0:1715330343.173177:0:7129:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938116224 00000100:00100000:1.0:1715330343.173199:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 351 00000100:00100000:1.0:1715330343.173202:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007666d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2014:x1798653938116224:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:1.0:1715330343.173221:0:7129:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007666d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2014:x1798653938116224:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 18us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330343.173226:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 351 00000100:00080000:0.0:1715330343.175483:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330313 00000100:00080000:0.0:1715330343.175489:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330313 00010000:00010000:3.0:1715330343.316512:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330343.561465:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330343.561616:0:9403:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938116544 00000100:00100000:2.0:1715330343.561625:0:9403:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938116544 00002000:00100000:2.0:1715330343.561662:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa00:0x0] (12582912->16777215) req@ffff88009ae8ed80 x1798653938116544/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:554/0 lens 488/0 e 0 to 0 dl 1715330354 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330343.561670:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae8ed80 with x1798653938116544 ext(12582912->16777215) 00002000:00010000:2.0:1715330343.561675:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ae8ed80 00000100:00100000:2.0:1715330343.561830:0:9403:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 20 00000100:00100000:2.0:1715330343.561837:0:9403:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+12:2011:x1798653938116544:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330343.636001:0:9403:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+14:2011:x1798653938116544:12345-192.168.204.49@tcp:4:dd.0 Request processed in 74154us (74534us total) trans 4294969954 rc 0/0 00000100:00100000:2.0:1715330343.636017:0:9403:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 20 00002000:00100000:2.0:1715330343.636029:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa00:0x0] (12582912->16777215) req@ffff88009ae8ed80 x1798653938116544/t4294969954(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:554/0 lens 488/448 e 0 to 0 dl 1715330354 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330343.636038:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae8ed80 with x1798653938116544 ext(12582912->16777215) 00002000:00010000:2.0:1715330343.636044:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ae8ed80 00000100:00100000:0.0:1715330344.281848:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330344.282286:0:9403:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938116736 00000100:00100000:2.0:1715330344.282294:0:9403:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938116736 00002000:00100000:2.0:1715330344.282339:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa00:0x0] (16777216->20971519) req@ffff88009ae8f100 x1798653938116736/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:555/0 lens 488/0 e 0 to 0 dl 1715330355 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330344.282348:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae8f100 with x1798653938116736 ext(16777216->20971519) 00002000:00010000:2.0:1715330344.282353:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ae8f100 00000100:00080000:0.0:1715330344.282640:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330314 00000100:00100000:2.0:1715330344.283379:0:9403:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 21 00000100:00100000:2.0:1715330344.283389:0:9403:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+14:2014:x1798653938116736:12345-192.168.204.49@tcp:4:dd.0 00010000:00010000:1.0:1715330344.319715:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330344.368678:0:9403:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+16:2014:x1798653938116736:12345-192.168.204.49@tcp:4:dd.0 Request processed in 85280us (86828us total) trans 4294969955 rc 0/0 00000100:00100000:0.0:1715330344.368690:0:9403:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 21 00002000:00100000:0.0:1715330344.368706:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa00:0x0] (16777216->20971519) req@ffff88009ae8f100 x1798653938116736/t4294969955(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:555/0 lens 488/448 e 0 to 0 dl 1715330355 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330344.368720:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae8f100 with x1798653938116736 ext(16777216->20971519) 00002000:00010000:0.0:1715330344.368725:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ae8f100 00000100:00100000:3.0:1715330344.531239:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1715330344.531263:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ae8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942524032:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1715330344.531328:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330344.531445:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942524032 00000100:00100000:0.0:1715330344.531451:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942524032 00000100:00100000:0.0:1715330344.531587:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3069 00000100:00100000:0.0:1715330344.531594:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942524032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1715330344.531627:0:19960:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445060608 avail 1315598336 00000100:00100000:0.0:1715330344.531946:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942524032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 352us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330344.531953:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3069 00000100:00100000:3.0:1715330344.532023:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ae8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942524032:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1715330344.983191:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330344.983482:0:9403:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938116864 00000100:00100000:2.0:1715330344.983520:0:9403:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938116864 00002000:00100000:2.0:1715330344.983564:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa00:0x0] (20971520->25165823) req@ffff88009ae8f800 x1798653938116864/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:555/0 lens 488/0 e 0 to 0 dl 1715330355 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330344.983573:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae8f800 with x1798653938116864 ext(20971520->25165823) 00002000:00010000:2.0:1715330344.983578:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ae8f800 00000100:00100000:2.0:1715330344.985098:0:9403:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 22 00000100:00100000:2.0:1715330344.985108:0:9403:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+16:2014:x1798653938116864:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330345.067630:0:9403:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+18:2014:x1798653938116864:12345-192.168.204.49@tcp:4:dd.0 Request processed in 82515us (84437us total) trans 4294969956 rc 0/0 00000100:00100000:0.0:1715330345.067642:0:9403:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 22 00002000:00100000:0.0:1715330345.067653:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa00:0x0] (20971520->25165823) req@ffff88009ae8f800 x1798653938116864/t4294969956(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:555/0 lens 488/448 e 0 to 0 dl 1715330355 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330345.067661:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae8f800 with x1798653938116864 ext(20971520->25165823) 00002000:00010000:0.0:1715330345.067667:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ae8f800 00010000:00010000:2.0:1715330345.321675:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330345.380174:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ae8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942524096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1715330345.380235:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330345.381565:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942524096 00000100:00100000:1.0:1715330345.381572:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942524096 00000100:00100000:1.0:1715330345.381624:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1715330345.381630:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942524096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1715330345.381658:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1715330345.381710:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942524096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (1474us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330345.381718:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1715330345.381775:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ae8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942524096:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1715330345.381838:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330315 00000100:00100000:2.0:1715330345.410945:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942524160:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1715330345.411010:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330345.412039:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942524160 00000100:00100000:3.0:1715330345.412050:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942524160 00000100:00100000:3.0:1715330345.412108:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1715330345.412115:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942524160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1715330345.412136:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1715330345.412186:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942524160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (1176us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330345.412193:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1715330345.412486:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942524160:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1715330345.412937:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330315 00000100:00100000:0.0:1715330345.778602:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330345.778673:0:9403:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938116992 00000100:00100000:2.0:1715330345.778682:0:9403:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938116992 00002000:00100000:2.0:1715330345.778719:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa00:0x0] (25165824->29360127) req@ffff88009ae8fb80 x1798653938116992/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:556/0 lens 488/0 e 0 to 0 dl 1715330356 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330345.778728:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae8fb80 with x1798653938116992 ext(25165824->29360127) 00002000:00010000:2.0:1715330345.778757:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ae8fb80 00000100:00100000:2.0:1715330345.778789:0:9403:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23 00000100:00100000:2.0:1715330345.778795:0:9403:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+18:2013:x1798653938116992:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330345.827176:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330345.827279:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938117184 00000100:00100000:1.0:1715330345.827287:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938117184 00000100:00100000:1.0:1715330345.827339:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5211 00000100:00100000:1.0:1715330345.827345:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:20908:x1798653938117184:12345-192.168.204.49@tcp:35:dd.0 00000001:00080000:1.0:1715330345.827520:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294984074 00000100:00100000:1.0:1715330345.827598:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+19:20908:x1798653938117184:12345-192.168.204.49@tcp:35:dd.0 Request processed in 253us (430us total) trans 4294984075 rc 0/0 00000100:00100000:1.0:1715330345.827604:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5211 00000020:00080000:1.0:1715330345.827608:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:2.0:1715330345.828246:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330315 00000001:00080000:0.0:1715330345.832883:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984075 is committed 00010000:00010000:3.0:1715330345.832910:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81440/0xd895711d66dbbad lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330345.832921:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81440/0xd895711d66dbbad lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330345.832927:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81440/0xd895711d66dbbad lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330345.832932:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da81440 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330345.832936:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81440/0xd895711d66dbbad lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330345.832942:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81440/0xd895711d66dbbad lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330345.832959:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x333666 (ffff88008b0d2000) 00010000:00010000:3.0:1715330345.832961:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330345.832964:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81440/0xd895711d66dbbad lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330345.832969:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81440/0xd895711d66dbbad lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00000100:00100000:0.0:1715330345.840905:0:9403:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+20:2013:x1798653938116992:12345-192.168.204.49@tcp:4:dd.0 Request processed in 62100us (62299us total) trans 4294969957 rc 0/0 00000100:00100000:0.0:1715330345.841061:0:9403:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23 00002000:00100000:0.0:1715330345.841076:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa00:0x0] (25165824->29360127) req@ffff88009ae8fb80 x1798653938116992/t4294969957(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:556/0 lens 488/448 e 0 to 0 dl 1715330356 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330345.841086:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae8fb80 with x1798653938116992 ext(25165824->29360127) 00002000:00010000:0.0:1715330345.841092:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ae8fb80 00010000:00010000:2.0:1715330346.324092:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330346.644336:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1715330346.644628:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3691:1798653942524288:0@lo:400:kworker.0 00000100:00100000:2.0:1715330346.644696:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330346.644724:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3691:1798653942524224:0@lo:400:kworker.0 00000100:00100000:2.0:1715330346.644772:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330346.644821:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942524288 00000100:00100000:2.0:1715330346.644826:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942524288 00000100:00100000:2.0:1715330346.644861:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1715330346.644866:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3691:x1798653942524288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330346.644908:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3691:x1798653942524288:12345-0@lo:400:kworker.0 Request processed in 41us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330346.644914:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1715330346.644948:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3691:1798653942524288:0@lo:400:kworker.0 00000100:00100000:3.0:1715330346.645102:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942524352:0@lo:400:kworker.0 00000100:00100000:3.0:1715330346.645133:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330346.645146:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3688:1798653942524608:0@lo:400:kworker.0 00000100:00100000:3.0:1715330346.645160:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330346.645167:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3688:1798653942524864:0@lo:400:kworker.0 00000100:00100000:3.0:1715330346.645180:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330346.645190:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1715330346.645193:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3688:1798653942524416:0@lo:400:kworker.0 00000100:00100000:3.0:1715330346.645206:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330346.645214:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942524672:0@lo:400:kworker.0 00000100:00100000:3.0:1715330346.645230:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330346.645240:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942524928:0@lo:400:kworker.0 00000100:00100000:3.0:1715330346.645252:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330346.645391:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942524352 00000100:00100000:0.0:1715330346.645396:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942524352 00000100:00100000:0.0:1715330346.645420:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3070 00000100:00100000:0.0:1715330346.645425:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942524352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330346.645470:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942524352:12345-0@lo:400:kworker.0 Request processed in 45us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330346.645476:0:7130:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942524224 00000100:00100000:0.0:1715330346.645476:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3070 00000100:00100000:1.0:1715330346.645481:0:7130:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942524224 00000100:00100000:0.0:1715330346.645494:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942524608 00000100:00100000:0.0:1715330346.645497:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942524608 00000100:00100000:1.0:1715330346.645510:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1715330346.645512:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942524864 00000100:00100000:1.0:1715330346.645514:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007666cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3691:x1798653942524224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330346.645514:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942524864 00000100:00100000:0.0:1715330346.645524:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942524416 00000100:00100000:0.0:1715330346.645525:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942524416 00000100:00100000:0.0:1715330346.645536:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1715330346.645540:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3688:x1798653942524608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330346.645542:0:7130:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007666cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3691:x1798653942524224:12345-0@lo:400:kworker.0 Request processed in 27us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330346.645547:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1715330346.645566:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3688:x1798653942524608:12345-0@lo:400:kworker.0 Request processed in 25us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330346.645570:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1715330346.645572:0:17215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942524672 00000100:00100000:3.0:1715330346.645575:0:17215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942524672 00000100:00100000:1.0:1715330346.645578:0:17217:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942524928 00000100:00100000:0.0:1715330346.645579:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1715330346.645580:0:17217:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942524928 00000100:00100000:0.0:1715330346.645582:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3688:x1798653942524864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330346.645602:0:17217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1715330346.645605:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3688:x1798653942524864:12345-0@lo:400:kworker.0 Request processed in 16us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330346.645606:0:17215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1715330346.645606:0:17217:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942524928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330346.645609:0:17215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942524672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330346.645611:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1715330346.645618:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1715330346.645622:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3688:x1798653942524416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330346.645632:0:17217:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942524928:12345-0@lo:400:kworker.0 Request processed in 25us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330346.645637:0:17217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1715330346.645640:0:17215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942524672:12345-0@lo:400:kworker.0 Request processed in 30us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330346.645643:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3688:x1798653942524416:12345-0@lo:400:kworker.0 Request processed in 21us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330346.645644:0:17215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1715330346.645648:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00080000:1.0:1715330346.645656:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330316 00000100:00080000:1.0:1715330346.645659:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330316 00000100:00080000:1.0:1715330346.645661:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330316 00000100:00100000:0.0:1715330346.645667:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942524480:0@lo:400:kworker.0 00000100:00100000:0.0:1715330346.645687:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330346.645703:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942524480 00000100:00100000:0.0:1715330346.645705:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942524736:0@lo:400:kworker.0 00000100:00100000:1.0:1715330346.645706:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942524480 00000100:00100000:0.0:1715330346.645720:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330346.645723:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3071 00000100:00100000:1.0:1715330346.645727:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942524480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330346.645743:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942524992:0@lo:400:kworker.0 00000100:00100000:1.0:1715330346.645769:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942524480:12345-0@lo:400:kworker.0 Request processed in 42us (81us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330346.645774:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3071 00000100:00100000:0.0:1715330346.645779:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330346.645787:0:12304:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942524736 00000100:00100000:1.0:1715330346.645789:0:12304:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942524736 00000100:00100000:1.0:1715330346.645798:0:12304:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942524992 00000100:00100000:1.0:1715330346.645800:0:12304:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942524992 00000100:00100000:0.0:1715330346.645801:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942524480:0@lo:400:kworker.0 00000100:00100000:1.0:1715330346.645809:0:12304:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1715330346.645809:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1715330346.645812:0:12304:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942524736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330346.645814:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3690:1798653942524544:0@lo:400:kworker.0 00000100:00100000:0.0:1715330346.645831:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330346.645832:0:12304:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942524736:12345-0@lo:400:kworker.0 Request processed in 18us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330346.645835:0:12304:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1715330346.645840:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3690:1798653942524800:0@lo:400:kworker.0 00000100:00100000:1.0:1715330346.645841:0:12304:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1715330346.645843:0:12304:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093370000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942524992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330346.645853:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330346.645857:0:12304:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093370000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942524992:12345-0@lo:400:kworker.0 Request processed in 12us (78us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330346.645861:0:12304:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1715330346.645866:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942524736:0@lo:400:kworker.0 00000100:00080000:1.0:1715330346.645869:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330316 00000100:00100000:0.0:1715330346.645874:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942524992:0@lo:400:kworker.0 00000100:00100000:0.0:1715330346.645890:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942524544 00000100:00100000:0.0:1715330346.645892:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942524544 00000100:00100000:0.0:1715330346.645922:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942524800 00000100:00100000:0.0:1715330346.645924:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942524800 00000100:00100000:3.0:1715330346.645935:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3688:1798653942524416:0@lo:400:kworker.0 00000100:00100000:0.0:1715330346.645935:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1715330346.645938:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093370380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3690:x1798653942524544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330346.645948:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942524672:0@lo:400:kworker.0 00000100:00100000:3.0:1715330346.645954:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942524928:0@lo:400:kworker.0 00000100:00100000:3.0:1715330346.645961:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942524352:0@lo:400:kworker.0 00000100:00100000:0.0:1715330346.645964:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093370380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3690:x1798653942524544:12345-0@lo:400:kworker.0 Request processed in 25us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330346.645967:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3688:1798653942524608:0@lo:400:kworker.0 00000100:00100000:0.0:1715330346.645969:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1715330346.645973:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3688:1798653942524864:0@lo:400:kworker.0 00000100:00100000:0.0:1715330346.645976:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1715330346.645980:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093370700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3690:x1798653942524800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330346.645998:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093370700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3690:x1798653942524800:12345-0@lo:400:kworker.0 Request processed in 17us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330346.646002:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1715330346.646020:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3690:1798653942524544:0@lo:400:kworker.0 00000100:00100000:0.0:1715330346.646031:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3690:1798653942524800:0@lo:400:kworker.0 00000100:00100000:2.0:1715330346.646237:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3691:1798653942524224:0@lo:400:kworker.0 00000100:00080000:1.0:1715330346.647196:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330316 00000100:00100000:3.0:1715330346.675884:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093370a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942525056:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1715330346.675931:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942525120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1715330346.675943:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330346.675986:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942525056 00000100:00100000:0.0:1715330346.675993:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942525056 00000100:00100000:0.0:1715330346.676022:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1715330346.676025:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942525056:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1715330346.676036:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1715330346.676047:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 212992 granted 126572224 pending 29532160 free 3898380288 avail 3666857984 00000100:00100000:3.0:1715330346.676056:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942525120 00000100:00100000:3.0:1715330346.676060:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942525120 00000100:00100000:3.0:1715330346.676078:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1715330346.676083:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942525120:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1715330346.676088:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942525056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (146us total) trans 0 rc 0/0 00002000:00000024:3.0:1715330346.676092:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 212992 granted 126572224 pending 29532160 free 3898380288 avail 3666857984 00000100:00100000:0.0:1715330346.676092:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1715330346.676117:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942525120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (80us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330346.676123:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1715330346.676130:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093370a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942525056:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1715330346.676154:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942525120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1715330346.824586:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330346.825153:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938117248 00000100:00100000:2.0:1715330346.825161:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938117248 00000100:00100000:2.0:1715330346.825212:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23815 00000100:00100000:2.0:1715330346.825219:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+15:20917:x1798653938117248:12345-192.168.204.49@tcp:101:dd.0 00010000:00010000:2.0:1715330346.825238:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330346.825256:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b46c0/0xd895711d66dbbc9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbe8f expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330346.825305:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7600/0xd895711d66dbbd0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330346.825317:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7600/0xd895711d66dbbd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330346.825328:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7600/0xd895711d66dbbd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00000004:00200000:2.0:1715330346.825364:0:25569:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 270336 00000004:00200000:2.0:1715330346.825368:0:25569:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1715330346.825383:0:25569:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7600/0xd895711d66dbbd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330346.825400:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b46c0/0xd895711d66dbbc9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe8f expref: 17 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330346.825433:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7600/0xd895711d66dbbd0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe8f expref: 16 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330346.825439:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:2.0:1715330346.825442:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1715330346.825445:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938b7600, rc 0) 00000100:00100000:2.0:1715330346.825492:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+16:20917:x1798653938117248:12345-192.168.204.49@tcp:101:dd.0 Request processed in 274us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330346.825498:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23815 00000100:00100000:0.0:1715330346.833145:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330346.833220:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938117376 00000100:00100000:2.0:1715330346.833230:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938117376 00000100:00100000:2.0:1715330346.833283:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23816 00000100:00100000:2.0:1715330346.833291:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093370e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+16:20917:x1798653938117376:12345-192.168.204.49@tcp:101:dd.0 00010000:00010000:2.0:1715330346.833311:0:7133:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330346.833314:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1715330346.833340:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7600/0xd895711d66dbbd0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe8f expref: 16 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330346.833374:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:2.0:1715330346.833378:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330346.833390:0:7133:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6880/0xd895711d66dbbd7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbe96 expref: -99 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330346.833501:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6640/0xd895711d66dbbde lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330346.833513:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6640/0xd895711d66dbbde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330346.833523:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6640/0xd895711d66dbbde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000004:00200000:2.0:1715330346.833533:0:7133:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1591:0x0]: returning size 29704192 00010000:00010000:2.0:1715330346.833645:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6880/0xd895711d66dbbd7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe96 expref: 18 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330346.833657:0:7133:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6640/0xd895711d66dbbde lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe96 expref: 17 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330346.833663:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff88008b0d2c00) 00010000:00010000:2.0:1715330346.833665:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330346.833668:0:7133:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938b6640, rc 0) 00000100:00100000:2.0:1715330346.833761:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093370e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+17:20917:x1798653938117376:12345-192.168.204.49@tcp:101:dd.0 Request processed in 440us (595us total) trans 4294984076 rc 0/0 00000100:00100000:2.0:1715330346.833768:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23816 00000100:00100000:0.0:1715330346.838894:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330346.839194:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330346.839765:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938117440 00000100:00100000:2.0:1715330346.839769:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938117504 00000100:00100000:1.0:1715330346.839773:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938117440 00000100:00100000:2.0:1715330346.839774:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938117504 00000100:00100000:2.0:1715330346.840309:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23817 00000100:00100000:2.0:1715330346.840315:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093371500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+18:20917:x1798653938117504:12345-192.168.204.49@tcp:101:dd.0 00000100:00100000:1.0:1715330346.840323:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1421 00000100:00100000:1.0:1715330346.840329:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093371180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:72de1896-1df4-4b3a-930a-9116d2c66168+18:2014:x1798653938117440:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1715330346.840333:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330346.840342:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330346.840352:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5d40/0xd895711d66dbbec lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbe9d expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330346.840361:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6640/0xd895711d66dbbde lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe96 expref: 18 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330346.840383:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5440/0xd895711d66dbbf3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330346.840388:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff88008b0d2c00) 00010000:00010000:1.0:1715330346.840392:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330346.840427:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093371180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:72de1896-1df4-4b3a-930a-9116d2c66168+18:2014:x1798653938117440:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 98us (1541us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330346.840432:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1421 00010000:00010000:2.0:1715330346.840544:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5440/0xd895711d66dbbf3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330346.840554:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5440/0xd895711d66dbbf3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330346.840651:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5d40/0xd895711d66dbbec lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe9d expref: 18 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330346.840679:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5440/0xd895711d66dbbf3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe9d expref: 17 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330346.840685:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff88008b0d2c00) 00010000:00010000:2.0:1715330346.840688:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1715330346.840690:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938b5440, rc 0) 00000100:00100000:2.0:1715330346.840716:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093371500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+17:20917:x1798653938117504:12345-192.168.204.49@tcp:101:dd.0 Request processed in 401us (1523us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330346.840856:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23817 00000100:00100000:1.0:1715330346.844120:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330346.844481:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938117632 00000100:00100000:3.0:1715330346.844490:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938117632 00000100:00100000:3.0:1715330346.844540:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23818 00000100:00100000:3.0:1715330346.844546:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+17:20917:x1798653938117632:12345-192.168.204.49@tcp:36:dd.0 00010000:00010000:3.0:1715330346.844591:0:25569:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330346.844615:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da821c0/0xd895711d66dbbb4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe81 expref: 17 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330346.844642:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff88008b0d2c00) 00010000:00010000:3.0:1715330346.844645:0:25569:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330346.844804:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81680/0xd895711d66dbbfa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330346.844819:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81680/0xd895711d66dbbfa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330346.844826:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81680/0xd895711d66dbbfa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00000001:00080000:3.0:1715330346.844858:0:25569:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294984077 00000004:00010000:3.0:1715330346.844873:0:25569:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88007d635180 reply state ffff880073bd8000 transno 4294984078 ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81680/0xd895711d66dbbfa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330346.844881:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81680/0xd895711d66dbbfa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330346.844885:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff88008b0d2c00) 00010000:00010000:3.0:1715330346.844887:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330346.844889:0:25569:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330346.845088:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+19:20917:x1798653938117632:12345-192.168.204.49@tcp:36:dd.0 Request processed in 540us (974us total) trans 4294984078 rc 0/0 00000100:00100000:3.0:1715330346.845093:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23818 00000020:00080000:3.0:1715330346.845097:0:25569:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330346.848224:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330346.848355:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938117696 00000100:00100000:3.0:1715330346.848363:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938117696 00000100:00100000:3.0:1715330346.848398:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23819 00000100:00100000:3.0:1715330346.848405:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093371880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+19:20917:x1798653938117696:12345-192.168.204.49@tcp:101:dd.0 00010000:00010000:3.0:1715330346.848424:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330346.848440:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80d80/0xd895711d66dbc01 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbea4 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330346.848716:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80d80/0xd895711d66dbc01 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1591:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbea4 expref: 20 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330346.848757:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80d80/0xd895711d66dbc01 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1591:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbea4 expref: 20 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330346.848777:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff88008b0d2c00) 00010000:00010000:3.0:1715330346.848780:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1715330346.848783:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011da80d80, rc 0) 00000100:00100000:3.0:1715330346.848843:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093371880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+20:20917:x1798653938117696:12345-192.168.204.49@tcp:101:dd.0 Request processed in 438us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330346.848849:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23819 00000100:00100000:0.0:1715330346.857320:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330346.857496:0:9403:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938117760 00000100:00100000:2.0:1715330346.857505:0:9403:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938117760 00002000:00010000:2.0:1715330346.857554:0:9403:0:(ofd_dev.c:2731:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/2560 (0->18446744073709551615) 00002000:00100000:2.0:1715330346.857557:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093371c00 with x1798653938117760 ext(0->18446744073709551615) 00002000:00010000:2.0:1715330346.857565:0:9403:0:(ofd_dev.c:2736:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093371c00. 00000100:00100000:2.0:1715330346.857589:0:9403:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 24 00000100:00100000:2.0:1715330346.857595:0:9403:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093371c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+20:2012:x1798653938117760:12345-192.168.204.49@tcp:10:dd.0 00000100:00080000:1.0:1715330346.857640:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330316 00002000:00010000:2.0:1715330346.879171:0:9403:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1715330346.879178:0:9403:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb mtime from disk: 0 -> 1715330347 00002000:00010000:2.0:1715330346.879181:0:9403:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1715330346.879183:0:9403:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb ctime from disk: 0 -> 1715330347 00002000:00010000:2.0:1715330346.879185:0:9403:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb blocks from disk: 0 -> 0 00000001:00080000:0.0:1715330346.881539:0:10666:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4294969958 is committed 00000100:00100000:2.0:1715330346.882076:0:9403:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093371c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+6:2012:x1798653938117760:12345-192.168.204.49@tcp:10:dd.0 Request processed in 24471us (24753us total) trans 4294969958 rc 0/0 00000100:00100000:2.0:1715330346.882093:0:9403:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 24 00002000:00010000:2.0:1715330346.882100:0:9403:0:(ofd_dev.c:2731:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/2560 (0->18446744073709551615) 00002000:00100000:2.0:1715330346.882103:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093371c00 with x1798653938117760 ext(0->18446744073709551615) 00002000:00010000:2.0:1715330346.882114:0:9403:0:(ofd_dev.c:2736:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093371c00. 00010000:00010000:3.0:1715330347.326956:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330347.636282:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330347.636387:0:9403:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938117888 00000100:00100000:2.0:1715330347.636396:0:9403:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938117888 00002000:00100000:2.0:1715330347.636433:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa00:0x0] (0->4194303) req@ffff880093371f80 x1798653938117888/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:558/0 lens 488/0 e 0 to 0 dl 1715330358 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330347.636472:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093371f80 with x1798653938117888 ext(0->4194303) 00002000:00010000:2.0:1715330347.636478:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093371f80 00000100:00100000:2.0:1715330347.636497:0:9403:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 25 00000100:00100000:2.0:1715330347.636502:0:9403:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093371f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938117888:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330347.693297:0:9403:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093371f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+8:2014:x1798653938117888:12345-192.168.204.49@tcp:4:dd.0 Request processed in 56784us (57011us total) trans 4294969959 rc 0/0 00000100:00100000:0.0:1715330347.693309:0:9403:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 25 00002000:00100000:0.0:1715330347.693322:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa00:0x0] (0->4194303) req@ffff880093371f80 x1798653938117888/t4294969959(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:558/0 lens 488/448 e 0 to 0 dl 1715330358 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330347.693331:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093371f80 with x1798653938117888 ext(0->4194303) 00002000:00010000:0.0:1715330347.693336:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093371f80 00000100:00100000:3.0:1715330348.084033:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1715330348.084053:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942525184:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1715330348.084122:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330348.084167:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942525184 00000100:00100000:0.0:1715330348.084174:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942525184 00000100:00100000:0.0:1715330348.084223:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3072 00000100:00100000:0.0:1715330348.084230:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942525184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1715330348.084259:0:19960:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444089856 avail 1314627584 00000100:00100000:0.0:1715330348.084306:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942525184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330348.084313:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3072 00000100:00100000:3.0:1715330348.084338:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942525184:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1715330348.176239:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330348.176285:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330348.176340:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330348.176457:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938118016 00000100:00100000:2.0:1715330348.176465:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938118016 00000100:00100000:2.0:1715330348.176506:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 337 00000100:00100000:2.0:1715330348.176511:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093372300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+20:2014:x1798653938118016:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:2.0:1715330348.176567:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093372300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+20:2014:x1798653938118016:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 55us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330348.176577:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 337 00000100:00100000:1.0:1715330348.176819:0:7129:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938117952 00000100:00100000:1.0:1715330348.176823:0:7129:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938117952 00000100:00100000:1.0:1715330348.176846:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 353 00000100:00100000:1.0:1715330348.176851:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007666c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2014:x1798653938117952:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:1.0:1715330348.176887:0:7129:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007666c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2014:x1798653938117952:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 36us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330348.176893:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 353 00000100:00100000:3.0:1715330348.176972:0:17215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938118144 00000100:00100000:3.0:1715330348.176975:0:17215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938118144 00000100:00100000:3.0:1715330348.176996:0:17215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 242 00000100:00100000:3.0:1715330348.177000:0:17215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938118144:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:3.0:1715330348.177023:0:17215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938118144:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 22us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330348.177027:0:17215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 242 00000100:00080000:0.0:1715330348.177620:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330318 00000100:00080000:0.0:1715330348.177623:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330318 00000100:00080000:0.0:1715330348.177625:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330318 00000100:00100000:0.0:1715330348.178377:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330348.179017:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938118080 00000100:00100000:2.0:1715330348.179024:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938118080 00000100:00080000:0.0:1715330348.179480:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330318 00000100:00100000:2.0:1715330348.180488:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 338 00000100:00100000:2.0:1715330348.180497:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938118080:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:2.0:1715330348.180581:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938118080:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 84us (2204us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330348.180587:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 338 00000100:00100000:0.0:1715330348.288384:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330348.288478:0:9403:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938118272 00000100:00100000:2.0:1715330348.288486:0:9403:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938118272 00002000:00100000:2.0:1715330348.288535:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa00:0x0] (4194304->8388607) req@ffff880093372a00 x1798653938118272/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:559/0 lens 488/0 e 0 to 0 dl 1715330359 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330348.288543:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093372a00 with x1798653938118272 ext(4194304->8388607) 00002000:00010000:2.0:1715330348.288548:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093372a00 00000100:00080000:0.0:1715330348.288593:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330318 00000100:00100000:1.0:1715330348.288832:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 26 00000100:00100000:1.0:1715330348.288839:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093372a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+8:2011:x1798653938118272:12345-192.168.204.49@tcp:4:dd.0 00010000:00010000:1.0:1715330348.334985:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330348.345624:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093372a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+10:2011:x1798653938118272:12345-192.168.204.49@tcp:4:dd.0 Request processed in 56775us (57237us total) trans 4294969960 rc 0/0 00000100:00100000:0.0:1715330348.345635:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 26 00002000:00100000:0.0:1715330348.345645:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (4194304->8388607) req@ffff880093372a00 x1798653938118272/t4294969960(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:559/0 lens 488/448 e 0 to 0 dl 1715330359 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330348.345654:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093372a00 with x1798653938118272 ext(4194304->8388607) 00002000:00010000:0.0:1715330348.345659:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093372a00 00000100:00100000:0.0:1715330348.808861:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330348.809680:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938118464 00000100:00100000:2.0:1715330348.809690:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938118464 00002000:00100000:2.0:1715330348.809772:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (8388608->12582911) req@ffff880093372d80 x1798653938118464/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:559/0 lens 488/0 e 0 to 0 dl 1715330359 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330348.809783:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093372d80 with x1798653938118464 ext(8388608->12582911) 00002000:00010000:2.0:1715330348.809790:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093372d80 00000100:00100000:2.0:1715330348.809826:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 27 00000100:00100000:2.0:1715330348.809833:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+10:2013:x1798653938118464:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330348.851395:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+12:2013:x1798653938118464:12345-192.168.204.49@tcp:4:dd.0 Request processed in 41538us (42522us total) trans 4294969961 rc 0/0 00000100:00100000:2.0:1715330348.851430:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 27 00002000:00100000:2.0:1715330348.851446:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (8388608->12582911) req@ffff880093372d80 x1798653938118464/t4294969961(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:559/0 lens 488/448 e 0 to 0 dl 1715330359 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330348.851455:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093372d80 with x1798653938118464 ext(8388608->12582911) 00002000:00010000:2.0:1715330348.851463:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093372d80 00000100:00100000:0.0:1715330349.316206:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330349.316299:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938118592 00000100:00100000:2.0:1715330349.316307:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938118592 00002000:00100000:2.0:1715330349.316342:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (12582912->16777215) req@ffff880093373100 x1798653938118592/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:560/0 lens 488/0 e 0 to 0 dl 1715330360 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330349.316351:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093373100 with x1798653938118592 ext(12582912->16777215) 00002000:00010000:2.0:1715330349.316356:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093373100 00000100:00100000:2.0:1715330349.317253:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 28 00000100:00100000:2.0:1715330349.317395:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093373100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+12:2013:x1798653938118592:12345-192.168.204.49@tcp:4:dd.0 00010000:00010000:2.0:1715330349.335990:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330349.367276:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093373100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+14:2013:x1798653938118592:12345-192.168.204.49@tcp:4:dd.0 Request processed in 50003us (51063us total) trans 4294969962 rc 0/0 00000100:00100000:2.0:1715330349.367289:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 28 00002000:00100000:2.0:1715330349.367302:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (12582912->16777215) req@ffff880093373100 x1798653938118592/t4294969962(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:560/0 lens 488/448 e 0 to 0 dl 1715330360 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330349.367312:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093373100 with x1798653938118592 ext(12582912->16777215) 00002000:00010000:2.0:1715330349.367317:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093373100 00000100:00100000:1.0:1715330349.538990:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942525248:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1715330349.539063:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330349.539108:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942525248 00000100:00100000:2.0:1715330349.539115:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942525248 00000100:00100000:2.0:1715330349.539158:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3073 00000100:00100000:2.0:1715330349.539163:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942525248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1715330349.539194:0:7138:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445060608 avail 1315598336 00000100:00100000:2.0:1715330349.539236:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942525248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330349.539242:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3073 00000100:00100000:1.0:1715330349.539265:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942525248:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1715330349.936906:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330349.936987:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938118720 00000100:00100000:2.0:1715330349.936995:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938118720 00002000:00100000:2.0:1715330349.937026:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (16777216->20971519) req@ffff880093373480 x1798653938118720/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:560/0 lens 488/0 e 0 to 0 dl 1715330360 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330349.937034:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093373480 with x1798653938118720 ext(16777216->20971519) 00002000:00010000:2.0:1715330349.937038:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093373480 00000100:00100000:2.0:1715330349.937620:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 29 00000100:00100000:2.0:1715330349.937626:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093373480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+14:2013:x1798653938118720:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330349.969897:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093373480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+16:2013:x1798653938118720:12345-192.168.204.49@tcp:4:dd.0 Request processed in 32262us (32990us total) trans 4294969963 rc 0/0 00000100:00100000:2.0:1715330349.969910:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 29 00002000:00100000:2.0:1715330349.969921:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (16777216->20971519) req@ffff880093373480 x1798653938118720/t4294969963(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:560/0 lens 488/448 e 0 to 0 dl 1715330360 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330349.969930:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093373480 with x1798653938118720 ext(16777216->20971519) 00002000:00010000:2.0:1715330349.969935:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093373480 00010000:00010000:2.0:1715330350.341239:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330350.387093:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942525312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1715330350.387147:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330350.388167:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942525312 00000100:00100000:3.0:1715330350.388175:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942525312 00000100:00100000:3.0:1715330350.388703:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1715330350.388710:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093373800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942525312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1715330350.388763:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1715330350.388809:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093373800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942525312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (1662us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330350.388815:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00080000:3.0:1715330350.388854:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330320 00000100:00100000:0.0:1715330350.389407:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942525312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1715330350.419515:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942525376:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1715330350.419585:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330350.421000:0:9401:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942525376 00000100:00100000:1.0:1715330350.421010:0:9401:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942525376 00000100:00100000:1.0:1715330350.421421:0:9401:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1715330350.421429:0:9401:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942525376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1715330350.421458:0:9401:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923509248 avail 3691986944 00000100:00080000:3.0:1715330350.421654:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330320 00000100:00100000:1.0:1715330350.422743:0:9401:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942525376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1300us (3143us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330350.422753:0:9401:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1715330350.422873:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942525376:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1715330350.507817:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330350.509393:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938118848 00000100:00100000:2.0:1715330350.509401:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938118848 00002000:00100000:2.0:1715330350.509460:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (20971520->25165823) req@ffff880093373b80 x1798653938118848/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:561/0 lens 488/0 e 0 to 0 dl 1715330361 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330350.509475:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093373b80 with x1798653938118848 ext(20971520->25165823) 00002000:00010000:2.0:1715330350.509480:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093373b80 00000100:00100000:2.0:1715330350.509508:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 30 00000100:00100000:2.0:1715330350.509514:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093373b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+16:2011:x1798653938118848:12345-192.168.204.49@tcp:4:dd.0 00000100:00080000:3.0:1715330350.512282:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330320 00000100:00100000:2.0:1715330350.551548:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093373b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+18:2011:x1798653938118848:12345-192.168.204.49@tcp:4:dd.0 Request processed in 42025us (43730us total) trans 4294969964 rc 0/0 00000100:00100000:2.0:1715330350.551561:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 30 00002000:00100000:2.0:1715330350.551573:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (20971520->25165823) req@ffff880093373b80 x1798653938118848/t4294969964(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:561/0 lens 488/448 e 0 to 0 dl 1715330361 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330350.551583:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093373b80 with x1798653938118848 ext(20971520->25165823) 00002000:00010000:2.0:1715330350.551588:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093373b80 00000100:00100000:0.0:1715330351.111592:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330351.111666:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938118976 00000100:00100000:2.0:1715330351.111674:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938118976 00002000:00100000:2.0:1715330351.111707:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (25165824->29360127) req@ffff880093370000 x1798653938118976/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:562/0 lens 488/0 e 0 to 0 dl 1715330362 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330351.111716:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093370000 with x1798653938118976 ext(25165824->29360127) 00002000:00010000:2.0:1715330351.111721:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093370000 00000100:00100000:2.0:1715330351.112068:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 31 00000100:00100000:2.0:1715330351.112075:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093370000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+18:2012:x1798653938118976:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330351.149131:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093370000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+20:2012:x1798653938118976:12345-192.168.204.49@tcp:4:dd.0 Request processed in 37047us (37537us total) trans 4294969965 rc 0/0 00000100:00100000:0.0:1715330351.149143:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 31 00002000:00100000:0.0:1715330351.149154:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (25165824->29360127) req@ffff880093370000 x1798653938118976/t4294969965(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:562/0 lens 488/448 e 0 to 0 dl 1715330362 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330351.149164:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093370000 with x1798653938118976 ext(25165824->29360127) 00002000:00010000:0.0:1715330351.149169:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093370000 00010000:00010000:3.0:1715330351.343301:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330351.609726:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330351.610578:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938119104 00000100:00100000:2.0:1715330351.610586:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938119104 00002000:00100000:2.0:1715330351.610621:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (29360128->33554431) req@ffff880093370a80 x1798653938119104/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:562/0 lens 488/0 e 0 to 0 dl 1715330362 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330351.610636:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093370a80 with x1798653938119104 ext(29360128->33554431) 00002000:00010000:2.0:1715330351.610641:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093370a80 00000100:00100000:2.0:1715330351.610657:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 32 00000100:00100000:2.0:1715330351.610663:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093370a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+20:2014:x1798653938119104:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330351.650930:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3689:1798653942525440:0@lo:400:kworker.0 00000100:00100000:1.0:1715330351.650989:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330351.651030:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3690:1798653942525504:0@lo:400:kworker.0 00000100:00100000:1.0:1715330351.651059:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330351.651085:0:7130:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942525440 00000100:00100000:1.0:1715330351.651092:0:7130:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942525440 00000100:00100000:1.0:1715330351.651125:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1715330351.651131:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007666c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3689:x1798653942525440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330351.651162:0:7130:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007666c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3689:x1798653942525440:12345-0@lo:400:kworker.0 Request processed in 31us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330351.651168:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1715330351.651203:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3689:1798653942525440:0@lo:400:kworker.0 00000100:00080000:1.0:1715330351.651217:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330321 00000100:00100000:1.0:1715330351.651235:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942525504 00000100:00100000:1.0:1715330351.651237:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942525504 00000100:00100000:1.0:1715330351.651255:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1715330351.651259:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3690:x1798653942525504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330351.651286:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3690:x1798653942525504:12345-0@lo:400:kworker.0 Request processed in 26us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330351.651294:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1715330351.651313:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3690:1798653942525504:0@lo:400:kworker.0 00000100:00100000:1.0:1715330351.652096:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3690:1798653942525760:0@lo:400:kworker.0 00000100:00100000:1.0:1715330351.652118:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330351.652128:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942525696:0@lo:400:kworker.0 00000100:00100000:1.0:1715330351.652132:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f57ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3690:1798653942526016:0@lo:400:kworker.0 00000100:00100000:1.0:1715330351.652148:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330351.652157:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1715330351.652159:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330351.652162:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942525568:0@lo:400:kworker.0 00000100:00100000:3.0:1715330351.652174:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f578000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942525952:0@lo:400:kworker.0 00000100:00100000:1.0:1715330351.652179:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330351.652190:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091eef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3690:1798653942525824:0@lo:400:kworker.0 00000100:00100000:3.0:1715330351.652194:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330351.652205:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942526208:0@lo:400:kworker.0 00000100:00100000:1.0:1715330351.652206:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330351.652216:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f57b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3690:1798653942526080:0@lo:400:kworker.0 00000100:00100000:1.0:1715330351.652230:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330351.652245:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942525760 00000100:00100000:1.0:1715330351.652248:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942525760 00000100:00100000:1.0:1715330351.652266:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942526016 00000100:00100000:1.0:1715330351.652268:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942526016 00000100:00100000:1.0:1715330351.652276:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942525824 00000100:00100000:1.0:1715330351.652277:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942525824 00000100:00100000:1.0:1715330351.652284:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942526080 00000100:00100000:1.0:1715330351.652285:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942526080 00000100:00100000:1.0:1715330351.652293:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1715330351.652296:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3690:x1798653942525760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330351.652322:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3690:x1798653942525760:12345-0@lo:400:kworker.0 Request processed in 24us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330351.652326:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1715330351.652336:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1715330351.652339:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3690:x1798653942526016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330351.652356:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3690:x1798653942526016:12345-0@lo:400:kworker.0 Request processed in 16us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330351.652360:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1715330351.652381:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1715330351.652385:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3690:x1798653942525824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330351.652405:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3690:x1798653942525824:12345-0@lo:400:kworker.0 Request processed in 19us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330351.652409:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1715330351.652417:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1715330351.652420:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3690:x1798653942526080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330351.652437:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3690:x1798653942526080:12345-0@lo:400:kworker.0 Request processed in 16us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330351.652441:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1715330351.652460:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091eef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3690:1798653942525824:0@lo:400:kworker.0 00000100:00100000:1.0:1715330351.652466:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f57b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3690:1798653942526080:0@lo:400:kworker.0 00000100:00100000:1.0:1715330351.652472:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f57ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3690:1798653942526016:0@lo:400:kworker.0 00000100:00100000:1.0:1715330351.652479:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3690:1798653942525760:0@lo:400:kworker.0 00000100:00100000:1.0:1715330351.652494:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3688:1798653942525632:0@lo:400:kworker.0 00000100:00100000:1.0:1715330351.652512:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330351.652522:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091eef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942525888:0@lo:400:kworker.0 00000100:00100000:1.0:1715330351.652534:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330351.652544:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942526144:0@lo:400:kworker.0 00000100:00100000:1.0:1715330351.652557:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330351.652576:0:17198:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942525952 00000100:00100000:1.0:1715330351.652579:0:17198:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942525952 00000100:00100000:1.0:1715330351.652594:0:17198:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942525888 00000100:00100000:1.0:1715330351.652595:0:17198:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942525888 00000100:00100000:1.0:1715330351.652603:0:17198:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942526144 00000100:00100000:1.0:1715330351.652605:0:17198:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942526144 00000100:00100000:1.0:1715330351.652616:0:17198:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1715330351.652619:0:17198:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d644a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942525952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330351.652643:0:17198:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d644a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942525952:12345-0@lo:400:kworker.0 Request processed in 22us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330351.652648:0:17198:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1715330351.652655:0:17198:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1715330351.652658:0:17198:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942525888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330351.652678:0:17198:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942525888:12345-0@lo:400:kworker.0 Request processed in 19us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330351.652683:0:17198:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1715330351.652690:0:17198:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1715330351.652693:0:17198:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942526144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330351.652711:0:17198:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942526144:12345-0@lo:400:kworker.0 Request processed in 17us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330351.652716:0:17198:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1715330351.652760:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942525632 00000100:00100000:1.0:1715330351.652763:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942525632 00000100:00100000:1.0:1715330351.652777:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1715330351.652780:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3688:x1798653942525632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330351.652803:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3688:x1798653942525632:12345-0@lo:400:kworker.0 Request processed in 22us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330351.652808:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1715330351.652814:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330351.652825:0:17215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942526208 00000100:00100000:1.0:1715330351.652827:0:17215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942526208 00000100:00100000:3.0:1715330351.652835:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f578000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942525952:0@lo:400:kworker.0 00000100:00100000:1.0:1715330351.652840:0:17215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1715330351.652843:0:17215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d644e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942526208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330351.652866:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942525696 00000100:00100000:1.0:1715330351.652867:0:17215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d644e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942526208:12345-0@lo:400:kworker.0 Request processed in 22us (53us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330351.652869:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942525696 00000100:00100000:1.0:1715330351.652871:0:17215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1715330351.652887:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942525568 00000100:00100000:3.0:1715330351.652889:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942525568 00000100:00100000:1.0:1715330351.652890:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3688:1798653942525632:0@lo:400:kworker.0 00000100:00100000:1.0:1715330351.652898:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091eef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942525888:0@lo:400:kworker.0 00000100:00100000:3.0:1715330351.652900:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3074 00000100:00100000:3.0:1715330351.652904:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942525696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330351.652905:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942526144:0@lo:400:kworker.0 00000100:00100000:1.0:1715330351.652922:0:7139:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3075 00000100:00100000:1.0:1715330351.652926:0:7139:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942525568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330351.652928:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942525696:12345-0@lo:400:kworker.0 Request processed in 24us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330351.652934:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3074 00000100:00100000:1.0:1715330351.652950:0:7139:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942525568:12345-0@lo:400:kworker.0 Request processed in 23us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330351.652955:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942525696:0@lo:400:kworker.0 00000100:00100000:1.0:1715330351.652955:0:7139:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3075 00000100:00100000:3.0:1715330351.652963:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942526208:0@lo:400:kworker.0 00000100:00100000:1.0:1715330351.652974:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942525568:0@lo:400:kworker.0 00000100:00080000:1.0:1715330351.652983:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330321 00000100:00080000:1.0:1715330351.652986:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330321 00000100:00080000:1.0:1715330351.652987:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330321 00000100:00100000:2.0:1715330351.653908:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093370a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+22:2014:x1798653938119104:12345-192.168.204.49@tcp:4:dd.0 Request processed in 43239us (44185us total) trans 4294969966 rc 0/0 00000100:00100000:2.0:1715330351.653917:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 32 00002000:00100000:2.0:1715330351.653928:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (29360128->33554431) req@ffff880093370a80 x1798653938119104/t4294969966(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:562/0 lens 488/448 e 0 to 0 dl 1715330362 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330351.653937:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093370a80 with x1798653938119104 ext(29360128->33554431) 00002000:00010000:2.0:1715330351.653942:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093370a80 00000100:00100000:1.0:1715330351.683051:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942526272:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1715330351.683107:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330351.683134:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1715330351.683139:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942526336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1715330351.683155:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330351.683184:0:9401:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942526272 00000100:00100000:1.0:1715330351.683190:0:9401:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942526272 00000100:00100000:1.0:1715330351.683219:0:9401:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942526336 00000100:00100000:1.0:1715330351.683221:0:9401:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942526336 00000100:00100000:1.0:1715330351.683235:0:9401:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1715330351.683241:0:9401:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942526272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1715330351.683262:0:9401:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 221184 granted 164173504 pending 33751040 free 3894185984 avail 3662663680 00000100:00100000:1.0:1715330351.683292:0:9401:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942526272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330351.683298:0:9401:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1715330351.683311:0:9401:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1715330351.683314:0:9401:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942526336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1715330351.683322:0:9401:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 221184 granted 164173504 pending 33751040 free 3894185984 avail 3662663680 00000100:00100000:1.0:1715330351.683338:0:9401:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942526336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 23us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330351.683343:0:9401:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1715330351.683386:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942526336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1715330351.683396:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942526272:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1715330351.828848:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330351.830025:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938119296 00000100:00100000:3.0:1715330351.830035:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938119296 00000100:00080000:1.0:1715330351.830230:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330321 00000100:00100000:3.0:1715330351.830334:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5212 00000100:00100000:3.0:1715330351.830341:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007acb2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+20:20917:x1798653938119296:12345-192.168.204.49@tcp:35:dd.0 00000001:00080000:3.0:1715330351.830533:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294984079 00000100:00100000:3.0:1715330351.831306:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007acb2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+22:20917:x1798653938119296:12345-192.168.204.49@tcp:35:dd.0 Request processed in 963us (2464us total) trans 4294984080 rc 0/0 00000100:00100000:3.0:1715330351.831314:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5212 00000020:00080000:3.0:1715330351.831318:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:0.0:1715330352.231375:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984080 is committed 00010000:00010000:3.0:1715330352.231452:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81680/0xd895711d66dbbfa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330352.231462:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81680/0xd895711d66dbbfa lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330352.231468:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81680/0xd895711d66dbbfa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330352.231474:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da81680 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330352.231478:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81680/0xd895711d66dbbfa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330352.231489:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81680/0xd895711d66dbbfa lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330352.231506:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff88008b0d2c00) 00010000:00010000:3.0:1715330352.231509:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330352.231512:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81680/0xd895711d66dbbfa lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330352.231516:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81680/0xd895711d66dbbfa lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330352.348671:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330352.837137:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330352.837248:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938119360 00000100:00100000:3.0:1715330352.837256:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938119360 00000100:00100000:3.0:1715330352.837304:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23820 00000100:00100000:3.0:1715330352.837310:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+16:20924:x1798653938119360:12345-192.168.204.49@tcp:101:dd.0 00010000:00010000:3.0:1715330352.837328:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330352.837354:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da806c0/0xd895711d66dbc08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbeab expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330352.837405:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82d00/0xd895711d66dbc0f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330352.837415:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82d00/0xd895711d66dbc0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330352.837424:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82d00/0xd895711d66dbc0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00200000:3.0:1715330352.837454:0:11283:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 270336 00000004:00200000:3.0:1715330352.837457:0:11283:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1715330352.837470:0:11283:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82d00/0xd895711d66dbc0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330352.837484:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da806c0/0xd895711d66dbc08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbeab expref: 18 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330352.837503:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82d00/0xd895711d66dbc0f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbeab expref: 17 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330352.837510:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:3.0:1715330352.837512:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1715330352.837514:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011da82d00, rc 0) 00000100:00100000:3.0:1715330352.837550:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+17:20924:x1798653938119360:12345-192.168.204.49@tcp:101:dd.0 Request processed in 240us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330352.837556:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23820 00000100:00100000:2.0:1715330352.841395:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330352.841509:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938119488 00000100:00100000:1.0:1715330352.841521:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938119488 00000100:00100000:1.0:1715330352.841577:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23821 00000100:00100000:1.0:1715330352.841583:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+17:20924:x1798653938119488:12345-192.168.204.49@tcp:101:dd.0 00010000:00010000:1.0:1715330352.841600:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330352.841603:0:25569:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1715330352.841625:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82d00/0xd895711d66dbc0f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbeab expref: 17 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330352.841642:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:1.0:1715330352.841646:0:25569:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330352.841656:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c900/0xd895711d66dbc16 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbeb2 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330352.841766:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c240/0xd895711d66dbc1d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330352.841777:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c240/0xd895711d66dbc1d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330352.841784:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c240/0xd895711d66dbc1d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330352.841796:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c000/0xd895711d66dbc24 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330352.841800:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c000/0xd895711d66dbc24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330352.841804:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c000/0xd895711d66dbc24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330352.841842:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cfc0/0xd895711d66dbc2b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330352.841849:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cfc0/0xd895711d66dbc2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330352.841871:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cfc0/0xd895711d66dbc2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00000004:00200000:1.0:1715330352.841877:0:25569:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1591:0x0]: returning size 35655680 00010000:00010000:1.0:1715330352.841945:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c240/0xd895711d66dbc1d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330352.841951:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c240/0xd895711d66dbc1d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330352.841956:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c240/0xd895711d66dbc1d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330352.841960:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c240/0xd895711d66dbc1d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330352.841965:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5c240 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330352.841969:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c240/0xd895711d66dbc1d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330352.841974:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c240/0xd895711d66dbc1d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330352.841982:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:1.0:1715330352.841984:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330352.841986:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c240/0xd895711d66dbc1d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330352.841991:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c240/0xd895711d66dbc1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330352.841999:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c000/0xd895711d66dbc24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330352.842007:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c000/0xd895711d66dbc24 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330352.842011:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c000/0xd895711d66dbc24 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330352.842014:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5c000 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330352.842016:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c000/0xd895711d66dbc24 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330352.842021:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c000/0xd895711d66dbc24 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330352.842026:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x333666 (ffff88008b0d2d00) 00010000:00010000:1.0:1715330352.842028:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330352.842029:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c000/0xd895711d66dbc24 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330352.842033:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c000/0xd895711d66dbc24 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330352.842060:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c900/0xd895711d66dbc16 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbeb2 expref: 19 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330352.842070:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cfc0/0xd895711d66dbc2b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbeb2 expref: 18 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330352.842075:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff88008b0d2c00) 00010000:00010000:1.0:1715330352.842077:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715330352.842079:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091c5cfc0, rc 0) 00000100:00100000:1.0:1715330352.843171:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+18:20924:x1798653938119488:12345-192.168.204.49@tcp:101:dd.0 Request processed in 1583us (1784us total) trans 4294984081 rc 0/0 00000100:00100000:1.0:1715330352.843181:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23821 00000100:00100000:0.0:1715330352.848837:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330352.849056:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938119616 00000100:00100000:1.0:1715330352.849065:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938119616 00000100:00100000:1.0:1715330352.849433:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23822 00000100:00100000:1.0:1715330352.849441:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+18:20924:x1798653938119616:12345-192.168.204.49@tcp:36:dd.0 00010000:00010000:1.0:1715330352.849502:0:25569:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330352.849530:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cfc0/0xd895711d66dbc2b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbeb2 expref: 18 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330352.850152:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff88008b0d2c00) 00010000:00010000:1.0:1715330352.850158:0:25569:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330352.850274:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d440/0xd895711d66dbc39 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330352.850285:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d440/0xd895711d66dbc39 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330352.850293:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d440/0xd895711d66dbc39 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00000001:00080000:1.0:1715330352.850324:0:25569:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294984082 00000004:00010000:1.0:1715330352.850338:0:25569:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009b5ed500 reply state ffff880091c04000 transno 4294984083 ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d440/0xd895711d66dbc39 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330352.850356:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d440/0xd895711d66dbc39 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:1.0:1715330352.850360:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff88008b0d2c00) 00010000:00010000:1.0:1715330352.850363:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330352.850365:0:25569:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1715330352.850433:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+20:20924:x1798653938119616:12345-192.168.204.49@tcp:36:dd.0 Request processed in 991us (1603us total) trans 4294984083 rc 0/0 00000100:00100000:1.0:1715330352.850439:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23822 00000020:00080000:1.0:1715330352.850442:0:25569:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330352.881030:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330352.881128:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938119680 00000100:00100000:2.0:1715330352.881137:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938119680 00002000:00010000:2.0:1715330352.881182:0:27574:0:(ofd_dev.c:2731:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/2560 (0->18446744073709551615) 00002000:00100000:2.0:1715330352.881186:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b5efb80 with x1798653938119680 ext(0->18446744073709551615) 00002000:00010000:2.0:1715330352.881196:0:27574:0:(ofd_dev.c:2736:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b5efb80. 00000100:00100000:2.0:1715330352.881216:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 33 00000100:00100000:2.0:1715330352.881222:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+22:2012:x1798653938119680:12345-192.168.204.49@tcp:10:dd.0 00000100:00080000:1.0:1715330352.882027:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330322 00002000:00010000:2.0:1715330352.901643:0:27574:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1715330352.901648:0:27574:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb mtime from disk: 1715330347 -> 1715330353 00002000:00010000:2.0:1715330352.901650:0:27574:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1715330352.901652:0:27574:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb ctime from disk: 1715330347 -> 1715330353 00002000:00010000:2.0:1715330352.901654:0:27574:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1715330352.902042:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+23:2012:x1798653938119680:12345-192.168.204.49@tcp:10:dd.0 Request processed in 20815us (21015us total) trans 4294969967 rc 0/0 00000100:00100000:2.0:1715330352.902052:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 33 00002000:00010000:2.0:1715330352.902056:0:27574:0:(ofd_dev.c:2731:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/2560 (0->18446744073709551615) 00002000:00100000:2.0:1715330352.902059:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b5efb80 with x1798653938119680 ext(0->18446744073709551615) 00002000:00010000:2.0:1715330352.902065:0:27574:0:(ofd_dev.c:2736:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b5efb80. 00000001:00080000:0.0:1715330352.902972:0:10666:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4294969967 is committed 00000100:00100000:2.0:1715330353.091051:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1715330353.091068:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d646a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942526400:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1715330353.091119:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330353.092259:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942526400 00000100:00100000:3.0:1715330353.092267:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942526400 00000100:00100000:3.0:1715330353.092313:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3076 00000100:00100000:3.0:1715330353.092319:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3689:x1798653942526400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1715330353.092355:0:19960:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444089856 avail 1314627584 00000100:00100000:3.0:1715330353.092399:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3689:x1798653942526400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (1279us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330353.092405:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3076 00000100:00100000:2.0:1715330353.092508:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d646a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942526400:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1715330353.185786:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330353.187263:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330353.187322:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330353.187399:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938119808 00000100:00100000:1.0:1715330353.187410:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938119808 00000100:00100000:1.0:1715330353.187468:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 345 00000100:00100000:1.0:1715330353.187476:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+6:2011:x1798653938119808:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:1.0:1715330353.187551:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+6:2011:x1798653938119808:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 75us (1779us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330353.187557:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 345 00000100:00100000:2.0:1715330353.187637:0:7129:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938119744 00000100:00100000:2.0:1715330353.187651:0:7129:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938119744 00000100:00100000:3.0:1715330353.187715:0:17197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938119872 00000100:00100000:3.0:1715330353.187720:0:17197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938119872 00000100:00100000:3.0:1715330353.187775:0:17197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 247 00000100:00100000:3.0:1715330353.187781:0:17197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:72de1896-1df4-4b3a-930a-9116d2c66168+6:2012:x1798653938119872:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:2.0:1715330353.187784:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 355 00000100:00100000:2.0:1715330353.187795:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007666c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2012:x1798653938119744:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:3.0:1715330353.187823:0:17197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:72de1896-1df4-4b3a-930a-9116d2c66168+6:2012:x1798653938119872:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 42us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330353.187829:0:17197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 247 00000100:00100000:2.0:1715330353.187858:0:7129:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007666c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2012:x1798653938119744:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 65us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330353.187865:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 355 00000100:00080000:0.0:1715330353.187955:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330323 00000100:00080000:0.0:1715330353.187959:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330323 00000100:00080000:0.0:1715330353.187962:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330323 00010000:00010000:3.0:1715330353.347448:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330353.809025:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330353.809120:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938120000 00000100:00100000:2.0:1715330353.809134:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938120000 00002000:00100000:2.0:1715330353.809189:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (0->4194303) req@ffff88009b5ed880 x1798653938120000/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:564/0 lens 488/0 e 0 to 0 dl 1715330364 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330353.809201:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b5ed880 with x1798653938120000 ext(0->4194303) 00002000:00010000:2.0:1715330353.809207:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b5ed880 00000100:00100000:2.0:1715330353.809248:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 34 00000100:00100000:2.0:1715330353.809258:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938120000:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330353.866566:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+8:2014:x1798653938120000:12345-192.168.204.49@tcp:4:dd.0 Request processed in 57290us (57529us total) trans 4294969968 rc 0/0 00000100:00100000:0.0:1715330353.866584:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 34 00002000:00100000:0.0:1715330353.866601:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (0->4194303) req@ffff88009b5ed880 x1798653938120000/t4294969968(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:564/0 lens 488/448 e 0 to 0 dl 1715330364 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330353.866610:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b5ed880 with x1798653938120000 ext(0->4194303) 00002000:00010000:0.0:1715330353.866616:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b5ed880 00000100:00100000:0.0:1715330354.341877:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330354.341965:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938120128 00000100:00100000:2.0:1715330354.341978:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938120128 00000100:00080000:0.0:1715330354.342037:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330324 00002000:00100000:2.0:1715330354.342038:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (4194304->8388607) req@ffff88009b5ef100 x1798653938120128/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:565/0 lens 488/0 e 0 to 0 dl 1715330365 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330354.342046:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b5ef100 with x1798653938120128 ext(4194304->8388607) 00002000:00010000:2.0:1715330354.342051:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b5ef100 00000100:00100000:2.0:1715330354.342068:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 35 00000100:00100000:2.0:1715330354.342074:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+8:2013:x1798653938120128:12345-192.168.204.49@tcp:4:dd.0 00010000:00010000:3.0:1715330354.349799:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330354.403958:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+10:2013:x1798653938120128:12345-192.168.204.49@tcp:4:dd.0 Request processed in 61870us (62074us total) trans 4294969969 rc 0/0 00000100:00100000:2.0:1715330354.403977:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 35 00002000:00100000:2.0:1715330354.403994:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (4194304->8388607) req@ffff88009b5ef100 x1798653938120128/t4294969969(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:565/0 lens 488/448 e 0 to 0 dl 1715330365 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330354.404004:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b5ef100 with x1798653938120128 ext(4194304->8388607) 00002000:00010000:2.0:1715330354.404447:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b5ef100 00000100:00100000:2.0:1715330354.548940:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942526464:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1715330354.549049:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330354.549148:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942526464 00000100:00100000:1.0:1715330354.549159:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942526464 00000100:00100000:1.0:1715330354.549706:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3077 00000100:00100000:1.0:1715330354.549714:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942526464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1715330354.549792:0:8592:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445060608 avail 1315598336 00000100:00100000:1.0:1715330354.549856:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942526464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 142us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330354.549861:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3077 00000100:00100000:2.0:1715330354.550056:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942526464:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1715330354.869506:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330354.869612:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938120320 00000100:00100000:2.0:1715330354.869962:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938120320 00002000:00100000:2.0:1715330354.870000:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (8388608->12582911) req@ffff88008d55c000 x1798653938120320/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:565/0 lens 488/0 e 0 to 0 dl 1715330365 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330354.870008:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d55c000 with x1798653938120320 ext(8388608->12582911) 00002000:00010000:2.0:1715330354.870013:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d55c000 00000100:00100000:2.0:1715330354.870042:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 36 00000100:00100000:2.0:1715330354.870049:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d55c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+10:2011:x1798653938120320:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330354.913693:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d55c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+12:2011:x1798653938120320:12345-192.168.204.49@tcp:4:dd.0 Request processed in 43631us (44182us total) trans 4294969970 rc 0/0 00000100:00100000:2.0:1715330354.913711:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 36 00002000:00100000:2.0:1715330354.913727:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (8388608->12582911) req@ffff88008d55c000 x1798653938120320/t4294969970(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:565/0 lens 488/448 e 0 to 0 dl 1715330365 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330354.913760:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d55c000 with x1798653938120320 ext(8388608->12582911) 00002000:00010000:2.0:1715330354.913765:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d55c000 00000100:00100000:0.0:1715330355.329326:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330355.329413:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938120448 00000100:00100000:2.0:1715330355.329420:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938120448 00002000:00100000:2.0:1715330355.329451:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (12582912->16777215) req@ffff88008d55c380 x1798653938120448/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:566/0 lens 488/0 e 0 to 0 dl 1715330366 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330355.329459:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d55c380 with x1798653938120448 ext(12582912->16777215) 00002000:00010000:2.0:1715330355.329463:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d55c380 00000100:00100000:2.0:1715330355.329486:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 37 00000100:00100000:2.0:1715330355.329491:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d55c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+12:2012:x1798653938120448:12345-192.168.204.49@tcp:4:dd.0 00010000:00010000:3.0:1715330355.351424:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330355.357212:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d55c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+14:2012:x1798653938120448:12345-192.168.204.49@tcp:4:dd.0 Request processed in 27706us (27907us total) trans 4294969971 rc 0/0 00000100:00100000:2.0:1715330355.357228:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 37 00002000:00100000:2.0:1715330355.357240:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (12582912->16777215) req@ffff88008d55c380 x1798653938120448/t4294969971(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:566/0 lens 488/448 e 0 to 0 dl 1715330366 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330355.357249:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d55c380 with x1798653938120448 ext(12582912->16777215) 00002000:00010000:2.0:1715330355.357262:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d55c380 00000100:00100000:1.0:1715330355.395223:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d55c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942526528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1715330355.395660:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330355.396695:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942526528 00000100:00100000:2.0:1715330355.396702:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942526528 00000100:00100000:2.0:1715330355.396770:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1715330355.396775:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942526528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1715330355.396802:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1715330355.396842:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942526528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (1564us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330355.396849:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1715330355.396895:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d55c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942526528:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1715330355.397048:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330325 00000100:00100000:0.0:1715330355.427372:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d646d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942526592:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1715330355.427439:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330355.428789:0:9400:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942526592 00000100:00100000:1.0:1715330355.428801:0:9400:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942526592 00000100:00100000:1.0:1715330355.429377:0:9400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1715330355.429383:0:9400:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d55ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942526592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1715330355.429406:0:9400:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1715330355.429458:0:9400:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d55ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942526592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (2020us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330355.429464:0:9400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00080000:2.0:1715330355.429522:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330325 00000100:00100000:0.0:1715330355.429579:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d646d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942526592:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1715330355.857489:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330355.857639:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938120576 00000100:00100000:2.0:1715330355.857647:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938120576 00002000:00100000:2.0:1715330355.857682:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (16777216->20971519) req@ffff88008d55ce00 x1798653938120576/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:566/0 lens 488/0 e 0 to 0 dl 1715330366 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330355.857692:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d55ce00 with x1798653938120576 ext(16777216->20971519) 00002000:00010000:2.0:1715330355.857697:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d55ce00 00000100:00100000:2.0:1715330355.857752:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 38 00000100:00100000:2.0:1715330355.857760:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d55ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+14:2012:x1798653938120576:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330355.916955:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d55ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+16:2012:x1798653938120576:12345-192.168.204.49@tcp:4:dd.0 Request processed in 59186us (59464us total) trans 4294969972 rc 0/0 00000100:00100000:2.0:1715330355.916968:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 38 00002000:00100000:2.0:1715330355.916978:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (16777216->20971519) req@ffff88008d55ce00 x1798653938120576/t4294969972(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:566/0 lens 488/448 e 0 to 0 dl 1715330366 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330355.916987:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d55ce00 with x1798653938120576 ext(16777216->20971519) 00002000:00010000:2.0:1715330355.916995:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d55ce00 00010000:00010000:1.0:1715330356.352955:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330356.383929:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330356.384028:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938120704 00000100:00100000:2.0:1715330356.384037:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938120704 00002000:00100000:2.0:1715330356.384093:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (20971520->25165823) req@ffff88008d55d180 x1798653938120704/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:567/0 lens 488/0 e 0 to 0 dl 1715330367 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330356.384103:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d55d180 with x1798653938120704 ext(20971520->25165823) 00002000:00010000:2.0:1715330356.384108:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d55d180 00000100:00100000:2.0:1715330356.384143:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 39 00000100:00100000:2.0:1715330356.384150:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d55d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+16:2013:x1798653938120704:12345-192.168.204.49@tcp:4:dd.0 00000100:00080000:0.0:1715330356.385908:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330326 00000100:00100000:2.0:1715330356.446712:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d55d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+18:2013:x1798653938120704:12345-192.168.204.49@tcp:4:dd.0 Request processed in 62552us (62782us total) trans 4294969973 rc 0/0 00000100:00100000:2.0:1715330356.446725:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 39 00002000:00100000:2.0:1715330356.446756:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (20971520->25165823) req@ffff88008d55d180 x1798653938120704/t4294969973(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:567/0 lens 488/448 e 0 to 0 dl 1715330367 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330356.446765:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d55d180 with x1798653938120704 ext(20971520->25165823) 00002000:00010000:2.0:1715330356.446770:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d55d180 00000100:00100000:0.0:1715330356.659773:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d647b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3688:1798653942526656:0@lo:400:kworker.0 00000100:00100000:0.0:1715330356.659857:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330356.659970:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d646d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3689:1798653942526720:0@lo:400:kworker.0 00000100:00100000:2.0:1715330356.660000:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330356.660067:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942526720 00000100:00100000:1.0:1715330356.660077:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942526720 00000100:00100000:1.0:1715330356.660138:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1715330356.660145:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1798653942526720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330356.660222:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1798653942526720:12345-0@lo:400:kworker.0 Request processed in 76us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330356.660229:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1715330356.660331:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d646d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3689:1798653942526720:0@lo:400:kworker.0 00000100:00100000:0.0:1715330356.660437:0:7129:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942526656 00000100:00100000:0.0:1715330356.660441:0:7129:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942526656 00000100:00100000:0.0:1715330356.660469:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1715330356.660474:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3688:x1798653942526656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330356.660489:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d646a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942526784:0@lo:400:kworker.0 00000100:00100000:0.0:1715330356.660499:0:7129:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3688:x1798653942526656:12345-0@lo:400:kworker.0 Request processed in 24us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330356.660504:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1715330356.660519:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1715330356.660525:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330326 00000100:00100000:3.0:1715330356.660535:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b31bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3690:1798653942527040:0@lo:400:kworker.0 00000100:00100000:0.0:1715330356.660535:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b31aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942526912:0@lo:400:kworker.0 00000100:00100000:0.0:1715330356.660555:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330356.660557:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330356.660566:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b318a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3690:1798653942527296:0@lo:400:kworker.0 00000100:00100000:0.0:1715330356.660568:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b318380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942527168:0@lo:400:kworker.0 00000100:00100000:3.0:1715330356.660584:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330356.660587:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330356.660597:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1715330356.660598:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b31a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942527424:0@lo:400:kworker.0 00000100:00100000:3.0:1715330356.660601:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d646d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3690:1798653942526848:0@lo:400:kworker.0 00000100:00100000:0.0:1715330356.660613:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330356.660618:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330356.660627:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b318000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942527104:0@lo:400:kworker.0 00000100:00100000:0.0:1715330356.660628:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d647b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3688:1798653942526656:0@lo:400:kworker.0 00000100:00100000:0.0:1715330356.660638:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1715330356.660640:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330356.660642:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b31b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3688:1798653942526976:0@lo:400:kworker.0 00000100:00100000:3.0:1715330356.660649:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b319c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942527360:0@lo:400:kworker.0 00000100:00100000:0.0:1715330356.660658:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330356.660665:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330356.660671:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b318e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3688:1798653942527232:0@lo:400:kworker.0 00000100:00100000:3.0:1715330356.660688:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942526784 00000100:00100000:0.0:1715330356.660689:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330356.660691:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942526784 00000100:00100000:3.0:1715330356.660717:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3078 00000100:00100000:0.0:1715330356.660718:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942526912 00000100:00100000:0.0:1715330356.660721:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942526912 00000100:00100000:3.0:1715330356.660722:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b319180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942526784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330356.660763:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3079 00000100:00100000:0.0:1715330356.660768:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d55d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942526912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330356.660774:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b319180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942526784:12345-0@lo:400:kworker.0 Request processed in 51us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330356.660780:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3078 00000100:00100000:0.0:1715330356.660795:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d55d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942526912:12345-0@lo:400:kworker.0 Request processed in 27us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330356.660797:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942527040 00000100:00100000:3.0:1715330356.660800:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942527040 00000100:00100000:0.0:1715330356.660801:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3079 00000100:00100000:3.0:1715330356.660817:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942527296 00000100:00100000:0.0:1715330356.660818:0:17197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942527168 00000100:00100000:3.0:1715330356.660819:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942527296 00000100:00100000:0.0:1715330356.660820:0:17197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942527168 00000100:00100000:3.0:1715330356.660828:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942526848 00000100:00100000:3.0:1715330356.660830:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942526848 00000100:00100000:3.0:1715330356.660835:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942526976 00000100:00100000:0.0:1715330356.660836:0:17197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942527424 00000100:00100000:3.0:1715330356.660837:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942526976 00000100:00100000:0.0:1715330356.660837:0:17197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942527424 00000100:00100000:3.0:1715330356.660845:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942527232 00000100:00100000:3.0:1715330356.660846:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942527232 00000100:00100000:0.0:1715330356.660850:0:17197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942527104 00000100:00100000:0.0:1715330356.660852:0:17197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942527104 00000100:00100000:3.0:1715330356.660855:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1715330356.660858:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3690:x1798653942527040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330356.660860:0:17197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942527360 00000100:00100000:0.0:1715330356.660862:0:17197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942527360 00000100:00100000:0.0:1715330356.660873:0:17197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1715330356.660876:0:17197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d55d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942527168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330356.660884:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3690:x1798653942527040:12345-0@lo:400:kworker.0 Request processed in 25us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330356.660888:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1715330356.660897:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1715330356.660899:0:17197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d55d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942527168:12345-0@lo:400:kworker.0 Request processed in 22us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330356.660901:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3690:x1798653942527296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330356.660904:0:17197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1715330356.660912:0:17197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1715330356.660915:0:17197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d55dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942527424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330356.660919:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3690:x1798653942527296:12345-0@lo:400:kworker.0 Request processed in 18us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330356.660924:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1715330356.660932:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1715330356.660935:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3690:x1798653942526848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330356.660953:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3690:x1798653942526848:12345-0@lo:400:kworker.0 Request processed in 17us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330356.660957:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1715330356.660965:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1715330356.660969:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d55df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1798653942526976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330356.660988:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d55df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1798653942526976:12345-0@lo:400:kworker.0 Request processed in 18us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330356.660993:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1715330356.661001:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1715330356.661004:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d55e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3688:x1798653942527232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330356.661023:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d55e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3688:x1798653942527232:12345-0@lo:400:kworker.0 Request processed in 17us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330356.661028:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1715330356.661042:0:17217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1715330356.661045:0:17217:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942527104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330356.661062:0:17217:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942527104:12345-0@lo:400:kworker.0 Request processed in 17us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330356.661066:0:17217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1715330356.661073:0:17217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1715330356.661076:0:17217:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942527360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330356.661088:0:17217:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942527360:12345-0@lo:400:kworker.0 Request processed in 11us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330356.661092:0:17217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00080000:3.0:1715330356.661103:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330326 00000100:00080000:3.0:1715330356.661105:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330326 00000100:00080000:3.0:1715330356.661107:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330326 00000100:00100000:3.0:1715330356.661118:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d646d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3690:1798653942526848:0@lo:400:kworker.0 00000100:00100000:3.0:1715330356.661125:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b318000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942527104:0@lo:400:kworker.0 00000100:00100000:3.0:1715330356.661130:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b319c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942527360:0@lo:400:kworker.0 00000100:00100000:3.0:1715330356.661136:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d646a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942526784:0@lo:400:kworker.0 00000100:00100000:3.0:1715330356.661141:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b31bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3690:1798653942527040:0@lo:400:kworker.0 00000100:00100000:3.0:1715330356.661146:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b318a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3690:1798653942527296:0@lo:400:kworker.0 00000100:00100000:0.0:1715330356.661219:0:17197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d55dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942527424:12345-0@lo:400:kworker.0 Request processed in 302us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330356.661224:0:17197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1715330356.661251:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b31b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3688:1798653942526976:0@lo:400:kworker.0 00000100:00100000:1.0:1715330356.661259:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b318e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3688:1798653942527232:0@lo:400:kworker.0 00000100:00100000:1.0:1715330356.661269:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b31aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942526912:0@lo:400:kworker.0 00000100:00100000:1.0:1715330356.661284:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b318380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942527168:0@lo:400:kworker.0 00000100:00100000:1.0:1715330356.661290:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b31a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942527424:0@lo:400:kworker.0 00000100:00100000:1.0:1715330356.690954:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1715330356.690981:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942527488:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1715330356.691056:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330356.691281:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d55e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942527552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1715330356.691306:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330356.691582:0:9400:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942527488 00000100:00100000:0.0:1715330356.691592:0:9400:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942527488 00000100:00100000:0.0:1715330356.691653:0:9400:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942527552 00000100:00100000:0.0:1715330356.691656:0:9400:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942527552 00000100:00100000:0.0:1715330356.691671:0:9400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1715330356.691679:0:9400:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942527488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1715330356.691704:0:9400:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 352256 granted 178923200 pending 25313280 free 3906768896 avail 3675246592 00000100:00100000:0.0:1715330356.691766:0:9400:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942527488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330356.691773:0:9400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1715330356.691788:0:9400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1715330356.691792:0:9400:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942527552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1715330356.691800:0:9400:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 352256 granted 178923200 pending 25313280 free 3906768896 avail 3675246592 00000100:00100000:0.0:1715330356.691819:0:9400:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942527552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 26us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330356.691824:0:9400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1715330356.691933:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d55e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942527552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1715330356.692023:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942527488:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1715330356.963061:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330356.963161:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938120832 00000100:00100000:2.0:1715330356.963171:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938120832 00002000:00100000:2.0:1715330356.963213:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (25165824->29360127) req@ffff88008d55ea00 x1798653938120832/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:567/0 lens 488/0 e 0 to 0 dl 1715330367 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330356.963222:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d55ea00 with x1798653938120832 ext(25165824->29360127) 00002000:00010000:2.0:1715330356.963227:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d55ea00 00000100:00100000:2.0:1715330356.963594:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 40 00000100:00100000:2.0:1715330356.963601:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d55ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+18:2012:x1798653938120832:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330356.999206:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d55ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+20:2012:x1798653938120832:12345-192.168.204.49@tcp:4:dd.0 Request processed in 35596us (36144us total) trans 4294969974 rc 0/0 00000100:00100000:2.0:1715330356.999220:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 40 00002000:00100000:2.0:1715330356.999231:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (25165824->29360127) req@ffff88008d55ea00 x1798653938120832/t4294969974(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:567/0 lens 488/448 e 0 to 0 dl 1715330367 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330356.999239:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d55ea00 with x1798653938120832 ext(25165824->29360127) 00002000:00010000:2.0:1715330356.999244:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d55ea00 00010000:00010000:0.0:1715330357.355566:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330357.417084:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330357.417181:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938120960 00000100:00100000:2.0:1715330357.417193:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938120960 00002000:00100000:2.0:1715330357.417237:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (29360128->33554431) req@ffff88008d55ed80 x1798653938120960/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:568/0 lens 488/0 e 0 to 0 dl 1715330368 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330357.417247:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d55ed80 with x1798653938120960 ext(29360128->33554431) 00002000:00010000:2.0:1715330357.417252:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d55ed80 00000100:00100000:2.0:1715330357.417317:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 41 00000100:00100000:2.0:1715330357.417324:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d55ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+20:2011:x1798653938120960:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330357.473499:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d55ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+22:2011:x1798653938120960:12345-192.168.204.49@tcp:4:dd.0 Request processed in 56163us (56414us total) trans 4294969975 rc 0/0 00000100:00100000:2.0:1715330357.473516:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 41 00002000:00100000:2.0:1715330357.473526:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (29360128->33554431) req@ffff88008d55ed80 x1798653938120960/t4294969975(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:568/0 lens 488/448 e 0 to 0 dl 1715330368 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330357.473534:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d55ed80 with x1798653938120960 ext(29360128->33554431) 00002000:00010000:2.0:1715330357.473540:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d55ed80 00000100:00100000:0.0:1715330357.849223:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330357.849340:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938121088 00000100:00100000:3.0:1715330357.849348:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938121088 00000100:00080000:0.0:1715330357.849437:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330327 00000100:00100000:3.0:1715330357.849482:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5213 00000100:00100000:3.0:1715330357.849490:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d55f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+20:20924:x1798653938121088:12345-192.168.204.49@tcp:35:dd.0 00000001:00080000:3.0:1715330357.850363:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294984084 00000100:00100000:3.0:1715330357.851699:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d55f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+22:20924:x1798653938121088:12345-192.168.204.49@tcp:35:dd.0 Request processed in 2205us (2479us total) trans 4294984085 rc 0/0 00000100:00100000:3.0:1715330357.851709:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5213 00000020:00080000:3.0:1715330357.851714:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:0.0:1715330357.851828:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984085 is committed 00010000:00010000:2.0:1715330357.851860:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d440/0xd895711d66dbc39 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330357.851868:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d440/0xd895711d66dbc39 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330357.851874:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d440/0xd895711d66dbc39 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330357.851879:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5d440 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330357.851883:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d440/0xd895711d66dbc39 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330357.851890:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d440/0xd895711d66dbc39 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330357.851907:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff88008b0d2c00) 00010000:00010000:2.0:1715330357.851909:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330357.851913:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d440/0xd895711d66dbc39 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330357.851917:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d440/0xd895711d66dbc39 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00000100:00100000:3.0:1715330358.100173:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1715330358.100208:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942527616:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1715330358.100311:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330358.100511:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942527616 00000100:00100000:0.0:1715330358.100520:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942527616 00000100:00100000:0.0:1715330358.100574:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3080 00000100:00100000:0.0:1715330358.100582:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942527616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1715330358.100623:0:7138:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444089856 avail 1314627584 00000100:00100000:0.0:1715330358.100679:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942527616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330358.100687:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3080 00000100:00100000:2.0:1715330358.100819:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942527616:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1715330358.194801:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330358.194907:0:7130:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938121152 00000100:00100000:3.0:1715330358.194916:0:7130:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938121152 00000100:00100000:3.0:1715330358.195280:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 357 00000100:00100000:3.0:1715330358.195288:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2011:x1798653938121152:12345-192.168.204.49@tcp:400:kworker.0 00000100:00080000:1.0:1715330358.195468:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330328 00000100:00100000:3.0:1715330358.196217:0:7130:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2011:x1798653938121152:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 926us (1420us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330358.196225:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 357 00000100:00100000:0.0:1715330358.196295:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330358.196349:0:12304:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938121280 00000100:00100000:1.0:1715330358.196354:0:12304:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938121280 00000100:00100000:1.0:1715330358.196386:0:12304:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 252 00000100:00100000:1.0:1715330358.196390:0:12304:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d55f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:72de1896-1df4-4b3a-930a-9116d2c66168+6:2011:x1798653938121280:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:1.0:1715330358.197269:0:12304:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d55f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:72de1896-1df4-4b3a-930a-9116d2c66168+6:2011:x1798653938121280:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 875us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330358.197277:0:12304:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 252 00000100:00080000:1.0:1715330358.197295:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330328 00000100:00100000:2.0:1715330358.197436:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330358.197497:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938121216 00000100:00100000:1.0:1715330358.197501:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938121216 00000100:00100000:1.0:1715330358.197541:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 352 00000100:00100000:1.0:1715330358.197545:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+6:2012:x1798653938121216:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:1.0:1715330358.197579:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+6:2012:x1798653938121216:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 33us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330358.197584:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 352 00000100:00080000:2.0:1715330358.197636:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330328 00010000:00010000:3.0:1715330358.358212:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330358.859583:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330358.859879:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938121344 00000100:00100000:1.0:1715330358.859888:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938121344 00000100:00100000:1.0:1715330358.860173:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23823 00000100:00100000:1.0:1715330358.860180:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d55f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+16:20932:x1798653938121344:12345-192.168.204.49@tcp:101:dd.0 00010000:00010000:1.0:1715330358.860200:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330358.860216:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5db00/0xd895711d66dbc40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbeb9 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330358.860274:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cb40/0xd895711d66dbc47 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330358.860284:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cb40/0xd895711d66dbc47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330358.860294:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cb40/0xd895711d66dbc47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00200000:1.0:1715330358.860327:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 270336 00000004:00200000:1.0:1715330358.860331:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1715330358.860344:0:7135:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cb40/0xd895711d66dbc47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330358.860360:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5db00/0xd895711d66dbc40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbeb9 expref: 18 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330358.860390:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cb40/0xd895711d66dbc47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbeb9 expref: 17 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330358.860397:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:1.0:1715330358.860399:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1715330358.860402:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091c5cb40, rc 0) 00000100:00100000:1.0:1715330358.861055:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d55f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:20932:x1798653938121344:12345-192.168.204.49@tcp:101:dd.0 Request processed in 874us (1478us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330358.861062:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23823 00000100:00100000:0.0:1715330358.868790:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330358.868881:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938121472 00000100:00100000:1.0:1715330358.868891:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938121472 00000100:00100000:1.0:1715330358.868944:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23824 00000100:00100000:1.0:1715330358.868952:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d55fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:20932:x1798653938121472:12345-192.168.204.49@tcp:101:dd.0 00010000:00010000:1.0:1715330358.868978:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330358.868981:0:7135:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1715330358.869003:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5cb40/0xd895711d66dbc47 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbeb9 expref: 17 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330358.869034:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:1.0:1715330358.869038:0:7135:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330358.869049:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ed00/0xd895711d66dbc4e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbec0 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330358.869167:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e1c0/0xd895711d66dbc55 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330358.869178:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e1c0/0xd895711d66dbc55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330358.869186:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e1c0/0xd895711d66dbc55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330358.869196:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e400/0xd895711d66dbc5c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330358.869201:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e400/0xd895711d66dbc5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330358.869205:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e400/0xd895711d66dbc5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330358.869260:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f3c0/0xd895711d66dbc63 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330358.869266:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f3c0/0xd895711d66dbc63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330358.869270:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f3c0/0xd895711d66dbc63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00200000:1.0:1715330358.869277:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1591:0x0]: returning size 37154816 00010000:00010000:1.0:1715330358.869352:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e1c0/0xd895711d66dbc55 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330358.869358:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e1c0/0xd895711d66dbc55 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330358.869366:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e1c0/0xd895711d66dbc55 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330358.869370:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e1c0/0xd895711d66dbc55 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330358.869375:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5e1c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330358.869379:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e1c0/0xd895711d66dbc55 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330358.869385:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e1c0/0xd895711d66dbc55 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330358.869392:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:1.0:1715330358.869394:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330358.869397:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e1c0/0xd895711d66dbc55 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330358.869401:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e1c0/0xd895711d66dbc55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330358.869408:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e400/0xd895711d66dbc5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330358.869412:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e400/0xd895711d66dbc5c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330358.869416:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e400/0xd895711d66dbc5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330358.869420:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5e400 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330358.869422:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e400/0xd895711d66dbc5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330358.869429:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e400/0xd895711d66dbc5c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330358.869433:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x333666 (ffff88008b0d2800) 00010000:00010000:1.0:1715330358.869435:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330358.869437:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e400/0xd895711d66dbc5c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330358.869441:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e400/0xd895711d66dbc5c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330358.869600:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ed00/0xd895711d66dbc4e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbec0 expref: 19 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330358.869611:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f3c0/0xd895711d66dbc63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbec0 expref: 18 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330358.869617:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff88008b0d2c00) 00010000:00010000:1.0:1715330358.869619:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715330358.869621:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091c5f3c0, rc 0) 00000100:00100000:1.0:1715330358.869673:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d55fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+18:20932:x1798653938121472:12345-192.168.204.49@tcp:101:dd.0 Request processed in 721us (896us total) trans 4294984086 rc 0/0 00000100:00100000:1.0:1715330358.869679:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23824 00000100:00100000:0.0:1715330358.872719:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330358.872808:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938121600 00000100:00100000:1.0:1715330358.872816:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938121600 00000100:00100000:1.0:1715330358.874277:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23825 00000100:00100000:1.0:1715330358.874285:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d55e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+18:20932:x1798653938121600:12345-192.168.204.49@tcp:36:dd.0 00010000:00010000:1.0:1715330358.874328:0:7135:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330358.874350:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f3c0/0xd895711d66dbc63 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbec0 expref: 18 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330358.874364:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff88008b0d2c00) 00010000:00010000:1.0:1715330358.874367:0:7135:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330358.874475:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e640/0xd895711d66dbc71 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330358.874485:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e640/0xd895711d66dbc71 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330358.874491:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e640/0xd895711d66dbc71 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000001:00080000:1.0:1715330358.874512:0:7135:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294984087 00000004:00010000:1.0:1715330358.874524:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008d55e680 reply state ffff880091c03000 transno 4294984088 ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e640/0xd895711d66dbc71 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330358.874530:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e640/0xd895711d66dbc71 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330358.874535:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff88008b0d2c00) 00010000:00010000:1.0:1715330358.874537:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330358.874538:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1715330358.874606:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d55e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+20:20932:x1798653938121600:12345-192.168.204.49@tcp:36:dd.0 Request processed in 322us (1893us total) trans 4294984088 rc 0/0 00000100:00100000:1.0:1715330358.874611:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23825 00000020:00080000:1.0:1715330358.874615:0:7135:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330358.924784:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330358.927137:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938121664 00000100:00100000:2.0:1715330358.927154:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938121664 00002000:00010000:2.0:1715330358.927215:0:27574:0:(ofd_dev.c:2731:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/2560 (0->18446744073709551615) 00002000:00100000:2.0:1715330358.927219:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d55c700 with x1798653938121664 ext(0->18446744073709551615) 00002000:00010000:2.0:1715330358.927239:0:27574:0:(ofd_dev.c:2736:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d55c700. 00000100:00100000:2.0:1715330358.927279:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 42 00000100:00100000:2.0:1715330358.927287:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d55c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+22:2012:x1798653938121664:12345-192.168.204.49@tcp:10:dd.0 00000100:00080000:0.0:1715330358.927815:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330328 00002000:00010000:2.0:1715330358.957865:0:27574:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1715330358.957872:0:27574:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb mtime from disk: 1715330353 -> 1715330359 00002000:00010000:2.0:1715330358.957875:0:27574:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1715330358.957877:0:27574:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb ctime from disk: 1715330353 -> 1715330359 00002000:00010000:2.0:1715330358.957879:0:27574:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1715330358.957962:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d55c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+23:2012:x1798653938121664:12345-192.168.204.49@tcp:10:dd.0 Request processed in 30669us (33181us total) trans 4294969976 rc 0/0 00000100:00100000:2.0:1715330358.957974:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 42 00002000:00010000:2.0:1715330358.957980:0:27574:0:(ofd_dev.c:2731:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/2560 (0->18446744073709551615) 00002000:00100000:2.0:1715330358.957983:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d55c700 with x1798653938121664 ext(0->18446744073709551615) 00002000:00010000:2.0:1715330358.957989:0:27574:0:(ofd_dev.c:2736:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d55c700. 00000001:00080000:0.0:1715330358.959612:0:10666:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4294969976 is committed 00010000:00010000:3.0:1715330359.359543:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330359.554996:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1715330359.555019:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942527680:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1715330359.555092:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330359.555156:0:7139:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942527680 00000100:00100000:3.0:1715330359.555163:0:7139:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942527680 00000100:00100000:3.0:1715330359.555203:0:7139:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3081 00000100:00100000:3.0:1715330359.555209:0:7139:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942527680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1715330359.555266:0:7139:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445060608 avail 1315598336 00000100:00100000:3.0:1715330359.555315:0:7139:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942527680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330359.555322:0:7139:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3081 00000100:00100000:2.0:1715330359.555420:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942527680:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1715330359.891210:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330359.891323:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938121792 00000100:00100000:2.0:1715330359.891333:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938121792 00002000:00100000:2.0:1715330359.891372:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (0->4194303) req@ffff88008b0c1c00 x1798653938121792/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:570/0 lens 488/0 e 0 to 0 dl 1715330370 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330359.891382:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b0c1c00 with x1798653938121792 ext(0->4194303) 00002000:00010000:2.0:1715330359.891387:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b0c1c00 00000100:00100000:2.0:1715330359.891462:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 43 00000100:00100000:2.0:1715330359.891469:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+6:2012:x1798653938121792:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330359.958182:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+8:2012:x1798653938121792:12345-192.168.204.49@tcp:4:dd.0 Request processed in 66704us (66971us total) trans 4294969977 rc 0/0 00000100:00100000:0.0:1715330359.958193:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 43 00002000:00100000:0.0:1715330359.958204:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (0->4194303) req@ffff88008b0c1c00 x1798653938121792/t4294969977(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:570/0 lens 488/448 e 0 to 0 dl 1715330370 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330359.958212:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b0c1c00 with x1798653938121792 ext(0->4194303) 00002000:00010000:0.0:1715330359.958228:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b0c1c00 00010000:00010000:1.0:1715330360.361088:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330360.409744:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942527744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1715330360.409827:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330360.409999:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942527744 00000100:00100000:3.0:1715330360.410015:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942527744 00000100:00100000:3.0:1715330360.410889:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1715330360.410897:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d646a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942527744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1715330360.410938:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1715330360.411007:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d646a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942527744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330360.411013:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00080000:3.0:1715330360.411046:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330330 00000100:00100000:0.0:1715330360.412464:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942527744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1715330360.435068:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d646d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942527808:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1715330360.435173:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330360.435364:0:9401:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942527808 00000100:00100000:0.0:1715330360.435373:0:9401:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942527808 00000100:00100000:0.0:1715330360.435450:0:9401:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1715330360.435458:0:9401:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942527808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1715330360.435488:0:9401:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1715330360.435530:0:9401:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942527808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330360.435537:0:9401:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1715330360.435626:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d646d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942527808:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1715330360.435717:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330330 00000100:00100000:0.0:1715330360.522930:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330360.525845:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938121920 00000100:00100000:2.0:1715330360.525860:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938121920 00002000:00100000:2.0:1715330360.526804:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (4194304->8388607) req@ffff88009d647b80 x1798653938121920/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:571/0 lens 488/0 e 0 to 0 dl 1715330371 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330360.526815:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d647b80 with x1798653938121920 ext(4194304->8388607) 00002000:00010000:2.0:1715330360.526822:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d647b80 00000100:00080000:3.0:1715330360.527586:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330330 00000100:00100000:2.0:1715330360.528086:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 44 00000100:00100000:2.0:1715330360.528094:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d647b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+8:2014:x1798653938121920:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330360.608659:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d647b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+10:2014:x1798653938121920:12345-192.168.204.49@tcp:4:dd.0 Request processed in 80552us (85730us total) trans 4294969978 rc 0/0 00000100:00100000:2.0:1715330360.608676:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 44 00002000:00100000:2.0:1715330360.608691:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (4194304->8388607) req@ffff88009d647b80 x1798653938121920/t4294969978(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:571/0 lens 488/448 e 0 to 0 dl 1715330371 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330360.608702:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d647b80 with x1798653938121920 ext(4194304->8388607) 00002000:00010000:2.0:1715330360.608709:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d647b80 00000100:00100000:0.0:1715330361.235011:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330361.235350:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938122048 00000100:00100000:2.0:1715330361.235365:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938122048 00002000:00100000:2.0:1715330361.235409:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (8388608->12582911) req@ffff88009d646d80 x1798653938122048/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:572/0 lens 488/0 e 0 to 0 dl 1715330372 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330361.235420:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d646d80 with x1798653938122048 ext(8388608->12582911) 00002000:00010000:2.0:1715330361.235425:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d646d80 00000100:00100000:2.0:1715330361.235470:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 45 00000100:00100000:2.0:1715330361.235476:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d646d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+10:2013:x1798653938122048:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330361.296429:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d646d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+12:2013:x1798653938122048:12345-192.168.204.49@tcp:4:dd.0 Request processed in 60939us (61417us total) trans 4294969979 rc 0/0 00000100:00100000:2.0:1715330361.296444:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 45 00002000:00100000:2.0:1715330361.296458:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (8388608->12582911) req@ffff88009d646d80 x1798653938122048/t4294969979(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:572/0 lens 488/448 e 0 to 0 dl 1715330372 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330361.296468:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d646d80 with x1798653938122048 ext(8388608->12582911) 00002000:00010000:2.0:1715330361.296474:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d646d80 00010000:00010000:2.0:1715330361.363577:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330361.671572:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942528000:0@lo:400:kworker.0 00000100:00100000:3.0:1715330361.671663:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330361.671698:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3689:1798653942528256:0@lo:400:kworker.0 00000100:00100000:3.0:1715330361.671727:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330361.671758:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3691:1798653942527872:0@lo:400:kworker.0 00000100:00100000:3.0:1715330361.671760:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3689:1798653942528512:0@lo:400:kworker.0 00000100:00100000:2.0:1715330361.671768:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3690:1798653942528064:0@lo:400:kworker.0 00000100:00100000:0.0:1715330361.671774:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3688:1798653942527936:0@lo:400:kworker.0 00000100:00100000:3.0:1715330361.671778:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330361.671809:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330361.671829:0:7139:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942528000 00000100:00100000:3.0:1715330361.671836:0:7139:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942528000 00000100:00100000:1.0:1715330361.671841:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942528128:0@lo:400:kworker.0 00000100:00100000:1.0:1715330361.671862:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330361.671869:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942528256 00000100:00100000:0.0:1715330361.671871:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330361.671876:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942528256 00000100:00100000:1.0:1715330361.671876:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942528384:0@lo:400:kworker.0 00000100:00100000:3.0:1715330361.671885:0:7139:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942528128 00000100:00100000:3.0:1715330361.671888:0:7139:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942528128 00000100:00100000:1.0:1715330361.671903:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330361.671910:0:7139:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3082 00000100:00100000:1.0:1715330361.671917:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942528640:0@lo:400:kworker.0 00000100:00100000:3.0:1715330361.671919:0:7139:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:3689:x1798653942528000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330361.671932:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330361.671935:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942528512 00000100:00100000:2.0:1715330361.671940:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942528512 00000100:00100000:2.0:1715330361.671953:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942527936 00000100:00100000:2.0:1715330361.671954:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942527936 00000100:00100000:1.0:1715330361.671968:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1715330361.671976:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b31a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1798653942528256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330361.671977:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1715330361.671982:0:7139:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:3689:x1798653942528000:12345-0@lo:400:kworker.0 Request processed in 62us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330361.671989:0:7139:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3082 00000100:00100000:0.0:1715330361.672003:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3688:1798653942528192:0@lo:400:kworker.0 00000100:00100000:3.0:1715330361.672004:0:7139:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3083 00000100:00100000:3.0:1715330361.672008:0:7139:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942528128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330361.672008:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b31a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1798653942528256:12345-0@lo:400:kworker.0 Request processed in 34us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330361.672014:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1715330361.672026:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330361.672029:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942528192 00000100:00100000:3.0:1715330361.672031:0:7139:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942528128:12345-0@lo:400:kworker.0 Request processed in 23us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330361.672032:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942528192 00000100:00100000:0.0:1715330361.672035:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3688:1798653942528448:0@lo:400:kworker.0 00000100:00100000:3.0:1715330361.672036:0:7139:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3083 00000100:00100000:1.0:1715330361.672046:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1715330361.672050:0:7130:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942527872 00000100:00100000:1.0:1715330361.672050:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3688:x1798653942527936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330361.672050:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330361.672052:0:7130:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942527872 00000100:00100000:3.0:1715330361.672071:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1715330361.672075:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4af2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3691:x1798653942527872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330361.672082:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3688:x1798653942527936:12345-0@lo:400:kworker.0 Request processed in 31us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330361.672087:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1715330361.672087:0:17197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942528384 00000100:00100000:0.0:1715330361.672091:0:17197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942528384 00000100:00100000:1.0:1715330361.672095:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942528448 00000100:00100000:3.0:1715330361.672097:0:7130:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4af2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3691:x1798653942527872:12345-0@lo:400:kworker.0 Request processed in 21us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330361.672097:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942528448 00000100:00100000:3.0:1715330361.672102:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1715330361.672107:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1715330361.672110:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1798653942528192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330361.672111:0:17197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942528640 00000100:00100000:0.0:1715330361.672113:0:17197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942528640 00000100:00100000:0.0:1715330361.672126:0:17197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1715330361.672129:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1715330361.672129:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1798653942528192:12345-0@lo:400:kworker.0 Request processed in 18us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330361.672131:0:17197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942528384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330361.672133:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134588700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3688:x1798653942528448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330361.672134:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1715330361.672156:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134588700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3688:x1798653942528448:12345-0@lo:400:kworker.0 Request processed in 22us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330361.672157:0:12304:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1715330361.672161:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1715330361.672162:0:12304:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942528640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330361.672172:0:17197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942528384:12345-0@lo:400:kworker.0 Request processed in 41us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330361.672178:0:17197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1715330361.672200:0:12304:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942528640:12345-0@lo:400:kworker.0 Request processed in 38us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330361.672203:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942528000:0@lo:400:kworker.0 00000100:00100000:1.0:1715330361.672206:0:12304:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1715330361.672217:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3689:1798653942528256:0@lo:400:kworker.0 00000100:00100000:0.0:1715330361.672229:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3688:1798653942527936:0@lo:400:kworker.0 00000100:00100000:1.0:1715330361.672233:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3691:1798653942527872:0@lo:400:kworker.0 00000100:00100000:0.0:1715330361.672239:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3688:1798653942528192:0@lo:400:kworker.0 00000100:00100000:1.0:1715330361.672243:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942528128:0@lo:400:kworker.0 00000100:00100000:0.0:1715330361.672248:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3688:1798653942528448:0@lo:400:kworker.0 00000100:00100000:1.0:1715330361.672253:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942528384:0@lo:400:kworker.0 00000100:00100000:1.0:1715330361.672260:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942528640:0@lo:400:kworker.0 00000100:00100000:2.0:1715330361.675981:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b318380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3689:x1798653942528512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330361.676077:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b318380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3689:x1798653942528512:12345-0@lo:400:kworker.0 Request processed in 4093us (4297us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330361.676085:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00080000:2.0:1715330361.676123:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330331 00000100:00080000:2.0:1715330361.676128:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330331 00000100:00080000:2.0:1715330361.676130:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330331 00000100:00080000:2.0:1715330361.676132:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330331 00000100:00100000:2.0:1715330361.676146:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330361.676174:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942528320:0@lo:400:kworker.0 00000100:00100000:0.0:1715330361.676217:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942528064 00000100:00100000:2.0:1715330361.676221:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330361.676225:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942528064 00000100:00100000:3.0:1715330361.676241:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3689:1798653942528512:0@lo:400:kworker.0 00000100:00100000:2.0:1715330361.676244:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942528576:0@lo:400:kworker.0 00000100:00100000:0.0:1715330361.676253:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1715330361.676257:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3690:x1798653942528064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330361.676262:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330361.676285:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3690:x1798653942528064:12345-0@lo:400:kworker.0 Request processed in 27us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330361.676289:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1715330361.676305:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3690:1798653942528064:0@lo:400:kworker.0 00000100:00100000:3.0:1715330361.676320:0:17215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942528320 00000100:00100000:3.0:1715330361.676326:0:17215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942528320 00000100:00100000:3.0:1715330361.677574:0:17215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942528576 00000100:00100000:3.0:1715330361.677580:0:17215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942528576 00000100:00100000:0.0:1715330361.677603:0:17198:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1715330361.677610:0:17198:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942528320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330361.677615:0:12304:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1715330361.677622:0:12304:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942528576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330361.677677:0:17198:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942528320:12345-0@lo:400:kworker.0 Request processed in 67us (1455us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330361.677683:0:17198:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1715330361.677689:0:12304:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942528576:12345-0@lo:400:kworker.0 Request processed in 68us (1426us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330361.677697:0:12304:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00080000:2.0:1715330361.678284:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330331 00000100:00100000:3.0:1715330361.679038:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942528320:0@lo:400:kworker.0 00000100:00100000:3.0:1715330361.679054:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942528576:0@lo:400:kworker.0 00000100:00100000:3.0:1715330361.699145:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1715330361.699195:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942528704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1715330361.699310:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330361.699517:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942528704 00000100:00100000:2.0:1715330361.699527:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942528704 00000100:00100000:2.0:1715330361.699595:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1715330361.699603:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b31aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942528704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1715330361.699632:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 114688 granted 183736000 pending 12656640 free 3910963200 avail 3679440896 00000100:00100000:2.0:1715330361.699709:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b31aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942528704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330361.699716:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1715330361.699835:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1715330361.699850:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f578000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942528768:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1715330361.699883:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330361.700140:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942528704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1715330361.700223:0:9401:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942528768 00000100:00100000:1.0:1715330361.700228:0:9401:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942528768 00000100:00100000:1.0:1715330361.700249:0:9401:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1715330361.700254:0:9401:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134588a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942528768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1715330361.700367:0:9401:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 114688 granted 183736000 pending 12656640 free 3910963200 avail 3679440896 00000100:00100000:1.0:1715330361.702531:0:9401:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134588a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942528768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2268us (2639us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330361.702546:0:9401:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1715330361.702797:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f578000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942528768:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1715330361.878280:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330361.878379:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938122176 00000100:00100000:2.0:1715330361.878388:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938122176 00002000:00100000:2.0:1715330361.878422:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (12582912->16777215) req@ffff880134588e00 x1798653938122176/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:572/0 lens 488/0 e 0 to 0 dl 1715330372 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330361.878436:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880134588e00 with x1798653938122176 ext(12582912->16777215) 00002000:00010000:2.0:1715330361.878440:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134588e00 00000100:00100000:2.0:1715330361.878722:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 46 00000100:00100000:2.0:1715330361.878753:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134588e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+12:2012:x1798653938122176:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330361.930204:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134588e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+14:2012:x1798653938122176:12345-192.168.204.49@tcp:4:dd.0 Request processed in 51464us (51921us total) trans 4294969980 rc 0/0 00000100:00100000:2.0:1715330361.930217:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 46 00002000:00100000:2.0:1715330361.930231:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (12582912->16777215) req@ffff880134588e00 x1798653938122176/t4294969980(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:572/0 lens 488/448 e 0 to 0 dl 1715330372 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330361.930241:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880134588e00 with x1798653938122176 ext(12582912->16777215) 00002000:00010000:2.0:1715330361.930247:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134588e00 00010000:00010000:0.0:1715330362.364984:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330362.665112:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330362.665245:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938122304 00000100:00100000:2.0:1715330362.665253:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938122304 00002000:00100000:2.0:1715330362.665294:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (16777216->20971519) req@ffff880134589180 x1798653938122304/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:573/0 lens 488/0 e 0 to 0 dl 1715330373 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330362.665303:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880134589180 with x1798653938122304 ext(16777216->20971519) 00002000:00010000:2.0:1715330362.665307:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134589180 00000100:00100000:2.0:1715330362.665336:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 47 00000100:00100000:2.0:1715330362.665342:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134589180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+14:2011:x1798653938122304:12345-192.168.204.49@tcp:4:dd.0 00000100:00080000:0.0:1715330362.668588:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330332 00000100:00100000:2.0:1715330362.732655:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134589180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+16:2011:x1798653938122304:12345-192.168.204.49@tcp:4:dd.0 Request processed in 67299us (67539us total) trans 4294969981 rc 0/0 00000100:00100000:2.0:1715330362.732671:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 47 00002000:00100000:2.0:1715330362.732688:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (16777216->20971519) req@ffff880134589180 x1798653938122304/t4294969981(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:573/0 lens 488/448 e 0 to 0 dl 1715330373 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330362.732698:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880134589180 with x1798653938122304 ext(16777216->20971519) 00002000:00010000:2.0:1715330362.732704:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134589180 00000100:00100000:3.0:1715330363.108017:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942528832:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1715330363.108105:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330363.108203:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942528832 00000100:00100000:3.0:1715330363.108211:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942528832 00000100:00100000:3.0:1715330363.108861:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3084 00000100:00100000:3.0:1715330363.108872:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b318e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942528832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1715330363.108927:0:19960:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444089856 avail 1314627584 00000100:00100000:3.0:1715330363.108973:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b318e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942528832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330363.108981:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3084 00000100:00100000:0.0:1715330363.109103:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942528832:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1715330363.201922:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330363.201981:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330363.202018:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330363.202048:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330363.202109:0:12304:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938122560 00000100:00100000:3.0:1715330363.202121:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938122432 00000100:00100000:0.0:1715330363.202121:0:12304:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938122560 00000100:00100000:3.0:1715330363.202127:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938122432 00000100:00100000:1.0:1715330363.202193:0:7129:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938122368 00000100:00100000:1.0:1715330363.202197:0:7129:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938122368 00000100:00100000:2.0:1715330363.202245:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938122496 00000100:00100000:2.0:1715330363.202248:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938122496 00000100:00100000:3.0:1715330363.202282:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 359 00000100:00100000:3.0:1715330363.202291:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+20:2014:x1798653938122432:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:1.0:1715330363.202297:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 359 00000100:00100000:1.0:1715330363.202301:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4af2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2014:x1798653938122368:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:3.0:1715330363.202372:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+20:2014:x1798653938122432:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 81us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330363.202378:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 359 00000100:00100000:3.0:1715330363.202398:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 360 00000100:00100000:3.0:1715330363.202402:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938122496:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:1.0:1715330363.202482:0:7129:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4af2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2014:x1798653938122368:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 179us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330363.202489:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 359 00000100:00080000:1.0:1715330363.202524:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330333 00000100:00080000:1.0:1715330363.202527:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330333 00000100:00080000:1.0:1715330363.202529:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330333 00000100:00080000:1.0:1715330363.202531:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330333 00000100:00100000:0.0:1715330363.202768:0:12304:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 257 00000100:00100000:0.0:1715330363.202774:0:12304:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938122560:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:0.0:1715330363.202803:0:12304:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938122560:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 30us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330363.202809:0:12304:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 257 00000100:00100000:3.0:1715330363.204796:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938122496:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 2384us (2737us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330363.204809:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 360 00000100:00100000:0.0:1715330363.370017:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330363.370604:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938122688 00000100:00100000:2.0:1715330363.370616:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938122688 00002000:00100000:2.0:1715330363.370668:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (20971520->25165823) req@ffff880134589f80 x1798653938122688/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:574/0 lens 488/0 e 0 to 0 dl 1715330374 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330363.370678:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880134589f80 with x1798653938122688 ext(20971520->25165823) 00002000:00010000:2.0:1715330363.370684:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134589f80 00000100:00100000:2.0:1715330363.370724:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 48 00000100:00100000:2.0:1715330363.370757:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134589f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+16:2011:x1798653938122688:12345-192.168.204.49@tcp:4:dd.0 00010000:00010000:3.0:1715330363.371861:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330363.447633:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134589f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+18:2011:x1798653938122688:12345-192.168.204.49@tcp:4:dd.0 Request processed in 76886us (77612us total) trans 4294969982 rc 0/0 00000100:00100000:0.0:1715330363.447648:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 48 00002000:00100000:0.0:1715330363.447663:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (20971520->25165823) req@ffff880134589f80 x1798653938122688/t4294969982(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:574/0 lens 488/448 e 0 to 0 dl 1715330374 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330363.447673:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880134589f80 with x1798653938122688 ext(20971520->25165823) 00002000:00010000:0.0:1715330363.447680:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134589f80 00000100:00100000:0.0:1715330363.864475:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330363.864584:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938122816 00000100:00100000:3.0:1715330363.864600:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938122816 00000100:00100000:3.0:1715330363.864682:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5214 00000100:00100000:3.0:1715330363.864692:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013458a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+20:20932:x1798653938122816:12345-192.168.204.49@tcp:35:dd.0 00000001:00080000:3.0:1715330363.864986:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294984089 00000100:00100000:3.0:1715330363.865126:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013458a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+22:20932:x1798653938122816:12345-192.168.204.49@tcp:35:dd.0 Request processed in 433us (666us total) trans 4294984090 rc 0/0 00000100:00100000:3.0:1715330363.865134:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5214 00000020:00080000:3.0:1715330363.865139:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:0.0:1715330364.249352:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984090 is committed 00010000:00010000:3.0:1715330364.249401:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e640/0xd895711d66dbc71 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330364.249413:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e640/0xd895711d66dbc71 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330364.249420:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e640/0xd895711d66dbc71 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330364.249426:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5e640 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330364.249431:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e640/0xd895711d66dbc71 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330364.249439:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e640/0xd895711d66dbc71 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330364.249463:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff88008b0d2c00) 00010000:00010000:3.0:1715330364.249466:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330364.249471:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e640/0xd895711d66dbc71 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330364.249478:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5e640/0xd895711d66dbc71 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330364.370997:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330364.564096:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1715330364.564120:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942528896:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1715330364.564209:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330364.565915:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942528896 00000100:00100000:3.0:1715330364.565928:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942528896 00000100:00100000:3.0:1715330364.565993:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3085 00000100:00100000:3.0:1715330364.566002:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013458a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942528896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1715330364.566045:0:19960:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445060608 avail 1315598336 00000100:00100000:3.0:1715330364.566140:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013458a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942528896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 130us (1922us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330364.566147:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3085 00000100:00100000:1.0:1715330364.566193:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942528896:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1715330364.882700:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330364.884207:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938122880 00000100:00100000:3.0:1715330364.884223:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938122880 00000100:00100000:3.0:1715330364.884289:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23826 00000100:00100000:3.0:1715330364.884297:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013458aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+16:20940:x1798653938122880:12345-192.168.204.49@tcp:101:dd.0 00010000:00010000:3.0:1715330364.884323:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330364.884347:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83cc0/0xd895711d66dbc78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbec7 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330364.884414:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82f40/0xd895711d66dbc7f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330364.884428:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82f40/0xd895711d66dbc7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330364.884440:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82f40/0xd895711d66dbc7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00200000:3.0:1715330364.884487:0:11283:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 270336 00000004:00200000:3.0:1715330364.884491:0:11283:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1715330364.884506:0:11283:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82f40/0xd895711d66dbc7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330364.884525:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83cc0/0xd895711d66dbc78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbec7 expref: 18 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330364.886843:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82f40/0xd895711d66dbc7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbec7 expref: 17 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330364.886865:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:3.0:1715330364.886870:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1715330364.886874:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011da82f40, rc 0) 00000100:00100000:3.0:1715330364.887021:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013458aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+17:20940:x1798653938122880:12345-192.168.204.49@tcp:101:dd.0 Request processed in 2721us (4335us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330364.887035:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23826 00000100:00100000:0.0:1715330364.891090:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330364.891215:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938123008 00000100:00100000:3.0:1715330364.891227:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938123008 00000100:00100000:3.0:1715330364.891305:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23827 00000100:00100000:3.0:1715330364.891316:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013458ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+17:20940:x1798653938123008:12345-192.168.204.49@tcp:101:dd.0 00010000:00010000:3.0:1715330364.891472:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330364.891479:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1715330364.891516:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82f40/0xd895711d66dbc7f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbec7 expref: 17 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330364.891536:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:3.0:1715330364.891541:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330364.891559:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82400/0xd895711d66dbc86 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbece expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330364.891713:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80900/0xd895711d66dbc8d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330364.891758:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80900/0xd895711d66dbc8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330364.891769:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80900/0xd895711d66dbc8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330364.891782:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82880/0xd895711d66dbc94 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330364.891788:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82880/0xd895711d66dbc94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330364.891793:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82880/0xd895711d66dbc94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330364.891849:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82ac0/0xd895711d66dbc9b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330364.891857:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82ac0/0xd895711d66dbc9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330364.891863:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82ac0/0xd895711d66dbc9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00200000:3.0:1715330364.891871:0:11283:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1591:0x0]: returning size 27959296 00010000:00010000:3.0:1715330364.891983:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80900/0xd895711d66dbc8d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330364.891989:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80900/0xd895711d66dbc8d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330364.891999:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80900/0xd895711d66dbc8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330364.892005:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80900/0xd895711d66dbc8d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330364.892011:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da80900 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330364.892016:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80900/0xd895711d66dbc8d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330364.892022:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80900/0xd895711d66dbc8d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330364.892030:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:3.0:1715330364.892033:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330364.892036:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80900/0xd895711d66dbc8d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330364.892041:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80900/0xd895711d66dbc8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330364.892050:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82880/0xd895711d66dbc94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330364.892055:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82880/0xd895711d66dbc94 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330364.892059:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82880/0xd895711d66dbc94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330364.892062:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da82880 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330364.892064:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82880/0xd895711d66dbc94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330364.892072:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82880/0xd895711d66dbc94 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330364.892077:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x333666 (ffff88009396d500) 00010000:00010000:3.0:1715330364.892079:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330364.892081:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82880/0xd895711d66dbc94 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330364.892085:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82880/0xd895711d66dbc94 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330364.892121:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82400/0xd895711d66dbc86 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbece expref: 19 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330364.892145:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82ac0/0xd895711d66dbc9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbece expref: 18 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330364.892151:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff88008b0d2c00) 00010000:00010000:3.0:1715330364.892153:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330364.892155:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011da82ac0, rc 0) 00000100:00100000:3.0:1715330364.894491:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013458ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+18:20940:x1798653938123008:12345-192.168.204.49@tcp:101:dd.0 Request processed in 3164us (3404us total) trans 4294984091 rc 0/0 00000100:00100000:3.0:1715330364.894504:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23827 00000100:00100000:0.0:1715330364.901908:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330364.902305:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938123136 00000100:00100000:3.0:1715330364.902319:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938123136 00000100:00100000:3.0:1715330364.902403:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23828 00000100:00100000:3.0:1715330364.902414:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013458b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+18:20940:x1798653938123136:12345-192.168.204.49@tcp:36:dd.0 00010000:00010000:3.0:1715330364.902500:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330364.902537:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82ac0/0xd895711d66dbc9b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbece expref: 18 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330364.902577:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff88008b0d2c00) 00010000:00010000:3.0:1715330364.902584:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330364.902803:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81d40/0xd895711d66dbca9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330364.902817:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81d40/0xd895711d66dbca9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330364.902826:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81d40/0xd895711d66dbca9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000001:00080000:3.0:1715330364.902858:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294984092 00000004:00010000:3.0:1715330364.902873:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88013458b100 reply state ffff8800938d5000 transno 4294984093 ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81d40/0xd895711d66dbca9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330364.902880:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81d40/0xd895711d66dbca9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:3.0:1715330364.902884:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff88008b0d2c00) 00010000:00010000:3.0:1715330364.902887:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330364.902889:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330364.902963:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013458b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+20:20940:x1798653938123136:12345-192.168.204.49@tcp:36:dd.0 Request processed in 550us (1071us total) trans 4294984093 rc 0/0 00000100:00100000:3.0:1715330364.902969:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23828 00000020:00080000:3.0:1715330364.902973:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330364.958251:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330364.958435:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938123200 00000100:00100000:2.0:1715330364.958446:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938123200 00000100:00080000:1.0:1715330364.958510:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330334 00002000:00010000:2.0:1715330364.958519:0:27574:0:(ofd_dev.c:2731:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/2560 (0->18446744073709551615) 00002000:00100000:2.0:1715330364.958525:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88013458b480 with x1798653938123200 ext(0->18446744073709551615) 00002000:00010000:2.0:1715330364.958545:0:27574:0:(ofd_dev.c:2736:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013458b480. 00000100:00100000:2.0:1715330364.958579:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 49 00000100:00100000:2.0:1715330364.958588:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013458b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+18:2012:x1798653938123200:12345-192.168.204.49@tcp:10:dd.0 00002000:00010000:2.0:1715330364.977292:0:27574:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1715330364.977307:0:27574:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb mtime from disk: 1715330359 -> 1715330365 00002000:00010000:2.0:1715330364.977311:0:27574:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1715330364.977313:0:27574:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb ctime from disk: 1715330359 -> 1715330365 00002000:00010000:2.0:1715330364.977317:0:27574:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1715330364.977435:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013458b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+19:2012:x1798653938123200:12345-192.168.204.49@tcp:10:dd.0 Request processed in 18839us (19189us total) trans 4294969983 rc 0/0 00000100:00100000:2.0:1715330364.977452:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 49 00002000:00010000:2.0:1715330364.977460:0:27574:0:(ofd_dev.c:2731:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/2560 (0->18446744073709551615) 00002000:00100000:2.0:1715330364.977464:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88013458b480 with x1798653938123200 ext(0->18446744073709551615) 00002000:00010000:2.0:1715330364.977472:0:27574:0:(ofd_dev.c:2736:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013458b480. 00000001:00080000:2.0:1715330364.980335:0:10666:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4294969983 is committed 00010000:00010000:2.0:1715330365.373301:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330365.427401:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013458b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942528960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1715330365.427480:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330365.427596:0:9401:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942528960 00000100:00100000:1.0:1715330365.427606:0:9401:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942528960 00000100:00080000:0.0:1715330365.427657:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330335 00000100:00100000:1.0:1715330365.427678:0:9401:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1715330365.427688:0:9401:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942528960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1715330365.427771:0:9401:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1715330365.427818:0:9401:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942528960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330365.427825:0:9401:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1715330365.428285:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88013458b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942528960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1715330365.444949:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942529024:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1715330365.445045:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330365.447199:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942529024 00000100:00100000:1.0:1715330365.447214:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942529024 00000100:00100000:1.0:1715330365.447286:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1715330365.447296:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b31b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942529024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1715330365.447332:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1715330365.447421:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b31b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942529024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 126us (2376us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330365.447428:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:2.0:1715330365.447518:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330335 00000100:00100000:3.0:1715330365.447692:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942529024:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1715330365.995697:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330365.995823:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938123328 00000100:00100000:2.0:1715330365.995832:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938123328 00002000:00100000:2.0:1715330365.995874:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (0->4194303) req@ffff88013458bb80 x1798653938123328/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:576/0 lens 488/0 e 0 to 0 dl 1715330376 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330365.995881:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88013458bb80 with x1798653938123328 ext(0->4194303) 00002000:00010000:2.0:1715330365.995886:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013458bb80 00000100:00100000:2.0:1715330365.995912:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 50 00000100:00100000:2.0:1715330365.995918:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013458bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938123328:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330366.048006:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013458bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+8:2013:x1798653938123328:12345-192.168.204.49@tcp:4:dd.0 Request processed in 52074us (52307us total) trans 4294969984 rc 0/0 00000100:00100000:2.0:1715330366.048024:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 50 00002000:00100000:2.0:1715330366.048043:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (0->4194303) req@ffff88013458bb80 x1798653938123328/t4294969984(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:576/0 lens 488/448 e 0 to 0 dl 1715330376 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330366.048057:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88013458bb80 with x1798653938123328 ext(0->4194303) 00002000:00010000:2.0:1715330366.048067:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013458bb80 00010000:00010000:2.0:1715330366.375040:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330366.531660:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330366.534045:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938123456 00000100:00100000:2.0:1715330366.534060:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938123456 00002000:00100000:2.0:1715330366.534141:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (4194304->8388607) req@ffff88013458b800 x1798653938123456/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:577/0 lens 488/0 e 0 to 0 dl 1715330377 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330366.534152:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88013458b800 with x1798653938123456 ext(4194304->8388607) 00002000:00010000:2.0:1715330366.534157:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013458b800 00000100:00100000:2.0:1715330366.534189:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 51 00000100:00100000:2.0:1715330366.534195:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013458b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+8:2012:x1798653938123456:12345-192.168.204.49@tcp:4:dd.0 00000100:00080000:0.0:1715330366.534334:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330336 00000100:00100000:0.0:1715330366.587362:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013458b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+10:2012:x1798653938123456:12345-192.168.204.49@tcp:4:dd.0 Request processed in 53155us (55707us total) trans 4294969985 rc 0/0 00000100:00100000:0.0:1715330366.587375:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 51 00002000:00100000:0.0:1715330366.587388:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (4194304->8388607) req@ffff88013458b800 x1798653938123456/t4294969985(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:577/0 lens 488/448 e 0 to 0 dl 1715330377 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330366.587398:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88013458b800 with x1798653938123456 ext(4194304->8388607) 00002000:00010000:0.0:1715330366.587405:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013458b800 00000100:00100000:0.0:1715330366.676219:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b31bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3691:1798653942529152:0@lo:400:kworker.0 00000100:00100000:3.0:1715330366.676286:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b319c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942529216:0@lo:400:kworker.0 00000100:00100000:3.0:1715330366.676319:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330366.676320:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330366.676347:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3688:1798653942529472:0@lo:400:kworker.0 00000100:00100000:3.0:1715330366.676383:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942529216 00000100:00100000:3.0:1715330366.676392:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942529216 00000100:00100000:3.0:1715330366.676438:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3086 00000100:00100000:3.0:1715330366.676444:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942529216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330366.676487:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942529216:12345-0@lo:400:kworker.0 Request processed in 42us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330366.676494:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3086 00000100:00100000:2.0:1715330366.676577:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b318000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3689:1798653942529280:0@lo:400:kworker.0 00000100:00100000:1.0:1715330366.676657:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b318a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3690:1798653942529088:0@lo:400:kworker.0 00000100:00100000:1.0:1715330366.676691:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330366.676713:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942529344:0@lo:400:kworker.0 00000100:00100000:1.0:1715330366.676726:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330366.676747:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942529600:0@lo:400:kworker.0 00000100:00100000:1.0:1715330366.676764:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330366.676773:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942529856:0@lo:400:kworker.0 00000100:00100000:1.0:1715330366.676786:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330366.676801:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1715330366.676805:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3690:1798653942529408:0@lo:400:kworker.0 00000100:00100000:1.0:1715330366.676827:0:12304:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942529600 00000100:00100000:1.0:1715330366.676830:0:12304:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942529600 00000100:00100000:1.0:1715330366.676850:0:12304:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942529856 00000100:00100000:1.0:1715330366.676852:0:12304:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942529856 00000100:00100000:1.0:1715330366.676870:0:12304:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1715330366.676874:0:12304:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942529600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330366.676900:0:12304:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942529600:12345-0@lo:400:kworker.0 Request processed in 26us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330366.676905:0:12304:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1715330366.676917:0:12304:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1715330366.676920:0:12304:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f578000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942529856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330366.676938:0:12304:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f578000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942529856:12345-0@lo:400:kworker.0 Request processed in 17us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330366.676942:0:12304:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00080000:1.0:1715330366.676951:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330336 00000100:00100000:2.0:1715330366.676999:0:7130:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942529088 00000100:00100000:2.0:1715330366.677002:0:7130:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942529088 00000100:00100000:0.0:1715330366.677003:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330366.677040:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1715330366.677045:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4af0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3690:x1798653942529088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330366.677073:0:7130:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4af0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3690:x1798653942529088:12345-0@lo:400:kworker.0 Request processed in 28us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330366.677078:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1715330366.677150:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942529344 00000100:00100000:3.0:1715330366.677153:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942529344 00000100:00100000:3.0:1715330366.677176:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3087 00000100:00100000:3.0:1715330366.677180:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942529344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330366.677201:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942529344:12345-0@lo:400:kworker.0 Request processed in 21us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330366.677205:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3087 00000100:00100000:1.0:1715330366.677302:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942529152 00000100:00100000:1.0:1715330366.677305:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942529152 00000100:00100000:0.0:1715330366.677320:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3688:1798653942529728:0@lo:400:kworker.0 00000100:00100000:1.0:1715330366.677324:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1715330366.677329:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3691:x1798653942529152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330366.677342:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330366.677356:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3691:x1798653942529152:12345-0@lo:400:kworker.0 Request processed in 27us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330366.677361:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1715330366.677367:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942529472 00000100:00100000:1.0:1715330366.677369:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942529472 00000100:00100000:1.0:1715330366.677379:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942529728 00000100:00100000:0.0:1715330366.677379:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b319c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942529216:0@lo:400:kworker.0 00000100:00100000:1.0:1715330366.677381:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942529728 00000100:00100000:1.0:1715330366.677389:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1715330366.677392:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3688:x1798653942529472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330366.677406:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1715330366.677408:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3688:x1798653942529472:12345-0@lo:400:kworker.0 Request processed in 15us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330366.677410:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3688:x1798653942529728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330366.677413:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00080000:1.0:1715330366.677426:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330336 00000100:00080000:1.0:1715330366.677428:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330336 00000100:00100000:1.0:1715330366.677435:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330366.677437:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3688:x1798653942529728:12345-0@lo:400:kworker.0 Request processed in 26us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330366.677442:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3690:1798653942529664:0@lo:400:kworker.0 00000100:00100000:0.0:1715330366.677443:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1715330366.677455:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330366.677455:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942529408 00000100:00100000:0.0:1715330366.677457:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942529408 00000100:00100000:1.0:1715330366.677470:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b318a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3690:1798653942529088:0@lo:400:kworker.0 00000100:00100000:0.0:1715330366.677475:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942529664 00000100:00100000:1.0:1715330366.677477:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942529344:0@lo:400:kworker.0 00000100:00100000:0.0:1715330366.677477:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942529664 00000100:00100000:1.0:1715330366.677483:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942529600:0@lo:400:kworker.0 00000100:00100000:0.0:1715330366.677488:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1715330366.677489:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942529856:0@lo:400:kworker.0 00000100:00100000:0.0:1715330366.677491:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091eef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3690:x1798653942529408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330366.677508:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1715330366.677512:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091eef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3690:x1798653942529664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330366.677517:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091eef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3690:x1798653942529408:12345-0@lo:400:kworker.0 Request processed in 25us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330366.677522:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1715330366.677534:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091eef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3690:x1798653942529664:12345-0@lo:400:kworker.0 Request processed in 21us (77us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330366.677539:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1715330366.677543:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3688:1798653942529472:0@lo:400:kworker.0 00000100:00100000:0.0:1715330366.677552:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3688:1798653942529728:0@lo:400:kworker.0 00000100:00080000:1.0:1715330366.677553:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330336 00000100:00100000:1.0:1715330366.677566:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3690:1798653942529408:0@lo:400:kworker.0 00000100:00100000:0.0:1715330366.677570:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b31bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3691:1798653942529152:0@lo:400:kworker.0 00000100:00100000:1.0:1715330366.677573:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3690:1798653942529664:0@lo:400:kworker.0 00000100:00100000:2.0:1715330366.677629:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330366.677706:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942529536:0@lo:400:kworker.0 00000100:00100000:2.0:1715330366.677724:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330366.677751:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942529792:0@lo:400:kworker.0 00000100:00100000:2.0:1715330366.677766:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330366.677785:0:17215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942529536 00000100:00100000:2.0:1715330366.677788:0:17215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942529536 00000100:00100000:3.0:1715330366.677879:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942529280 00000100:00100000:3.0:1715330366.677882:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942529280 00000100:00100000:2.0:1715330366.678124:0:17215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942529792 00000100:00100000:2.0:1715330366.678127:0:17215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942529792 00000100:00100000:1.0:1715330366.678161:0:17198:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1715330366.678165:0:17198:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942529536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330366.678190:0:17198:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942529536:12345-0@lo:400:kworker.0 Request processed in 24us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330366.678195:0:17198:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1715330366.678218:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942529536:0@lo:400:kworker.0 00000100:00100000:3.0:1715330366.678348:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1715330366.678353:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3689:x1798653942529280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330366.678381:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3689:x1798653942529280:12345-0@lo:400:kworker.0 Request processed in 28us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330366.678387:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1715330366.678429:0:17215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1715330366.678434:0:17215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942529792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330366.678459:0:17215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942529792:12345-0@lo:400:kworker.0 Request processed in 25us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330366.678464:0:17215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00080000:0.0:1715330366.678500:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330336 00000100:00100000:1.0:1715330366.678542:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b318000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3689:1798653942529280:0@lo:400:kworker.0 00000100:00100000:1.0:1715330366.678550:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942529792:0@lo:400:kworker.0 00000100:00100000:0.0:1715330366.710438:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942529920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1715330366.710520:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330366.710588:0:9401:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942529920 00000100:00100000:0.0:1715330366.710598:0:9401:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942529920 00000100:00100000:0.0:1715330366.710638:0:9401:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1715330366.710647:0:9401:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942529920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1715330366.710683:0:9401:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 270336 granted 197793472 pending 8437760 free 3923546112 avail 3692023808 00000100:00100000:0.0:1715330366.710744:0:9401:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942529920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330366.710752:0:9401:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1715330366.710795:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942529920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1715330366.710907:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1715330366.710917:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942529984:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1715330366.710950:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330366.711053:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942529984 00000100:00100000:0.0:1715330366.711056:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942529984 00000100:00100000:0.0:1715330366.711070:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1715330366.711074:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942529984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1715330366.711083:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 270336 granted 197793472 pending 8437760 free 3923546112 avail 3692023808 00000100:00100000:0.0:1715330366.711127:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942529984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330366.711132:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1715330366.711184:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942529984:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1715330367.099850:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330367.100539:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938123584 00000100:00100000:2.0:1715330367.100549:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938123584 00002000:00100000:2.0:1715330367.100598:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (8388608->12582911) req@ffff88009ff78e00 x1798653938123584/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:578/0 lens 488/0 e 0 to 0 dl 1715330378 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330367.100609:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff78e00 with x1798653938123584 ext(8388608->12582911) 00002000:00010000:2.0:1715330367.100614:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff78e00 00000100:00100000:2.0:1715330367.100645:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 52 00000100:00100000:2.0:1715330367.100651:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+10:2012:x1798653938123584:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330367.145254:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+12:2012:x1798653938123584:12345-192.168.204.49@tcp:4:dd.0 Request processed in 44592us (45404us total) trans 4294969986 rc 0/0 00000100:00100000:2.0:1715330367.145270:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 52 00002000:00100000:2.0:1715330367.145282:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (8388608->12582911) req@ffff88009ff78e00 x1798653938123584/t4294969986(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:578/0 lens 488/448 e 0 to 0 dl 1715330378 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330367.145291:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff78e00 with x1798653938123584 ext(8388608->12582911) 00002000:00010000:2.0:1715330367.145297:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff78e00 00010000:00010000:3.0:1715330367.377969:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330367.654219:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330367.654302:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938123712 00000100:00100000:2.0:1715330367.654313:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938123712 00002000:00100000:2.0:1715330367.654353:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (12582912->16777215) req@ffff88009ff79180 x1798653938123712/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:578/0 lens 488/0 e 0 to 0 dl 1715330378 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330367.654364:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff79180 with x1798653938123712 ext(12582912->16777215) 00002000:00010000:2.0:1715330367.654371:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff79180 00000100:00100000:2.0:1715330367.654402:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 53 00000100:00100000:2.0:1715330367.654408:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+12:2013:x1798653938123712:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330367.698852:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+14:2013:x1798653938123712:12345-192.168.204.49@tcp:4:dd.0 Request processed in 44429us (44628us total) trans 4294969987 rc 0/0 00000100:00100000:2.0:1715330367.698866:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 53 00002000:00100000:2.0:1715330367.698880:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (12582912->16777215) req@ffff88009ff79180 x1798653938123712/t4294969987(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:578/0 lens 488/448 e 0 to 0 dl 1715330378 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330367.698890:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff79180 with x1798653938123712 ext(12582912->16777215) 00002000:00010000:2.0:1715330367.698896:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff79180 00000100:00100000:2.0:1715330368.115805:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1715330368.115837:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942530048:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1715330368.115920:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330368.116126:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942530048 00000100:00100000:0.0:1715330368.116136:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942530048 00000100:00100000:0.0:1715330368.117398:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3088 00000100:00100000:0.0:1715330368.117406:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942530048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1715330368.117455:0:8592:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444089856 avail 1314627584 00000100:00100000:0.0:1715330368.117531:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942530048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (1611us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330368.117538:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3088 00000100:00100000:2.0:1715330368.117683:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ff79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942530048:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1715330368.207443:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330368.207491:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330368.207529:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330368.207568:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330368.207621:0:7129:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938123776 00000100:00100000:0.0:1715330368.207630:0:7129:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938123776 00000100:00100000:0.0:1715330368.207696:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 361 00000100:00100000:0.0:1715330368.207703:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4af3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2014:x1798653938123776:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:0.0:1715330368.207788:0:7129:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4af3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2014:x1798653938123776:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 84us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330368.207794:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 361 00000100:00100000:0.0:1715330368.209464:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938123840 00000100:00100000:0.0:1715330368.209472:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938123840 00000100:00100000:0.0:1715330368.209515:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938123904 00000100:00100000:0.0:1715330368.209517:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938123904 00000100:00100000:0.0:1715330368.209539:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 367 00000100:00100000:0.0:1715330368.209545:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+20:2014:x1798653938123840:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:0.0:1715330368.209713:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+20:2014:x1798653938123840:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 167us (2284us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330368.209719:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 367 00000100:00100000:0.0:1715330368.209745:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 368 00000100:00100000:0.0:1715330368.209748:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938123904:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:0.0:1715330368.209766:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938123904:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 17us (2198us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330368.209770:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 368 00000100:00100000:3.0:1715330368.212498:0:17197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938123968 00000100:00100000:3.0:1715330368.212511:0:17197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938123968 00000100:00100000:3.0:1715330368.212577:0:17197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 262 00000100:00100000:3.0:1715330368.212584:0:17197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938123968:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:3.0:1715330368.212665:0:17197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938123968:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 80us (5173us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330368.212672:0:17197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 262 00000100:00080000:1.0:1715330368.213206:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330338 00000100:00080000:1.0:1715330368.213211:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330338 00000100:00080000:1.0:1715330368.213213:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330338 00000100:00080000:1.0:1715330368.213215:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330338 00000100:00100000:0.0:1715330368.273937:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330368.277168:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938124096 00000100:00100000:2.0:1715330368.277179:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938124096 00002000:00100000:2.0:1715330368.277247:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (16777216->20971519) req@ffff88009ff7a300 x1798653938124096/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:579/0 lens 488/0 e 0 to 0 dl 1715330379 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330368.277264:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff7a300 with x1798653938124096 ext(16777216->20971519) 00002000:00010000:2.0:1715330368.277271:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff7a300 00000100:00100000:2.0:1715330368.277317:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 54 00000100:00100000:2.0:1715330368.277327:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+14:2014:x1798653938124096:12345-192.168.204.49@tcp:4:dd.0 00000100:00080000:1.0:1715330368.277464:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330338 00000100:00100000:2.0:1715330368.339845:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+16:2014:x1798653938124096:12345-192.168.204.49@tcp:4:dd.0 Request processed in 62505us (65901us total) trans 4294969988 rc 0/0 00000100:00100000:2.0:1715330368.339865:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 54 00002000:00100000:2.0:1715330368.339882:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (16777216->20971519) req@ffff88009ff7a300 x1798653938124096/t4294969988(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:579/0 lens 488/448 e 0 to 0 dl 1715330379 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330368.339893:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff7a300 with x1798653938124096 ext(16777216->20971519) 00002000:00010000:2.0:1715330368.339899:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff7a300 00010000:00010000:1.0:1715330368.379967:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330369.158467:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330369.158575:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938124288 00000100:00100000:2.0:1715330369.158583:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938124288 00002000:00100000:2.0:1715330369.158619:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (20971520->25165823) req@ffff88009ff7a680 x1798653938124288/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:580/0 lens 488/0 e 0 to 0 dl 1715330380 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330369.158629:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff7a680 with x1798653938124288 ext(20971520->25165823) 00002000:00010000:2.0:1715330369.158633:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff7a680 00000100:00100000:2.0:1715330369.158977:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 55 00000100:00100000:2.0:1715330369.158985:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+16:2013:x1798653938124288:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330369.200651:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+18:2013:x1798653938124288:12345-192.168.204.49@tcp:4:dd.0 Request processed in 41654us (42179us total) trans 4294969989 rc 0/0 00000100:00100000:0.0:1715330369.200665:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 55 00002000:00100000:0.0:1715330369.200677:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (20971520->25165823) req@ffff88009ff7a680 x1798653938124288/t4294969989(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:580/0 lens 488/448 e 0 to 0 dl 1715330380 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330369.200686:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff7a680 with x1798653938124288 ext(20971520->25165823) 00002000:00010000:0.0:1715330369.200692:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff7a680 00010000:00010000:2.0:1715330369.381719:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330369.572167:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1715330369.572195:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942530112:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1715330369.572276:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330369.572716:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942530112 00000100:00100000:2.0:1715330369.572742:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942530112 00000100:00100000:2.0:1715330369.572823:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3089 00000100:00100000:2.0:1715330369.572833:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942530112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1715330369.572888:0:8592:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445060608 avail 1315598336 00000100:00100000:2.0:1715330369.572977:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942530112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 145us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330369.572985:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3089 00000100:00100000:0.0:1715330369.573569:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942530112:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1715330369.777390:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330369.777561:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938124416 00000100:00100000:2.0:1715330369.777577:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938124416 00002000:00100000:2.0:1715330369.777629:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (25165824->29360127) req@ffff88009ff7ad80 x1798653938124416/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:580/0 lens 488/0 e 0 to 0 dl 1715330380 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330369.777639:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff7ad80 with x1798653938124416 ext(25165824->29360127) 00002000:00010000:2.0:1715330369.777645:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff7ad80 00000100:00100000:2.0:1715330369.778541:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 56 00000100:00100000:2.0:1715330369.778551:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+18:2011:x1798653938124416:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330369.873056:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+20:2011:x1798653938124416:12345-192.168.204.49@tcp:4:dd.0 Request processed in 94477us (95652us total) trans 4294969990 rc 0/0 00000100:00100000:2.0:1715330369.873082:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 56 00002000:00100000:2.0:1715330369.873109:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (25165824->29360127) req@ffff88009ff7ad80 x1798653938124416/t4294969990(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:580/0 lens 488/448 e 0 to 0 dl 1715330380 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330369.873121:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff7ad80 with x1798653938124416 ext(25165824->29360127) 00002000:00010000:2.0:1715330369.873129:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff7ad80 00000100:00100000:0.0:1715330369.904081:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330369.904206:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938124544 00000100:00100000:3.0:1715330369.904216:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938124544 00000100:00100000:3.0:1715330369.904994:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5215 00000100:00100000:3.0:1715330369.905003:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+20:20940:x1798653938124544:12345-192.168.204.49@tcp:35:dd.0 00000001:00080000:3.0:1715330369.905243:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294984094 00000100:00100000:3.0:1715330369.905352:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+22:20940:x1798653938124544:12345-192.168.204.49@tcp:35:dd.0 Request processed in 350us (1315us total) trans 4294984095 rc 0/0 00000100:00100000:3.0:1715330369.905358:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5215 00000020:00080000:3.0:1715330369.905363:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:2.0:1715330369.908325:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984095 is committed 00010000:00010000:0.0:1715330369.908586:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81d40/0xd895711d66dbca9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330369.908603:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81d40/0xd895711d66dbca9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330369.908610:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81d40/0xd895711d66dbca9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330369.908616:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da81d40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330369.908622:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81d40/0xd895711d66dbca9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330369.908628:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81d40/0xd895711d66dbca9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330369.908647:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff88008b0d2c00) 00010000:00010000:0.0:1715330369.908649:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330369.908653:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81d40/0xd895711d66dbca9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330369.908658:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81d40/0xd895711d66dbca9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330370.382935:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330370.437179:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1715330370.437208:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942530176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1715330370.437288:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330370.437386:0:9401:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942530176 00000100:00100000:2.0:1715330370.437394:0:9401:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942530176 00000100:00080000:1.0:1715330370.438689:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330340 00000100:00100000:2.0:1715330370.438760:0:9401:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1715330370.438771:0:9401:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942530176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1715330370.438820:0:9401:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1715330370.439001:0:9401:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942530176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 230us (1714us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330370.439008:0:9401:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1715330370.439107:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942530176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1715330370.450949:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942530240:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1715330370.451004:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330370.451041:0:9401:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942530240 00000100:00100000:3.0:1715330370.451048:0:9401:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942530240 00000100:00100000:3.0:1715330370.452408:0:9401:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1715330370.452415:0:9401:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942530240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1715330370.452438:0:9401:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1715330370.452506:0:9401:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942530240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (1502us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330370.452513:0:9401:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00080000:1.0:1715330370.452606:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330340 00000100:00100000:2.0:1715330370.452664:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942530240:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1715330370.939518:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330370.939619:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938124608 00000100:00100000:2.0:1715330370.939629:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938124608 00000100:00100000:2.0:1715330370.948876:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23829 00000100:00100000:2.0:1715330370.948889:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+16:20948:x1798653938124608:12345-192.168.204.49@tcp:101:dd.0 00010000:00010000:2.0:1715330370.948924:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330370.948946:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6640/0xd895711d66dbcb0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbed5 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330370.949004:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4b40/0xd895711d66dbcb7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00000100:00080000:1.0:1715330370.949094:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330340 00010000:00010000:2.0:1715330370.949233:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4b40/0xd895711d66dbcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330370.949249:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4b40/0xd895711d66dbcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00000004:00200000:2.0:1715330370.949293:0:25569:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 270336 00000004:00200000:2.0:1715330370.949296:0:25569:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1715330370.949313:0:25569:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4b40/0xd895711d66dbcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330370.949335:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6640/0xd895711d66dbcb0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbed5 expref: 18 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330370.949367:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4b40/0xd895711d66dbcb7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbed5 expref: 17 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330370.949377:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:2.0:1715330370.949380:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1715330370.949383:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938b4b40, rc 0) 00000100:00100000:2.0:1715330370.949524:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+17:20948:x1798653938124608:12345-192.168.204.49@tcp:101:dd.0 Request processed in 637us (10013us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330370.949531:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23829 00000100:00100000:0.0:1715330370.961145:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330370.961323:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938124736 00000100:00100000:2.0:1715330370.961334:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938124736 00000100:00100000:2.0:1715330370.961400:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23830 00000100:00100000:2.0:1715330370.961411:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+17:20948:x1798653938124736:12345-192.168.204.49@tcp:101:dd.0 00010000:00010000:2.0:1715330370.961443:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330370.961449:0:25569:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1715330370.961481:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4b40/0xd895711d66dbcb7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbed5 expref: 17 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330370.961518:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:2.0:1715330370.961523:0:25569:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330370.961537:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4240/0xd895711d66dbcbe lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbedc expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330370.961655:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6400/0xd895711d66dbcc5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330370.961667:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6400/0xd895711d66dbcc5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330370.961675:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6400/0xd895711d66dbcc5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330370.961685:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7180/0xd895711d66dbccc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330370.961690:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7180/0xd895711d66dbccc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330370.961695:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7180/0xd895711d66dbccc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330370.961762:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b61c0/0xd895711d66dbcd3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330370.961769:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b61c0/0xd895711d66dbcd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330370.961775:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b61c0/0xd895711d66dbcd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00000004:00200000:2.0:1715330370.961783:0:25569:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1591:0x0]: returning size 30277632 00010000:00010000:2.0:1715330370.961872:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6400/0xd895711d66dbcc5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330370.961878:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6400/0xd895711d66dbcc5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330370.961883:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6400/0xd895711d66dbcc5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330370.961888:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6400/0xd895711d66dbcc5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330370.961893:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b6400 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330370.961897:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6400/0xd895711d66dbcc5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330370.961903:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6400/0xd895711d66dbcc5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330370.961910:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:2.0:1715330370.961913:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330370.961916:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6400/0xd895711d66dbcc5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330370.961920:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6400/0xd895711d66dbcc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330370.961927:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7180/0xd895711d66dbccc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330370.961932:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7180/0xd895711d66dbccc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330370.961936:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7180/0xd895711d66dbccc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330370.961940:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b7180 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330370.961948:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7180/0xd895711d66dbccc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330370.961953:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7180/0xd895711d66dbccc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330370.961959:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x333666 (ffff88009b985900) 00010000:00010000:2.0:1715330370.961961:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330370.961963:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7180/0xd895711d66dbccc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330370.961968:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7180/0xd895711d66dbccc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330370.962000:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4240/0xd895711d66dbcbe lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbedc expref: 19 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330370.962011:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b61c0/0xd895711d66dbcd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbedc expref: 18 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330370.962027:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff88008b0d2c00) 00010000:00010000:2.0:1715330370.962029:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330370.962031:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938b61c0, rc 0) 00000100:00100000:2.0:1715330370.962080:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+18:20948:x1798653938124736:12345-192.168.204.49@tcp:101:dd.0 Request processed in 670us (949us total) trans 4294984096 rc 0/0 00000100:00100000:2.0:1715330370.962087:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23830 00000100:00100000:0.0:1715330370.965286:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330370.968642:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938124864 00000100:00100000:2.0:1715330370.968655:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938124864 00000100:00100000:2.0:1715330370.968721:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23831 00000100:00100000:2.0:1715330370.968740:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+18:20948:x1798653938124864:12345-192.168.204.49@tcp:36:dd.0 00010000:00010000:2.0:1715330370.971140:0:7135:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330370.971173:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b61c0/0xd895711d66dbcd3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbedc expref: 18 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330370.971188:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff88008b0d2c00) 00010000:00010000:2.0:1715330370.971191:0:7135:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330370.971428:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5f80/0xd895711d66dbce1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330370.971440:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5f80/0xd895711d66dbce1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330370.971447:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5f80/0xd895711d66dbce1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000001:00080000:2.0:1715330370.971475:0:7135:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294984097 00000004:00010000:2.0:1715330370.971487:0:7135:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009ff7b800 reply state ffff880093aac000 transno 4294984098 ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5f80/0xd895711d66dbce1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330370.971494:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5f80/0xd895711d66dbce1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330370.971499:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff88008b0d2c00) 00010000:00010000:2.0:1715330370.971507:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330370.971509:0:7135:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1715330370.971970:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+20:20948:x1798653938124864:12345-192.168.204.49@tcp:36:dd.0 Request processed in 3240us (6692us total) trans 4294984098 rc 0/0 00000100:00100000:2.0:1715330370.971978:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23831 00000020:00080000:2.0:1715330370.971983:0:7135:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330371.015444:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330371.015575:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938124928 00000100:00100000:2.0:1715330371.015590:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938124928 00002000:00010000:2.0:1715330371.015840:0:27574:0:(ofd_dev.c:2731:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/2560 (0->18446744073709551615) 00002000:00100000:2.0:1715330371.015846:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff7bb80 with x1798653938124928 ext(0->18446744073709551615) 00002000:00010000:2.0:1715330371.015860:0:27574:0:(ofd_dev.c:2736:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff7bb80. 00000100:00080000:1.0:1715330371.015930:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330341 00000100:00100000:2.0:1715330371.016006:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 57 00000100:00100000:2.0:1715330371.016024:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+20:2011:x1798653938124928:12345-192.168.204.49@tcp:10:dd.0 00002000:00010000:2.0:1715330371.038698:0:27574:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1715330371.038706:0:27574:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb mtime from disk: 1715330365 -> 1715330371 00002000:00010000:2.0:1715330371.038709:0:27574:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1715330371.038710:0:27574:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb ctime from disk: 1715330365 -> 1715330371 00002000:00010000:2.0:1715330371.038712:0:27574:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1715330371.038826:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+21:2011:x1798653938124928:12345-192.168.204.49@tcp:10:dd.0 Request processed in 22805us (23387us total) trans 4294969991 rc 0/0 00000100:00100000:2.0:1715330371.038838:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 57 00002000:00010000:2.0:1715330371.038844:0:27574:0:(ofd_dev.c:2731:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/2560 (0->18446744073709551615) 00002000:00100000:2.0:1715330371.038847:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff7bb80 with x1798653938124928 ext(0->18446744073709551615) 00002000:00010000:2.0:1715330371.038855:0:27574:0:(ofd_dev.c:2736:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff7bb80. 00000001:00080000:0.0:1715330371.041539:0:10666:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4294969991 is committed 00010000:00010000:3.0:1715330371.386867:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330371.684131:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3690:1798653942530368:0@lo:400:kworker.0 00000100:00100000:3.0:1715330371.684206:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330371.684229:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3690:1798653942530624:0@lo:400:kworker.0 00000100:00100000:3.0:1715330371.684245:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330371.684255:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3690:1798653942530880:0@lo:400:kworker.0 00000100:00100000:3.0:1715330371.684268:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330371.684285:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1715330371.684290:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942530432:0@lo:400:kworker.0 00000100:00100000:3.0:1715330371.684308:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330371.684309:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942530368 00000100:00100000:3.0:1715330371.684317:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3690:1798653942530688:0@lo:400:kworker.0 00000100:00100000:1.0:1715330371.684317:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942530368 00000100:00100000:3.0:1715330371.684330:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330371.684338:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3690:1798653942530944:0@lo:400:kworker.0 00000100:00100000:1.0:1715330371.684347:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942530624 00000100:00100000:3.0:1715330371.684349:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330371.684349:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942530624 00000100:00100000:1.0:1715330371.684360:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942530880 00000100:00100000:1.0:1715330371.684362:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942530880 00000100:00100000:3.0:1715330371.684366:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942530432 00000100:00100000:1.0:1715330371.684368:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942530688 00000100:00100000:3.0:1715330371.684369:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942530432 00000100:00100000:1.0:1715330371.684370:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942530688 00000100:00100000:1.0:1715330371.684378:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942530944 00000100:00100000:1.0:1715330371.684379:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942530944 00000100:00100000:1.0:1715330371.684389:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1715330371.684393:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3090 00000100:00100000:1.0:1715330371.684394:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3690:x1798653942530368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330371.684397:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942530432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330371.684433:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942530432:12345-0@lo:400:kworker.0 Request processed in 35us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330371.684437:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3690:x1798653942530368:12345-0@lo:400:kworker.0 Request processed in 43us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330371.684438:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3090 00000100:00100000:1.0:1715330371.684443:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1715330371.684454:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1715330371.684457:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3690:x1798653942530624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330371.684467:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942530432:0@lo:400:kworker.0 00000100:00100000:1.0:1715330371.684474:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3690:x1798653942530624:12345-0@lo:400:kworker.0 Request processed in 16us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330371.684477:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3690:1798653942530368:0@lo:400:kworker.0 00000100:00100000:1.0:1715330371.684478:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1715330371.684483:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3690:1798653942530624:0@lo:400:kworker.0 00000100:00100000:1.0:1715330371.684484:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1715330371.684487:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3690:x1798653942530880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330371.684503:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1715330371.684505:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3690:x1798653942530880:12345-0@lo:400:kworker.0 Request processed in 17us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330371.684506:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3690:x1798653942530688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330371.684509:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1715330371.684516:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1715330371.684518:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3690:x1798653942530944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330371.684525:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3690:x1798653942530688:12345-0@lo:400:kworker.0 Request processed in 19us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330371.684530:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1715330371.684537:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3690:x1798653942530944:12345-0@lo:400:kworker.0 Request processed in 18us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330371.684542:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1715330371.684547:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3690:1798653942530688:0@lo:400:kworker.0 00000100:00100000:3.0:1715330371.684554:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3690:1798653942530944:0@lo:400:kworker.0 00000100:00080000:1.0:1715330371.684558:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330341 00000100:00100000:3.0:1715330371.684560:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3690:1798653942530880:0@lo:400:kworker.0 00000100:00080000:1.0:1715330371.684561:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330341 00000100:00100000:0.0:1715330371.684642:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3689:1798653942530304:0@lo:400:kworker.0 00000100:00100000:0.0:1715330371.684670:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330371.684681:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942530560:0@lo:400:kworker.0 00000100:00100000:0.0:1715330371.684694:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330371.684713:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942530816:0@lo:400:kworker.0 00000100:00100000:0.0:1715330371.684755:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330371.684766:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942531072:0@lo:400:kworker.0 00000100:00100000:0.0:1715330371.684780:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330371.684788:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3688:1798653942530496:0@lo:400:kworker.0 00000100:00100000:0.0:1715330371.684807:0:17215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942530816 00000100:00100000:0.0:1715330371.684810:0:17215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942530816 00000100:00100000:2.0:1715330371.684829:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330371.684830:0:17215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1715330371.684834:0:17215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b318000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942530816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330371.684843:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942530752:0@lo:400:kworker.0 00000100:00100000:0.0:1715330371.684860:0:17215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b318000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942530816:12345-0@lo:400:kworker.0 Request processed in 24us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330371.684861:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330371.684865:0:17215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1715330371.684874:0:17215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942531072 00000100:00100000:0.0:1715330371.684876:0:17215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942531072 00000100:00100000:2.0:1715330371.684877:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942531008:0@lo:400:kworker.0 00000100:00100000:0.0:1715330371.684890:0:17215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942530752 00000100:00100000:0.0:1715330371.684893:0:17215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942530752 00000100:00100000:2.0:1715330371.684896:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330371.684946:0:17215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942531008 00000100:00100000:0.0:1715330371.684949:0:17215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942531008 00000100:00100000:2.0:1715330371.684957:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1715330371.684964:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b31bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942531072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330371.684968:0:17215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1715330371.684972:0:17215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942530752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330371.685015:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b31bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942531072:12345-0@lo:400:kworker.0 Request processed in 51us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330371.685018:0:17215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942530752:12345-0@lo:400:kworker.0 Request processed in 45us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330371.685023:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1715330371.685055:0:7130:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942530304 00000100:00100000:1.0:1715330371.685058:0:7130:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942530304 00000100:00100000:0.0:1715330371.685074:0:17215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1715330371.685083:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1715330371.685085:0:17215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1715330371.685087:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4af2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3689:x1798653942530304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330371.685088:0:17215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942531008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330371.685115:0:7130:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4af2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3689:x1798653942530304:12345-0@lo:400:kworker.0 Request processed in 27us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330371.685115:0:17215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942531008:12345-0@lo:400:kworker.0 Request processed in 27us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330371.685120:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1715330371.685120:0:17215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:0.0:1715330371.685132:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330341 00000100:00080000:0.0:1715330371.685135:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330341 00000100:00100000:0.0:1715330371.685146:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3689:1798653942530304:0@lo:400:kworker.0 00000100:00100000:0.0:1715330371.685153:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942530816:0@lo:400:kworker.0 00000100:00100000:0.0:1715330371.685160:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942531072:0@lo:400:kworker.0 00000100:00100000:1.0:1715330371.685161:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942530560 00000100:00100000:1.0:1715330371.685164:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942530560 00000100:00100000:1.0:1715330371.685177:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3091 00000100:00100000:1.0:1715330371.685180:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942530560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330371.685201:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942530560:12345-0@lo:400:kworker.0 Request processed in 20us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330371.685205:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3091 00000100:00100000:0.0:1715330371.685231:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942530560:0@lo:400:kworker.0 00000100:00100000:2.0:1715330371.685240:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942530496 00000100:00100000:2.0:1715330371.685244:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942530496 00000100:00100000:2.0:1715330371.685288:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1715330371.685294:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3688:x1798653942530496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330371.685332:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3688:x1798653942530496:12345-0@lo:400:kworker.0 Request processed in 37us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330371.685339:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1715330371.685368:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3688:1798653942530496:0@lo:400:kworker.0 00000100:00100000:2.0:1715330371.685377:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942530752:0@lo:400:kworker.0 00000100:00100000:2.0:1715330371.685384:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942531008:0@lo:400:kworker.0 00000100:00100000:1.0:1715330371.714985:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1715330371.715015:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942531136:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1715330371.715070:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330371.715090:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942531136 00000100:00100000:0.0:1715330371.715097:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942531136 00000100:00100000:0.0:1715330371.715143:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1715330371.715153:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a639b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942531136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1715330371.715237:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 262144 granted 210450112 pending 0 free 3923546112 avail 3692023808 00000100:00100000:0.0:1715330371.715701:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a639b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942531136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 548us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330371.715707:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1715330371.715905:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1715330371.715914:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942531200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1715330371.715933:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330371.716099:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942531200 00000100:00100000:2.0:1715330371.716103:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942531200 00000100:00100000:1.0:1715330371.716199:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942531136:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1715330371.716313:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1715330371.716318:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b31aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942531200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1715330371.716331:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 262144 granted 210450112 pending 0 free 3923546112 avail 3692023808 00000100:00100000:2.0:1715330371.716358:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b31aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942531200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330371.716363:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1715330371.716454:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942531200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1715330371.955123:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330371.955355:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938125056 00000100:00100000:2.0:1715330371.955364:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938125056 00002000:00100000:2.0:1715330371.955399:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (0->4194303) req@ffff88008b31b100 x1798653938125056/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:582/0 lens 488/0 e 0 to 0 dl 1715330382 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330371.955408:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b31b100 with x1798653938125056 ext(0->4194303) 00002000:00010000:2.0:1715330371.955413:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b31b100 00000100:00100000:2.0:1715330371.955430:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 58 00000100:00100000:2.0:1715330371.955435:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b31b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938125056:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330372.021624:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b31b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+8:2014:x1798653938125056:12345-192.168.204.49@tcp:4:dd.0 Request processed in 66176us (66496us total) trans 4294969992 rc 0/0 00000100:00100000:0.0:1715330372.021637:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 58 00002000:00100000:0.0:1715330372.021651:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (0->4194303) req@ffff88008b31b100 x1798653938125056/t4294969992(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:582/0 lens 488/448 e 0 to 0 dl 1715330382 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330372.021660:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b31b100 with x1798653938125056 ext(0->4194303) 00002000:00010000:0.0:1715330372.021666:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b31b100 00010000:00010000:1.0:1715330372.391659:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330372.525154:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330372.525826:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938125184 00000100:00100000:2.0:1715330372.525835:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938125184 00002000:00100000:2.0:1715330372.525881:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (4194304->8388607) req@ffff88008b318a80 x1798653938125184/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:583/0 lens 488/0 e 0 to 0 dl 1715330383 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330372.525897:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b318a80 with x1798653938125184 ext(4194304->8388607) 00002000:00010000:2.0:1715330372.525903:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b318a80 00000100:00100000:2.0:1715330372.528684:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 59 00000100:00100000:2.0:1715330372.528698:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b318a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+8:2012:x1798653938125184:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330372.577302:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b318a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+10:2012:x1798653938125184:12345-192.168.204.49@tcp:4:dd.0 Request processed in 48599us (52147us total) trans 4294969993 rc 0/0 00000100:00100000:2.0:1715330372.577315:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 59 00002000:00100000:2.0:1715330372.577325:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (4194304->8388607) req@ffff88008b318a80 x1798653938125184/t4294969993(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:583/0 lens 488/448 e 0 to 0 dl 1715330383 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330372.577333:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b318a80 with x1798653938125184 ext(4194304->8388607) 00002000:00010000:2.0:1715330372.577338:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b318a80 00000100:00100000:0.0:1715330373.041165:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330373.042859:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938125312 00000100:00100000:2.0:1715330373.042870:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938125312 00002000:00100000:2.0:1715330373.042936:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (8388608->12582911) req@ffff88008b319c00 x1798653938125312/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:584/0 lens 488/0 e 0 to 0 dl 1715330384 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330373.042945:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b319c00 with x1798653938125312 ext(8388608->12582911) 00002000:00010000:2.0:1715330373.042950:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b319c00 00000100:00100000:2.0:1715330373.042992:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 60 00000100:00100000:2.0:1715330373.042999:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b319c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+10:2014:x1798653938125312:12345-192.168.204.49@tcp:4:dd.0 00000100:00080000:0.0:1715330373.045806:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330343 00000100:00100000:0.0:1715330373.048464:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330373.049006:0:9403:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938125376 00000100:00100000:1.0:1715330373.049018:0:9403:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938125376 00002000:00100000:1.0:1715330373.049069:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa00:0x0] (12582912->12812287) req@ffff88012fa85880 x1798653938125376/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:584/0 lens 488/0 e 0 to 0 dl 1715330384 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330373.049079:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fa85880 with x1798653938125376 ext(12582912->12812287) 00002000:00010000:1.0:1715330373.049085:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fa85880 00000100:00100000:1.0:1715330373.050538:0:9403:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 61 00000100:00100000:1.0:1715330373.050549:0:9403:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+12:2014:x1798653938125376:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330373.099378:0:9403:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+14:2014:x1798653938125376:12345-192.168.204.49@tcp:4:dd.0 Request processed in 48822us (50918us total) trans 4294969994 rc 0/0 00000100:00100000:1.0:1715330373.099390:0:9403:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 61 00002000:00100000:1.0:1715330373.099401:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa00:0x0] (12582912->12812287) req@ffff88012fa85880 x1798653938125376/t4294969994(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:584/0 lens 488/448 e 0 to 0 dl 1715330384 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330373.099410:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fa85880 with x1798653938125376 ext(12582912->12812287) 00002000:00010000:1.0:1715330373.099416:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fa85880 00000100:00100000:2.0:1715330373.106257:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b319c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+14:2014:x1798653938125312:12345-192.168.204.49@tcp:4:dd.0 Request processed in 63245us (65093us total) trans 4294969995 rc 0/0 00000100:00100000:2.0:1715330373.106272:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 60 00002000:00100000:2.0:1715330373.106285:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (8388608->12582911) req@ffff88008b319c00 x1798653938125312/t4294969995(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:584/0 lens 488/448 e 0 to 0 dl 1715330384 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330373.106294:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b319c00 with x1798653938125312 ext(8388608->12582911) 00002000:00010000:2.0:1715330373.106300:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b319c00 00000100:00100000:0.0:1715330373.123668:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942531264:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1715330373.123724:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330373.123828:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942531264 00000100:00100000:3.0:1715330373.123834:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942531264 00000100:00100000:3.0:1715330373.123880:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3092 00000100:00100000:3.0:1715330373.123886:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942531264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1715330373.123914:0:19960:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444089856 avail 1314627584 00000100:00100000:3.0:1715330373.125766:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942531264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1874us (2036us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330373.125780:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3092 00000100:00100000:0.0:1715330373.125875:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942531264:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1715330373.215443:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330373.215491:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330373.215527:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330373.215584:0:7129:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938125504 00000100:00100000:1.0:1715330373.215594:0:7129:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938125504 00000100:00100000:1.0:1715330373.215642:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 363 00000100:00100000:1.0:1715330373.215649:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4af3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2014:x1798653938125504:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:1.0:1715330373.215711:0:7129:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4af3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2014:x1798653938125504:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 62us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330373.215717:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 363 00000100:00080000:1.0:1715330373.215846:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330343 00000100:00100000:0.0:1715330373.215921:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330373.215950:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938125632 00000100:00100000:2.0:1715330373.215954:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938125632 00000100:00100000:2.0:1715330373.216021:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938125568 00000100:00100000:2.0:1715330373.216024:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938125568 00000100:00100000:2.0:1715330373.216040:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 375 00000100:00100000:2.0:1715330373.216044:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938125632:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:2.0:1715330373.216077:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938125632:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 32us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330373.216082:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 375 00000100:00100000:2.0:1715330373.216092:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 376 00000100:00100000:2.0:1715330373.216096:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7ec1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+20:2013:x1798653938125568:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:2.0:1715330373.216325:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7ec1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+20:2013:x1798653938125568:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 227us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330373.216332:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 376 00000100:00080000:1.0:1715330373.216534:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330343 00000100:00080000:1.0:1715330373.216537:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330343 00000100:00100000:3.0:1715330373.216615:0:17197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938125696 00000100:00100000:3.0:1715330373.216618:0:17197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938125696 00000100:00100000:3.0:1715330373.216657:0:17197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 267 00000100:00100000:3.0:1715330373.216662:0:17197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938125696:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:3.0:1715330373.216689:0:17197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938125696:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 28us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330373.216696:0:17197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 267 00000100:00080000:1.0:1715330373.216745:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330343 00010000:00010000:2.0:1715330373.392932:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330374.326166:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330374.326548:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938125824 00000100:00100000:2.0:1715330374.326559:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938125824 00002000:00100000:2.0:1715330374.326600:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (16777216->20971519) req@ffff880091e99f80 x1798653938125824/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:585/0 lens 488/0 e 0 to 0 dl 1715330385 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330374.326610:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091e99f80 with x1798653938125824 ext(16777216->20971519) 00002000:00010000:2.0:1715330374.326615:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091e99f80 00000100:00100000:2.0:1715330374.326655:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 62 00000100:00100000:2.0:1715330374.326663:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+14:2011:x1798653938125824:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330374.371524:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+16:2011:x1798653938125824:12345-192.168.204.49@tcp:4:dd.0 Request processed in 44845us (45354us total) trans 4294969996 rc 0/0 00000100:00100000:2.0:1715330374.371540:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 62 00002000:00100000:2.0:1715330374.371557:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (16777216->20971519) req@ffff880091e99f80 x1798653938125824/t4294969996(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:585/0 lens 488/448 e 0 to 0 dl 1715330385 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330374.371567:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091e99f80 with x1798653938125824 ext(16777216->20971519) 00002000:00010000:2.0:1715330374.371575:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091e99f80 00010000:00010000:2.0:1715330374.395033:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330374.579301:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091e9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942531328:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1715330374.579374:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330374.579608:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942531328 00000100:00100000:3.0:1715330374.579620:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942531328 00000100:00100000:3.0:1715330374.579671:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3093 00000100:00100000:3.0:1715330374.579677:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942531328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1715330374.579709:0:19960:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445060608 avail 1315598336 00000100:00100000:3.0:1715330374.579827:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942531328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 149us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330374.579833:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3093 00000100:00100000:2.0:1715330374.579935:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091e9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942531328:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1715330375.122503:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330375.122601:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938125952 00000100:00100000:2.0:1715330375.122610:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938125952 00002000:00100000:2.0:1715330375.122666:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (20971520->25165823) req@ffff880091e99500 x1798653938125952/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:586/0 lens 488/0 e 0 to 0 dl 1715330386 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330375.122676:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091e99500 with x1798653938125952 ext(20971520->25165823) 00002000:00010000:2.0:1715330375.122681:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091e99500 00000100:00100000:2.0:1715330375.122707:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 63 00000100:00100000:2.0:1715330375.122713:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+16:2013:x1798653938125952:12345-192.168.204.49@tcp:4:dd.0 00000100:00080000:1.0:1715330375.125095:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330345 00000100:00100000:0.0:1715330375.202585:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+18:2013:x1798653938125952:12345-192.168.204.49@tcp:4:dd.0 Request processed in 79856us (80074us total) trans 4294969997 rc 0/0 00000100:00100000:0.0:1715330375.202603:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 63 00002000:00100000:0.0:1715330375.202619:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (20971520->25165823) req@ffff880091e99500 x1798653938125952/t4294969997(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:586/0 lens 488/448 e 0 to 0 dl 1715330386 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330375.202628:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091e99500 with x1798653938125952 ext(20971520->25165823) 00002000:00010000:0.0:1715330375.202636:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091e99500 00010000:00010000:3.0:1715330375.397017:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330375.443993:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1715330375.444021:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942531392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1715330375.444090:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330375.444207:0:9401:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942531392 00000100:00100000:3.0:1715330375.444215:0:9401:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942531392 00000100:00100000:3.0:1715330375.444266:0:9401:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1715330375.444273:0:9401:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942531392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1715330375.444307:0:9401:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1715330375.444342:0:9401:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942531392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330375.444347:0:9401:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00080000:3.0:1715330375.444374:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330345 00000100:00100000:1.0:1715330375.444434:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942531392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1715330375.459488:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942531456:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1715330375.459547:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330375.459624:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942531456 00000100:00100000:3.0:1715330375.459632:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942531456 00000100:00100000:3.0:1715330375.459668:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1715330375.459673:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942531456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1715330375.459696:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923509248 avail 3691986944 00000100:00080000:2.0:1715330375.463145:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330345 00000100:00100000:3.0:1715330375.463338:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942531456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3660us (3786us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330375.463354:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1715330375.463431:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942531456:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1715330375.750640:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330375.751555:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938126144 00000100:00100000:2.0:1715330375.751569:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938126144 00002000:00100000:2.0:1715330375.751640:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (25165824->29360127) req@ffff880091e9a300 x1798653938126144/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:586/0 lens 488/0 e 0 to 0 dl 1715330386 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330375.751652:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091e9a300 with x1798653938126144 ext(25165824->29360127) 00002000:00010000:2.0:1715330375.751659:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091e9a300 00000100:00100000:2.0:1715330375.751819:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 64 00000100:00100000:2.0:1715330375.751826:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+18:2012:x1798653938126144:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330375.805268:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+20:2012:x1798653938126144:12345-192.168.204.49@tcp:4:dd.0 Request processed in 53430us (54629us total) trans 4294969998 rc 0/0 00000100:00100000:2.0:1715330375.805283:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 64 00002000:00100000:2.0:1715330375.805297:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (25165824->29360127) req@ffff880091e9a300 x1798653938126144/t4294969998(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:586/0 lens 488/448 e 0 to 0 dl 1715330386 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330375.805305:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091e9a300 with x1798653938126144 ext(25165824->29360127) 00002000:00010000:2.0:1715330375.805311:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091e9a300 00000100:00100000:0.0:1715330375.921239:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330375.921774:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938126272 00000100:00100000:3.0:1715330375.921783:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938126272 00000100:00100000:3.0:1715330375.921877:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5216 00000100:00100000:3.0:1715330375.921884:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f578a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+20:20948:x1798653938126272:12345-192.168.204.49@tcp:35:dd.0 00000100:00080000:2.0:1715330375.921994:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330345 00000001:00080000:3.0:1715330375.922063:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294984099 00000100:00100000:3.0:1715330375.922287:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f578a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+22:20948:x1798653938126272:12345-192.168.204.49@tcp:35:dd.0 Request processed in 402us (1054us total) trans 4294984100 rc 0/0 00000100:00100000:3.0:1715330375.922294:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5216 00000020:00080000:3.0:1715330375.922300:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:2.0:1715330376.232278:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984100 is committed 00010000:00010000:3.0:1715330376.232361:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5f80/0xd895711d66dbce1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330376.232371:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5f80/0xd895711d66dbce1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330376.232377:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5f80/0xd895711d66dbce1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330376.232383:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b5f80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330376.232387:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5f80/0xd895711d66dbce1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330376.232393:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5f80/0xd895711d66dbce1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330376.232410:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff88008b0d2c00) 00010000:00010000:3.0:1715330376.232413:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330376.232417:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5f80/0xd895711d66dbce1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330376.232425:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5f80/0xd895711d66dbce1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:1.0:1715330376.399274:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330376.691034:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3691:1798653942531712:0@lo:400:kworker.0 00000100:00100000:3.0:1715330376.691094:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330376.691119:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942531968:0@lo:400:kworker.0 00000100:00100000:3.0:1715330376.691138:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330376.691149:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942532224:0@lo:400:kworker.0 00000100:00100000:3.0:1715330376.691161:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330376.691176:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1715330376.691180:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942531648:0@lo:400:kworker.0 00000100:00100000:3.0:1715330376.691200:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330376.691209:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3691:1798653942531904:0@lo:400:kworker.0 00000100:00100000:3.0:1715330376.691221:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330376.691229:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3691:1798653942532160:0@lo:400:kworker.0 00000100:00100000:3.0:1715330376.691239:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330376.691259:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942531712 00000100:00100000:3.0:1715330376.691265:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942531712 00000100:00100000:3.0:1715330376.691289:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942531904 00000100:00100000:3.0:1715330376.691291:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942531904 00000100:00100000:3.0:1715330376.691305:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942532160 00000100:00100000:3.0:1715330376.691307:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942532160 00000100:00100000:3.0:1715330376.691318:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1715330376.691324:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3691:x1798653942531712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330376.691360:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3691:x1798653942531712:12345-0@lo:400:kworker.0 Request processed in 36us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330376.691368:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1715330376.691378:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1715330376.691382:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3691:x1798653942531904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330376.691397:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3691:x1798653942531904:12345-0@lo:400:kworker.0 Request processed in 15us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330376.691401:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1715330376.691407:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1715330376.691410:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3691:x1798653942532160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330376.691425:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3691:x1798653942532160:12345-0@lo:400:kworker.0 Request processed in 14us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330376.691429:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1715330376.691441:0:17197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942531968 00000100:00100000:3.0:1715330376.691443:0:17197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942531968 00000100:00100000:3.0:1715330376.691454:0:17197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942532224 00000100:00100000:3.0:1715330376.691456:0:17197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942532224 00000100:00100000:3.0:1715330376.691467:0:17197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1715330376.691471:0:17197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942531968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330376.691489:0:17197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942531968:12345-0@lo:400:kworker.0 Request processed in 18us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330376.691493:0:17197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1715330376.691499:0:17197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1715330376.691501:0:17197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942532224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330376.691515:0:17197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942532224:12345-0@lo:400:kworker.0 Request processed in 13us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330376.691518:0:17197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1715330376.691545:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3691:1798653942531904:0@lo:400:kworker.0 00000100:00100000:3.0:1715330376.691552:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3691:1798653942532160:0@lo:400:kworker.0 00000100:00100000:3.0:1715330376.691559:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3691:1798653942531712:0@lo:400:kworker.0 00000100:00100000:3.0:1715330376.691565:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942531968:0@lo:400:kworker.0 00000100:00100000:3.0:1715330376.691570:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942532224:0@lo:400:kworker.0 00000100:00100000:3.0:1715330376.691590:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942531648 00000100:00100000:3.0:1715330376.691592:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942531648 00000100:00100000:3.0:1715330376.691611:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3094 00000100:00100000:3.0:1715330376.691614:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006f397c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3691:x1798653942531648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330376.691637:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006f397c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3691:x1798653942531648:12345-0@lo:400:kworker.0 Request processed in 22us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330376.691642:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3094 00000100:00100000:3.0:1715330376.691868:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942531648:0@lo:400:kworker.0 00000100:00080000:3.0:1715330376.691889:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330346 00000100:00080000:3.0:1715330376.691893:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330346 00000100:00100000:2.0:1715330376.692023:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3689:1798653942531584:0@lo:400:kworker.0 00000100:00100000:2.0:1715330376.692048:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330376.692074:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3689:1798653942531840:0@lo:400:kworker.0 00000100:00100000:2.0:1715330376.692091:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330376.692100:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3689:1798653942532096:0@lo:400:kworker.0 00000100:00100000:2.0:1715330376.692112:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330376.692124:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1715330376.692135:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3689:1798653942531520:0@lo:400:kworker.0 00000100:00100000:2.0:1715330376.692153:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330376.692166:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942531776:0@lo:400:kworker.0 00000100:00100000:2.0:1715330376.692180:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330376.692188:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942532032:0@lo:400:kworker.0 00000100:00100000:2.0:1715330376.692201:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330376.692208:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942532288:0@lo:400:kworker.0 00000100:00100000:2.0:1715330376.692219:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330376.692236:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942531584 00000100:00100000:2.0:1715330376.692239:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942531584 00000100:00100000:2.0:1715330376.692255:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942531840 00000100:00100000:2.0:1715330376.692257:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942531840 00000100:00100000:2.0:1715330376.692267:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942532096 00000100:00100000:2.0:1715330376.692269:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942532096 00000100:00100000:2.0:1715330376.692278:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1715330376.692281:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1798653942531584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330376.692309:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1798653942531584:12345-0@lo:400:kworker.0 Request processed in 26us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330376.692313:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1715330376.692321:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1715330376.692324:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1798653942531840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330376.692340:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1798653942531840:12345-0@lo:400:kworker.0 Request processed in 15us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330376.692344:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1715330376.692350:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1715330376.692353:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3689:x1798653942532096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330376.692366:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3689:x1798653942532096:12345-0@lo:400:kworker.0 Request processed in 13us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330376.692372:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1715330376.692387:0:9398:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942532032 00000100:00100000:2.0:1715330376.692389:0:9398:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942532032 00000100:00100000:2.0:1715330376.692399:0:9398:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942532288 00000100:00100000:2.0:1715330376.692401:0:9398:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942532288 00000100:00100000:2.0:1715330376.692410:0:9398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1715330376.692413:0:9398:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942532032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330376.692432:0:9398:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942532032:12345-0@lo:400:kworker.0 Request processed in 19us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330376.692436:0:9398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1715330376.692444:0:9398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1715330376.692447:0:9398:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942532288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330376.692463:0:9398:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942532288:12345-0@lo:400:kworker.0 Request processed in 16us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330376.692467:0:9398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1715330376.692487:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942532032:0@lo:400:kworker.0 00000100:00100000:2.0:1715330376.692494:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942532288:0@lo:400:kworker.0 00000100:00100000:2.0:1715330376.692503:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3689:1798653942531584:0@lo:400:kworker.0 00000100:00100000:2.0:1715330376.692510:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3689:1798653942531840:0@lo:400:kworker.0 00000100:00100000:2.0:1715330376.692516:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3689:1798653942532096:0@lo:400:kworker.0 00000100:00100000:0.0:1715330376.692670:0:7130:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942531520 00000100:00100000:0.0:1715330376.692673:0:7130:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942531520 00000100:00100000:0.0:1715330376.692694:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1715330376.692698:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4af2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3689:x1798653942531520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330376.692760:0:7130:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4af2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3689:x1798653942531520:12345-0@lo:400:kworker.0 Request processed in 59us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330376.692766:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1715330376.692847:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3689:1798653942531520:0@lo:400:kworker.0 00000100:00100000:3.0:1715330376.694449:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942531776 00000100:00100000:3.0:1715330376.694456:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942531776 00000100:00100000:3.0:1715330376.694494:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3095 00000100:00100000:3.0:1715330376.694499:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942531776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330376.694561:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942531776:12345-0@lo:400:kworker.0 Request processed in 61us (2378us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330376.694566:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3095 00000100:00080000:3.0:1715330376.694580:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330346 00000100:00080000:3.0:1715330376.694584:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330346 00000100:00080000:3.0:1715330376.694586:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330346 00000100:00100000:2.0:1715330376.694755:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942531776:0@lo:400:kworker.0 00000100:00100000:0.0:1715330376.723052:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1715330376.723075:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942532352:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1715330376.723147:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330376.723192:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942532352 00000100:00100000:0.0:1715330376.723199:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942532352 00000100:00100000:0.0:1715330376.723235:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1715330376.723242:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942532352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1715330376.723264:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 4243456 granted 268572352 pending 25591808 free 3902345216 avail 3670822912 00000100:00100000:0.0:1715330376.723312:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942532352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330376.723318:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1715330376.723409:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091c3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942532352:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1715330376.723597:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942532416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1715330376.723620:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330376.723708:0:9401:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942532416 00000100:00100000:3.0:1715330376.723712:0:9401:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942532416 00000100:00100000:3.0:1715330376.723773:0:9401:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1715330376.723777:0:9401:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f578700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942532416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1715330376.723787:0:9401:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 4243456 granted 268572352 pending 25591808 free 3902345216 avail 3670822912 00000100:00100000:3.0:1715330376.723812:0:9401:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f578700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942532416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330376.723817:0:9401:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1715330376.725433:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942532416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1715330376.936792:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330376.943006:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938126336 00000100:00100000:3.0:1715330376.943019:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938126336 00000100:00100000:3.0:1715330376.943086:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23832 00000100:00100000:3.0:1715330376.943092:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f579180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+16:20956:x1798653938126336:12345-192.168.204.49@tcp:101:dd.0 00010000:00010000:3.0:1715330376.943112:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330376.943129:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81200/0xd895711d66dbce8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbee3 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330376.943174:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81f80/0xd895711d66dbcef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330376.943184:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81f80/0xd895711d66dbcef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330376.943193:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81f80/0xd895711d66dbcef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00000004:00200000:3.0:1715330376.943222:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 270336 00000004:00200000:3.0:1715330376.943225:0:9622:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1715330376.943238:0:9622:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81f80/0xd895711d66dbcef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330376.943257:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81200/0xd895711d66dbce8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbee3 expref: 18 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330376.943287:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81f80/0xd895711d66dbcef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbee3 expref: 17 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330376.943294:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:3.0:1715330376.943297:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1715330376.943299:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011da81f80, rc 0) 00000100:00100000:3.0:1715330376.943346:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f579180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+17:20956:x1798653938126336:12345-192.168.204.49@tcp:101:dd.0 Request processed in 253us (6561us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330376.943352:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23832 00000100:00100000:0.0:1715330376.952821:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330376.953451:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938126464 00000100:00100000:2.0:1715330376.953460:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938126464 00000100:00100000:2.0:1715330376.953508:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23833 00000100:00100000:2.0:1715330376.953599:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f579880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+17:20956:x1798653938126464:12345-192.168.204.49@tcp:101:dd.0 00010000:00010000:2.0:1715330376.953620:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330376.953623:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1715330376.953645:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81f80/0xd895711d66dbcef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbee3 expref: 17 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330376.953678:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:2.0:1715330376.953682:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330376.953693:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6ac0/0xd895711d66dbcf6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbeea expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330376.954150:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4480/0xd895711d66dbcfd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330376.954163:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4480/0xd895711d66dbcfd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330376.954170:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4480/0xd895711d66dbcfd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330376.954182:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66dbd04 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330376.954187:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66dbd04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330376.954192:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66dbd04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330376.954233:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b58c0/0xd895711d66dbd0b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330376.954240:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b58c0/0xd895711d66dbd0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330376.954245:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b58c0/0xd895711d66dbd0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00200000:2.0:1715330376.954252:0:11283:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1591:0x0]: returning size 30420992 00010000:00010000:2.0:1715330376.955403:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4480/0xd895711d66dbcfd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330376.955413:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4480/0xd895711d66dbcfd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330376.955419:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4480/0xd895711d66dbcfd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330376.955424:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4480/0xd895711d66dbcfd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330376.955429:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b4480 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330376.955432:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4480/0xd895711d66dbcfd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330376.955438:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4480/0xd895711d66dbcfd lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330376.955447:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:2.0:1715330376.955450:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330376.955452:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4480/0xd895711d66dbcfd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330376.955456:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4480/0xd895711d66dbcfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330376.955471:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66dbd04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330376.955475:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66dbd04 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330376.955480:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66dbd04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330376.955483:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b5200 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330376.955485:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66dbd04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330376.955489:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66dbd04 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330376.955494:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x333666 (ffff88009d434000) 00010000:00010000:2.0:1715330376.955496:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330376.955498:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66dbd04 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330376.955502:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66dbd04 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330376.955534:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6ac0/0xd895711d66dbcf6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbeea expref: 19 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330376.955544:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b58c0/0xd895711d66dbd0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbeea expref: 18 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330376.955550:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff88008b0d2c00) 00010000:00010000:2.0:1715330376.955553:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330376.955555:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938b58c0, rc 0) 00000100:00100000:2.0:1715330376.955624:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f579880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+18:20956:x1798653938126464:12345-192.168.204.49@tcp:101:dd.0 Request processed in 2109us (3442us total) trans 4294984101 rc 0/0 00000100:00100000:2.0:1715330376.955632:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23833 00000100:00100000:0.0:1715330376.962226:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330376.964885:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938126592 00000100:00100000:2.0:1715330376.964896:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938126592 00000100:00100000:2.0:1715330376.964968:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23834 00000100:00100000:2.0:1715330376.964975:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+18:20956:x1798653938126592:12345-192.168.204.49@tcp:36:dd.0 00010000:00010000:2.0:1715330376.965022:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330376.965045:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b58c0/0xd895711d66dbd0b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbeea expref: 18 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330376.965074:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff88008b0d2c00) 00010000:00010000:2.0:1715330376.965079:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330376.965189:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66dbd19 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330376.965199:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66dbd19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330376.965206:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66dbd19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000001:00080000:2.0:1715330376.965230:0:11283:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294984102 00000004:00010000:2.0:1715330376.965241:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012f57a680 reply state ffff88009ae84000 transno 4294984103 ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66dbd19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330376.965247:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66dbd19 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330376.965255:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff88008b0d2c00) 00010000:00010000:2.0:1715330376.965257:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330376.965259:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1715330376.965317:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+20:20956:x1798653938126592:12345-192.168.204.49@tcp:36:dd.0 Request processed in 343us (3098us total) trans 4294984103 rc 0/0 00000100:00100000:2.0:1715330376.965323:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23834 00000020:00080000:2.0:1715330376.965326:0:11283:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330377.047132:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330377.047233:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938126656 00000100:00100000:2.0:1715330377.047242:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938126656 00002000:00010000:2.0:1715330377.047294:0:27574:0:(ofd_dev.c:2731:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/2560 (0->18446744073709551615) 00002000:00100000:2.0:1715330377.047298:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f579f80 with x1798653938126656 ext(0->18446744073709551615) 00002000:00010000:2.0:1715330377.047308:0:27574:0:(ofd_dev.c:2736:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f579f80. 00000100:00100000:2.0:1715330377.047329:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 65 00000100:00100000:2.0:1715330377.047336:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f579f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+20:2014:x1798653938126656:12345-192.168.204.49@tcp:10:dd.0 00000100:00080000:3.0:1715330377.048993:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330347 00002000:00010000:2.0:1715330377.082487:0:27574:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1715330377.082493:0:27574:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb mtime from disk: 1715330371 -> 1715330377 00002000:00010000:2.0:1715330377.082495:0:27574:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1715330377.082497:0:27574:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb ctime from disk: 1715330371 -> 1715330377 00002000:00010000:2.0:1715330377.082499:0:27574:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1715330377.083423:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f579f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+21:2014:x1798653938126656:12345-192.168.204.49@tcp:10:dd.0 Request processed in 36082us (36294us total) trans 4294969999 rc 0/0 00000100:00100000:2.0:1715330377.083434:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 65 00002000:00010000:2.0:1715330377.083439:0:27574:0:(ofd_dev.c:2731:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/2560 (0->18446744073709551615) 00002000:00100000:2.0:1715330377.083442:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f579f80 with x1798653938126656 ext(0->18446744073709551615) 00002000:00010000:2.0:1715330377.083449:0:27574:0:(ofd_dev.c:2736:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f579f80. 00000001:00080000:0.0:1715330377.084833:0:10666:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4294969999 is committed 00010000:00010000:2.0:1715330377.402122:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330377.856340:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330377.856456:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938126784 00000100:00100000:2.0:1715330377.856466:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938126784 00002000:00100000:2.0:1715330377.856513:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (0->4194303) req@ffff88012f57ad80 x1798653938126784/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:588/0 lens 488/0 e 0 to 0 dl 1715330388 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330377.856524:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f57ad80 with x1798653938126784 ext(0->4194303) 00002000:00010000:2.0:1715330377.856529:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f57ad80 00000100:00100000:2.0:1715330377.856552:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 66 00000100:00100000:2.0:1715330377.856558:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+6:2012:x1798653938126784:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330377.921835:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+8:2012:x1798653938126784:12345-192.168.204.49@tcp:4:dd.0 Request processed in 65261us (65489us total) trans 4294970000 rc 0/0 00000100:00100000:0.0:1715330377.921848:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 66 00002000:00100000:0.0:1715330377.921862:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (0->4194303) req@ffff88012f57ad80 x1798653938126784/t4294970000(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:588/0 lens 488/448 e 0 to 0 dl 1715330388 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330377.921871:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f57ad80 with x1798653938126784 ext(0->4194303) 00002000:00010000:0.0:1715330377.921877:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f57ad80 00000100:00100000:0.0:1715330378.070824:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330378.072285:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938126848 00000100:00100000:2.0:1715330378.072294:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938126848 00002000:00100000:2.0:1715330378.072329:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (4194304->6045695) req@ffff88008b161180 x1798653938126848/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:589/0 lens 488/0 e 0 to 0 dl 1715330389 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330378.072338:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b161180 with x1798653938126848 ext(4194304->6045695) 00002000:00010000:2.0:1715330378.072342:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b161180 00000100:00100000:2.0:1715330378.072367:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 67 00000100:00100000:2.0:1715330378.072373:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b161180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+8:2013:x1798653938126848:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330378.074042:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330378.074229:0:9403:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938126912 00000100:00100000:0.0:1715330378.074236:0:9403:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938126912 00002000:00100000:0.0:1715330378.074265:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa00:0x0] (6045696->6242303) req@ffff880091c3ea00 x1798653938126912/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:589/0 lens 488/0 e 0 to 0 dl 1715330389 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330378.074273:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c3ea00 with x1798653938126912 ext(6045696->6242303) 00002000:00010000:0.0:1715330378.074279:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091c3ea00 00000100:00100000:0.0:1715330378.075595:0:9403:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 68 00000100:00100000:0.0:1715330378.075602:0:9403:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+9:2013:x1798653938126912:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330378.078515:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330378.083655:0:9404:0:(service.c:3202:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1715330378.083672:0:9404:0:(service.c:3261:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:2.0:1715330378.085543:0:9404:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938127040 00000100:00100000:2.0:1715330378.085550:0:9404:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938127040 00002000:00100000:2.0:1715330378.085580:0:9404:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0xa00:0x0] (6242304->6258687) req@ffff88008b160000 x1798653938127040/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:589/0 lens 16872/0 e 0 to 0 dl 1715330389 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330378.085588:0:9404:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b160000 with x1798653938127040 ext(6242304->6258687) 00002000:00010000:2.0:1715330378.085593:0:9404:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b160000 00000100:00100000:3.0:1715330378.085981:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 69 00000100:00100000:3.0:1715330378.085988:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b160000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+14:2011:x1798653938127040:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330378.086507:0:9403:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+15:2013:x1798653938126912:12345-192.168.204.49@tcp:4:dd.0 Request processed in 10903us (12469us total) trans 4294970001 rc 0/0 00000100:00100000:2.0:1715330378.086515:0:9403:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 68 00002000:00100000:2.0:1715330378.086521:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0xa00:0x0] (6045696->6242303) req@ffff880091c3ea00 x1798653938126912/t4294970001(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:589/0 lens 488/448 e 0 to 0 dl 1715330389 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330378.086528:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c3ea00 with x1798653938126912 ext(6045696->6242303) 00002000:00010000:2.0:1715330378.086532:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091c3ea00 00000100:00100000:3.0:1715330378.086926:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b160000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+14:2011:x1798653938127040:12345-192.168.204.49@tcp:4:dd.0 Request processed in 937us (8417us total) trans 4294970002 rc 0/0 00000100:00100000:3.0:1715330378.086932:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 69 00002000:00100000:3.0:1715330378.086937:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0xa00:0x0] (6242304->6258687) req@ffff88008b160000 x1798653938127040/t4294970002(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:589/0 lens 16872/448 e 0 to 0 dl 1715330389 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330378.086944:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b160000 with x1798653938127040 ext(6242304->6258687) 00002000:00010000:3.0:1715330378.086947:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b160000 00000100:00100000:2.0:1715330378.108515:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b161180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+14:2013:x1798653938126848:12345-192.168.204.49@tcp:4:dd.0 Request processed in 36134us (37692us total) trans 4294970003 rc 0/0 00000100:00100000:2.0:1715330378.108527:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 67 00002000:00100000:2.0:1715330378.108537:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (4194304->6045695) req@ffff88008b161180 x1798653938126848/t4294970003(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:589/0 lens 488/448 e 0 to 0 dl 1715330389 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330378.108545:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b161180 with x1798653938126848 ext(4194304->6045695) 00002000:00010000:2.0:1715330378.108551:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b161180 00000100:00100000:2.0:1715330378.130984:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007d637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942532480:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1715330378.131051:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330378.131169:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942532480 00000100:00100000:0.0:1715330378.131176:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942532480 00000100:00100000:0.0:1715330378.131225:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3096 00000100:00100000:0.0:1715330378.131231:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3691:x1798653942532480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1715330378.131259:0:19960:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444089856 avail 1314627584 00000100:00100000:0.0:1715330378.131292:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3691:x1798653942532480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330378.131297:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3096 00000100:00100000:2.0:1715330378.131368:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007d637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942532480:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1715330378.223580:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330378.223623:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330378.223644:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938127168 00000100:00100000:3.0:1715330378.223652:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938127168 00000100:00100000:0.0:1715330378.223661:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330378.223696:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330378.223774:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938127296 00000100:00100000:1.0:1715330378.223778:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938127296 00000100:00080000:2.0:1715330378.225170:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330348 00000100:00080000:2.0:1715330378.225174:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330348 00000100:00100000:3.0:1715330378.225207:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938127232 00000100:00100000:0.0:1715330378.225208:0:7129:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938127104 00000100:00100000:3.0:1715330378.225212:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938127232 00000100:00100000:0.0:1715330378.225212:0:7129:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938127104 00000100:00100000:3.0:1715330378.225231:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 383 00000100:00100000:3.0:1715330378.225237:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+20:2013:x1798653938127168:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:0.0:1715330378.225238:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 365 00000100:00100000:0.0:1715330378.225244:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4af0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2013:x1798653938127104:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:3.0:1715330378.225291:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+20:2013:x1798653938127168:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 54us (1718us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330378.225292:0:7129:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4af0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2013:x1798653938127104:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 48us (1630us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330378.225296:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 383 00000100:00100000:0.0:1715330378.225297:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 365 00000100:00100000:3.0:1715330378.225308:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 384 00000100:00100000:3.0:1715330378.225312:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938127232:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:3.0:1715330378.225329:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938127232:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 17us (1633us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330378.225333:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 384 00000100:00080000:3.0:1715330378.225351:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330348 00000100:00080000:3.0:1715330378.225352:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330348 00000100:00100000:1.0:1715330378.225800:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 272 00000100:00100000:1.0:1715330378.225806:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938127296:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:1.0:1715330378.225846:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938127296:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 39us (2223us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330378.225851:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 272 00010000:00010000:2.0:1715330378.405434:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330379.383492:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330379.383780:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938127424 00000100:00100000:2.0:1715330379.383791:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938127424 00002000:00100000:2.0:1715330379.383859:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (8388608->12582911) req@ffff88007d635500 x1798653938127424/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:590/0 lens 488/0 e 0 to 0 dl 1715330390 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330379.383879:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88007d635500 with x1798653938127424 ext(8388608->12582911) 00002000:00010000:2.0:1715330379.383885:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007d635500 00000100:00100000:2.0:1715330379.383918:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 70 00000100:00100000:2.0:1715330379.383926:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+14:2014:x1798653938127424:12345-192.168.204.49@tcp:4:dd.0 00000100:00080000:3.0:1715330379.386172:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330349 00010000:00010000:3.0:1715330379.407419:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330379.451932:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+16:2014:x1798653938127424:12345-192.168.204.49@tcp:4:dd.0 Request processed in 67992us (68439us total) trans 4294970004 rc 0/0 00000100:00100000:2.0:1715330379.451952:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 70 00002000:00100000:2.0:1715330379.451967:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (8388608->12582911) req@ffff88007d635500 x1798653938127424/t4294970004(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:590/0 lens 488/448 e 0 to 0 dl 1715330390 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330379.451978:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88007d635500 with x1798653938127424 ext(8388608->12582911) 00002000:00010000:2.0:1715330379.451985:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007d635500 00000100:00100000:1.0:1715330379.587433:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942532544:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1715330379.587483:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330379.587685:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942532544 00000100:00100000:0.0:1715330379.587692:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942532544 00000100:00100000:0.0:1715330379.587753:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3097 00000100:00100000:0.0:1715330379.587759:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942532544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1715330379.587788:0:19960:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445060608 avail 1315598336 00000100:00100000:0.0:1715330379.587829:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942532544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330379.587835:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3097 00000100:00100000:1.0:1715330379.587981:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942532544:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1715330380.253213:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330380.253683:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938127552 00000100:00100000:2.0:1715330380.253694:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938127552 00002000:00100000:2.0:1715330380.253791:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (12582912->16777215) req@ffff88007d637b80 x1798653938127552/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:591/0 lens 488/0 e 0 to 0 dl 1715330391 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330380.253802:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88007d637b80 with x1798653938127552 ext(12582912->16777215) 00002000:00010000:2.0:1715330380.253808:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007d637b80 00000100:00100000:2.0:1715330380.253842:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 71 00000100:00100000:2.0:1715330380.253861:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+16:2012:x1798653938127552:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330380.370858:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+18:2012:x1798653938127552:12345-192.168.204.49@tcp:4:dd.0 Request processed in 116987us (117634us total) trans 4294970005 rc 0/0 00000100:00100000:0.0:1715330380.370875:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 71 00002000:00100000:0.0:1715330380.370890:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (12582912->16777215) req@ffff88007d637b80 x1798653938127552/t4294970005(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:591/0 lens 488/448 e 0 to 0 dl 1715330391 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330380.370901:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88007d637b80 with x1798653938127552 ext(12582912->16777215) 00002000:00010000:0.0:1715330380.370908:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007d637b80 00010000:00010000:1.0:1715330380.409004:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330380.451053:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942532608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1715330380.451140:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330380.451361:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942532608 00000100:00100000:1.0:1715330380.451373:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942532608 00000100:00100000:1.0:1715330380.451446:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1715330380.451455:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091eee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942532608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1715330380.451494:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1715330380.451545:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091eee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942532608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330380.451552:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00080000:3.0:1715330380.451622:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330350 00000100:00100000:0.0:1715330380.452183:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091c3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942532608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1715330380.468392:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942532672:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1715330380.468470:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330380.468887:0:9401:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942532672 00000100:00100000:0.0:1715330380.468896:0:9401:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942532672 00000100:00100000:0.0:1715330380.468941:0:9401:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1715330380.468948:0:9401:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942532672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1715330380.468975:0:9401:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1715330380.469025:0:9401:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942532672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330380.469032:0:9401:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00080000:3.0:1715330380.469077:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330350 00000100:00100000:2.0:1715330380.470918:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942532672:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1715330381.142121:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330381.142627:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938127680 00000100:00100000:2.0:1715330381.142634:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938127680 00002000:00100000:2.0:1715330381.144266:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (16777216->20971519) req@ffff880091eedc00 x1798653938127680/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:592/0 lens 488/0 e 0 to 0 dl 1715330392 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330381.144275:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091eedc00 with x1798653938127680 ext(16777216->20971519) 00002000:00010000:2.0:1715330381.144281:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091eedc00 00000100:00100000:2.0:1715330381.144311:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 72 00000100:00100000:2.0:1715330381.144318:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091eedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+18:2014:x1798653938127680:12345-192.168.204.49@tcp:4:dd.0 00000100:00080000:3.0:1715330381.147707:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330351 00000100:00100000:0.0:1715330381.228255:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091eedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+20:2014:x1798653938127680:12345-192.168.204.49@tcp:4:dd.0 Request processed in 83926us (86132us total) trans 4294970006 rc 0/0 00000100:00100000:0.0:1715330381.228268:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 72 00002000:00100000:0.0:1715330381.228279:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (16777216->20971519) req@ffff880091eedc00 x1798653938127680/t4294970006(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:592/0 lens 488/448 e 0 to 0 dl 1715330392 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330381.228287:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091eedc00 with x1798653938127680 ext(16777216->20971519) 00002000:00010000:0.0:1715330381.228293:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091eedc00 00010000:00010000:2.0:1715330381.412040:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330381.699019:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3688:1798653942532800:0@lo:400:kworker.0 00000100:00100000:3.0:1715330381.699079:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330381.699099:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3688:1798653942533056:0@lo:400:kworker.0 00000100:00100000:3.0:1715330381.699114:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330381.699123:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3688:1798653942533312:0@lo:400:kworker.0 00000100:00100000:3.0:1715330381.699138:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330381.699155:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1715330381.699159:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942532864:0@lo:400:kworker.0 00000100:00100000:3.0:1715330381.699177:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330381.699187:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3688:1798653942533120:0@lo:400:kworker.0 00000100:00100000:3.0:1715330381.699201:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330381.699209:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3688:1798653942533376:0@lo:400:kworker.0 00000100:00100000:3.0:1715330381.699220:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330381.699244:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942532800 00000100:00100000:3.0:1715330381.699250:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942532800 00000100:00100000:3.0:1715330381.699278:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942533056 00000100:00100000:3.0:1715330381.699280:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942533056 00000100:00100000:3.0:1715330381.699292:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942533312 00000100:00100000:3.0:1715330381.699293:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942533312 00000100:00100000:3.0:1715330381.699301:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942533120 00000100:00100000:3.0:1715330381.699302:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942533120 00000100:00100000:3.0:1715330381.699309:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942533376 00000100:00100000:3.0:1715330381.699311:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942533376 00000100:00100000:3.0:1715330381.699319:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1715330381.699324:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3688:x1798653942532800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330381.699362:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3688:x1798653942532800:12345-0@lo:400:kworker.0 Request processed in 37us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330381.699367:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1715330381.699382:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1715330381.699385:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1798653942533056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330381.699404:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1798653942533056:12345-0@lo:400:kworker.0 Request processed in 18us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330381.699408:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1715330381.699414:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1715330381.699418:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d62bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3688:x1798653942533312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330381.699433:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d62bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3688:x1798653942533312:12345-0@lo:400:kworker.0 Request processed in 15us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330381.699437:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1715330381.699446:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1715330381.699448:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b319880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3688:x1798653942533120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330381.699464:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b319880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3688:x1798653942533120:12345-0@lo:400:kworker.0 Request processed in 15us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330381.699468:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1715330381.699476:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1715330381.699479:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b319180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3688:x1798653942533376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330381.699493:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b319180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3688:x1798653942533376:12345-0@lo:400:kworker.0 Request processed in 14us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330381.699500:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1715330381.699531:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3688:1798653942533120:0@lo:400:kworker.0 00000100:00100000:3.0:1715330381.699539:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3688:1798653942533376:0@lo:400:kworker.0 00000100:00100000:3.0:1715330381.699545:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3688:1798653942532800:0@lo:400:kworker.0 00000100:00100000:3.0:1715330381.699552:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3688:1798653942533056:0@lo:400:kworker.0 00000100:00100000:3.0:1715330381.699559:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3688:1798653942533312:0@lo:400:kworker.0 00000100:00100000:3.0:1715330381.699581:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942532864 00000100:00100000:3.0:1715330381.699583:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942532864 00000100:00100000:3.0:1715330381.699603:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3098 00000100:00100000:3.0:1715330381.699607:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d62a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942532864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330381.699637:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d62a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942532864:12345-0@lo:400:kworker.0 Request processed in 30us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330381.699642:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3098 00000100:00100000:3.0:1715330381.699658:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942532864:0@lo:400:kworker.0 00000100:00080000:3.0:1715330381.699673:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330351 00000100:00080000:3.0:1715330381.699677:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330351 00000100:00100000:0.0:1715330381.699934:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3691:1798653942532736:0@lo:400:kworker.0 00000100:00100000:0.0:1715330381.699963:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330381.699976:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942532992:0@lo:400:kworker.0 00000100:00100000:0.0:1715330381.699992:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330381.700013:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942533248:0@lo:400:kworker.0 00000100:00100000:0.0:1715330381.700031:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330381.700043:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091e9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942533504:0@lo:400:kworker.0 00000100:00100000:0.0:1715330381.700056:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330381.700067:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1715330381.700071:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3691:1798653942532928:0@lo:400:kworker.0 00000100:00100000:0.0:1715330381.700087:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330381.700095:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942533184:0@lo:400:kworker.0 00000100:00100000:0.0:1715330381.700108:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330381.700118:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942533440:0@lo:400:kworker.0 00000100:00100000:0.0:1715330381.700131:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330381.700149:0:17205:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942533248 00000100:00100000:0.0:1715330381.700153:0:17205:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942533248 00000100:00100000:0.0:1715330381.700172:0:17205:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942533504 00000100:00100000:0.0:1715330381.700174:0:17205:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942533504 00000100:00100000:0.0:1715330381.700187:0:17205:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942533184 00000100:00100000:0.0:1715330381.700188:0:17205:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942533184 00000100:00100000:0.0:1715330381.700195:0:17205:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942533440 00000100:00100000:0.0:1715330381.700196:0:17205:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942533440 00000100:00100000:0.0:1715330381.700206:0:17205:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1715330381.700209:0:17205:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942533248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330381.700235:0:17205:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942533248:12345-0@lo:400:kworker.0 Request processed in 24us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330381.700239:0:17205:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1715330381.700249:0:17205:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1715330381.700251:0:17205:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942533504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330381.700268:0:17205:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942533504:12345-0@lo:400:kworker.0 Request processed in 16us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330381.700272:0:17205:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1715330381.700279:0:17205:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1715330381.700282:0:17205:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942533184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330381.700297:0:17205:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942533184:12345-0@lo:400:kworker.0 Request processed in 14us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330381.700302:0:17205:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1715330381.700307:0:17205:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1715330381.700310:0:17205:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942533440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330381.700325:0:17205:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942533440:12345-0@lo:400:kworker.0 Request processed in 14us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330381.700329:0:17205:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1715330381.700350:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942533184:0@lo:400:kworker.0 00000100:00100000:0.0:1715330381.700357:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942533440:0@lo:400:kworker.0 00000100:00100000:0.0:1715330381.700363:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942533248:0@lo:400:kworker.0 00000100:00100000:0.0:1715330381.700369:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091e9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942533504:0@lo:400:kworker.0 00000100:00080000:0.0:1715330381.700384:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330351 00000100:00100000:1.0:1715330381.700869:0:7130:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942532736 00000100:00100000:1.0:1715330381.700873:0:7130:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942532736 00000100:00100000:1.0:1715330381.700910:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1715330381.700914:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4af1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3691:x1798653942532736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330381.700950:0:7130:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4af1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3691:x1798653942532736:12345-0@lo:400:kworker.0 Request processed in 35us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330381.700955:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1715330381.700985:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3691:1798653942532736:0@lo:400:kworker.0 00000100:00080000:0.0:1715330381.702062:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330351 00000100:00100000:3.0:1715330381.702273:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942532992 00000100:00100000:3.0:1715330381.702278:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942532992 00000100:00100000:3.0:1715330381.702310:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3099 00000100:00100000:3.0:1715330381.702314:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091eec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942532992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330381.704817:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091eec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942532992:12345-0@lo:400:kworker.0 Request processed in 2495us (4816us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330381.704839:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3099 00000100:00100000:3.0:1715330381.704872:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942532928 00000100:00100000:3.0:1715330381.704879:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942532928 00000100:00100000:1.0:1715330381.705185:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942532992:0@lo:400:kworker.0 00000100:00100000:3.0:1715330381.706645:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1715330381.706654:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3691:x1798653942532928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330381.706887:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3691:x1798653942532928:12345-0@lo:400:kworker.0 Request processed in 233us (6797us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330381.706893:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1715330381.706964:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3691:1798653942532928:0@lo:400:kworker.0 00000100:00100000:2.0:1715330381.732387:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942533568:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1715330381.732450:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330381.732693:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b318e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942533632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1715330381.732917:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330381.733294:0:9401:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942533568 00000100:00100000:2.0:1715330381.733305:0:9401:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942533568 00000100:00100000:2.0:1715330381.733354:0:9401:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942533632 00000100:00100000:2.0:1715330381.733357:0:9401:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942533632 00000100:00100000:2.0:1715330381.733375:0:9401:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1715330381.733381:0:9401:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942533568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1715330381.733418:0:9401:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 2310144 granted 296969920 pending 19013632 free 3904704512 avail 3673182208 00000100:00100000:2.0:1715330381.733472:0:9401:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942533568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330381.733480:0:9401:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1715330381.733496:0:9401:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1715330381.733499:0:9401:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942533632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1715330381.733508:0:9401:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 2310144 granted 296969920 pending 19013632 free 3904704512 avail 3673182208 00000100:00100000:2.0:1715330381.733529:0:9401:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942533632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 29us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330381.733533:0:9401:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1715330381.733568:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b318e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942533632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1715330381.733965:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091c3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942533568:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1715330381.951672:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330381.952132:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938127808 00000100:00100000:3.0:1715330381.952599:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938127808 00000100:00100000:3.0:1715330381.953125:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5217 00000100:00100000:3.0:1715330381.953133:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+20:20956:x1798653938127808:12345-192.168.204.49@tcp:35:dd.0 00000001:00080000:3.0:1715330381.953885:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294984104 00000100:00100000:3.0:1715330381.953964:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+22:20956:x1798653938127808:12345-192.168.204.49@tcp:35:dd.0 Request processed in 831us (2299us total) trans 4294984105 rc 0/0 00000100:00100000:3.0:1715330381.953971:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5217 00000020:00080000:3.0:1715330381.953975:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:0.0:1715330381.954163:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330351 00000001:00080000:1.0:1715330382.233573:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984105 is committed 00010000:00010000:0.0:1715330382.233970:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66dbd19 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330382.233980:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66dbd19 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330382.233991:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66dbd19 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330382.233997:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b4900 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330382.234001:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66dbd19 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330382.234007:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66dbd19 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330382.234021:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff88008b0d2c00) 00010000:00010000:0.0:1715330382.234024:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330382.234027:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66dbd19 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330382.234031:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66dbd19 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330382.414933:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330382.964674:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330382.965497:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938127872 00000100:00100000:3.0:1715330382.965504:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938127872 00000100:00100000:3.0:1715330382.965552:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23835 00000100:00100000:3.0:1715330382.965557:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091e9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+16:20964:x1798653938127872:12345-192.168.204.49@tcp:101:dd.0 00010000:00010000:3.0:1715330382.965576:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330382.965593:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82640/0xd895711d66dbd20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbef1 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330382.966455:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80000/0xd895711d66dbd27 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330382.966470:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80000/0xd895711d66dbd27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330382.966481:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80000/0xd895711d66dbd27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000004:00200000:3.0:1715330382.966516:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 270336 00000004:00200000:3.0:1715330382.966519:0:7134:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1715330382.966532:0:7134:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80000/0xd895711d66dbd27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330382.966549:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82640/0xd895711d66dbd20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbef1 expref: 18 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330382.966987:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80000/0xd895711d66dbd27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbef1 expref: 17 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330382.966996:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:3.0:1715330382.966999:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1715330382.967002:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011da80000, rc 0) 00000100:00100000:3.0:1715330382.967050:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091e9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+17:20964:x1798653938127872:12345-192.168.204.49@tcp:101:dd.0 Request processed in 1492us (2383us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330382.967056:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23835 00000100:00100000:0.0:1715330382.971553:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330382.971687:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938128000 00000100:00100000:3.0:1715330382.971696:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938128000 00000100:00100000:3.0:1715330382.971815:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23836 00000100:00100000:3.0:1715330382.971823:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093373800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+17:20964:x1798653938128000:12345-192.168.204.49@tcp:101:dd.0 00010000:00010000:3.0:1715330382.971838:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330382.971841:0:7134:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1715330382.971864:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80000/0xd895711d66dbd27 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbef1 expref: 17 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330382.971895:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:3.0:1715330382.971898:0:7134:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330382.971908:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da833c0/0xd895711d66dbd2e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbef8 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330382.971985:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80fc0/0xd895711d66dbd35 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330382.971995:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80fc0/0xd895711d66dbd35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330382.972001:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80fc0/0xd895711d66dbd35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330382.972013:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83a80/0xd895711d66dbd3c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330382.972018:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83a80/0xd895711d66dbd3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330382.972022:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83a80/0xd895711d66dbd3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330382.972056:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80480/0xd895711d66dbd43 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330382.972063:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80480/0xd895711d66dbd43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330382.972067:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80480/0xd895711d66dbd43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000004:00200000:3.0:1715330382.972073:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1591:0x0]: returning size 25051136 00010000:00010000:3.0:1715330382.972139:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80fc0/0xd895711d66dbd35 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330382.972144:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80fc0/0xd895711d66dbd35 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330382.972149:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80fc0/0xd895711d66dbd35 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330382.972153:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80fc0/0xd895711d66dbd35 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330382.972158:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da80fc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330382.972162:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80fc0/0xd895711d66dbd35 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330382.972171:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80fc0/0xd895711d66dbd35 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330382.972177:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:3.0:1715330382.972179:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330382.972182:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80fc0/0xd895711d66dbd35 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330382.972186:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80fc0/0xd895711d66dbd35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330382.972193:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83a80/0xd895711d66dbd3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330382.972197:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83a80/0xd895711d66dbd3c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330382.972202:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83a80/0xd895711d66dbd3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330382.972205:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da83a80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330382.972207:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83a80/0xd895711d66dbd3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330382.972211:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83a80/0xd895711d66dbd3c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330382.972216:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x333666 (ffff88008779d100) 00010000:00010000:3.0:1715330382.972218:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330382.972220:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83a80/0xd895711d66dbd3c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330382.972223:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83a80/0xd895711d66dbd3c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330382.972250:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da833c0/0xd895711d66dbd2e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbef8 expref: 19 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330382.972259:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80480/0xd895711d66dbd43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbef8 expref: 18 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330382.972264:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff88008b0d2c00) 00010000:00010000:3.0:1715330382.972265:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330382.972267:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011da80480, rc 0) 00000100:00100000:3.0:1715330382.972310:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093373800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+18:20964:x1798653938128000:12345-192.168.204.49@tcp:101:dd.0 Request processed in 488us (765us total) trans 4294984106 rc 0/0 00000100:00100000:3.0:1715330382.972315:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23836 00000100:00100000:0.0:1715330382.976340:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330382.976846:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938128128 00000100:00100000:2.0:1715330382.976854:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938128128 00000100:00100000:2.0:1715330382.976900:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23837 00000100:00100000:2.0:1715330382.976906:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+18:20964:x1798653938128128:12345-192.168.204.49@tcp:36:dd.0 00010000:00010000:2.0:1715330382.976948:0:7133:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330382.976968:0:7133:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80480/0xd895711d66dbd43 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbef8 expref: 18 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330382.976993:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff88008b0d2c00) 00010000:00010000:2.0:1715330382.976996:0:7133:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330382.977109:0:7133:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66dbd51 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330382.977121:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66dbd51 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330382.977128:0:7133:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66dbd51 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00000001:00080000:2.0:1715330382.977158:0:7133:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294984107 00000004:00010000:2.0:1715330382.977171:0:7133:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880091d55880 reply state ffff880091e53000 transno 4294984108 ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66dbd51 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330382.977179:0:7133:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66dbd51 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:2.0:1715330382.977184:0:7133:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff88008b0d2c00) 00010000:00010000:2.0:1715330382.977186:0:7133:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330382.977188:0:7133:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1715330382.977259:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+20:20964:x1798653938128128:12345-192.168.204.49@tcp:36:dd.0 Request processed in 352us (926us total) trans 4294984108 rc 0/0 00000100:00100000:2.0:1715330382.977265:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23837 00000020:00080000:2.0:1715330382.977269:0:7133:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330383.139093:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942533696:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1715330383.139148:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330383.139259:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942533696 00000100:00100000:3.0:1715330383.139266:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942533696 00000100:00100000:3.0:1715330383.140314:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3100 00000100:00100000:3.0:1715330383.140322:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942533696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1715330383.140351:0:19960:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444089856 avail 1314627584 00000100:00100000:3.0:1715330383.141808:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942533696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1472us (2645us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330383.141818:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3100 00000100:00100000:1.0:1715330383.141938:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942533696:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1715330383.166986:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330383.167054:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938128192 00000100:00100000:2.0:1715330383.167062:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938128192 00002000:00010000:2.0:1715330383.167530:0:27574:0:(ofd_dev.c:2731:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/2560 (0->18446744073709551615) 00002000:00100000:2.0:1715330383.167534:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d55c00 with x1798653938128192 ext(0->18446744073709551615) 00002000:00010000:2.0:1715330383.167544:0:27574:0:(ofd_dev.c:2736:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091d55c00. 00000100:00100000:2.0:1715330383.167575:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 73 00000100:00100000:2.0:1715330383.167581:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+20:2012:x1798653938128192:12345-192.168.204.49@tcp:10:dd.0 00000100:00080000:0.0:1715330383.167871:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330353 00002000:00010000:2.0:1715330383.185008:0:27574:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1715330383.185015:0:27574:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb mtime from disk: 1715330377 -> 1715330383 00002000:00010000:2.0:1715330383.185018:0:27574:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1715330383.185020:0:27574:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb ctime from disk: 1715330377 -> 1715330383 00002000:00010000:2.0:1715330383.185021:0:27574:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1715330383.185601:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+21:2012:x1798653938128192:12345-192.168.204.49@tcp:10:dd.0 Request processed in 18013us (18616us total) trans 4294970007 rc 0/0 00000100:00100000:2.0:1715330383.185612:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 73 00002000:00010000:2.0:1715330383.185618:0:27574:0:(ofd_dev.c:2731:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/2560 (0->18446744073709551615) 00002000:00100000:2.0:1715330383.185621:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d55c00 with x1798653938128192 ext(0->18446744073709551615) 00002000:00010000:2.0:1715330383.185627:0:27574:0:(ofd_dev.c:2736:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091d55c00. 00000001:00080000:0.0:1715330383.192639:0:10666:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4294970007 is committed 00000100:00100000:0.0:1715330383.231307:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330383.231350:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330383.231394:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330383.231483:0:9398:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938128384 00000100:00100000:1.0:1715330383.231483:0:7129:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938128256 00000100:00100000:2.0:1715330383.231490:0:9398:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938128384 00000100:00100000:1.0:1715330383.231490:0:7129:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938128256 00000100:00100000:2.0:1715330383.231528:0:9398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 277 00000100:00100000:1.0:1715330383.231528:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 367 00000100:00100000:2.0:1715330383.231533:0:9398:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938128384:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:1.0:1715330383.231533:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4af3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2014:x1798653938128256:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:3.0:1715330383.231606:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938128320 00000100:00100000:3.0:1715330383.231609:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938128320 00000100:00100000:3.0:1715330383.231632:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 391 00000100:00100000:3.0:1715330383.231636:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938128320:12345-192.168.204.49@tcp:400:kworker.0 00000100:00080000:0.0:1715330383.231664:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330353 00000100:00080000:0.0:1715330383.231670:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330353 00000100:00080000:0.0:1715330383.231673:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330353 00000100:00100000:1.0:1715330383.231789:0:7129:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4af3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2014:x1798653938128256:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 255us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330383.231824:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 367 00000100:00100000:2.0:1715330383.231925:0:9398:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938128384:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 390us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330383.231931:0:9398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 277 00000100:00100000:3.0:1715330383.232045:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938128320:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 407us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330383.232053:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 391 00010000:00010000:3.0:1715330383.417002:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330384.419063:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330384.527449:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330384.527545:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938128512 00000100:00100000:2.0:1715330384.527553:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938128512 00002000:00100000:2.0:1715330384.527587:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (0->4194303) req@ffff880091d54a80 x1798653938128512/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:595/0 lens 488/0 e 0 to 0 dl 1715330395 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330384.527595:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d54a80 with x1798653938128512 ext(0->4194303) 00002000:00010000:2.0:1715330384.527600:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091d54a80 00000100:00100000:2.0:1715330384.527629:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 74 00000100:00100000:2.0:1715330384.527635:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+6:2011:x1798653938128512:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330384.595766:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1715330384.595792:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942533760:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1715330384.595848:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330384.598076:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942533760 00000100:00100000:3.0:1715330384.598090:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942533760 00000100:00100000:3.0:1715330384.598159:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3101 00000100:00100000:3.0:1715330384.598167:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942533760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1715330384.598210:0:19960:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445060608 avail 1315598336 00000100:00100000:3.0:1715330384.598759:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942533760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 593us (2911us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330384.598766:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3101 00000100:00100000:1.0:1715330384.598871:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091c3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942533760:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1715330384.648458:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+8:2011:x1798653938128512:12345-192.168.204.49@tcp:4:dd.0 Request processed in 120815us (121007us total) trans 4294970008 rc 0/0 00000100:00100000:0.0:1715330384.648470:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 74 00002000:00100000:0.0:1715330384.648481:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (0->4194303) req@ffff880091d54a80 x1798653938128512/t4294970008(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:595/0 lens 488/448 e 0 to 0 dl 1715330395 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330384.648489:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d54a80 with x1798653938128512 ext(0->4194303) 00002000:00010000:0.0:1715330384.648494:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091d54a80 00000100:00100000:0.0:1715330385.373323:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330385.373401:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938128640 00000100:00100000:2.0:1715330385.373409:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938128640 00002000:00100000:2.0:1715330385.373462:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (4194304->8388607) req@ffff880091d54e00 x1798653938128640/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:596/0 lens 488/0 e 0 to 0 dl 1715330396 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330385.373471:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d54e00 with x1798653938128640 ext(4194304->8388607) 00002000:00010000:2.0:1715330385.373476:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091d54e00 00000100:00100000:2.0:1715330385.373506:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 75 00000100:00100000:2.0:1715330385.373513:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+8:2012:x1798653938128640:12345-192.168.204.49@tcp:4:dd.0 00000100:00080000:2.0:1715330385.376232:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330355 00000100:00100000:0.0:1715330385.417451:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+10:2012:x1798653938128640:12345-192.168.204.49@tcp:4:dd.0 Request processed in 43927us (44125us total) trans 4294970009 rc 0/0 00000100:00100000:0.0:1715330385.417463:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 75 00002000:00100000:0.0:1715330385.417474:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (4194304->8388607) req@ffff880091d54e00 x1798653938128640/t4294970009(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:596/0 lens 488/448 e 0 to 0 dl 1715330396 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330385.417484:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d54e00 with x1798653938128640 ext(4194304->8388607) 00002000:00010000:0.0:1715330385.417489:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091d54e00 00010000:00010000:2.0:1715330385.422225:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330385.458887:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942533824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1715330385.458939:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330385.458997:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942533824 00000100:00100000:1.0:1715330385.459004:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942533824 00000100:00080000:3.0:1715330385.459042:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330355 00000100:00100000:1.0:1715330385.459052:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1715330385.459058:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b318e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942533824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1715330385.459082:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1715330385.459829:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b318e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942533824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 770us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330385.459836:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1715330385.459896:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942533824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1715330385.477165:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942533888:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1715330385.477231:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330385.477362:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942533888 00000100:00100000:1.0:1715330385.477372:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942533888 00000100:00100000:1.0:1715330385.477453:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1715330385.477461:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942533888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1715330385.477501:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1715330385.477549:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942533888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330385.477558:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00080000:2.0:1715330385.477634:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330355 00000100:00100000:0.0:1715330385.477698:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942533888:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1715330386.408156:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330386.409104:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938128768 00000100:00100000:2.0:1715330386.409114:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938128768 00002000:00100000:2.0:1715330386.409156:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (8388608->12582911) req@ffff88008b0c2680 x1798653938128768/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:597/0 lens 488/0 e 0 to 0 dl 1715330397 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330386.409165:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b0c2680 with x1798653938128768 ext(8388608->12582911) 00002000:00010000:2.0:1715330386.409169:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b0c2680 00000100:00100000:2.0:1715330386.409207:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 76 00000100:00100000:2.0:1715330386.409213:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+10:2013:x1798653938128768:12345-192.168.204.49@tcp:4:dd.0 00010000:00010000:2.0:1715330386.423981:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330386.490651:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+12:2013:x1798653938128768:12345-192.168.204.49@tcp:4:dd.0 Request processed in 81427us (82492us total) trans 4294970010 rc 0/0 00000100:00100000:0.0:1715330386.490663:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 76 00002000:00100000:0.0:1715330386.490675:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (8388608->12582911) req@ffff88008b0c2680 x1798653938128768/t4294970010(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:597/0 lens 488/448 e 0 to 0 dl 1715330397 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330386.490684:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b0c2680 with x1798653938128768 ext(8388608->12582911) 00002000:00010000:0.0:1715330386.490689:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b0c2680 00000100:00100000:1.0:1715330386.711851:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3690:1798653942533952:0@lo:400:kworker.0 00000100:00100000:1.0:1715330386.712145:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330386.712373:0:7129:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942533952 00000100:00100000:0.0:1715330386.712380:0:7129:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942533952 00000100:00100000:0.0:1715330386.712430:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1715330386.712437:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4af1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3690:x1798653942533952:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1715330386.713031:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330356 00000100:00100000:2.0:1715330386.713049:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3691:1798653942534016:0@lo:400:kworker.0 00000100:00100000:2.0:1715330386.713077:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330386.713166:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942534016 00000100:00100000:2.0:1715330386.713174:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942534016 00000100:00100000:2.0:1715330386.713202:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1715330386.713210:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3691:x1798653942534016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330386.713244:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3691:x1798653942534016:12345-0@lo:400:kworker.0 Request processed in 36us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330386.713249:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1715330386.713536:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3691:1798653942534016:0@lo:400:kworker.0 00000100:00100000:0.0:1715330386.714365:0:7129:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4af1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3690:x1798653942533952:12345-0@lo:400:kworker.0 Request processed in 1926us (2218us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330386.714366:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3690:1798653942533952:0@lo:400:kworker.0 00000100:00100000:0.0:1715330386.714372:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1715330386.715343:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942534080:0@lo:400:kworker.0 00000100:00100000:2.0:1715330386.715380:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330386.715984:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942534080 00000100:00100000:1.0:1715330386.715991:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942534080 00000100:00100000:1.0:1715330386.716021:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3102 00000100:00100000:1.0:1715330386.716027:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942534080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330386.716074:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942534080:12345-0@lo:400:kworker.0 Request processed in 46us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330386.716080:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3102 00000100:00100000:2.0:1715330386.716239:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942534080:0@lo:400:kworker.0 00000100:00100000:2.0:1715330386.716252:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1715330386.716257:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3688:1798653942534144:0@lo:400:kworker.0 00000100:00100000:2.0:1715330386.716278:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330386.716296:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942534144 00000100:00100000:2.0:1715330386.716298:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942534144 00000100:00100000:2.0:1715330386.716316:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1715330386.716320:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3688:x1798653942534144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330386.716344:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3688:x1798653942534144:12345-0@lo:400:kworker.0 Request processed in 24us (66us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330386.716350:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1715330386.716371:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3688:1798653942534144:0@lo:400:kworker.0 00000100:00100000:3.0:1715330386.716550:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3691:1798653942534272:0@lo:400:kworker.0 00000100:00100000:3.0:1715330386.716573:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330386.716585:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3691:1798653942534528:0@lo:400:kworker.0 00000100:00100000:3.0:1715330386.716599:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330386.716610:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1715330386.716614:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942534208:0@lo:400:kworker.0 00000100:00100000:3.0:1715330386.716631:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330386.716639:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942534464:0@lo:400:kworker.0 00000100:00100000:3.0:1715330386.716656:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330386.716665:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942534720:0@lo:400:kworker.0 00000100:00100000:3.0:1715330386.716680:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330386.716694:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942534272 00000100:00100000:3.0:1715330386.716697:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942534272 00000100:00100000:3.0:1715330386.716716:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942534528 00000100:00100000:3.0:1715330386.716718:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942534528 00000100:00100000:3.0:1715330386.716761:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1715330386.716765:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3691:x1798653942534272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330386.716789:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3691:x1798653942534272:12345-0@lo:400:kworker.0 Request processed in 24us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330386.716794:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1715330386.716802:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1715330386.716805:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3691:x1798653942534528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330386.716819:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3691:x1798653942534528:12345-0@lo:400:kworker.0 Request processed in 14us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330386.716824:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1715330386.716843:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3691:1798653942534272:0@lo:400:kworker.0 00000100:00100000:3.0:1715330386.716849:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3691:1798653942534528:0@lo:400:kworker.0 00000100:00080000:3.0:1715330386.716861:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330356 00000100:00100000:3.0:1715330386.716875:0:9398:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942534464 00000100:00100000:3.0:1715330386.716877:0:9398:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942534464 00000100:00100000:3.0:1715330386.716889:0:9398:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942534720 00000100:00100000:3.0:1715330386.716890:0:9398:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942534720 00000100:00100000:3.0:1715330386.716900:0:9398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1715330386.716903:0:9398:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942534464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330386.716922:0:9398:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942534464:12345-0@lo:400:kworker.0 Request processed in 18us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330386.716928:0:9398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1715330386.716934:0:9398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1715330386.716937:0:9398:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942534720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330386.716949:0:9398:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942534720:12345-0@lo:400:kworker.0 Request processed in 12us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330386.716953:0:9398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1715330386.716966:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942534464:0@lo:400:kworker.0 00000100:00100000:3.0:1715330386.716972:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942534720:0@lo:400:kworker.0 00000100:00080000:3.0:1715330386.716980:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330356 00000100:00100000:2.0:1715330386.717036:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3688:1798653942534336:0@lo:400:kworker.0 00000100:00100000:2.0:1715330386.717052:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330386.717060:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3688:1798653942534592:0@lo:400:kworker.0 00000100:00100000:2.0:1715330386.717069:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330386.717076:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1715330386.717079:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942534400:0@lo:400:kworker.0 00000100:00100000:2.0:1715330386.717091:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330386.717097:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942534656:0@lo:400:kworker.0 00000100:00100000:2.0:1715330386.717110:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330386.717123:0:17198:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942534400 00000100:00100000:2.0:1715330386.717126:0:17198:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942534400 00000100:00100000:2.0:1715330386.717138:0:17198:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942534656 00000100:00100000:2.0:1715330386.717139:0:17198:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942534656 00000100:00100000:2.0:1715330386.717150:0:17198:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1715330386.717154:0:17198:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942534400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330386.717176:0:17198:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942534400:12345-0@lo:400:kworker.0 Request processed in 22us (84us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330386.717182:0:17198:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1715330386.717190:0:17198:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1715330386.717193:0:17198:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942534656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330386.717212:0:17198:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942534656:12345-0@lo:400:kworker.0 Request processed in 18us (101us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330386.717216:0:17198:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1715330386.717235:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942534400:0@lo:400:kworker.0 00000100:00100000:2.0:1715330386.717242:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942534656:0@lo:400:kworker.0 00000100:00100000:2.0:1715330386.717278:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942534336 00000100:00100000:2.0:1715330386.717281:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942534336 00000100:00100000:2.0:1715330386.717294:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942534592 00000100:00100000:0.0:1715330386.721069:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942534208 00000100:00100000:0.0:1715330386.721082:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942534208 00000100:00100000:0.0:1715330386.721136:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3103 00000100:00100000:0.0:1715330386.721144:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942534208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330386.721222:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942534208:12345-0@lo:400:kworker.0 Request processed in 78us (4590us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330386.721228:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3103 00000100:00100000:0.0:1715330386.721266:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942534208:0@lo:400:kworker.0 00000100:00100000:3.0:1715330386.721662:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1715330386.721668:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3688:x1798653942534336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330386.721717:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3688:x1798653942534336:12345-0@lo:400:kworker.0 Request processed in 48us (4662us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330386.721722:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00080000:3.0:1715330386.721769:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330356 00000100:00080000:3.0:1715330386.721773:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330356 00000100:00100000:2.0:1715330386.722129:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942534592 00000100:00100000:2.0:1715330386.722155:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1715330386.722159:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3688:x1798653942534592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330386.722189:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3688:x1798653942534592:12345-0@lo:400:kworker.0 Request processed in 29us (5118us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330386.722193:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:0.0:1715330386.722268:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3688:1798653942534336:0@lo:400:kworker.0 00000100:00100000:0.0:1715330386.722278:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3688:1798653942534592:0@lo:400:kworker.0 00000100:00080000:3.0:1715330386.722422:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330356 00000100:00100000:2.0:1715330386.739000:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1715330386.739016:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942534848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1715330386.739017:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942534784:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1715330386.739066:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330386.739091:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330386.739105:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942534784 00000100:00100000:3.0:1715330386.739111:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942534784 00000100:00100000:2.0:1715330386.739117:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942534848 00000100:00100000:2.0:1715330386.739120:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942534848 00000100:00100000:3.0:1715330386.739325:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1715330386.739332:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942534784:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1715330386.739332:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1715330386.739337:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942534848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1715330386.739358:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 180224 granted 297010880 pending 12656640 free 3910963200 avail 3679440896 00002000:00000024:2.0:1715330386.739358:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 180224 granted 297010880 pending 12656640 free 3910963200 avail 3679440896 00000100:00100000:3.0:1715330386.739389:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942534784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330386.739392:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942534848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330386.739395:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1715330386.739398:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1715330386.739424:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942534784:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1715330386.739424:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942534848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1715330387.341009:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330387.341143:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938128896 00000100:00100000:2.0:1715330387.341151:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938128896 00002000:00100000:2.0:1715330387.341200:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (12582912->16777215) req@ffff88008b0c0e00 x1798653938128896/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:598/0 lens 488/0 e 0 to 0 dl 1715330398 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330387.341215:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b0c0e00 with x1798653938128896 ext(12582912->16777215) 00002000:00010000:2.0:1715330387.341219:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b0c0e00 00000100:00100000:2.0:1715330387.341289:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 77 00000100:00100000:2.0:1715330387.341295:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+12:2011:x1798653938128896:12345-192.168.204.49@tcp:4:dd.0 00000100:00080000:3.0:1715330387.343931:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330357 00010000:00010000:3.0:1715330387.425960:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330387.426183:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+14:2011:x1798653938128896:12345-192.168.204.49@tcp:4:dd.0 Request processed in 84881us (85174us total) trans 4294970011 rc 0/0 00000100:00100000:2.0:1715330387.426194:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 77 00002000:00100000:2.0:1715330387.426205:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (12582912->16777215) req@ffff88008b0c0e00 x1798653938128896/t4294970011(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:598/0 lens 488/448 e 0 to 0 dl 1715330398 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330387.426213:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b0c0e00 with x1798653938128896 ext(12582912->16777215) 00002000:00010000:2.0:1715330387.426218:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b0c0e00 00000100:00100000:0.0:1715330387.971698:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330387.973599:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938129024 00000100:00100000:3.0:1715330387.973612:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938129024 00000100:00080000:0.0:1715330387.973677:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330357 00000100:00100000:3.0:1715330387.973684:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5218 00000100:00100000:3.0:1715330387.973691:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007acb2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+20:20964:x1798653938129024:12345-192.168.204.49@tcp:35:dd.0 00000001:00080000:3.0:1715330387.973897:0:15159:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294984109 00000100:00100000:3.0:1715330387.973978:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007acb2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+22:20964:x1798653938129024:12345-192.168.204.49@tcp:35:dd.0 Request processed in 287us (2292us total) trans 4294984110 rc 0/0 00000100:00100000:3.0:1715330387.973985:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5218 00000020:00080000:3.0:1715330387.973989:0:15159:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:2.0:1715330387.978117:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984110 is committed 00010000:00010000:3.0:1715330387.978183:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66dbd51 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330387.978196:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66dbd51 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330387.978203:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66dbd51 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330387.978209:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b4900 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330387.978214:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66dbd51 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330387.978220:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66dbd51 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330387.978240:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff88008b0d2c00) 00010000:00010000:3.0:1715330387.978243:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330387.978246:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66dbd51 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00010000:00010000:3.0:1715330387.978251:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66dbd51 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7133 initiator: MDT0 00000100:00100000:0.0:1715330388.147059:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1715330388.147084:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942534912:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1715330388.147151:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330388.147301:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942534912 00000100:00100000:1.0:1715330388.147310:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942534912 00000100:00100000:1.0:1715330388.147353:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3104 00000100:00100000:1.0:1715330388.147360:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942534912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1715330388.147396:0:19960:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444089856 avail 1314627584 00000100:00100000:1.0:1715330388.147444:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942534912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330388.147451:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3104 00000100:00100000:2.0:1715330388.147545:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091c3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942534912:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1715330388.153316:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330388.153649:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938129088 00000100:00100000:2.0:1715330388.153657:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938129088 00002000:00100000:2.0:1715330388.153688:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (16777216->19243007) req@ffff88008b0c3b80 x1798653938129088/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:599/0 lens 488/0 e 0 to 0 dl 1715330399 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330388.153697:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b0c3b80 with x1798653938129088 ext(16777216->19243007) 00002000:00010000:2.0:1715330388.153702:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b0c3b80 00000100:00100000:2.0:1715330388.154194:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 78 00000100:00100000:2.0:1715330388.154201:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+14:2014:x1798653938129088:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330388.195871:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+16:2014:x1798653938129088:12345-192.168.204.49@tcp:4:dd.0 Request processed in 41661us (42556us total) trans 4294970012 rc 0/0 00000100:00100000:0.0:1715330388.195882:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 78 00002000:00100000:0.0:1715330388.195892:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (16777216->19243007) req@ffff88008b0c3b80 x1798653938129088/t4294970012(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:599/0 lens 488/448 e 0 to 0 dl 1715330399 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330388.195900:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b0c3b80 with x1798653938129088 ext(16777216->19243007) 00002000:00010000:0.0:1715330388.195905:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b0c3b80 00000100:00100000:0.0:1715330388.243465:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330388.243510:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330388.243558:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330388.243588:0:17197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938129280 00000100:00100000:0.0:1715330388.243596:0:17197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938129280 00000100:00100000:0.0:1715330388.243652:0:17197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 282 00000100:00100000:0.0:1715330388.243659:0:17197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:72de1896-1df4-4b3a-930a-9116d2c66168+6:2011:x1798653938129280:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:0.0:1715330388.243721:0:17197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:72de1896-1df4-4b3a-930a-9116d2c66168+6:2011:x1798653938129280:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 61us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330388.243727:0:17197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 282 00000100:00100000:2.0:1715330388.243979:0:7129:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938129152 00000100:00100000:2.0:1715330388.243984:0:7129:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938129152 00000100:00100000:2.0:1715330388.244009:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 369 00000100:00100000:2.0:1715330388.244013:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a9253050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2011:x1798653938129152:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:2.0:1715330388.244041:0:7129:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a9253050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2011:x1798653938129152:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 27us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330388.244046:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 369 00000100:00100000:3.0:1715330388.244166:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938129216 00000100:00100000:3.0:1715330388.244169:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938129216 00000100:00100000:3.0:1715330388.244204:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 398 00000100:00100000:3.0:1715330388.244208:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+6:2012:x1798653938129216:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:3.0:1715330388.244235:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+6:2012:x1798653938129216:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 27us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330388.244240:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 398 00000100:00080000:1.0:1715330388.244311:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330358 00000100:00080000:1.0:1715330388.244315:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330358 00000100:00080000:1.0:1715330388.244317:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330358 00010000:00010000:1.0:1715330388.427360:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330388.992815:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330388.993130:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938129344 00000100:00100000:2.0:1715330388.993142:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938129344 00000100:00100000:2.0:1715330388.993211:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23838 00000100:00100000:2.0:1715330388.993219:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+16:20971:x1798653938129344:12345-192.168.204.49@tcp:101:dd.0 00010000:00010000:2.0:1715330388.993247:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330388.993275:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4fc0/0xd895711d66dbd58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbeff expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330388.993346:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4000/0xd895711d66dbd5f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330388.993360:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4000/0xd895711d66dbd5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330388.993372:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4000/0xd895711d66dbd5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00200000:2.0:1715330388.993428:0:11283:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 270336 00000004:00200000:2.0:1715330388.993432:0:11283:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1715330388.993451:0:11283:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4000/0xd895711d66dbd5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330388.993472:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4fc0/0xd895711d66dbd58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbeff expref: 18 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330388.993510:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4000/0xd895711d66dbd5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbeff expref: 17 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330388.993518:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:2.0:1715330388.993521:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1715330388.993524:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938b4000, rc 0) 00000100:00100000:2.0:1715330388.993582:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+17:20971:x1798653938129344:12345-192.168.204.49@tcp:101:dd.0 Request processed in 363us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330388.993588:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23838 00000100:00100000:0.0:1715330388.997205:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330388.997710:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938129472 00000100:00100000:3.0:1715330388.997721:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938129472 00000100:00100000:3.0:1715330388.997949:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23839 00000100:00100000:3.0:1715330388.997958:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+17:20971:x1798653938129472:12345-192.168.204.49@tcp:101:dd.0 00010000:00010000:3.0:1715330388.997979:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330388.997983:0:9622:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1715330388.998012:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4000/0xd895711d66dbd5f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbeff expref: 17 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330388.998046:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:3.0:1715330388.998051:0:9622:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330388.998066:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83180/0xd895711d66dbd66 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbf06 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330388.998188:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80240/0xd895711d66dbd6d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330388.998199:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80240/0xd895711d66dbd6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330388.998206:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80240/0xd895711d66dbd6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330388.998218:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83600/0xd895711d66dbd74 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330388.998223:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83600/0xd895711d66dbd74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330388.998228:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83600/0xd895711d66dbd74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330388.998275:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80480/0xd895711d66dbd7b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330388.998283:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80480/0xd895711d66dbd7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330388.998288:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80480/0xd895711d66dbd7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00000004:00200000:3.0:1715330388.998296:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1591:0x0]: returning size 19243008 00010000:00010000:3.0:1715330388.998379:0:9622:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80240/0xd895711d66dbd6d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330388.998385:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80240/0xd895711d66dbd6d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330388.998394:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80240/0xd895711d66dbd6d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330388.998399:0:9622:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80240/0xd895711d66dbd6d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330388.998404:0:9622:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da80240 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330388.998408:0:9622:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80240/0xd895711d66dbd6d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330388.998415:0:9622:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80240/0xd895711d66dbd6d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330388.998422:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:3.0:1715330388.998425:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330388.998428:0:9622:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80240/0xd895711d66dbd6d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330388.998433:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80240/0xd895711d66dbd6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330388.998442:0:9622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83600/0xd895711d66dbd74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330388.998446:0:9622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83600/0xd895711d66dbd74 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330388.998450:0:9622:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83600/0xd895711d66dbd74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330388.998455:0:9622:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da83600 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330388.998457:0:9622:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83600/0xd895711d66dbd74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330388.998465:0:9622:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83600/0xd895711d66dbd74 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330388.998471:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x333666 (ffff880091ea7c00) 00010000:00010000:3.0:1715330388.998473:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330388.998475:0:9622:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83600/0xd895711d66dbd74 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330388.998479:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83600/0xd895711d66dbd74 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330388.998511:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83180/0xd895711d66dbd66 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf06 expref: 19 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330388.998522:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80480/0xd895711d66dbd7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf06 expref: 18 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330388.998529:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff88008b0d2c00) 00010000:00010000:3.0:1715330388.998530:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330388.998533:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011da80480, rc 0) 00000100:00100000:3.0:1715330388.998712:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+18:20971:x1798653938129472:12345-192.168.204.49@tcp:101:dd.0 Request processed in 753us (1518us total) trans 4294984111 rc 0/0 00000100:00100000:3.0:1715330388.998720:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23839 00000100:00100000:0.0:1715330389.008190:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330389.010405:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938129600 00000100:00100000:3.0:1715330389.010422:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938129600 00000100:00100000:3.0:1715330389.010525:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23840 00000100:00100000:3.0:1715330389.010532:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+18:20971:x1798653938129600:12345-192.168.204.49@tcp:36:dd.0 00010000:00010000:3.0:1715330389.010602:0:9622:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330389.010631:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80480/0xd895711d66dbd7b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf06 expref: 18 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330389.010666:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff88008b0d2c00) 00010000:00010000:3.0:1715330389.010671:0:9622:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330389.010897:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da833c0/0xd895711d66dbd89 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330389.010914:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da833c0/0xd895711d66dbd89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330389.010922:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da833c0/0xd895711d66dbd89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00000001:00080000:3.0:1715330389.010961:0:9622:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294984112 00000004:00010000:3.0:1715330389.010978:0:9622:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008b0c1f80 reply state ffff88012b0a5000 transno 4294984113 ns: mdt-lustre-MDT0000_UUID lock: ffff88011da833c0/0xd895711d66dbd89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330389.010986:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da833c0/0xd895711d66dbd89 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330389.010991:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff88008b0d2c00) 00010000:00010000:3.0:1715330389.010995:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330389.010998:0:9622:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1715330389.011106:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+20:20971:x1798653938129600:12345-192.168.204.49@tcp:36:dd.0 Request processed in 572us (2926us total) trans 4294984113 rc 0/0 00000100:00100000:3.0:1715330389.011112:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23840 00000020:00080000:3.0:1715330389.011118:0:9622:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:1.0:1715330389.013919:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330359 00000100:00100000:0.0:1715330389.023666:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330389.023775:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938129664 00000100:00100000:2.0:1715330389.023786:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938129664 00000100:00080000:1.0:1715330389.023958:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330359 00002000:00010000:2.0:1715330389.024024:0:27574:0:(ofd_dev.c:2731:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/2560 (0->18446744073709551615) 00002000:00100000:2.0:1715330389.024029:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b0c0000 with x1798653938129664 ext(0->18446744073709551615) 00002000:00010000:2.0:1715330389.024041:0:27574:0:(ofd_dev.c:2736:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b0c0000. 00000100:00100000:2.0:1715330389.024072:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 79 00000100:00100000:2.0:1715330389.024081:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+16:2012:x1798653938129664:12345-192.168.204.49@tcp:10:dd.0 00002000:00010000:2.0:1715330389.044078:0:27574:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1715330389.044085:0:27574:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb mtime from disk: 1715330383 -> 1715330389 00002000:00010000:2.0:1715330389.044088:0:27574:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1715330389.044089:0:27574:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb ctime from disk: 1715330383 -> 1715330389 00002000:00010000:2.0:1715330389.044092:0:27574:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1715330389.044192:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+17:2012:x1798653938129664:12345-192.168.204.49@tcp:10:dd.0 Request processed in 20105us (20530us total) trans 4294970013 rc 0/0 00000100:00100000:2.0:1715330389.044204:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 79 00002000:00010000:2.0:1715330389.044210:0:27574:0:(ofd_dev.c:2731:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/2560 (0->18446744073709551615) 00002000:00100000:2.0:1715330389.044215:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b0c0000 with x1798653938129664 ext(0->18446744073709551615) 00002000:00010000:2.0:1715330389.044222:0:27574:0:(ofd_dev.c:2736:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b0c0000. 00010000:00010000:2.0:1715330389.428931:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330389.603365:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942534976:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1715330389.603437:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330389.604344:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942534976 00000100:00100000:0.0:1715330389.604356:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942534976 00000100:00100000:0.0:1715330389.604416:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3105 00000100:00100000:0.0:1715330389.604424:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942534976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1715330389.604469:0:8592:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445060608 avail 1315598336 00000100:00100000:0.0:1715330389.604526:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942534976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (1088us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330389.604533:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3105 00000100:00100000:2.0:1715330389.604989:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091c3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942534976:0@lo:41:osp-pre-1-0.0 00000001:00080000:0.0:1715330390.252045:0:10666:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4294970013 is committed 00010000:00010000:2.0:1715330390.431067:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330390.470085:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942535040:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1715330390.471567:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330390.472447:0:9401:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942535040 00000100:00100000:1.0:1715330390.472457:0:9401:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942535040 00000100:00080000:2.0:1715330390.472644:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330360 00000100:00100000:1.0:1715330390.472824:0:9401:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1715330390.472833:0:9401:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942535040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1715330390.472874:0:9401:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1715330390.472945:0:9401:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942535040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (1382us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330390.472952:0:9401:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1715330390.474541:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942535040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1715330390.487771:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1715330390.487808:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d55f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942535104:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1715330390.487897:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330390.488076:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942535104 00000100:00100000:0.0:1715330390.488084:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942535104 00000100:00100000:0.0:1715330390.489404:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1715330390.489413:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942535104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1715330390.489447:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1715330390.489526:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942535104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (1629us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330390.489534:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00080000:2.0:1715330390.490642:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330360 00000100:00100000:3.0:1715330390.491926:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d55f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942535104:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1715330390.615659:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330390.616101:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938129792 00000100:00100000:2.0:1715330390.616112:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938129792 00002000:00100000:2.0:1715330390.616160:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (0->4194303) req@ffff88008d55d500 x1798653938129792/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:601/0 lens 488/0 e 0 to 0 dl 1715330401 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330390.616169:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d55d500 with x1798653938129792 ext(0->4194303) 00002000:00010000:2.0:1715330390.616175:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d55d500 00000100:00100000:2.0:1715330390.616212:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 80 00000100:00100000:2.0:1715330390.616219:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d55d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+6:2011:x1798653938129792:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330390.727810:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d55d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+8:2011:x1798653938129792:12345-192.168.204.49@tcp:4:dd.0 Request processed in 111571us (112144us total) trans 4294970014 rc 0/0 00000100:00100000:2.0:1715330390.727826:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 80 00002000:00100000:2.0:1715330390.727840:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (0->4194303) req@ffff88008d55d500 x1798653938129792/t4294970014(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:601/0 lens 488/448 e 0 to 0 dl 1715330401 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330390.727851:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d55d500 with x1798653938129792 ext(0->4194303) 00002000:00010000:2.0:1715330390.727858:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d55d500 00010000:00010000:3.0:1715330391.433755:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330391.690940:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330391.692092:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938129920 00000100:00100000:2.0:1715330391.692101:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938129920 00002000:00100000:2.0:1715330391.692158:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (4194304->8388607) req@ffff88008d55ca80 x1798653938129920/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:602/0 lens 488/0 e 0 to 0 dl 1715330402 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330391.692168:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d55ca80 with x1798653938129920 ext(4194304->8388607) 00002000:00010000:2.0:1715330391.692173:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d55ca80 00000100:00100000:2.0:1715330391.692204:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 81 00000100:00100000:2.0:1715330391.692210:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d55ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+8:2012:x1798653938129920:12345-192.168.204.49@tcp:4:dd.0 00000100:00080000:0.0:1715330391.696436:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330361 00000100:00100000:3.0:1715330391.731212:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3690:1798653942535232:0@lo:400:kworker.0 00000100:00100000:3.0:1715330391.731285:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330391.731307:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3690:1798653942535488:0@lo:400:kworker.0 00000100:00100000:3.0:1715330391.731323:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330391.731332:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3690:1798653942535744:0@lo:400:kworker.0 00000100:00100000:3.0:1715330391.731346:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330391.731366:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1715330391.731371:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942535296:0@lo:400:kworker.0 00000100:00100000:3.0:1715330391.731390:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330391.731400:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3690:1798653942535552:0@lo:400:kworker.0 00000100:00100000:3.0:1715330391.731413:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330391.731421:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f578a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3690:1798653942535808:0@lo:400:kworker.0 00000100:00100000:3.0:1715330391.731434:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330391.731457:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942535232 00000100:00100000:3.0:1715330391.731464:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942535232 00000100:00100000:3.0:1715330391.731496:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942535488 00000100:00100000:3.0:1715330391.731498:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942535488 00000100:00100000:3.0:1715330391.731521:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942535744 00000100:00100000:3.0:1715330391.731523:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942535744 00000100:00100000:3.0:1715330391.731529:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942535552 00000100:00100000:3.0:1715330391.731531:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942535552 00000100:00100000:3.0:1715330391.731539:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942535808 00000100:00100000:3.0:1715330391.731541:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942535808 00000100:00100000:3.0:1715330391.731551:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1715330391.731557:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3690:x1798653942535232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330391.731598:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3690:x1798653942535232:12345-0@lo:400:kworker.0 Request processed in 41us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330391.731606:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1715330391.731622:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1715330391.731625:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3690:x1798653942535488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330391.731654:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3690:x1798653942535488:12345-0@lo:400:kworker.0 Request processed in 28us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330391.731659:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1715330391.731667:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:3.0:1715330391.731671:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3690:x1798653942535744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330391.731688:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3690:x1798653942535744:12345-0@lo:400:kworker.0 Request processed in 17us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330391.731693:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:3.0:1715330391.731699:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:3.0:1715330391.731702:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3690:x1798653942535552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330391.731717:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3690:x1798653942535552:12345-0@lo:400:kworker.0 Request processed in 14us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330391.731721:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00080000:0.0:1715330391.733372:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330361 00000100:00080000:0.0:1715330391.733378:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330361 00000100:00100000:3.0:1715330391.733479:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:3.0:1715330391.733495:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3690:x1798653942535808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330391.733539:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3690:x1798653942535808:12345-0@lo:400:kworker.0 Request processed in 50us (2104us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330391.733546:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:3.0:1715330391.733603:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3690:1798653942535552:0@lo:400:kworker.0 00000100:00100000:3.0:1715330391.733613:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f578a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3690:1798653942535808:0@lo:400:kworker.0 00000100:00100000:3.0:1715330391.733625:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3690:1798653942535232:0@lo:400:kworker.0 00000100:00100000:3.0:1715330391.733634:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3690:1798653942535488:0@lo:400:kworker.0 00000100:00100000:3.0:1715330391.733655:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3690:1798653942535744:0@lo:400:kworker.0 00000100:00100000:3.0:1715330391.733711:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3688:1798653942535360:0@lo:400:kworker.0 00000100:00100000:3.0:1715330391.733866:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330391.733879:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942535616:0@lo:400:kworker.0 00000100:00100000:3.0:1715330391.733898:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330391.733917:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942535872:0@lo:400:kworker.0 00000100:00100000:3.0:1715330391.733930:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330391.733932:0:9398:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942535616 00000100:00100000:0.0:1715330391.733938:0:9398:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942535616 00000100:00100000:3.0:1715330391.733945:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1715330391.733950:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3688:1798653942535168:0@lo:400:kworker.0 00000100:00100000:0.0:1715330391.733965:0:9398:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942535872 00000100:00100000:0.0:1715330391.733967:0:9398:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942535872 00000100:00100000:3.0:1715330391.733969:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330391.733978:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942535424:0@lo:400:kworker.0 00000100:00100000:0.0:1715330391.733984:0:9398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1715330391.733988:0:9398:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942535616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330391.733993:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330391.734003:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942535680:0@lo:400:kworker.0 00000100:00100000:3.0:1715330391.734016:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330391.734019:0:9398:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942535616:12345-0@lo:400:kworker.0 Request processed in 30us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330391.734025:0:9398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1715330391.734026:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942535936:0@lo:400:kworker.0 00000100:00100000:0.0:1715330391.734034:0:9398:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942535680 00000100:00100000:0.0:1715330391.734036:0:9398:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942535680 00000100:00100000:3.0:1715330391.734037:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330391.734048:0:9398:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942535936 00000100:00100000:0.0:1715330391.734049:0:9398:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942535936 00000100:00100000:3.0:1715330391.734051:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942535616:0@lo:400:kworker.0 00000100:00100000:0.0:1715330391.734060:0:9398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1715330391.734063:0:9398:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f578a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942535872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330391.734066:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942535360 00000100:00100000:3.0:1715330391.734069:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942535360 00000100:00100000:3.0:1715330391.734084:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:0.0:1715330391.734086:0:9398:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f578a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942535872:12345-0@lo:400:kworker.0 Request processed in 22us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330391.734087:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3688:x1798653942535360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330391.734091:0:9398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1715330391.734098:0:9398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1715330391.734101:0:9398:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942535680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330391.734109:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3688:x1798653942535360:12345-0@lo:400:kworker.0 Request processed in 21us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330391.734114:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:0.0:1715330391.734119:0:9398:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942535680:12345-0@lo:400:kworker.0 Request processed in 17us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330391.734123:0:9398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1715330391.734126:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942535296 00000100:00100000:3.0:1715330391.734128:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942535296 00000100:00100000:0.0:1715330391.734130:0:9398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1715330391.734132:0:9398:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942535936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330391.734143:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942535424 00000100:00100000:3.0:1715330391.734144:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942535424 00000100:00100000:0.0:1715330391.734148:0:9398:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942535936:12345-0@lo:400:kworker.0 Request processed in 15us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330391.734152:0:9398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1715330391.734154:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3106 00000100:00100000:3.0:1715330391.734157:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942535296:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1715330391.734171:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330361 00000100:00100000:3.0:1715330391.734182:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942535296:12345-0@lo:400:kworker.0 Request processed in 25us (2791us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330391.734188:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3106 00000100:00100000:3.0:1715330391.734197:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3107 00000100:00100000:3.0:1715330391.734200:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942535424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330391.734218:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942535424:12345-0@lo:400:kworker.0 Request processed in 17us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330391.734222:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3107 00000100:00100000:3.0:1715330391.734248:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942535296:0@lo:400:kworker.0 00000100:00100000:3.0:1715330391.734262:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942535424:0@lo:400:kworker.0 00000100:00100000:3.0:1715330391.734269:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942535680:0@lo:400:kworker.0 00000100:00100000:3.0:1715330391.734276:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942535936:0@lo:400:kworker.0 00000100:00100000:3.0:1715330391.734282:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3688:1798653942535360:0@lo:400:kworker.0 00000100:00100000:3.0:1715330391.734289:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942535872:0@lo:400:kworker.0 00000100:00100000:3.0:1715330391.734315:0:7130:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942535168 00000100:00100000:3.0:1715330391.734317:0:7130:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942535168 00000100:00080000:0.0:1715330391.734335:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330361 00000100:00100000:3.0:1715330391.734343:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1715330391.734347:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a9253850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3688:x1798653942535168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330391.734371:0:7130:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a9253850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3688:x1798653942535168:12345-0@lo:400:kworker.0 Request processed in 23us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330391.734376:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1715330391.734397:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3688:1798653942535168:0@lo:400:kworker.0 00000100:00100000:0.0:1715330391.746885:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942536000:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1715330391.746962:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330391.747013:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1715330391.747020:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942536064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1715330391.747042:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330391.747143:0:9401:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942536000 00000100:00100000:2.0:1715330391.747152:0:9401:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942536000 00000100:00100000:2.0:1715330391.747198:0:9401:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942536064 00000100:00100000:2.0:1715330391.747201:0:9401:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942536064 00000100:00100000:2.0:1715330391.747219:0:9401:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1715330391.747226:0:9401:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d55f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942536000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1715330391.747253:0:9401:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 172032 granted 311396032 pending 8437760 free 3923546112 avail 3692023808 00000100:00100000:2.0:1715330391.747291:0:9401:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d55f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942536000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330391.747297:0:9401:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1715330391.747312:0:9401:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1715330391.747314:0:9401:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942536064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1715330391.747321:0:9401:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 172032 granted 311396032 pending 8437760 free 3923546112 avail 3692023808 00000100:00100000:2.0:1715330391.747332:0:9401:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942536064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 17us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330391.747337:0:9401:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1715330391.747362:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942536064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1715330391.747373:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942536000:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1715330391.792549:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d55ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+10:2012:x1798653938129920:12345-192.168.204.49@tcp:4:dd.0 Request processed in 100323us (101602us total) trans 4294970015 rc 0/0 00000100:00100000:2.0:1715330391.792566:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 81 00002000:00100000:2.0:1715330391.792582:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (4194304->8388607) req@ffff88008d55ca80 x1798653938129920/t4294970015(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:602/0 lens 488/448 e 0 to 0 dl 1715330402 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330391.792592:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d55ca80 with x1798653938129920 ext(4194304->8388607) 00002000:00010000:2.0:1715330391.792598:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008d55ca80 00010000:00010000:1.0:1715330392.435020:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330392.913540:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330392.913995:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938130048 00000100:00100000:2.0:1715330392.914004:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938130048 00002000:00100000:2.0:1715330392.914039:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (8388608->12582911) req@ffff88009ba64a80 x1798653938130048/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:603/0 lens 488/0 e 0 to 0 dl 1715330403 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330392.914047:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba64a80 with x1798653938130048 ext(8388608->12582911) 00002000:00010000:2.0:1715330392.914053:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba64a80 00000100:00100000:2.0:1715330392.914083:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 82 00000100:00100000:2.0:1715330392.914088:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+10:2013:x1798653938130048:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330393.062225:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+12:2013:x1798653938130048:12345-192.168.204.49@tcp:4:dd.0 Request processed in 148125us (148681us total) trans 4294970016 rc 0/0 00000100:00100000:2.0:1715330393.062239:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 82 00002000:00100000:2.0:1715330393.062262:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (8388608->12582911) req@ffff88009ba64a80 x1798653938130048/t4294970016(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:603/0 lens 488/448 e 0 to 0 dl 1715330403 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330393.062270:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba64a80 with x1798653938130048 ext(8388608->12582911) 00002000:00010000:2.0:1715330393.062276:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba64a80 00000100:00100000:3.0:1715330393.157628:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942536128:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1715330393.157683:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330393.157728:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942536128 00000100:00100000:3.0:1715330393.157747:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942536128 00000100:00100000:3.0:1715330393.157779:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3108 00000100:00100000:3.0:1715330393.157784:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942536128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1715330393.157814:0:19960:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444089856 avail 1314627584 00000100:00100000:3.0:1715330393.157846:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942536128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330393.157852:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3108 00000100:00100000:3.0:1715330393.157888:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942536128:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1715330393.250231:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330393.250267:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330393.250295:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330393.250322:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330393.250355:0:7129:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938130176 00000100:00100000:0.0:1715330393.250361:0:7129:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938130176 00000100:00100000:0.0:1715330393.250410:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 371 00000100:00100000:0.0:1715330393.250415:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a9253450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2011:x1798653938130176:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:0.0:1715330393.250460:0:7129:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a9253450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2011:x1798653938130176:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 45us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330393.250465:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 371 00000100:00100000:0.0:1715330393.250487:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938130240 00000100:00100000:0.0:1715330393.250489:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938130240 00000100:00100000:0.0:1715330393.250504:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938130304 00000100:00100000:0.0:1715330393.250505:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938130304 00000100:00100000:0.0:1715330393.250516:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 405 00000100:00100000:0.0:1715330393.250519:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+20:2011:x1798653938130240:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:0.0:1715330393.250540:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+20:2011:x1798653938130240:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 20us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330393.250548:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 405 00000100:00100000:0.0:1715330393.250554:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 406 00000100:00100000:0.0:1715330393.250557:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+6:2011:x1798653938130304:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:0.0:1715330393.250570:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+6:2011:x1798653938130304:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 12us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330393.250574:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 406 00000100:00080000:1.0:1715330393.250879:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330363 00000100:00080000:1.0:1715330393.250884:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330363 00000100:00080000:1.0:1715330393.250885:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330363 00000100:00100000:2.0:1715330393.251093:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938130368 00000100:00100000:2.0:1715330393.251097:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938130368 00000100:00100000:2.0:1715330393.251131:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 287 00000100:00100000:2.0:1715330393.251136:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72de1896-1df4-4b3a-930a-9116d2c66168+6:2011:x1798653938130368:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:2.0:1715330393.251172:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72de1896-1df4-4b3a-930a-9116d2c66168+6:2011:x1798653938130368:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 36us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330393.251179:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 287 00000100:00080000:1.0:1715330393.251232:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330363 00010000:00010000:2.0:1715330393.445313:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330394.005372:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330394.006947:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938130496 00000100:00100000:3.0:1715330394.006963:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938130496 00000100:00100000:3.0:1715330394.007609:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5219 00000100:00100000:3.0:1715330394.007618:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+20:20971:x1798653938130496:12345-192.168.204.49@tcp:35:dd.0 00000001:00080000:3.0:1715330394.010435:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294984114 00000100:00100000:3.0:1715330394.010595:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+22:20971:x1798653938130496:12345-192.168.204.49@tcp:35:dd.0 Request processed in 2973us (5230us total) trans 4294984115 rc 0/0 00000100:00100000:3.0:1715330394.010618:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5219 00000020:00080000:3.0:1715330394.010624:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:2.0:1715330394.014413:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984115 is committed 00010000:00010000:0.0:1715330394.014478:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da833c0/0xd895711d66dbd89 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330394.014490:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da833c0/0xd895711d66dbd89 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330394.014497:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da833c0/0xd895711d66dbd89 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330394.014503:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da833c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330394.014507:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da833c0/0xd895711d66dbd89 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330394.014514:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da833c0/0xd895711d66dbd89 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330394.014533:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff88008b0d2c00) 00010000:00010000:0.0:1715330394.014535:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330394.014539:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da833c0/0xd895711d66dbd89 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330394.014544:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da833c0/0xd895711d66dbd89 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:2.0:1715330394.445131:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330394.612205:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942536192:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1715330394.612284:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330394.612470:0:7139:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942536192 00000100:00100000:2.0:1715330394.612478:0:7139:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942536192 00000100:00100000:2.0:1715330394.612523:0:7139:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3109 00000100:00100000:2.0:1715330394.612529:0:7139:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942536192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1715330394.612570:0:7139:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445060608 avail 1315598336 00000100:00100000:2.0:1715330394.612648:0:7139:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942536192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330394.612656:0:7139:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3109 00000100:00100000:0.0:1715330394.613582:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942536192:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1715330395.034541:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330395.035504:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938130560 00000100:00100000:3.0:1715330395.035517:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938130560 00000100:00100000:3.0:1715330395.035599:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23841 00000100:00100000:3.0:1715330395.035607:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+16:20979:x1798653938130560:12345-192.168.204.49@tcp:101:dd.0 00010000:00010000:3.0:1715330395.035634:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330395.035656:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83a80/0xd895711d66dbd90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbf0d expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00000100:00080000:1.0:1715330395.035700:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330365 00010000:00010000:3.0:1715330395.035775:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80fc0/0xd895711d66dbd97 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330395.035788:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80fc0/0xd895711d66dbd97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330395.035801:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80fc0/0xd895711d66dbd97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00000004:00200000:3.0:1715330395.035846:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 270336 00000004:00200000:3.0:1715330395.035850:0:9622:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1715330395.035869:0:9622:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80fc0/0xd895711d66dbd97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330395.035890:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83a80/0xd895711d66dbd90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf0d expref: 18 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330395.035922:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80fc0/0xd895711d66dbd97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf0d expref: 17 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330395.035935:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:3.0:1715330395.035938:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1715330395.035941:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011da80fc0, rc 0) 00000100:00100000:3.0:1715330395.035996:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+17:20979:x1798653938130560:12345-192.168.204.49@tcp:101:dd.0 Request processed in 391us (1468us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330395.036002:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23841 00000100:00100000:0.0:1715330395.059413:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330395.059534:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938130688 00000100:00100000:2.0:1715330395.059545:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938130688 00000100:00100000:2.0:1715330395.059613:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23842 00000100:00100000:2.0:1715330395.059621:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:20979:x1798653938130688:12345-192.168.204.49@tcp:101:dd.0 00010000:00010000:2.0:1715330395.059644:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330395.059648:0:7135:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1715330395.059678:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80fc0/0xd895711d66dbd97 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf0d expref: 17 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330395.059709:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:2.0:1715330395.059714:0:7135:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330395.059756:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4000/0xd895711d66dbd9e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbf14 expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330395.059874:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4fc0/0xd895711d66dbda5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330395.059886:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4fc0/0xd895711d66dbda5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330395.059894:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4fc0/0xd895711d66dbda5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330395.059905:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66dbdac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330395.059910:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66dbdac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330395.059916:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66dbdac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330395.060321:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b58c0/0xd895711d66dbdb3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330395.060330:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b58c0/0xd895711d66dbdb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330395.060336:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b58c0/0xd895711d66dbdb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00200000:2.0:1715330395.060345:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1591:0x0]: returning size 15265792 00010000:00010000:2.0:1715330395.060431:0:7135:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4fc0/0xd895711d66dbda5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330395.060438:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4fc0/0xd895711d66dbda5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330395.060443:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4fc0/0xd895711d66dbda5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330395.060448:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4fc0/0xd895711d66dbda5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330395.060455:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b4fc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330395.060459:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4fc0/0xd895711d66dbda5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330395.060465:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4fc0/0xd895711d66dbda5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330395.060473:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:2.0:1715330395.060476:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330395.060479:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4fc0/0xd895711d66dbda5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330395.060484:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4fc0/0xd895711d66dbda5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330395.060495:0:7135:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66dbdac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330395.060500:0:7135:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66dbdac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330395.060505:0:7135:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66dbdac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330395.060509:0:7135:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b4900 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330395.060511:0:7135:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66dbdac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330395.060516:0:7135:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66dbdac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330395.060522:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x333666 (ffff88009d434700) 00010000:00010000:2.0:1715330395.060524:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330395.060526:0:7135:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66dbdac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330395.060531:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4900/0xd895711d66dbdac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7135 initiator: MDT0 00010000:00010000:2.0:1715330395.060563:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4000/0xd895711d66dbd9e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf14 expref: 19 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330395.060575:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b58c0/0xd895711d66dbdb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf14 expref: 18 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330395.060591:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff88008b0d2c00) 00010000:00010000:2.0:1715330395.060593:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330395.060596:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938b58c0, rc 0) 00000100:00100000:2.0:1715330395.060665:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+18:20979:x1798653938130688:12345-192.168.204.49@tcp:101:dd.0 Request processed in 1044us (1262us total) trans 4294984116 rc 0/0 00000100:00100000:2.0:1715330395.060673:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23842 00000100:00100000:3.0:1715330395.073537:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330395.073630:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938130816 00000100:00100000:0.0:1715330395.073640:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938130816 00000100:00100000:0.0:1715330395.073695:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23843 00000100:00100000:0.0:1715330395.073702:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+18:20979:x1798653938130816:12345-192.168.204.49@tcp:36:dd.0 00010000:00010000:0.0:1715330395.073790:0:9622:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715330395.073815:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b58c0/0xd895711d66dbdb3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf14 expref: 18 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330395.073845:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff88008b0d2c00) 00010000:00010000:0.0:1715330395.073849:0:9622:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715330395.073989:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087725200/0xd895711d66dbdc1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330395.074000:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087725200/0xd895711d66dbdc1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330395.074007:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087725200/0xd895711d66dbdc1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00000001:00080000:0.0:1715330395.074034:0:9622:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294984117 00000004:00010000:0.0:1715330395.074049:0:9622:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8801344f3800 reply state ffff88012fba1000 transno 4294984118 ns: mdt-lustre-MDT0000_UUID lock: ffff880087725200/0xd895711d66dbdc1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330395.074061:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087725200/0xd895711d66dbdc1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:0.0:1715330395.074065:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff88008b0d2c00) 00010000:00010000:0.0:1715330395.074067:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330395.074070:0:9622:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1715330395.074144:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+20:20979:x1798653938130816:12345-192.168.204.49@tcp:36:dd.0 Request processed in 441us (619us total) trans 4294984118 rc 0/0 00000100:00100000:0.0:1715330395.074150:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23843 00000020:00080000:0.0:1715330395.074154:0:9622:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330395.272325:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330395.272627:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938130880 00000100:00100000:2.0:1715330395.272637:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938130880 00002000:00010000:2.0:1715330395.272691:0:27574:0:(ofd_dev.c:2731:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/2560 (0->18446744073709551615) 00002000:00100000:2.0:1715330395.272695:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d644000 with x1798653938130880 ext(0->18446744073709551615) 00002000:00010000:2.0:1715330395.272706:0:27574:0:(ofd_dev.c:2736:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d644000. 00000100:00100000:2.0:1715330395.272727:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 83 00000100:00100000:2.0:1715330395.272764:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d644000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+12:2014:x1798653938130880:12345-192.168.204.49@tcp:10:dd.0 00000100:00080000:1.0:1715330395.273253:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330365 00002000:00010000:2.0:1715330395.286760:0:27574:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1715330395.286768:0:27574:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb mtime from disk: 1715330389 -> 1715330395 00002000:00010000:2.0:1715330395.286772:0:27574:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1715330395.286774:0:27574:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb ctime from disk: 1715330389 -> 1715330395 00002000:00010000:2.0:1715330395.286777:0:27574:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x2c0000401:0xa00:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1715330395.286877:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d644000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+13:2014:x1798653938130880:12345-192.168.204.49@tcp:10:dd.0 Request processed in 14106us (14554us total) trans 4294970017 rc 0/0 00000100:00100000:2.0:1715330395.286889:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 83 00002000:00010000:2.0:1715330395.286895:0:27574:0:(ofd_dev.c:2731:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/2560 (0->18446744073709551615) 00002000:00100000:2.0:1715330395.286899:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d644000 with x1798653938130880 ext(0->18446744073709551615) 00002000:00010000:2.0:1715330395.286906:0:27574:0:(ofd_dev.c:2736:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d644000. 00010000:00010000:3.0:1715330395.450923:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330395.476268:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d645f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942536256:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1715330395.476357:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330395.480604:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942536256 00000100:00100000:3.0:1715330395.480620:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942536256 00000100:00100000:3.0:1715330395.480708:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1715330395.480716:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942536256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1715330395.480770:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1715330395.480846:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942536256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (4490us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330395.480854:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00080000:1.0:1715330395.480925:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330365 00000100:00100000:2.0:1715330395.482034:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d645f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942536256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1715330395.507357:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942536320:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1715330395.507430:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330395.507615:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942536320 00000100:00100000:0.0:1715330395.507623:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942536320 00000100:00100000:0.0:1715330395.507674:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1715330395.507680:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942536320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1715330395.507707:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1715330395.507761:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942536320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330395.507768:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00080000:0.0:1715330395.507793:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330365 00000100:00100000:1.0:1715330395.508008:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942536320:0@lo:13:osp-pre-0-1.0 00000001:00080000:0.0:1715330396.231917:0:10666:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4294970017 is committed 00010000:00010000:1.0:1715330396.452107:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330396.740415:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3688:1798653942536384:0@lo:400:kworker.0 00000100:00100000:0.0:1715330396.740497:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330396.740530:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1715330396.740535:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3688:1798653942536448:0@lo:400:kworker.0 00000100:00100000:0.0:1715330396.740587:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330396.740661:0:7130:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942536384 00000100:00100000:1.0:1715330396.740671:0:7130:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942536384 00000100:00100000:1.0:1715330396.740716:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1715330396.740724:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a9253c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3688:x1798653942536384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330396.740800:0:7130:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a9253c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3688:x1798653942536384:12345-0@lo:400:kworker.0 Request processed in 77us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330396.740808:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00080000:1.0:1715330396.740850:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330366 00000100:00100000:2.0:1715330396.740921:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942536512:0@lo:400:kworker.0 00000100:00100000:2.0:1715330396.740955:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330396.740989:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942536512 00000100:00100000:2.0:1715330396.740992:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942536512 00000100:00100000:2.0:1715330396.741017:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3110 00000100:00100000:2.0:1715330396.741021:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942536512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330396.741056:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942536512:12345-0@lo:400:kworker.0 Request processed in 34us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330396.741061:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3110 00000100:00100000:2.0:1715330396.741098:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942536512:0@lo:400:kworker.0 00000100:00100000:3.0:1715330396.741261:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3691:1798653942536576:0@lo:400:kworker.0 00000100:00100000:1.0:1715330396.744567:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3689:1798653942536704:0@lo:400:kworker.0 00000100:00100000:2.0:1715330396.744723:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3690:1798653942536768:0@lo:400:kworker.0 00000100:00100000:0.0:1715330396.745399:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3688:1798653942536384:0@lo:400:kworker.0 00000100:00100000:0.0:1715330396.745435:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942536640:0@lo:400:kworker.0 00000100:00100000:0.0:1715330396.745466:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330396.745481:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942536896:0@lo:400:kworker.0 00000100:00100000:0.0:1715330396.745502:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330396.745517:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942537152:0@lo:400:kworker.0 00000100:00100000:0.0:1715330396.745537:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330396.745584:0:17198:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942536896 00000100:00100000:2.0:1715330396.745952:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942536448 00000100:00100000:2.0:1715330396.745959:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942536448 00000100:00100000:2.0:1715330396.746298:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:2.0:1715330396.746309:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3688:x1798653942536448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330396.746389:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3688:x1798653942536448:12345-0@lo:400:kworker.0 Request processed in 83us (5800us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330396.746396:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:2.0:1715330396.746420:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942537152 00000100:00100000:2.0:1715330396.746423:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942537152 00000100:00100000:2.0:1715330396.746454:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1715330396.746459:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d645500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942537152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330396.746486:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d645500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942537152:12345-0@lo:400:kworker.0 Request processed in 27us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330396.746492:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1715330396.746509:0:7139:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942536640 00000100:00100000:2.0:1715330396.746511:0:7139:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942536640 00000100:00100000:2.0:1715330396.746531:0:7139:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3111 00000100:00100000:2.0:1715330396.746535:0:7139:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d646680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942536640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330396.746574:0:7139:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d646680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942536640:12345-0@lo:400:kworker.0 Request processed in 38us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330396.746579:0:7139:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3111 00000100:00100000:2.0:1715330396.746614:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330396.746636:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942536832:0@lo:400:kworker.0 00000100:00100000:2.0:1715330396.746657:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330396.746666:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942537088:0@lo:400:kworker.0 00000100:00100000:2.0:1715330396.746682:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330396.746702:0:17215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942536832 00000100:00100000:2.0:1715330396.746704:0:17215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942536832 00000100:00100000:2.0:1715330396.746722:0:17215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942537088 00000100:00100000:2.0:1715330396.746724:0:17215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942537088 00000100:00100000:2.0:1715330396.746757:0:17215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1715330396.746762:0:17215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942536832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330396.746786:0:17215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942536832:12345-0@lo:400:kworker.0 Request processed in 24us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330396.746790:0:17215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1715330396.746798:0:17215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1715330396.746801:0:17215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942537088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330396.746820:0:17215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942537088:12345-0@lo:400:kworker.0 Request processed in 18us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330396.746825:0:17215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1715330396.746852:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942536832:0@lo:400:kworker.0 00000100:00100000:2.0:1715330396.746861:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942537088:0@lo:400:kworker.0 00000100:00080000:1.0:1715330396.746990:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330366 00000100:00100000:1.0:1715330396.747003:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330396.747025:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3689:1798653942536960:0@lo:400:kworker.0 00000100:00100000:1.0:1715330396.747055:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330396.747081:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942536576 00000100:00100000:1.0:1715330396.747083:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942536576 00000100:00100000:1.0:1715330396.747101:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942536704 00000100:00100000:1.0:1715330396.747102:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942536704 00000100:00100000:1.0:1715330396.747115:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942536960 00000100:00100000:1.0:1715330396.747117:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942536960 00000100:00100000:1.0:1715330396.747125:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:1.0:1715330396.747128:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3691:x1798653942536576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330396.747153:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3691:x1798653942536576:12345-0@lo:400:kworker.0 Request processed in 24us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330396.747158:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:1.0:1715330396.747166:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:1.0:1715330396.747169:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1798653942536704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330396.747185:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1798653942536704:12345-0@lo:400:kworker.0 Request processed in 16us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330396.747189:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:1.0:1715330396.747195:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:1.0:1715330396.747197:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3689:x1798653942536960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330396.747210:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3689:x1798653942536960:12345-0@lo:400:kworker.0 Request processed in 12us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330396.747214:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00080000:1.0:1715330396.747223:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330366 00000100:00100000:1.0:1715330396.747237:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3689:1798653942536704:0@lo:400:kworker.0 00000100:00100000:1.0:1715330396.747245:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3689:1798653942536960:0@lo:400:kworker.0 00000100:00100000:1.0:1715330396.747284:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942536640:0@lo:400:kworker.0 00000100:00100000:1.0:1715330396.747296:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942537152:0@lo:400:kworker.0 00000100:00100000:1.0:1715330396.747308:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3688:1798653942536448:0@lo:400:kworker.0 00000100:00100000:3.0:1715330396.747507:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330396.747538:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3690:1798653942537024:0@lo:400:kworker.0 00000100:00100000:3.0:1715330396.747571:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330396.747631:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942536768 00000100:00100000:1.0:1715330396.747634:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942536768 00000100:00100000:1.0:1715330396.747655:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942537024 00000100:00100000:1.0:1715330396.747656:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942537024 00000100:00100000:1.0:1715330396.747668:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:1.0:1715330396.747671:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3690:x1798653942536768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330396.747767:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3690:x1798653942536768:12345-0@lo:400:kworker.0 Request processed in 93us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330396.747773:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00100000:1.0:1715330396.747784:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:1.0:1715330396.747787:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3690:x1798653942537024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330396.747806:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3690:x1798653942537024:12345-0@lo:400:kworker.0 Request processed in 18us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330396.747810:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00080000:1.0:1715330396.747820:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330366 00000100:00100000:3.0:1715330396.747872:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3690:1798653942536768:0@lo:400:kworker.0 00000100:00100000:3.0:1715330396.747881:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3690:1798653942537024:0@lo:400:kworker.0 00000100:00100000:0.0:1715330396.748064:0:17198:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942536896 00000100:00100000:0.0:1715330396.748109:0:17198:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1715330396.748115:0:17198:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d646300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942536896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330396.748154:0:17198:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d646300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942536896:12345-0@lo:400:kworker.0 Request processed in 39us (2651us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330396.748158:0:17198:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1715330396.748187:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942536896:0@lo:400:kworker.0 00000100:00100000:2.0:1715330396.748418:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3691:1798653942536576:0@lo:400:kworker.0 00000100:00100000:0.0:1715330396.755524:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1715330396.755559:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d647100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942537216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1715330396.755637:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330396.756301:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942537280:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1715330396.756333:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330396.756575:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942537216 00000100:00100000:0.0:1715330396.756589:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942537216 00000100:00100000:0.0:1715330396.756636:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942537280 00000100:00100000:0.0:1715330396.756638:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942537280 00000100:00100000:2.0:1715330396.756652:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1715330396.756661:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d646a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942537216:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1715330396.756666:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1715330396.756673:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942537280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1715330396.756699:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 65536 granted 307177152 pending 0 free 3923546112 avail 3692023808 00002000:00000024:0.0:1715330396.756702:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 65536 granted 307177152 pending 0 free 3923546112 avail 3692023808 00000100:00100000:2.0:1715330396.757356:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d646a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942537216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 695us (1719us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330396.757365:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1715330396.757585:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d647100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942537216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1715330396.757712:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942537280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1038us (1377us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330396.757720:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1715330396.757810:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942537280:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1715330397.054855:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330397.055104:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938131008 00000100:00100000:2.0:1715330397.055116:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938131008 00002000:00100000:2.0:1715330397.055184:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (0->4194303) req@ffff88009d647100 x1798653938131008/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:608/0 lens 488/0 e 0 to 0 dl 1715330408 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330397.055195:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d647100 with x1798653938131008 ext(0->4194303) 00002000:00010000:2.0:1715330397.055201:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d647100 00000100:00100000:2.0:1715330397.055223:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 84 00000100:00100000:2.0:1715330397.055229:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d647100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+6:2012:x1798653938131008:12345-192.168.204.49@tcp:4:dd.0 00000100:00080000:1.0:1715330397.055609:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330367 00000100:00100000:0.0:1715330397.208409:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d647100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+8:2012:x1798653938131008:12345-192.168.204.49@tcp:4:dd.0 Request processed in 153166us (153553us total) trans 4294970018 rc 0/0 00000100:00100000:0.0:1715330397.208424:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 84 00002000:00100000:0.0:1715330397.208440:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (0->4194303) req@ffff88009d647100 x1798653938131008/t4294970018(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:608/0 lens 488/448 e 0 to 0 dl 1715330408 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330397.208451:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d647100 with x1798653938131008 ext(0->4194303) 00002000:00010000:0.0:1715330397.208457:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d647100 00010000:00010000:2.0:1715330397.457625:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330398.163069:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1715330398.163093:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942537344:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1715330398.163321:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330398.163709:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942537344 00000100:00100000:3.0:1715330398.163719:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942537344 00000100:00100000:3.0:1715330398.163791:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3112 00000100:00100000:3.0:1715330398.163799:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942537344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1715330398.163888:0:19960:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444089856 avail 1314627584 00000100:00100000:3.0:1715330398.163933:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942537344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 133us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330398.163940:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3112 00000100:00100000:2.0:1715330398.164027:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942537344:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1715330398.258714:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330398.258825:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330398.258879:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330398.258975:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938131136 00000100:00100000:2.0:1715330398.258985:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938131136 00002000:00100000:2.0:1715330398.259034:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0xa00:0x0] (4194304->8388607) req@ffff88009d645f80 x1798653938131136/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:609/0 lens 488/0 e 0 to 0 dl 1715330409 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330398.259045:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d645f80 with x1798653938131136 ext(4194304->8388607) 00002000:00010000:2.0:1715330398.259051:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d645f80 00000100:00100000:2.0:1715330398.259084:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 85 00000100:00100000:2.0:1715330398.259092:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d645f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+8:2012:x1798653938131136:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330398.259911:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938131264 00000100:00100000:3.0:1715330398.259917:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938131264 00000100:00100000:1.0:1715330398.260166:0:17205:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938131392 00000100:00100000:1.0:1715330398.260171:0:17205:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938131392 00000100:00100000:1.0:1715330398.260199:0:17205:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 292 00000100:00100000:1.0:1715330398.260204:0:17205:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938131392:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:1.0:1715330398.260269:0:17205:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938131392:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 63us (1388us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330398.260279:0:17205:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 292 00000100:00080000:0.0:1715330398.260850:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330368 00000100:00080000:0.0:1715330398.260855:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330368 00000100:00100000:3.0:1715330398.260924:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 413 00000100:00100000:3.0:1715330398.260931:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+20:2013:x1798653938131264:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:3.0:1715330398.260977:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+20:2013:x1798653938131264:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 47us (2152us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330398.260983:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 413 00000100:00100000:0.0:1715330398.261118:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330398.261179:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330398.261210:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330398.261401:0:7129:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938131200 00000100:00100000:1.0:1715330398.261406:0:7129:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938131200 00000100:00100000:1.0:1715330398.261433:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 373 00000100:00100000:1.0:1715330398.261438:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dcabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2014:x1798653938131200:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:1.0:1715330398.261464:0:7129:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dcabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2014:x1798653938131200:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 26us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330398.261470:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 373 00000100:00080000:1.0:1715330398.261546:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330368 00000100:00100000:3.0:1715330398.261722:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938131328 00000100:00100000:3.0:1715330398.261725:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938131328 00000100:00100000:1.0:1715330398.261947:0:17198:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938131456 00000100:00100000:1.0:1715330398.261950:0:17198:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938131456 00000100:00100000:1.0:1715330398.261976:0:17198:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 293 00000100:00100000:1.0:1715330398.261980:0:17198:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:72de1896-1df4-4b3a-930a-9116d2c66168+9:2014:x1798653938131456:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:1.0:1715330398.262004:0:17198:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:72de1896-1df4-4b3a-930a-9116d2c66168+9:2014:x1798653938131456:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 23us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330398.262009:0:17198:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 293 00000100:00100000:3.0:1715330398.262262:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 414 00000100:00100000:3.0:1715330398.262268:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938131328:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:3.0:1715330398.262301:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938131328:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 27us (1115us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330398.262309:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 414 00000100:00080000:1.0:1715330398.263926:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330368 00000100:00100000:0.0:1715330398.318409:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d645f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+10:2012:x1798653938131136:12345-192.168.204.49@tcp:4:dd.0 Request processed in 59307us (59698us total) trans 4294970019 rc 0/0 00000100:00100000:0.0:1715330398.318421:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 85 00002000:00100000:0.0:1715330398.318434:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0xa00:0x0] (4194304->8388607) req@ffff88009d645f80 x1798653938131136/t4294970019(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:609/0 lens 488/448 e 0 to 0 dl 1715330409 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330398.318442:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d645f80 with x1798653938131136 ext(4194304->8388607) 00002000:00010000:0.0:1715330398.318448:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d645f80 00010000:00010000:2.0:1715330398.457679:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715330399.462968:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330399.505784:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330399.506023:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938131584 00000100:00100000:2.0:1715330399.506033:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938131584 00002000:00100000:2.0:1715330399.506105:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0xa00:0x0] (8388608->12582911) req@ffff8801344f2a00 x1798653938131584/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:610/0 lens 488/0 e 0 to 0 dl 1715330410 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00000100:00080000:1.0:1715330399.506105:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330369 00002000:00100000:2.0:1715330399.506115:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801344f2a00 with x1798653938131584 ext(8388608->12582911) 00002000:00010000:2.0:1715330399.506120:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801344f2a00 00000100:00100000:2.0:1715330399.506154:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 86 00000100:00100000:2.0:1715330399.511243:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+10:2011:x1798653938131584:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330399.619979:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942537408:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1715330399.620265:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330399.620380:0:7139:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942537408 00000100:00100000:3.0:1715330399.620388:0:7139:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942537408 00000100:00100000:3.0:1715330399.620440:0:7139:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3113 00000100:00100000:3.0:1715330399.620447:0:7139:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942537408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1715330399.620487:0:7139:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445060608 avail 1315598336 00000100:00100000:3.0:1715330399.620536:0:7139:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942537408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330399.620543:0:7139:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3113 00000100:00100000:1.0:1715330399.624920:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942537408:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1715330399.637639:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+12:2011:x1798653938131584:12345-192.168.204.49@tcp:4:dd.0 Request processed in 131466us (131856us total) trans 4294970020 rc 0/0 00000100:00100000:0.0:1715330399.637651:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 86 00002000:00100000:0.0:1715330399.637664:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0xa00:0x0] (8388608->12582911) req@ffff8801344f2a00 x1798653938131584/t4294970020(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:610/0 lens 488/448 e 0 to 0 dl 1715330410 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330399.637673:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801344f2a00 with x1798653938131584 ext(8388608->12582911) 00002000:00010000:0.0:1715330399.637679:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801344f2a00 00000100:00100000:0.0:1715330400.064612:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330400.066065:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938131712 00000100:00100000:3.0:1715330400.066082:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938131712 00000100:00080000:1.0:1715330400.067279:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330370 00000100:00100000:3.0:1715330400.067458:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5220 00000100:00100000:3.0:1715330400.067467:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013458a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+20:20979:x1798653938131712:12345-192.168.204.49@tcp:35:dd.0 00000001:00080000:3.0:1715330400.067921:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294984119 00000100:00100000:3.0:1715330400.069481:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013458a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+22:20979:x1798653938131712:12345-192.168.204.49@tcp:35:dd.0 Request processed in 2007us (4869us total) trans 4294984120 rc 0/0 00000100:00100000:3.0:1715330400.069501:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5220 00000020:00080000:3.0:1715330400.069509:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:0.0:1715330400.071991:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984120 is committed 00010000:00010000:3.0:1715330400.072014:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880087725200/0xd895711d66dbdc1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330400.072025:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880087725200/0xd895711d66dbdc1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330400.072031:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880087725200/0xd895711d66dbdc1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330400.072036:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087725200 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330400.072039:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087725200/0xd895711d66dbdc1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330400.072048:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087725200/0xd895711d66dbdc1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330400.072063:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff88008b0d2c00) 00010000:00010000:3.0:1715330400.072065:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330400.072069:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880087725200/0xd895711d66dbdc1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330400.072073:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087725200/0xd895711d66dbdc1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1591:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9622 initiator: MDT0 00010000:00010000:1.0:1715330400.465768:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330400.499295:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1715330400.499319:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942537472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1715330400.499379:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330400.500073:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942537472 00000100:00100000:2.0:1715330400.500081:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942537472 00000100:00080000:1.0:1715330400.500175:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330370 00000100:00100000:2.0:1715330400.500901:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1715330400.500907:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942537472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1715330400.500936:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1715330400.500991:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942537472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (1611us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330400.500996:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1715330400.501071:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942537472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1715330400.514987:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942537536:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1715330400.515058:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330400.515307:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942537536 00000100:00100000:3.0:1715330400.515415:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942537536 00000100:00100000:3.0:1715330400.515462:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1715330400.515467:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942537536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1715330400.515494:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923509248 avail 3691986944 00000100:00080000:1.0:1715330400.515888:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330370 00000100:00100000:2.0:1715330400.516018:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091c3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942537536:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1715330400.516125:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942537536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 657us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330400.516131:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1715330401.077353:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330401.079486:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938131776 00000100:00100000:3.0:1715330401.079499:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938131776 00000100:00100000:3.0:1715330401.079567:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23844 00000100:00100000:3.0:1715330401.079576:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013458a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+16:20987:x1798653938131776:12345-192.168.204.49@tcp:101:rm.0 00010000:00010000:3.0:1715330401.079610:0:7135:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330401.079636:0:7135:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80000/0xd895711d66dbdc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbf1b expref: -99 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330401.079712:0:7135:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82640/0xd895711d66dbdcf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330401.079726:0:7135:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82640/0xd895711d66dbdcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330401.079759:0:7135:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82640/0xd895711d66dbdcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00000004:00200000:3.0:1715330401.079804:0:7135:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 270336 00000004:00200000:3.0:1715330401.079809:0:7135:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1715330401.079829:0:7135:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82640/0xd895711d66dbdcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7135 initiator: MDT0 00010000:00010000:3.0:1715330401.079851:0:7135:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80000/0xd895711d66dbdc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf1b expref: 18 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330401.079895:0:7135:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82640/0xd895711d66dbdcf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf1b expref: 17 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330401.079904:0:7135:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:3.0:1715330401.079907:0:7135:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1715330401.079910:0:7135:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011da82640, rc 0) 00000100:00100000:3.0:1715330401.079970:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013458a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:20987:x1798653938131776:12345-192.168.204.49@tcp:101:rm.0 Request processed in 395us (2630us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330401.079977:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23844 00000100:00100000:0.0:1715330401.092408:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330401.094362:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938131840 00000100:00100000:2.0:1715330401.094377:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938131840 00000100:00100000:2.0:1715330401.095389:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23845 00000100:00100000:2.0:1715330401.095398:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+17:20987:x1798653938131840:12345-192.168.204.49@tcp:101:rm.0 00010000:00010000:2.0:1715330401.095422:0:11283:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330401.095445:0:11283:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6ac0/0xd895711d66dbdd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbf22 expref: -99 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330401.095519:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66dbddd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.095532:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66dbddd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.095543:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66dbddd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.095559:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4480/0xd895711d66dbde4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.095564:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4480/0xd895711d66dbde4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.095569:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4480/0xd895711d66dbde4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.095630:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5f80/0xd895711d66dbdeb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.095637:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5f80/0xd895711d66dbdeb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.095643:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5f80/0xd895711d66dbdeb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000004:00200000:2.0:1715330401.095680:0:11283:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x1591:0x0]: returning size 14266368 00000004:00200000:2.0:1715330401.095685:0:11283:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1715330401.095701:0:11283:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5f80/0xd895711d66dbdeb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.095710:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5f80/0xd895711d66dbdeb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.095717:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66dbddd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.095722:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66dbddd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.095727:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66dbddd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.095750:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66dbddd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.095755:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b5200 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330401.095758:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66dbddd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.095763:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66dbddd lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.095773:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:2.0:1715330401.095775:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330401.095779:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66dbddd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.095783:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5200/0xd895711d66dbddd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.095810:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4480/0xd895711d66dbde4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.095815:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4480/0xd895711d66dbde4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.095820:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4480/0xd895711d66dbde4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.095824:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b4480 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330401.095825:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4480/0xd895711d66dbde4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.095828:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4480/0xd895711d66dbde4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.095837:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x333666 (ffff88009d434200) 00010000:00010000:2.0:1715330401.095838:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330401.095840:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4480/0xd895711d66dbde4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.095844:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4480/0xd895711d66dbde4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.095868:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6ac0/0xd895711d66dbdd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf22 expref: 19 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330401.096822:0:11283:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5f80/0xd895711d66dbdeb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf22 expref: 18 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330401.096828:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff88008b0d2c00) 00010000:00010000:2.0:1715330401.096830:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330401.096832:0:11283:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938b5f80, rc 0) 00000100:00100000:2.0:1715330401.097872:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+18:20987:x1798653938131840:12345-192.168.204.49@tcp:101:rm.0 Request processed in 2470us (5472us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330401.097881:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23845 00000100:00100000:0.0:1715330401.115012:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330401.115220:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938131968 00000100:00100000:2.0:1715330401.115232:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938131968 00000100:00100000:2.0:1715330401.115298:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23846 00000100:00100000:2.0:1715330401.115308:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+18:20987:x1798653938131968:12345-192.168.204.49@tcp:36:rm.0 00010000:00010000:2.0:1715330401.115369:0:11283:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1715330401.115399:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80d80/0xd895711d66dbc01 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1591:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbea4 expref: 18 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330401.115442:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5f80/0xd895711d66dbdeb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf22 expref: 17 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330401.115454:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5440/0xd895711d66dbbf3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe9d expref: 16 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330401.115462:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff88008b0d2c00) 00010000:00010000:2.0:1715330401.115487:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82640/0xd895711d66dbdcf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf1b expref: 15 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330401.115495:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:2.0:1715330401.115498:0:11283:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330401.115529:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b61c0/0xd895711d66dbdf2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.115541:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b61c0/0xd895711d66dbdf2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.115549:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b61c0/0xd895711d66dbdf2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.115561:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4240/0xd895711d66dbdf9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x333666 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.115565:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4240/0xd895711d66dbdf9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.115570:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4240/0xd895711d66dbdf9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.115633:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7180/0xd895711d66dbe00 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.115638:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7180/0xd895711d66dbe00 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1591:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.115642:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7180/0xd895711d66dbe00 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1591:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00000040:00080000:2.0:1715330401.115959:0:11283:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].2553, 64 off171584 00000004:00080000:2.0:1715330401.115965:0:11283:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 375592233079ns, next at 376592231385ns, rc = 0 00010000:00010000:2.0:1715330401.116011:0:11283:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6400/0xd895711d66dbe07 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.116017:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6400/0xd895711d66dbe07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.116023:0:11283:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6400/0xd895711d66dbe07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.116030:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6400/0xd895711d66dbe07 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.116034:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6400/0xd895711d66dbe07 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.116039:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6400/0xd895711d66dbe07 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.116043:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6400/0xd895711d66dbe07 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.116048:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b6400 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330401.116052:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6400/0xd895711d66dbe07 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.116062:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6400/0xd895711d66dbe07 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.116068:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff88009d434500) 00010000:00010000:2.0:1715330401.116070:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1715330401.116073:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6400/0xd895711d66dbe07 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.116077:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6400/0xd895711d66dbe07 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.116099:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7180/0xd895711d66dbe00 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1591:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.116104:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7180/0xd895711d66dbe00 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1591:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.116108:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7180/0xd895711d66dbe00 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1591:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.116111:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b7180 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330401.116114:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7180/0xd895711d66dbe00 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1591:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.116117:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7180/0xd895711d66dbe00 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1591:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.116121:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff88009d434500) 00010000:00010000:2.0:1715330401.116123:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715330401.116124:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7180/0xd895711d66dbe00 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1591:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.116127:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7180/0xd895711d66dbe00 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1591:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.116229:0:11283:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b61c0/0xd895711d66dbdf2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.116234:0:11283:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b61c0/0xd895711d66dbdf2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.116238:0:11283:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b61c0/0xd895711d66dbdf2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.116242:0:11283:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b61c0/0xd895711d66dbdf2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.116245:0:11283:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b61c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330401.116246:0:11283:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b61c0/0xd895711d66dbdf2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.116250:0:11283:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b61c0/0xd895711d66dbdf2 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.116254:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:2.0:1715330401.116256:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330401.116257:0:11283:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b61c0/0xd895711d66dbdf2 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.116261:0:11283:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b61c0/0xd895711d66dbdf2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000004:00010000:2.0:1715330401.116266:0:11283:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009ff7b100 reply state ffff88009aefd000 transno 4294984121 ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4240/0xd895711d66dbdf9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.116272:0:11283:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4240/0xd895711d66dbdf9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:2.0:1715330401.116276:0:11283:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x333666 (ffff88009d434700) 00010000:00010000:2.0:1715330401.116279:0:11283:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330401.116281:0:11283:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1715330401.116360:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72de1896-1df4-4b3a-930a-9116d2c66168+16:20987:x1798653938131968:12345-192.168.204.49@tcp:36:rm.0 Request processed in 1053us (1363us total) trans 4294984121 rc 0/0 00000100:00100000:2.0:1715330401.116367:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23846 00010000:00010000:2.0:1715330401.469090:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330401.747703:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942537728:0@lo:400:kworker.0 00000100:00100000:3.0:1715330401.747802:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330401.747830:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3689:1798653942537984:0@lo:400:kworker.0 00000100:00100000:3.0:1715330401.747853:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330401.747864:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3689:1798653942538240:0@lo:400:kworker.0 00000100:00100000:3.0:1715330401.747878:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330401.747898:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1715330401.747903:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3689:1798653942537664:0@lo:400:kworker.0 00000100:00100000:3.0:1715330401.747918:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330401.747928:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3689:1798653942537920:0@lo:400:kworker.0 00000100:00100000:3.0:1715330401.747942:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330401.747949:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3689:1798653942538176:0@lo:400:kworker.0 00000100:00100000:3.0:1715330401.747963:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330401.747995:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942537984 00000100:00100000:3.0:1715330401.748003:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942537984 00000100:00100000:3.0:1715330401.748040:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942538240 00000100:00100000:3.0:1715330401.748042:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942538240 00000100:00100000:3.0:1715330401.748051:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942537664 00000100:00100000:3.0:1715330401.748052:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942537664 00000100:00100000:3.0:1715330401.748059:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942537920 00000100:00100000:3.0:1715330401.748061:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942537920 00000100:00100000:3.0:1715330401.748068:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942538176 00000100:00100000:3.0:1715330401.748069:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942538176 00000100:00100000:3.0:1715330401.748080:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:3.0:1715330401.748087:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1798653942537984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330401.748131:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1798653942537984:12345-0@lo:400:kworker.0 Request processed in 43us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330401.748138:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00100000:3.0:1715330401.748154:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:3.0:1715330401.748157:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3689:x1798653942538240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330401.748177:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3689:x1798653942538240:12345-0@lo:400:kworker.0 Request processed in 19us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330401.748185:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00100000:3.0:1715330401.748193:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:3.0:1715330401.748196:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1798653942537664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330401.748215:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1798653942537664:12345-0@lo:400:kworker.0 Request processed in 18us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330401.748219:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:3.0:1715330401.748225:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:3.0:1715330401.748228:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1798653942537920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330401.748247:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1798653942537920:12345-0@lo:400:kworker.0 Request processed in 17us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330401.748251:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00000100:00100000:3.0:1715330401.748257:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:3.0:1715330401.748260:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3689:x1798653942538176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330401.748277:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3689:x1798653942538176:12345-0@lo:400:kworker.0 Request processed in 16us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330401.748281:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000100:00080000:3.0:1715330401.748292:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330371 00000100:00080000:3.0:1715330401.748296:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330371 00000100:00100000:3.0:1715330401.748319:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3689:1798653942537664:0@lo:400:kworker.0 00000100:00100000:3.0:1715330401.748328:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3689:1798653942537920:0@lo:400:kworker.0 00000100:00100000:3.0:1715330401.748334:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3689:1798653942538176:0@lo:400:kworker.0 00000100:00100000:3.0:1715330401.748341:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3689:1798653942537984:0@lo:400:kworker.0 00000100:00100000:3.0:1715330401.748347:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3689:1798653942538240:0@lo:400:kworker.0 00000100:00100000:3.0:1715330401.748384:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942537728 00000100:00100000:3.0:1715330401.748388:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942537728 00000100:00100000:3.0:1715330401.748407:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3114 00000100:00100000:3.0:1715330401.748410:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3689:x1798653942537728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330401.748438:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3689:x1798653942537728:12345-0@lo:400:kworker.0 Request processed in 27us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330401.748443:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3114 00000100:00100000:3.0:1715330401.748475:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942537728:0@lo:400:kworker.0 00000100:00100000:0.0:1715330401.748575:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3691:1798653942537600:0@lo:400:kworker.0 00000100:00100000:0.0:1715330401.748609:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330401.748623:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942537856:0@lo:400:kworker.0 00000100:00100000:0.0:1715330401.748638:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330401.748647:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942538112:0@lo:400:kworker.0 00000100:00100000:0.0:1715330401.748664:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330401.748675:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942538368:0@lo:400:kworker.0 00000100:00100000:0.0:1715330401.748690:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330401.748701:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1715330401.748705:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3691:1798653942537792:0@lo:400:kworker.0 00000100:00100000:0.0:1715330401.748755:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330401.748767:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942538048:0@lo:400:kworker.0 00000100:00100000:0.0:1715330401.748785:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330401.748795:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093b70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942538304:0@lo:400:kworker.0 00000100:00100000:0.0:1715330401.748810:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330401.748829:0:17205:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942538112 00000100:00100000:0.0:1715330401.748831:0:17205:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942538112 00000100:00100000:0.0:1715330401.748852:0:17205:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942538368 00000100:00100000:0.0:1715330401.748854:0:17205:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942538368 00000100:00100000:0.0:1715330401.748867:0:17205:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942538048 00000100:00100000:0.0:1715330401.748868:0:17205:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942538048 00000100:00100000:0.0:1715330401.748877:0:17205:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942538304 00000100:00100000:0.0:1715330401.748878:0:17205:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942538304 00000100:00100000:0.0:1715330401.748889:0:17205:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1715330401.748893:0:17205:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942538112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330401.748921:0:17205:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942538112:12345-0@lo:400:kworker.0 Request processed in 27us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330401.748925:0:17205:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1715330401.748934:0:17205:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1715330401.748937:0:17205:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942538368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330401.748954:0:17205:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942538368:12345-0@lo:400:kworker.0 Request processed in 16us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330401.748958:0:17205:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1715330401.748963:0:17205:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1715330401.748966:0:17205:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009132c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942538048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330401.748979:0:17205:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009132c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942538048:12345-0@lo:400:kworker.0 Request processed in 13us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330401.748983:0:17205:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1715330401.748988:0:17205:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1715330401.748990:0:17205:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009132c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942538304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330401.749006:0:17205:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009132c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942538304:12345-0@lo:400:kworker.0 Request processed in 15us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330401.749009:0:17205:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1715330401.749037:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942538048:0@lo:400:kworker.0 00000100:00100000:0.0:1715330401.749044:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093b70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942538304:0@lo:400:kworker.0 00000100:00100000:0.0:1715330401.749050:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942538112:0@lo:400:kworker.0 00000100:00100000:0.0:1715330401.749056:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942538368:0@lo:400:kworker.0 00000100:00100000:0.0:1715330401.749084:0:7130:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942537600 00000100:00100000:0.0:1715330401.749086:0:7130:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942537600 00000100:00100000:0.0:1715330401.749106:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1715330401.749110:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dcaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3691:x1798653942537600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330401.749133:0:7130:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dcaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3691:x1798653942537600:12345-0@lo:400:kworker.0 Request processed in 23us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330401.749138:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1715330401.749160:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3691:1798653942537600:0@lo:400:kworker.0 00000100:00100000:3.0:1715330401.751202:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942537792 00000100:00100000:3.0:1715330401.751216:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942537792 00000100:00100000:3.0:1715330401.751280:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:3.0:1715330401.751287:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009132c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3691:x1798653942537792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330401.751376:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009132c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3691:x1798653942537792:12345-0@lo:400:kworker.0 Request processed in 90us (2646us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330401.751382:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00080000:3.0:1715330401.751402:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330371 00000100:00080000:3.0:1715330401.751406:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330371 00000100:00100000:3.0:1715330401.751422:0:7139:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942537856 00000100:00100000:3.0:1715330401.751425:0:7139:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942537856 00000100:00100000:3.0:1715330401.751454:0:7139:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3115 00000100:00100000:3.0:1715330401.751467:0:7139:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942537856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330401.751495:0:7139:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942537856:12345-0@lo:400:kworker.0 Request processed in 36us (2855us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330401.751499:0:7139:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3115 00000100:00100000:1.0:1715330401.752124:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3691:1798653942537792:0@lo:400:kworker.0 00000100:00100000:1.0:1715330401.752137:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942537856:0@lo:400:kworker.0 00000100:00100000:0.0:1715330401.764539:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942538432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1715330401.764638:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330401.764680:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1715330401.764686:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942538496:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1715330401.764708:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330401.764748:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942538432 00000100:00100000:0.0:1715330401.764748:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942538496 00000100:00100000:1.0:1715330401.764757:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942538432 00000100:00100000:0.0:1715330401.764757:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942538496 00000100:00100000:0.0:1715330401.764807:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1715330401.764816:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009132ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942538496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1715330401.764858:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 172032 granted 329782976 pending 12656640 free 3910963200 avail 3679440896 00000100:00100000:0.0:1715330401.764901:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009132ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942538496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330401.764909:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1715330401.764960:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942538496:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1715330401.765040:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1715330401.765046:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009132ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942538432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1715330401.765059:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 172032 granted 329782976 pending 12656640 free 3910963200 avail 3679440896 00000100:00100000:1.0:1715330401.765095:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009132ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942538432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330401.765100:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1715330401.765106:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091c3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942538432:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1715330402.234559:0:10666:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4294970020 is committed 00010000:00010000:0.0:1715330402.469228:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330402.613012:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330402.613075:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938132032 00000100:00100000:2.0:1715330402.613085:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938132032 00000100:00080000:3.0:1715330402.613148:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330372 00000100:00100000:2.0:1715330402.613152:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23847 00000100:00100000:2.0:1715330402.613159:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009132d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+16:21175:x1798653938132032:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:2.0:1715330402.613184:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330402.613203:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4b40/0xd895711d66dbe0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbf29 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330402.613252:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6640/0xd895711d66dbe15 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330402.613261:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6640/0xd895711d66dbe15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330402.613272:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6640/0xd895711d66dbe15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000004:00200000:2.0:1715330402.613308:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 270336 00000004:00200000:2.0:1715330402.613311:0:7134:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1715330402.613326:0:7134:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6640/0xd895711d66dbe15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330402.613343:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4b40/0xd895711d66dbe0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf29 expref: 18 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330402.613377:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6640/0xd895711d66dbe15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf29 expref: 17 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330402.613384:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:2.0:1715330402.613386:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1715330402.613388:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938b6640, rc 0) 00000100:00100000:2.0:1715330402.613425:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009132d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+17:21175:x1798653938132032:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 266us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330402.613431:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23847 00000100:00100000:0.0:1715330402.624240:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330402.624598:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938132096 00000100:00100000:2.0:1715330402.624607:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938132096 00000100:00100000:2.0:1715330402.624650:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23848 00000100:00100000:2.0:1715330402.624656:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009132d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+17:21175:x1798653938132096:12345-192.168.204.49@tcp:41:lfs.0 00000004:00000024:2.0:1715330402.624692:0:9622:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444089856 avail 1314627584 00000100:00100000:2.0:1715330402.624795:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009132d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+17:21175:x1798653938132096:12345-192.168.204.49@tcp:41:lfs.0 Request processed in 137us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330402.624800:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23848 00000100:00100000:0.0:1715330402.629712:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330402.631437:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938132160 00000100:00100000:2.0:1715330402.631454:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938132160 00000100:00100000:2.0:1715330402.632055:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23849 00000100:00100000:2.0:1715330402.632063:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009132d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+6:21175:x1798653938132160:12345-192.168.204.49@tcp:41:lfs.0 00000004:00000024:2.0:1715330402.632108:0:7134:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445060608 avail 1315598336 00000100:00100000:2.0:1715330402.632187:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009132d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+6:21175:x1798653938132160:12345-192.168.204.49@tcp:41:lfs.0 Request processed in 124us (2480us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330402.632194:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23849 00000100:00080000:3.0:1715330402.632335:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330372 00000100:00100000:0.0:1715330402.638498:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330402.639282:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938132224 00000100:00100000:1.0:1715330402.639290:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938132224 00000100:00100000:1.0:1715330402.639343:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 232 00000100:00100000:1.0:1715330402.639350:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009132dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:72de1896-1df4-4b3a-930a-9116d2c66168+6:21175:x1798653938132224:12345-192.168.204.49@tcp:13:lfs.0 00000100:00080000:3.0:1715330402.639352:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330372 00002000:00000024:1.0:1715330402.639380:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1715330402.639441:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009132dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:72de1896-1df4-4b3a-930a-9116d2c66168+6:21175:x1798653938132224:12345-192.168.204.49@tcp:13:lfs.0 Request processed in 90us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330402.639456:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 232 00000100:00100000:0.0:1715330402.649491:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330402.649585:0:9401:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938132288 00000100:00100000:2.0:1715330402.649593:0:9401:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938132288 00000100:00100000:2.0:1715330402.649648:0:9401:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 233 00000100:00100000:2.0:1715330402.649655:0:9401:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009132df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:72de1896-1df4-4b3a-930a-9116d2c66168+6:21175:x1798653938132288:12345-192.168.204.49@tcp:13:lfs.0 00002000:00000024:2.0:1715330402.649680:0:9401:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 172032 granted 317126336 pending 0 free 3910963200 avail 3666784256 00000100:00080000:3.0:1715330402.649789:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330372 00000100:00100000:2.0:1715330402.650944:0:9401:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009132df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:72de1896-1df4-4b3a-930a-9116d2c66168+6:21175:x1798653938132288:12345-192.168.204.49@tcp:13:lfs.0 Request processed in 1284us (1457us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330402.650953:0:9401:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 233 00000100:00100000:1.0:1715330403.170874:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1715330403.170898:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942538560:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1715330403.170962:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330403.171006:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942538560 00000100:00100000:2.0:1715330403.171014:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942538560 00000100:00100000:2.0:1715330403.171845:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3116 00000100:00100000:2.0:1715330403.171853:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3691:x1798653942538560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1715330403.171878:0:19960:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444089856 avail 1314627584 00000100:00100000:2.0:1715330403.171922:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3691:x1798653942538560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330403.171928:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3116 00000100:00100000:1.0:1715330403.172549:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942538560:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1715330403.265290:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330403.266611:0:7129:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938132352 00000100:00100000:2.0:1715330403.266621:0:7129:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938132352 00000100:00100000:2.0:1715330403.268722:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 375 00000100:00100000:2.0:1715330403.268742:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dcaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2014:x1798653938132352:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:2.0:1715330403.268806:0:7129:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dcaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2014:x1798653938132352:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 77us (3525us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330403.268813:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 375 00000100:00080000:3.0:1715330403.269565:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330373 00010000:00010000:3.0:1715330403.473161:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330404.474931:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330404.628049:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1715330404.628069:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942538624:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1715330404.628123:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330404.629718:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942538624 00000100:00100000:0.0:1715330404.629741:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942538624 00000100:00100000:0.0:1715330404.629787:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3117 00000100:00100000:0.0:1715330404.629794:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942538624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1715330404.629825:0:19960:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445060608 avail 1315598336 00000100:00100000:0.0:1715330404.629880:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942538624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (1756us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330404.629887:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3117 00000100:00100000:2.0:1715330404.630652:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942538624:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1715330405.477173:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330405.507085:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1715330405.507103:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942538688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1715330405.507158:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330405.507345:0:9401:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942538688 00000100:00100000:0.0:1715330405.507351:0:9401:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942538688 00000100:00100000:0.0:1715330405.507423:0:9401:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1715330405.507430:0:9401:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942538688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1715330405.507461:0:9401:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1715330405.507494:0:9401:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942538688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330405.507500:0:9401:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00080000:3.0:1715330405.507786:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330375 00000100:00100000:2.0:1715330405.508147:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091c3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942538688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1715330405.523521:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942538752:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1715330405.523582:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330405.524241:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942538752 00000100:00100000:1.0:1715330405.524249:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942538752 00000100:00100000:1.0:1715330405.524302:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1715330405.524308:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942538752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1715330405.524328:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1715330405.524374:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942538752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330405.524380:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1715330405.524424:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942538752:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1715330405.524437:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330375 00000001:00080000:0.0:1715330406.234713:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984121 is committed 00000004:00080000:0.0:1715330406.234722:0:7116:0:(osp_sync.c:1604:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 35 committed 00010000:00010000:0.0:1715330406.234773:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4240/0xd895711d66dbdf9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330406.234783:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4240/0xd895711d66dbdf9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330406.234789:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4240/0xd895711d66dbdf9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330406.234793:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b4240 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330406.234797:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4240/0xd895711d66dbdf9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330406.234802:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4240/0xd895711d66dbdf9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330406.234817:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x333666 (ffff88009d434700) 00010000:00010000:0.0:1715330406.234819:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330406.234823:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4240/0xd895711d66dbdf9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00010000:00010000:0.0:1715330406.234828:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4240/0xd895711d66dbdf9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x333666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11283 initiator: MDT0 00000100:00100000:2.0:1715330406.234990:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942538816:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1715330406.235040:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330406.235074:0:17217:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942538816 00000100:00100000:2.0:1715330406.235079:0:17217:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942538816 00000100:00100000:2.0:1715330406.235110:0:17217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5344 00000100:00100000:2.0:1715330406.235115:0:17217:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d60a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942538816:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1715330406.235136:0:17217:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2560 count 1 00010000:00010000:2.0:1715330406.235155:0:17217:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800938b4b40/0xd895711d66dbe1c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330406.235171:0:17217:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011da80b40/0xd895711d66dbbc2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe88 expref: 5 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330406.235177:0:17217:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1715330406.235180:0:17217:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1715330406.235182:0:17217:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800938b4b40/0xd895711d66dbe1c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330406.235203:0:17217:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011da80b40/0xd895711d66dbbc2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50000000010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe88 expref: 5 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330406.235214:0:17217:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011da80b40/0xd895711d66dbbc2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x70000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe88 expref: 5 pid: 17217 timeout: 480 lvb_type: 0 00000100:00100000:2.0:1715330406.235227:0:17217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d60aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:17217:1798653942538880:192.168.204.49@tcp:104: 00000100:00100000:2.0:1715330406.235269:0:17217:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db63e40 going to sleep for 11 seconds 00000100:00080000:2.0:1715330406.235286:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330376 00000100:00100000:2.0:1715330406.261107:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330406.261218:0:17217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d60aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:17217:1798653942538880:192.168.204.49@tcp:104: 00010000:00010000:0.0:1715330406.261244:0:17217:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800938b4b40/0xd895711d66dbe1c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330406.261766:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938132416 00000100:00100000:1.0:1715330406.261772:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938132416 00010000:00010000:1.0:1715330406.261811:0:10674:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011da80b40/0xd895711d66dbbc2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x60000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe88 expref: 6 pid: 17217 timeout: 480 lvb_type: 0 00000100:00100000:1.0:1715330406.261840:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1590 00000100:00100000:1.0:1715330406.261847:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d60ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938132416:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1715330406.261858:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330406.261863:0:10674:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011da80b40/0xd895711d66dbbc2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x60000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe88 expref: 6 pid: 17217 timeout: 480 lvb_type: 0 00010000:00010000:1.0:1715330406.261873:0:10674:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011da80b40/0xd895711d66dbbc2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe88 expref: 6 pid: 17217 timeout: 480 lvb_type: 0 00010000:00010000:1.0:1715330406.261897:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011da80b40/0xd895711d66dbbc2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe88 expref: 6 pid: 17217 timeout: 480 lvb_type: 0 00010000:00010000:1.0:1715330406.261919:0:10674:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330406.261920:0:10674:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715330406.261924:0:10674:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800938b4b40/0xd895711d66dbe1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330406.261933:0:10674:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800938b4b40/0xd895711d66dbe1c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330406.261954:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330406.261989:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d60ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:72de1896-1df4-4b3a-930a-9116d2c66168+5:2014:x1798653938132416:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 142us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330406.261996:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1590 00010000:00010000:0.0:1715330406.262160:0:17217:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800938b4b40/0xd895711d66dbe1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330406.262167:0:17217:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800938b4b40/0xd895711d66dbe1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330406.262174:0:17217:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800938b4b40/0xd895711d66dbe1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330406.262180:0:17217:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800938b4b40/0xd895711d66dbe1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330406.262187:0:17217:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800938b4b40/0xd895711d66dbe1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330406.262192:0:17217:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b4b40 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330406.262195:0:17217:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800938b4b40/0xd895711d66dbe1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330406.262203:0:17217:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800938b4b40/0xd895711d66dbe1c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330406.262214:0:17217:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800938b4b40/0xd895711d66dbe1c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330406.262219:0:17217:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800938b4b40/0xd895711d66dbe1c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1715330406.265568:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330376 00000100:00100000:1.0:1715330406.286910:0:17217:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d60a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3690:x1798653942538816:12345-0@lo:6:osp-syn-1-0.0 Request processed in 51786us (51863us total) trans 4294970021 rc 0/0 00000100:00100000:1.0:1715330406.286923:0:17217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5344 00000004:00080000:2.0:1715330406.287045:0:3690:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d609f80/2, rc 0, transno 2725 00000100:00100000:2.0:1715330406.287051:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942538816:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1715330406.478913:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330406.755174:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d60b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3691:1798653942538944:0@lo:400:kworker.0 00000100:00100000:2.0:1715330406.755298:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330406.755328:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d60bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942539200:0@lo:400:kworker.0 00000100:00100000:2.0:1715330406.755355:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330406.755367:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942539456:0@lo:400:kworker.0 00000100:00100000:2.0:1715330406.755401:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330406.755415:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d60aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942539712:0@lo:400:kworker.0 00000100:00100000:2.0:1715330406.755429:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330406.755449:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1715330406.755455:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d60b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3691:1798653942539136:0@lo:400:kworker.0 00000100:00100000:2.0:1715330406.755481:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330406.755495:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d609880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942539392:0@lo:400:kworker.0 00000100:00100000:2.0:1715330406.755512:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330406.755521:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d608a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942539648:0@lo:400:kworker.0 00000100:00100000:2.0:1715330406.755535:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330406.755557:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d60b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942539072:0@lo:400:kworker.0 00000100:00100000:2.0:1715330406.755577:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330406.755590:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d608700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3689:1798653942539328:0@lo:400:kworker.0 00000100:00100000:2.0:1715330406.755607:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330406.755617:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3689:1798653942539584:0@lo:400:kworker.0 00000100:00100000:2.0:1715330406.755630:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330406.755642:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1715330406.755646:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d60a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3689:1798653942539008:0@lo:400:kworker.0 00000100:00100000:2.0:1715330406.755662:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330406.755672:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3689:1798653942539264:0@lo:400:kworker.0 00000100:00100000:2.0:1715330406.755688:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330406.755699:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3689:1798653942539520:0@lo:400:kworker.0 00000100:00100000:2.0:1715330406.755715:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330406.756082:0:7139:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942539200 00000100:00100000:3.0:1715330406.756092:0:7139:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942539200 00000100:00100000:3.0:1715330406.756124:0:7139:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942539072 00000100:00100000:3.0:1715330406.756126:0:7139:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942539072 00000100:00100000:3.0:1715330406.756140:0:7139:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3118 00000100:00100000:3.0:1715330406.756146:0:7139:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942539200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330406.756196:0:7139:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942539200:12345-0@lo:400:kworker.0 Request processed in 49us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330406.756202:0:7139:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3118 00000100:00100000:3.0:1715330406.756215:0:7139:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3119 00000100:00100000:3.0:1715330406.756219:0:7139:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:3689:x1798653942539072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330406.756239:0:7139:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:3689:x1798653942539072:12345-0@lo:400:kworker.0 Request processed in 20us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330406.756244:0:7139:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3119 00000100:00100000:3.0:1715330406.756258:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942539136 00000100:00100000:3.0:1715330406.756260:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942539136 00000100:00100000:3.0:1715330406.756273:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942539328 00000100:00100000:3.0:1715330406.756274:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942539328 00000100:00100000:3.0:1715330406.756287:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942539584 00000100:00100000:3.0:1715330406.756288:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942539584 00000100:00100000:3.0:1715330406.756296:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942539008 00000100:00100000:3.0:1715330406.756297:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942539008 00000100:00100000:3.0:1715330406.756304:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942539264 00000100:00100000:3.0:1715330406.756305:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942539264 00000100:00100000:3.0:1715330406.756313:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942539520 00000100:00100000:3.0:1715330406.756314:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942539520 00000100:00100000:3.0:1715330406.756322:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:3.0:1715330406.756325:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3691:x1798653942539136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330406.756345:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3691:x1798653942539136:12345-0@lo:400:kworker.0 Request processed in 19us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330406.756350:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:3.0:1715330406.756356:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:3.0:1715330406.756359:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091cc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1798653942539328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330406.756389:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091cc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1798653942539328:12345-0@lo:400:kworker.0 Request processed in 29us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330406.756394:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:3.0:1715330406.756403:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:3.0:1715330406.756406:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091cca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3689:x1798653942539584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330406.756429:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091cca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3689:x1798653942539584:12345-0@lo:400:kworker.0 Request processed in 22us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330406.756434:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00100000:3.0:1715330406.756441:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:3.0:1715330406.756445:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091cc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1798653942539008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330406.756447:0:7130:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942538944 00000100:00100000:0.0:1715330406.756451:0:7130:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942538944 00000100:00100000:3.0:1715330406.756461:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091cc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1798653942539008:12345-0@lo:400:kworker.0 Request processed in 16us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330406.756465:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:00100000:3.0:1715330406.756472:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:0.0:1715330406.756474:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1715330406.756475:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1798653942539264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330406.756478:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dca8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3691:x1798653942538944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330406.756492:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1798653942539264:12345-0@lo:400:kworker.0 Request processed in 17us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330406.756497:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:0.0:1715330406.756502:0:7130:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dca8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3691:x1798653942538944:12345-0@lo:400:kworker.0 Request processed in 23us (1206us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330406.756503:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:3.0:1715330406.756507:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091cc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3689:x1798653942539520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330406.756508:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1715330406.756524:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091cc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3689:x1798653942539520:12345-0@lo:400:kworker.0 Request processed in 17us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330406.756528:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00100000:0.0:1715330406.756532:0:17198:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942539456 00000100:00100000:0.0:1715330406.756534:0:17198:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942539456 00000100:00100000:0.0:1715330406.756549:0:17198:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942539712 00000100:00080000:3.0:1715330406.756550:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330376 00000100:00100000:0.0:1715330406.756551:0:17198:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942539712 00000100:00080000:3.0:1715330406.756554:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330376 00000100:00080000:3.0:1715330406.756556:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330376 00000100:00100000:0.0:1715330406.756561:0:17198:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942539392 00000100:00100000:0.0:1715330406.756562:0:17198:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942539392 00000100:00100000:0.0:1715330406.756572:0:17198:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942539648 00000100:00100000:0.0:1715330406.756573:0:17198:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942539648 00000100:00100000:0.0:1715330406.756595:0:17198:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1715330406.756599:0:17198:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942539456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330406.756624:0:17198:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942539456:12345-0@lo:400:kworker.0 Request processed in 25us (1222us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330406.756628:0:17198:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1715330406.756635:0:17217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1715330406.756643:0:17217:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3691:x1798653942539712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330406.756668:0:17217:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3691:x1798653942539712:12345-0@lo:400:kworker.0 Request processed in 29us (1239us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330406.757243:0:17198:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1715330406.757248:0:17198:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942539392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330406.757270:0:17198:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942539392:12345-0@lo:400:kworker.0 Request processed in 23us (1758us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330406.757274:0:17198:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1715330406.757282:0:17198:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1715330406.757285:0:17198:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942539648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330406.757298:0:17198:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942539648:12345-0@lo:400:kworker.0 Request processed in 13us (1763us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330406.757302:0:17198:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1715330406.757367:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d60a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3689:1798653942539008:0@lo:400:kworker.0 00000100:00100000:0.0:1715330406.757387:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3689:1798653942539264:0@lo:400:kworker.0 00000100:00100000:0.0:1715330406.757394:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3689:1798653942539520:0@lo:400:kworker.0 00000100:00100000:0.0:1715330406.757401:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d60b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942539072:0@lo:400:kworker.0 00000100:00100000:0.0:1715330406.757407:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d608700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3689:1798653942539328:0@lo:400:kworker.0 00000100:00100000:0.0:1715330406.757413:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3689:1798653942539584:0@lo:400:kworker.0 00000100:00100000:0.0:1715330406.757439:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d60b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3691:1798653942539136:0@lo:400:kworker.0 00000100:00100000:0.0:1715330406.757446:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d609880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942539392:0@lo:400:kworker.0 00000100:00100000:0.0:1715330406.757453:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d608a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942539648:0@lo:400:kworker.0 00000100:00100000:0.0:1715330406.757458:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d60b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3691:1798653942538944:0@lo:400:kworker.0 00000100:00100000:0.0:1715330406.757465:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d60bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942539200:0@lo:400:kworker.0 00000100:00100000:0.0:1715330406.757471:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942539456:0@lo:400:kworker.0 00000100:00100000:0.0:1715330406.757478:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d60aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942539712:0@lo:400:kworker.0 00000100:00100000:1.0:1715330406.757751:0:17217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00080000:3.0:1715330406.760011:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330376 00000100:00100000:0.0:1715330406.771053:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942539776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1715330406.771135:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330406.771170:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942539840:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1715330406.771184:0:9401:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942539776 00000100:00100000:3.0:1715330406.771196:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330406.771216:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942539840 00000100:00100000:1.0:1715330406.771222:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942539840 00000100:00100000:1.0:1715330406.771255:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1715330406.771267:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942539840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1715330406.771292:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 172032 granted 317126336 pending 0 free 3923546112 avail 3692023808 00000100:00100000:1.0:1715330406.771327:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942539840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330406.771332:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1715330406.771384:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942539840:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1715330406.771414:0:9401:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942539776 00000100:00100000:0.0:1715330406.771443:0:9401:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1715330406.771449:0:9401:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009132e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3689:x1798653942539776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1715330406.771460:0:9401:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 172032 granted 317126336 pending 0 free 3923546112 avail 3692023808 00000100:00100000:0.0:1715330406.771484:0:9401:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009132e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3689:x1798653942539776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330406.771490:0:9401:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1715330406.771517:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942539776:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1715330407.481252:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330408.186269:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091ccb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942539904:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1715330408.186470:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330408.186525:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942539904 00000100:00100000:2.0:1715330408.186533:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942539904 00000100:00100000:2.0:1715330408.186584:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3120 00000100:00100000:2.0:1715330408.186592:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942539904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1715330408.186636:0:19960:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444089856 avail 1314627584 00000100:00100000:2.0:1715330408.186673:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942539904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330408.186681:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3120 00000100:00100000:2.0:1715330408.186717:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091ccb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942539904:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1715330408.272026:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330408.272128:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330408.272152:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330408.272163:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938132544 00000100:00100000:1.0:1715330408.272173:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330408.272174:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938132544 00000100:00100000:1.0:1715330408.272216:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330408.272234:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938132608 00000100:00100000:0.0:1715330408.272237:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938132608 00000100:00100000:1.0:1715330408.272242:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 427 00000100:00100000:1.0:1715330408.272250:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+15:2014:x1798653938132544:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:0.0:1715330408.272254:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 428 00000100:00100000:0.0:1715330408.272258:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938132608:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:3.0:1715330408.272457:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938132672 00000100:00100000:3.0:1715330408.272461:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938132672 00000100:00100000:3.0:1715330408.272484:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938132736 00000100:00100000:3.0:1715330408.272485:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938132736 00000100:00100000:3.0:1715330408.272500:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 302 00000100:00100000:3.0:1715330408.272505:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938132672:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:0.0:1715330408.272581:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938132608:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 320us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330408.273056:0:7129:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938132480 00000100:00100000:2.0:1715330408.273062:0:7129:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938132480 00000100:00100000:2.0:1715330408.273096:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 377 00000100:00100000:2.0:1715330408.273101:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dca8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2013:x1798653938132480:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:0.0:1715330408.273224:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 428 00000100:00100000:0.0:1715330408.273259:0:17205:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 303 00000100:00100000:0.0:1715330408.273264:0:17205:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:72de1896-1df4-4b3a-930a-9116d2c66168+5:2013:x1798653938132736:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:3.0:1715330408.273419:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938132672:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 911us (1243us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330408.273426:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 302 00000100:00080000:3.0:1715330408.273447:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330378 00000100:00080000:3.0:1715330408.273450:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330378 00000100:00080000:3.0:1715330408.273452:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330378 00000100:00080000:3.0:1715330408.273454:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330378 00000100:00080000:3.0:1715330408.273455:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330378 00000100:00100000:2.0:1715330408.273559:0:7129:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dca8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2013:x1798653938132480:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 456us (1540us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330408.273566:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 377 00000100:00100000:1.0:1715330408.273948:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+15:2014:x1798653938132544:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 1696us (1818us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330408.273957:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 427 00000100:00100000:0.0:1715330408.274653:0:17205:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:72de1896-1df4-4b3a-930a-9116d2c66168+5:2013:x1798653938132736:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 1386us (2434us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330408.274661:0:17205:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 303 00010000:00010000:1.0:1715330408.483255:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330409.485955:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330409.637645:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1715330409.637669:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942539968:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1715330409.637759:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330409.640798:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942539968 00000100:00100000:3.0:1715330409.640813:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942539968 00000100:00100000:3.0:1715330409.641455:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3121 00000100:00100000:3.0:1715330409.641461:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091ccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942539968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1715330409.641500:0:8592:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445060608 avail 1315598336 00000100:00100000:3.0:1715330409.641580:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091ccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942539968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (3822us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330409.641586:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3121 00000100:00100000:2.0:1715330409.641652:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942539968:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1715330410.487444:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330410.514967:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942540032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1715330410.515063:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330410.515154:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942540032 00000100:00100000:2.0:1715330410.515164:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942540032 00000100:00100000:2.0:1715330410.515211:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1715330410.515217:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942540032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1715330410.515251:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1715330410.515288:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942540032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330410.515293:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00080000:3.0:1715330410.515349:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330380 00000100:00100000:3.0:1715330410.515379:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942540032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1715330410.531051:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1715330410.531081:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091cca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942540096:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1715330410.531167:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330410.531355:0:9401:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942540096 00000100:00100000:2.0:1715330410.531364:0:9401:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942540096 00000100:00100000:2.0:1715330410.531413:0:9401:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1715330410.531420:0:9401:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942540096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1715330410.531450:0:9401:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1715330410.531491:0:9401:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942540096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330410.531500:0:9401:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00080000:3.0:1715330410.531571:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330380 00000100:00100000:3.0:1715330410.531604:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091cca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942540096:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1715330411.490332:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330411.763500:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091ccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3690:1798653942540160:0@lo:400:kworker.0 00000100:00100000:0.0:1715330411.763577:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330411.763607:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1715330411.763612:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091ccad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3690:1798653942540224:0@lo:400:kworker.0 00000100:00100000:0.0:1715330411.763635:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330411.763676:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942540224 00000100:00100000:0.0:1715330411.763683:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942540224 00000100:00100000:2.0:1715330411.763810:0:7130:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942540160 00000100:00100000:2.0:1715330411.763813:0:7130:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942540160 00000100:00100000:1.0:1715330411.763857:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091cc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3691:1798653942540480:0@lo:400:kworker.0 00000100:00100000:1.0:1715330411.763882:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330411.763936:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091cc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942540288:0@lo:400:kworker.0 00000100:00100000:3.0:1715330411.763963:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330411.763978:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091cca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3688:1798653942540544:0@lo:400:kworker.0 00000100:00100000:3.0:1715330411.764000:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942540288 00000100:00100000:3.0:1715330411.764002:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942540288 00000100:00100000:3.0:1715330411.764025:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3122 00000100:00100000:3.0:1715330411.764031:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942540288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330411.764072:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942540288:12345-0@lo:400:kworker.0 Request processed in 41us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330411.764078:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3122 00000100:00100000:3.0:1715330411.764108:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091cc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3689:1798653942540352:0@lo:400:kworker.0 00000100:00100000:2.0:1715330411.764951:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1715330411.764956:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dca8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3690:x1798653942540160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330411.764994:0:7130:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dca8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3690:x1798653942540160:12345-0@lo:400:kworker.0 Request processed in 38us (1418us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330411.765000:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00080000:2.0:1715330411.765032:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330381 00000100:00100000:1.0:1715330411.765146:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134565180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3691:1798653942540736:0@lo:400:kworker.0 00000100:00100000:1.0:1715330411.765166:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330411.767016:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942540480 00000100:00100000:0.0:1715330411.767025:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942540480 00000100:00100000:0.0:1715330411.767066:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:0.0:1715330411.767072:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009132e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3690:x1798653942540224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330411.767121:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009132e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3690:x1798653942540224:12345-0@lo:400:kworker.0 Request processed in 49us (3485us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330411.767126:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00100000:0.0:1715330411.767137:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:0.0:1715330411.767140:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3691:x1798653942540480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330411.767159:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3691:x1798653942540480:12345-0@lo:400:kworker.0 Request processed in 17us (3276us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330411.767163:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00100000:0.0:1715330411.767185:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091cc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942540416:0@lo:400:kworker.0 00000100:00100000:0.0:1715330411.767208:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330411.767220:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134566680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942540672:0@lo:400:kworker.0 00000100:00100000:0.0:1715330411.767237:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330411.767246:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134567100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942540928:0@lo:400:kworker.0 00000100:00100000:0.0:1715330411.767258:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330411.767313:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091ccad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3690:1798653942540224:0@lo:400:kworker.0 00000100:00100000:0.0:1715330411.767324:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091ccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3690:1798653942540160:0@lo:400:kworker.0 00000100:00100000:0.0:1715330411.767353:0:17205:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942540672 00000100:00100000:0.0:1715330411.767355:0:17205:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942540672 00000100:00100000:0.0:1715330411.767371:0:17205:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942540928 00000100:00100000:0.0:1715330411.767373:0:17205:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942540928 00000100:00100000:0.0:1715330411.767384:0:17205:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1715330411.767387:0:17205:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009132ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942540672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330411.767409:0:17205:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009132ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942540672:12345-0@lo:400:kworker.0 Request processed in 21us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330411.767414:0:17205:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1715330411.767420:0:17205:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1715330411.767423:0:17205:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009132f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3690:x1798653942540928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330411.767438:0:17205:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009132f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3690:x1798653942540928:12345-0@lo:400:kworker.0 Request processed in 13us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330411.767442:0:17205:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1715330411.767458:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880134566680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942540672:0@lo:400:kworker.0 00000100:00100000:0.0:1715330411.767465:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880134567100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942540928:0@lo:400:kworker.0 00000100:00100000:0.0:1715330411.767497:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942540416 00000100:00100000:0.0:1715330411.767499:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942540416 00000100:00100000:0.0:1715330411.767513:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3123 00000100:00100000:0.0:1715330411.767517:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009132ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942540416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330411.767539:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009132ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942540416:12345-0@lo:400:kworker.0 Request processed in 22us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330411.767544:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3123 00000100:00100000:0.0:1715330411.767556:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091cc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942540416:0@lo:400:kworker.0 00000100:00080000:2.0:1715330411.767611:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330381 00000100:00080000:2.0:1715330411.767614:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330381 00000100:00100000:0.0:1715330411.767952:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942540736 00000100:00100000:0.0:1715330411.767957:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942540736 00000100:00100000:0.0:1715330411.768121:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:0.0:1715330411.768125:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3691:x1798653942540736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330411.768152:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3691:x1798653942540736:12345-0@lo:400:kworker.0 Request processed in 27us (2985us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330411.768156:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00080000:2.0:1715330411.768444:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330381 00000100:00100000:1.0:1715330411.768515:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880134565180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3691:1798653942540736:0@lo:400:kworker.0 00000100:00100000:1.0:1715330411.768534:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091cc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3691:1798653942540480:0@lo:400:kworker.0 00000100:00100000:2.0:1715330411.768576:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330411.768602:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134564000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3688:1798653942540800:0@lo:400:kworker.0 00000100:00100000:2.0:1715330411.768624:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330411.768643:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091cc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942540288:0@lo:400:kworker.0 00000100:00100000:3.0:1715330411.768689:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330411.768706:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942540608:0@lo:400:kworker.0 00000100:00100000:3.0:1715330411.768726:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330411.768753:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134565880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942540864:0@lo:400:kworker.0 00000100:00100000:3.0:1715330411.768766:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330411.768785:0:17217:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942540608 00000100:00100000:3.0:1715330411.768787:0:17217:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942540608 00000100:00100000:3.0:1715330411.768803:0:17217:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942540864 00000100:00100000:3.0:1715330411.768805:0:17217:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942540864 00000100:00100000:3.0:1715330411.768815:0:17217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1715330411.768819:0:17217:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942540608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330411.768840:0:17217:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942540608:12345-0@lo:400:kworker.0 Request processed in 21us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330411.768845:0:17217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1715330411.768853:0:17217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1715330411.768856:0:17217:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942540864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330411.768873:0:17217:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942540864:12345-0@lo:400:kworker.0 Request processed in 16us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330411.768881:0:17217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1715330411.768896:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942540608:0@lo:400:kworker.0 00000100:00100000:3.0:1715330411.768903:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880134565880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942540864:0@lo:400:kworker.0 00000100:00100000:0.0:1715330411.768959:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942540544 00000100:00100000:0.0:1715330411.768962:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942540544 00000100:00100000:0.0:1715330411.768977:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942540800 00000100:00100000:0.0:1715330411.768979:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942540800 00000100:00100000:0.0:1715330411.768988:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942540352 00000100:00100000:0.0:1715330411.768990:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942540352 00000100:00100000:0.0:1715330411.768998:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:0.0:1715330411.769002:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134565f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3688:x1798653942540544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330411.769027:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134565f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3688:x1798653942540544:12345-0@lo:400:kworker.0 Request processed in 24us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330411.769031:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00000100:00100000:0.0:1715330411.769037:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:0.0:1715330411.769041:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134564700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3688:x1798653942540800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330411.769055:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134564700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3688:x1798653942540800:12345-0@lo:400:kworker.0 Request processed in 14us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330411.769059:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00100000:0.0:1715330411.769065:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00000100:00100000:0.0:1715330411.769068:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3689:x1798653942540352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330411.769083:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3689:x1798653942540352:12345-0@lo:400:kworker.0 Request processed in 15us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330411.769088:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00000100:00100000:2.0:1715330411.769148:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091cca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3688:1798653942540544:0@lo:400:kworker.0 00000100:00100000:2.0:1715330411.769156:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880134564000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3688:1798653942540800:0@lo:400:kworker.0 00000100:00080000:2.0:1715330411.769167:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330381 00000100:00080000:2.0:1715330411.769169:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330381 00000100:00100000:2.0:1715330411.769182:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091cc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3689:1798653942540352:0@lo:400:kworker.0 00000100:00100000:1.0:1715330411.780386:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093b73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942540992:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1715330411.780405:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1715330411.780421:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942541056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1715330411.780491:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330411.780569:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942541056 00000100:00100000:2.0:1715330411.780578:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942541056 00000100:00100000:2.0:1715330411.780804:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1715330411.780812:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3689:x1798653942541056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1715330411.780845:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 172032 granted 317126336 pending 0 free 3923546112 avail 3692023808 00000100:00100000:1.0:1715330411.781092:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330411.781154:0:9401:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942540992 00000100:00100000:3.0:1715330411.781158:0:9401:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942540992 00000100:00100000:3.0:1715330411.781178:0:9401:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1715330411.781182:0:9401:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942540992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1715330411.781196:0:9401:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 172032 granted 317126336 pending 0 free 3923546112 avail 3692023808 00000100:00100000:3.0:1715330411.781234:0:9401:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942540992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330411.781240:0:9401:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1715330411.781890:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093b73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942540992:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1715330411.782000:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3689:x1798653942541056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1187us (1509us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330411.782011:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1715330411.782080:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942541056:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1715330412.248364:0:10666:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4294970021 is committed 00000001:02000400:1.0:1715330412.383929:0:32092:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 63b: async write errors should be returned to fsync ============================================================= 04:40:11 (1715330411) 00010000:00010000:1.0:1715330412.493159:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330412.934851:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330412.936827:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938132864 00000100:00100000:3.0:1715330412.936841:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938132864 00000100:00080000:2.0:1715330412.936896:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330382 00000100:00100000:3.0:1715330412.936927:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23850 00000100:00100000:3.0:1715330412.936935:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+15:21826:x1798653938132864:12345-192.168.204.49@tcp:101:dd.0 00010000:00010000:3.0:1715330412.936955:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330412.936959:0:25569:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1715330412.936989:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6640/0xd895711d66dbe15 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf29 expref: 15 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330412.937008:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:3.0:1715330412.937013:0:25569:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330412.937031:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81f80/0xd895711d66dbe23 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbf30 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330412.937157:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81200/0xd895711d66dbe2a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330412.937170:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81200/0xd895711d66dbe2a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330412.937178:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81200/0xd895711d66dbe2a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330412.937191:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81d40/0xd895711d66dbe31 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x55b36aa0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330412.937196:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81d40/0xd895711d66dbe31 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x55b36aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330412.937202:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81d40/0xd895711d66dbe31 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x55b36aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00000004:00080000:3.0:1715330412.937540:0:25569:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa01:0x0], index 0: 0 00010000:00010000:3.0:1715330412.937684:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82ac0/0xd895711d66dbe38 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x159a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330412.937691:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82ac0/0xd895711d66dbe38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x159a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330412.937698:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82ac0/0xd895711d66dbe38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x159a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330412.937767:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81200/0xd895711d66dbe2a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330412.937777:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81200/0xd895711d66dbe2a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330412.937782:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81200/0xd895711d66dbe2a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330412.937788:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81200/0xd895711d66dbe2a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330412.937795:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da81200 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330412.937801:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81200/0xd895711d66dbe2a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330412.937808:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81200/0xd895711d66dbe2a lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330412.937816:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:3.0:1715330412.937819:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330412.937823:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81200/0xd895711d66dbe2a lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330412.937827:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81200/0xd895711d66dbe2a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00000004:00010000:3.0:1715330412.937839:0:25569:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88008d7b6680 reply state ffff88012fbdb000 transno 4294984122 ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81d40/0xd895711d66dbe31 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x55b36aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330412.937847:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81d40/0xd895711d66dbe31 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x55b36aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330412.937854:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x55b36aa0 (ffff880091ea7100) 00010000:00010000:3.0:1715330412.937856:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330412.937859:0:25569:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330412.937884:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81f80/0xd895711d66dbe23 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf30 expref: 17 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330412.937894:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82ac0/0xd895711d66dbe38 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x159a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf30 expref: 16 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330412.937900:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159a:0x0].0x0 (ffff880091ea7700) 00010000:00010000:3.0:1715330412.937901:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330412.937903:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011da82ac0, rc 0) 00000100:00100000:3.0:1715330412.937983:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+17:21826:x1798653938132864:12345-192.168.204.49@tcp:101:dd.0 Request processed in 1048us (3143us total) trans 4294984122 rc 0/0 00000100:00100000:3.0:1715330412.937993:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23850 00000100:00100000:0.0:1715330412.949236:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330412.949305:0:17205:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938132928 00000100:00100000:3.0:1715330412.949317:0:17205:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938132928 00000100:00100000:3.0:1715330412.949385:0:17205:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5345 00000100:00100000:3.0:1715330412.949392:0:17205:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:72de1896-1df4-4b3a-930a-9116d2c66168+6:21826:x1798653938132928:12345-192.168.204.49@tcp:101:dd.0 00010000:00010000:3.0:1715330412.949416:0:17205:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330412.949443:0:17205:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011da82400/0xd895711d66dbe46 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbf37 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1715330412.949474:0:17205:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0xa01:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1715330412.949503:0:17205:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330412.949505:0:17205:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330412.949520:0:17205:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011da82400/0xd895711d66dbe46 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf37 expref: 7 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330412.949537:0:17205:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011da82400/0xd895711d66dbe46 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf37 expref: 7 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330412.949557:0:17205:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011da82400, rc 0) 00000100:00100000:3.0:1715330412.949607:0:17205:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:72de1896-1df4-4b3a-930a-9116d2c66168+7:21826:x1798653938132928:12345-192.168.204.49@tcp:101:dd.0 Request processed in 215us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330412.949614:0:17205:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5345 00000100:00080000:2.0:1715330412.949932:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330382 00000100:00100000:2.0:1715330412.956512:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330412.956586:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938133056 00000100:00100000:3.0:1715330412.956794:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938133056 00000100:00100000:3.0:1715330412.956842:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5221 00000100:00100000:3.0:1715330412.956852:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+17:21826:x1798653938133056:12345-192.168.204.49@tcp:35:dd.0 00000100:00100000:3.0:1715330412.958366:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+18:21826:x1798653938133056:12345-192.168.204.49@tcp:35:dd.0 Request processed in 1509us (1861us total) trans 4294984123 rc 0/0 00000100:00100000:3.0:1715330412.958376:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5221 00000100:00100000:0.0:1715330412.977014:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330412.977340:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938133120 00000100:00100000:1.0:1715330412.977354:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938133120 00000100:00100000:1.0:1715330412.977410:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23851 00000100:00100000:1.0:1715330412.977417:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009132f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+18:21827:x1798653938133120:12345-192.168.204.49@tcp:101:rm.0 00010000:00010000:1.0:1715330412.977443:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330412.977467:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5eac0/0xd895711d66dbe4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbf3e expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330412.977535:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f840/0xd895711d66dbe54 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330412.977549:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f840/0xd895711d66dbe54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330412.977560:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f840/0xd895711d66dbe54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000004:00200000:1.0:1715330412.977613:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 270336 00000004:00200000:1.0:1715330412.977617:0:7134:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1715330412.977636:0:7134:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f840/0xd895711d66dbe54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330412.978868:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5eac0/0xd895711d66dbe4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf3e expref: 20 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330412.978886:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f840/0xd895711d66dbe54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf3e expref: 19 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330412.978895:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:1.0:1715330412.978899:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1715330412.978902:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091c5f840, rc 0) 00000100:00100000:1.0:1715330412.978985:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009132f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+19:21827:x1798653938133120:12345-192.168.204.49@tcp:101:rm.0 Request processed in 1566us (1977us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330412.978993:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23851 00000100:00100000:0.0:1715330412.989422:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330412.989498:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938133248 00000100:00100000:1.0:1715330412.989509:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938133248 00000100:00100000:1.0:1715330412.989565:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23852 00000100:00100000:1.0:1715330412.989573:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009132f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+19:21827:x1798653938133248:12345-192.168.204.49@tcp:36:rm.0 00010000:00010000:1.0:1715330412.989632:0:7134:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1715330412.989665:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82ac0/0xd895711d66dbe38 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x159a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf30 expref: 19 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330412.989685:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159a:0x0].0x0 (ffff880091ea7700) 00010000:00010000:1.0:1715330412.989702:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f840/0xd895711d66dbe54 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf3e expref: 18 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330412.989710:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:1.0:1715330412.989713:0:7134:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330412.989763:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5fcc0/0xd895711d66dbe5b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330412.989775:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5fcc0/0xd895711d66dbe5b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330412.989786:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5fcc0/0xd895711d66dbe5b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330412.989797:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ef40/0xd895711d66dbe62 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x55b36aa0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330412.989808:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ef40/0xd895711d66dbe62 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x55b36aa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330412.989815:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ef40/0xd895711d66dbe62 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x55b36aa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330412.989888:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c6c0/0xd895711d66dbe69 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x159a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330412.989894:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c6c0/0xd895711d66dbe69 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330412.989899:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c6c0/0xd895711d66dbe69 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000040:00080000:1.0:1715330412.990173:0:7134:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].51, 64 off11456 00000004:00080000:1.0:1715330412.990180:0:7134:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 387466447778ns, next at 388466445873ns, rc = 0 00010000:00010000:1.0:1715330412.990229:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d200/0xd895711d66dbe70 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x159a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330412.990236:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d200/0xd895711d66dbe70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x159a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330412.990243:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d200/0xd895711d66dbe70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x159a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330412.990250:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d200/0xd895711d66dbe70 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x159a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330412.990265:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d200/0xd895711d66dbe70 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x159a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330412.990270:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d200/0xd895711d66dbe70 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x159a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330412.990280:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d200/0xd895711d66dbe70 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x159a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330412.990286:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5d200 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:1.0:1715330412.990290:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d200/0xd895711d66dbe70 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x159a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330412.990297:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d200/0xd895711d66dbe70 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x159a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330412.990305:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159a:0x0].0x0 (ffff88008b0d2e00) 00010000:00010000:1.0:1715330412.990307:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1715330412.990311:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d200/0xd895711d66dbe70 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x159a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330412.990315:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d200/0xd895711d66dbe70 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x159a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330412.990342:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c6c0/0xd895711d66dbe69 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330412.990347:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c6c0/0xd895711d66dbe69 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x159a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330412.990352:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c6c0/0xd895711d66dbe69 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x159a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330412.990356:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5c6c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330412.990360:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c6c0/0xd895711d66dbe69 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x159a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330412.990366:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c6c0/0xd895711d66dbe69 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x159a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330412.990376:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159a:0x0].0x0 (ffff88008b0d2e00) 00010000:00010000:1.0:1715330412.990379:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715330412.990382:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c6c0/0xd895711d66dbe69 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x159a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330412.990387:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5c6c0/0xd895711d66dbe69 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x159a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330412.990508:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5fcc0/0xd895711d66dbe5b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330412.990513:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5fcc0/0xd895711d66dbe5b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330412.990517:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5fcc0/0xd895711d66dbe5b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330412.990521:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5fcc0/0xd895711d66dbe5b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330412.990525:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5fcc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330412.990528:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5fcc0/0xd895711d66dbe5b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330412.990533:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5fcc0/0xd895711d66dbe5b lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330412.990540:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:1.0:1715330412.990542:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330412.990544:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5fcc0/0xd895711d66dbe5b lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330412.990549:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5fcc0/0xd895711d66dbe5b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00000004:00010000:1.0:1715330412.990557:0:7134:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009132f800 reply state ffff88009b414000 transno 4294984124 ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ef40/0xd895711d66dbe62 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x55b36aa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330412.990566:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ef40/0xd895711d66dbe62 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x55b36aa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330412.990571:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x55b36aa0 (ffff880091ea7100) 00010000:00010000:1.0:1715330412.990574:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330412.990578:0:7134:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1715330412.990659:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009132f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+19:21827:x1798653938133248:12345-192.168.204.49@tcp:36:rm.0 Request processed in 1085us (1250us total) trans 4294984124 rc 0/0 00000100:00100000:1.0:1715330412.990667:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23852 00000100:00100000:0.0:1715330413.025812:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330413.025878:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938133312 00000100:00100000:2.0:1715330413.025987:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938133312 00000100:00100000:2.0:1715330413.026269:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23853 00000100:00100000:2.0:1715330413.026277:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009132fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+19:21830:x1798653938133312:12345-192.168.204.49@tcp:101:multiop.0 00010000:00010000:2.0:1715330413.026298:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330413.026316:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5d40/0xd895711d66dbe77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbf45 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330413.026379:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6880/0xd895711d66dbe7e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330413.026392:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6880/0xd895711d66dbe7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330413.026403:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6880/0xd895711d66dbe7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00000004:00200000:2.0:1715330413.026448:0:25569:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 270336 00000004:00200000:2.0:1715330413.026451:0:25569:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1715330413.026470:0:25569:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6880/0xd895711d66dbe7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330413.026491:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5d40/0xd895711d66dbe77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf45 expref: 21 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330413.026506:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6880/0xd895711d66dbe7e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf45 expref: 20 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330413.026512:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:2.0:1715330413.026515:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1715330413.026518:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938b6880, rc 0) 00000100:00100000:2.0:1715330413.026560:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009132fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+20:21830:x1798653938133312:12345-192.168.204.49@tcp:101:multiop.0 Request processed in 284us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330413.026566:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23853 00000100:00100000:0.0:1715330413.032138:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330413.032235:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938133440 00000100:00100000:1.0:1715330413.032247:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938133440 00000100:00100000:1.0:1715330413.032318:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23854 00000100:00100000:1.0:1715330413.032327:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009132c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+20:21830:x1798653938133440:12345-192.168.204.49@tcp:101:multiop.0 00010000:00010000:1.0:1715330413.032348:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715330413.032352:0:7134:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1715330413.032383:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6880/0xd895711d66dbe7e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf45 expref: 20 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330413.032400:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:1.0:1715330413.032404:0:7134:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715330413.032418:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d8c0/0xd895711d66dbe85 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbf4c expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330413.032526:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5dd40/0xd895711d66dbe8c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330413.032543:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5dd40/0xd895711d66dbe8c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330413.032551:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5dd40/0xd895711d66dbe8c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330413.032559:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f600/0xd895711d66dbe93 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x55b36aa0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330413.032565:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f600/0xd895711d66dbe93 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x55b36aa0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330413.032569:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f600/0xd895711d66dbe93 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x55b36aa0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000004:00080000:1.0:1715330413.032851:0:7134:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa01:0x0], index 1: 0 00010000:00010000:1.0:1715330413.032971:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5fa80/0xd895711d66dbe9a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x159b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330413.032978:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5fa80/0xd895711d66dbe9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x159b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330413.032984:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5fa80/0xd895711d66dbe9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x159b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330413.033013:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5dd40/0xd895711d66dbe8c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330413.033019:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5dd40/0xd895711d66dbe8c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330413.033024:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5dd40/0xd895711d66dbe8c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330413.033030:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5dd40/0xd895711d66dbe8c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330413.033036:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5dd40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:1.0:1715330413.033040:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5dd40/0xd895711d66dbe8c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330413.033046:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5dd40/0xd895711d66dbe8c lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330413.033054:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:1.0:1715330413.033057:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715330413.033059:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5dd40/0xd895711d66dbe8c lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330413.033064:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5dd40/0xd895711d66dbe8c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00000004:00010000:1.0:1715330413.033073:0:7134:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009132c380 reply state ffff88009ae81000 transno 4294984125 ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f600/0xd895711d66dbe93 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x55b36aa0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330413.033080:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f600/0xd895711d66dbe93 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x55b36aa0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:1.0:1715330413.033085:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x55b36aa0 (ffff880091ea7100) 00010000:00010000:1.0:1715330413.033087:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715330413.033089:0:7134:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1715330413.033108:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5d8c0/0xd895711d66dbe85 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf4c expref: 22 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330413.033118:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5fa80/0xd895711d66dbe9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x159b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf4c expref: 21 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330413.033124:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159b:0x0].0x0 (ffff88008b0d2300) 00010000:00010000:1.0:1715330413.033127:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715330413.033129:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091c5fa80, rc 0) 00000100:00100000:1.0:1715330413.034626:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009132c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+22:21830:x1798653938133440:12345-192.168.204.49@tcp:101:multiop.0 Request processed in 2295us (2487us total) trans 4294984125 rc 0/0 00000100:00100000:1.0:1715330413.034636:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23854 00000100:00100000:0.0:1715330413.044127:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330413.044227:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938133504 00000100:00100000:3.0:1715330413.044238:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938133504 00000100:00100000:3.0:1715330413.044303:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5346 00000100:00100000:3.0:1715330413.044312:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009132c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72de1896-1df4-4b3a-930a-9116d2c66168+5:21830:x1798653938133504:12345-192.168.204.49@tcp:101:multiop.0 00010000:00010000:3.0:1715330413.044331:0:9633:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330413.044354:0:9633:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011da82880/0xd895711d66dbea8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbf53 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1715330413.044377:0:9633:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000401:0xa01:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1715330413.044400:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330413.044402:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330413.044413:0:9633:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011da82880/0xd895711d66dbea8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf53 expref: 6 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330413.044433:0:9633:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011da82880/0xd895711d66dbea8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf53 expref: 6 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330413.044443:0:9633:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011da82880, rc 0) 00000100:00080000:2.0:1715330413.044464:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330383 00000100:00100000:3.0:1715330413.045312:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009132c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72de1896-1df4-4b3a-930a-9116d2c66168+6:21830:x1798653938133504:12345-192.168.204.49@tcp:101:multiop.0 Request processed in 998us (1195us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330413.045320:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5346 00000100:00100000:0.0:1715330413.058715:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330413.058842:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938133568 00000100:00100000:1.0:1715330413.058854:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938133568 00000100:00100000:1.0:1715330413.058937:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23855 00000100:00100000:1.0:1715330413.058945:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009132ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+22:21830:x1798653938133568:12345-192.168.204.49@tcp:44:multiop.0 00000001:00080000:0.0:1715330413.061252:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984125 is committed 00000004:00080000:0.0:1715330413.061275:0:7116:0:(osp_sync.c:1604:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 34 committed 00010000:00010000:3.0:1715330413.061310:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81d40/0xd895711d66dbe31 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x55b36aa0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330413.061325:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81d40/0xd895711d66dbe31 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x55b36aa0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330413.061331:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81d40/0xd895711d66dbe31 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x55b36aa0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330413.061340:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da81d40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330413.061345:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81d40/0xd895711d66dbe31 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x55b36aa0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330413.061354:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81d40/0xd895711d66dbe31 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x55b36aa0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330413.061376:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x55b36aa0 (ffff880091ea7100) 00010000:00010000:3.0:1715330413.061379:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330413.061385:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81d40/0xd895711d66dbe31 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x55b36aa0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330413.061390:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81d40/0xd895711d66dbe31 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x55b36aa0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330413.061419:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ef40/0xd895711d66dbe62 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x55b36aa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330413.061424:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ef40/0xd895711d66dbe62 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x55b36aa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330413.061429:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ef40/0xd895711d66dbe62 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x55b36aa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330413.061432:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5ef40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330413.061434:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ef40/0xd895711d66dbe62 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x55b36aa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330413.061439:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ef40/0xd895711d66dbe62 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x55b36aa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330413.061445:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x55b36aa0 (ffff880091ea7100) 00010000:00010000:3.0:1715330413.061447:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330413.061449:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ef40/0xd895711d66dbe62 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x55b36aa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330413.061453:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5ef40/0xd895711d66dbe62 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x55b36aa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330413.061462:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f600/0xd895711d66dbe93 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x55b36aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330413.061467:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f600/0xd895711d66dbe93 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x55b36aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330413.061472:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f600/0xd895711d66dbe93 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x55b36aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330413.061481:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880091c5f600 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330413.061483:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f600/0xd895711d66dbe93 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x55b36aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330413.061489:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f600/0xd895711d66dbe93 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x55b36aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330413.061495:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x55b36aa0 (ffff880091ea7100) 00010000:00010000:3.0:1715330413.061497:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330413.061499:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f600/0xd895711d66dbe93 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x55b36aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330413.061504:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5f600/0xd895711d66dbe93 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x55b36aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00000100:00100000:1.0:1715330413.061773:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009132ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+15:21830:x1798653938133568:12345-192.168.204.49@tcp:44:multiop.0 Request processed in 2821us (3065us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330413.061788:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23855 00000100:00100000:2.0:1715330413.063358:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1715330413.063488:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134564380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942541120:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1715330413.063614:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330413.063663:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942541120 00000100:00100000:0.0:1715330413.063674:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942541120 00000100:00100000:0.0:1715330413.063766:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5347 00000100:00100000:0.0:1715330413.063774:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134565500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942541120:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1715330413.063818:0:9633:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2561 count 1 00010000:00010000:0.0:1715330413.063845:0:9633:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880087726ac0/0xd895711d66dbeaf lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330413.063870:0:9633:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011da82400/0xd895711d66dbe46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf37 expref: 6 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330413.063879:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1715330413.063882:0:9633:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1715330413.063886:0:9633:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880087726ac0/0xd895711d66dbeaf lrc: 4/0,1 mode: --/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330413.063917:0:9633:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011da82400/0xd895711d66dbe46 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf37 expref: 6 pid: 17205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330413.063936:0:9633:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011da82400/0xd895711d66dbe46 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf37 expref: 6 pid: 17205 timeout: 487 lvb_type: 0 00000100:00100000:0.0:1715330413.063947:0:9633:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009132f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9633:1798653942541184:192.168.204.49@tcp:104: 00000100:00080000:2.0:1715330413.064119:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330383 00000100:00100000:0.0:1715330413.064914:0:9633:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011db636c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715330413.066578:0:9633:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009132f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9633:1798653942541184:192.168.204.49@tcp:104: 00010000:00010000:2.0:1715330413.066610:0:9633:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880087726ac0/0xd895711d66dbeaf lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715330413.066619:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330413.066678:0:17205:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938133632 00000100:00100000:1.0:1715330413.066686:0:17205:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938133632 00000100:00100000:1.0:1715330413.066752:0:17205:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5348 00000100:00100000:1.0:1715330413.066764:0:17205:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009132f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938133632:12345-192.168.204.49@tcp:16:multiop.0 00000100:00100000:1.0:1715330413.066982:0:17205:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009132f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938133632:12345-192.168.204.49@tcp:16:multiop.0 Request processed in 219us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330413.066990:0:17205:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5348 00000100:00100000:1.0:1715330413.068465:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330413.068764:0:10673:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938133696 00000100:00100000:3.0:1715330413.068771:0:10673:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938133696 00010000:00010000:3.0:1715330413.068803:0:10673:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011da82400/0xd895711d66dbe46 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf37 expref: 7 pid: 17205 timeout: 487 lvb_type: 0 00000100:00100000:3.0:1715330413.070447:0:10673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1591 00000100:00100000:3.0:1715330413.070460:0:10673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:72de1896-1df4-4b3a-930a-9116d2c66168+7:2012:x1798653938133696:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1715330413.070485:0:10673:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330413.070496:0:10673:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011da82400/0xd895711d66dbe46 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf37 expref: 7 pid: 17205 timeout: 487 lvb_type: 0 00010000:00010000:3.0:1715330413.070512:0:10673:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011da82400/0xd895711d66dbe46 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf37 expref: 7 pid: 17205 timeout: 487 lvb_type: 0 00010000:00010000:3.0:1715330413.070552:0:10673:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011da82400/0xd895711d66dbe46 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf37 expref: 7 pid: 17205 timeout: 487 lvb_type: 0 00010000:00010000:3.0:1715330413.070587:0:10673:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330413.070590:0:10673:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330413.070595:0:10673:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880087726ac0/0xd895711d66dbeaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330413.070604:0:10673:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880087726ac0/0xd895711d66dbeaf lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330413.070637:0:10673:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715330413.070700:0:10673:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:72de1896-1df4-4b3a-930a-9116d2c66168+6:2012:x1798653938133696:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 241us (2237us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330413.070707:0:10673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1591 00010000:00010000:2.0:1715330413.070840:0:9633:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880087726ac0/0xd895711d66dbeaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330413.070851:0:9633:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880087726ac0/0xd895711d66dbeaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330413.070865:0:9633:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880087726ac0/0xd895711d66dbeaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330413.070874:0:9633:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880087726ac0/0xd895711d66dbeaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330413.070880:0:9633:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880087726ac0/0xd895711d66dbeaf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330413.070887:0:9633:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087726ac0 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330413.070891:0:9633:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880087726ac0/0xd895711d66dbeaf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330413.070906:0:9633:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880087726ac0/0xd895711d66dbeaf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330413.070923:0:9633:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880087726ac0/0xd895711d66dbeaf lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330413.070930:0:9633:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880087726ac0/0xd895711d66dbeaf lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9633 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330413.071266:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134565500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3688:x1798653942541120:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7483us (7644us total) trans 4294969952 rc 0/0 00000100:00100000:2.0:1715330413.071274:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5347 00000004:00080000:0.0:1715330413.071404:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880134564380/2, rc 0, transno 2656 00000100:00100000:0.0:1715330413.071412:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880134564380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942541120:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1715330413.071693:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330413.072344:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938133824 00000100:00100000:3.0:1715330413.072352:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938133824 00000100:00100000:3.0:1715330413.072401:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5222 00000100:00100000:3.0:1715330413.072407:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091cc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+15:21830:x1798653938133824:12345-192.168.204.49@tcp:35:multiop.0 00000100:00100000:3.0:1715330413.072646:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091cc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+16:21830:x1798653938133824:12345-192.168.204.49@tcp:35:multiop.0 Request processed in 239us (954us total) trans 4294984126 rc 0/0 00000100:00100000:3.0:1715330413.072653:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5222 00000100:00100000:1.0:1715330413.203583:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1715330413.203612:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134566300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942541248:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1715330413.203681:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330413.203827:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942541248 00000100:00100000:2.0:1715330413.203834:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942541248 00000100:00100000:2.0:1715330413.203885:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3124 00000100:00100000:2.0:1715330413.203893:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:3691:x1798653942541248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1715330413.203933:0:8592:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444089856 avail 1314627584 00000100:00100000:2.0:1715330413.203972:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:3691:x1798653942541248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330413.203979:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3124 00000100:00100000:1.0:1715330413.204652:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880134566300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942541248:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1715330413.282792:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330413.283123:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330413.283229:0:7129:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938133888 00000100:00100000:2.0:1715330413.283239:0:7129:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938133888 00000100:00100000:2.0:1715330413.283301:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 379 00000100:00100000:2.0:1715330413.283310:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dca9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2013:x1798653938133888:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:2.0:1715330413.283388:0:7129:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dca9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2013:x1798653938133888:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 79us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330413.283394:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 379 00000100:00080000:3.0:1715330413.283458:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330383 00000100:00100000:1.0:1715330413.283470:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938133952 00000100:00100000:1.0:1715330413.283475:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938133952 00000100:00100000:1.0:1715330413.283503:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 435 00000100:00100000:1.0:1715330413.283508:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091cca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938133952:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:1.0:1715330413.283535:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091cca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938133952:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 27us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330413.283541:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 435 00000100:00080000:3.0:1715330413.283636:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330383 00010000:00010000:2.0:1715330413.495601:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330414.498318:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330414.642943:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1715330414.642964:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134567800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942541312:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1715330414.643024:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330414.643068:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942541312 00000100:00100000:2.0:1715330414.643075:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942541312 00000100:00100000:0.0:1715330414.644356:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3125 00000100:00100000:0.0:1715330414.644364:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942541312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1715330414.644399:0:8592:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445060608 avail 1315598336 00000100:00100000:0.0:1715330414.644451:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942541312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (1427us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330414.644457:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3125 00000100:00100000:1.0:1715330414.644538:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880134567800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942541312:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1715330415.499937:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330415.527378:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1715330415.527404:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093b73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942541376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1715330415.527475:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330415.527608:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942541376 00000100:00100000:2.0:1715330415.527619:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942541376 00000100:00080000:3.0:1715330415.528667:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330385 00000100:00100000:0.0:1715330415.530588:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1715330415.530601:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3689:x1798653942541376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1715330415.530656:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1715330415.534482:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3689:x1798653942541376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3879us (7001us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330415.534497:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1715330415.534626:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093b73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942541376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1715330415.541141:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1715330415.541169:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134567b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942541440:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1715330415.541252:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330415.541304:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942541440 00000100:00100000:1.0:1715330415.541312:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942541440 00000100:00100000:1.0:1715330415.541359:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1715330415.541367:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942541440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1715330415.541391:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1715330415.541425:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942541440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330415.541432:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:1.0:1715330415.541451:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330385 00000100:00100000:1.0:1715330415.541480:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880134567b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942541440:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1715330416.288324:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330416.290436:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330416.290491:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330416.290652:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938134144 00000100:00100000:3.0:1715330416.290662:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938134144 00000100:00100000:3.0:1715330416.290725:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 436 00000100:00100000:3.0:1715330416.290749:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938134144:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:3.0:1715330416.290816:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938134144:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 84us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330416.290823:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 436 00000100:00100000:2.0:1715330416.290935:0:7130:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938134016 00000100:00100000:2.0:1715330416.290941:0:7130:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938134016 00000100:00100000:2.0:1715330416.290966:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 380 00000100:00100000:2.0:1715330416.290970:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dcaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2013:x1798653938134016:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:2.0:1715330416.290994:0:7130:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dcaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2013:x1798653938134016:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 23us (2680us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330416.290999:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 380 00000100:00100000:0.0:1715330416.291136:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330416.291234:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00080000:0.0:1715330416.291259:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330386 00000100:00080000:0.0:1715330416.291263:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330386 00000100:00100000:0.0:1715330416.291273:0:17205:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938134272 00000100:00100000:0.0:1715330416.291276:0:17205:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938134272 00000100:00100000:0.0:1715330416.291297:0:17205:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938134208 00000100:00100000:0.0:1715330416.291299:0:17205:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938134208 00000100:00100000:0.0:1715330416.291311:0:17205:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 308 00000100:00100000:0.0:1715330416.291316:0:17205:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938134272:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:0.0:1715330416.291340:0:17205:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938134272:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 23us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330416.291345:0:17205:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 308 00000100:00100000:0.0:1715330416.291354:0:17205:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 309 00000100:00100000:0.0:1715330416.291357:0:17205:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938134208:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:0.0:1715330416.291371:0:17205:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938134208:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 14us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330416.291375:0:17205:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 309 00000100:00080000:0.0:1715330416.291412:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330386 00000100:00080000:0.0:1715330416.291414:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330386 00000100:00100000:3.0:1715330416.291758:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938134080 00000100:00100000:3.0:1715330416.291761:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938134080 00000100:00100000:3.0:1715330416.291780:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 437 00000100:00100000:3.0:1715330416.291784:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+16:2013:x1798653938134080:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:3.0:1715330416.291812:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+16:2013:x1798653938134080:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 27us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330416.291816:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 437 00000100:00080000:0.0:1715330416.291921:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330386 00010000:00010000:1.0:1715330416.503299:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330416.771112:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134565c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3691:1798653942541568:0@lo:400:kworker.0 00000100:00100000:0.0:1715330416.771180:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330416.771220:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1715330416.771225:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134566d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3691:1798653942541504:0@lo:400:kworker.0 00000100:00100000:0.0:1715330416.771250:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330416.771279:0:7129:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942541504 00000100:00100000:0.0:1715330416.771285:0:7129:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942541504 00000100:00100000:0.0:1715330416.771328:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1715330416.771334:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dca9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3691:x1798653942541504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330416.771367:0:7129:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dca9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3691:x1798653942541504:12345-0@lo:400:kworker.0 Request processed in 33us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330416.771375:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00080000:0.0:1715330416.771399:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330386 00000100:00100000:0.0:1715330416.771415:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880134566d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3691:1798653942541504:0@lo:400:kworker.0 00000100:00100000:0.0:1715330416.771435:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134567b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942541632:0@lo:400:kworker.0 00000100:00100000:0.0:1715330416.771463:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330416.771478:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1715330416.771482:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134567800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3688:1798653942541696:0@lo:400:kworker.0 00000100:00100000:0.0:1715330416.771498:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330416.771515:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942541632 00000100:00100000:0.0:1715330416.771517:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942541632 00000100:00100000:0.0:1715330416.771538:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3126 00000100:00100000:0.0:1715330416.771542:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d60a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942541632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330416.771570:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d60a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942541632:12345-0@lo:400:kworker.0 Request processed in 27us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330416.771575:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3126 00000100:00100000:0.0:1715330416.771596:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880134567b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942541632:0@lo:400:kworker.0 00000100:00100000:0.0:1715330416.771620:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942541568 00000100:00100000:0.0:1715330416.771623:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942541568 00000100:00100000:0.0:1715330416.771644:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942541696 00000100:00100000:0.0:1715330416.771647:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942541696 00000100:00100000:0.0:1715330416.771663:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:0.0:1715330416.771668:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091ccad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3691:x1798653942541568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330416.771705:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091ccad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3691:x1798653942541568:12345-0@lo:400:kworker.0 Request processed in 35us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330416.771711:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000100:00100000:0.0:1715330416.771723:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439 00000100:00100000:0.0:1715330416.771727:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d60aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3688:x1798653942541696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330416.771798:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d60aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3688:x1798653942541696:12345-0@lo:400:kworker.0 Request processed in 69us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330416.771804:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439 00000100:00100000:0.0:1715330416.771840:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880134567800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3688:1798653942541696:0@lo:400:kworker.0 00000100:00100000:0.0:1715330416.771861:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880134565c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3691:1798653942541568:0@lo:400:kworker.0 00000100:00100000:3.0:1715330416.772066:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134567100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942541952:0@lo:400:kworker.0 00000100:00100000:3.0:1715330416.772101:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330416.772123:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134567b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942542208:0@lo:400:kworker.0 00000100:00100000:3.0:1715330416.772142:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330416.772159:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1715330416.772165:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134565180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3689:1798653942541888:0@lo:400:kworker.0 00000100:00100000:3.0:1715330416.772181:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330416.772201:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134567800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3689:1798653942542144:0@lo:400:kworker.0 00000100:00100000:3.0:1715330416.772221:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330416.772242:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942541888 00000100:00100000:3.0:1715330416.772246:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942541888 00000100:00100000:3.0:1715330416.772270:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942542144 00000100:00100000:3.0:1715330416.772272:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942542144 00000100:00100000:3.0:1715330416.772287:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00000100:00100000:3.0:1715330416.772292:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1798653942541888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330416.772331:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1798653942541888:12345-0@lo:400:kworker.0 Request processed in 37us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330416.772336:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00000100:00100000:3.0:1715330416.772350:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:3.0:1715330416.772354:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3689:x1798653942542144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330416.772380:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3689:x1798653942542144:12345-0@lo:400:kworker.0 Request processed in 25us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330416.772387:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00000100:00080000:3.0:1715330416.772406:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330386 00000100:00100000:1.0:1715330416.772635:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134566300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942541760:0@lo:400:kworker.0 00000100:00100000:1.0:1715330416.772660:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330416.772676:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134566680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942542016:0@lo:400:kworker.0 00000100:00100000:1.0:1715330416.772691:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330416.772702:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134566d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942542272:0@lo:400:kworker.0 00000100:00100000:1.0:1715330416.772715:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330416.772726:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1715330416.772753:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134565880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3690:1798653942541824:0@lo:400:kworker.0 00000100:00100000:1.0:1715330416.772771:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330416.772781:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134565c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3690:1798653942542080:0@lo:400:kworker.0 00000100:00100000:1.0:1715330416.772797:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330416.772822:0:17217:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942541952 00000100:00100000:1.0:1715330416.772827:0:17217:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942541952 00000100:00100000:1.0:1715330416.772853:0:17217:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942542208 00000100:00100000:1.0:1715330416.772855:0:17217:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942542208 00000100:00100000:1.0:1715330416.772871:0:17217:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942542016 00000100:00100000:1.0:1715330416.772872:0:17217:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942542016 00000100:00100000:1.0:1715330416.772886:0:17217:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942542272 00000100:00100000:1.0:1715330416.772888:0:17217:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942542272 00000100:00100000:1.0:1715330416.772904:0:17217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1715330416.772909:0:17217:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942541952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330416.772943:0:17217:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942541952:12345-0@lo:400:kworker.0 Request processed in 33us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330416.772949:0:17217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1715330416.772960:0:17217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1715330416.772964:0:17217:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942542208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330416.772988:0:17217:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942542208:12345-0@lo:400:kworker.0 Request processed in 23us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330416.772992:0:17217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1715330416.773000:0:17217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1715330416.773004:0:17217:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3690:x1798653942542016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330416.773029:0:17217:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3690:x1798653942542016:12345-0@lo:400:kworker.0 Request processed in 24us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330416.773034:0:17217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1715330416.773041:0:17217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1715330416.773045:0:17217:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942542272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330416.773064:0:17217:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942542272:12345-0@lo:400:kworker.0 Request processed in 19us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330416.773068:0:17217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1715330416.773096:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942541760 00000100:00100000:1.0:1715330416.773099:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942541760 00000100:00100000:1.0:1715330416.773121:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3127 00000100:00100000:1.0:1715330416.773124:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942541760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330416.773151:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942541760:12345-0@lo:400:kworker.0 Request processed in 26us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330416.773157:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3127 00000100:00100000:1.0:1715330416.773186:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880134566300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942541760:0@lo:400:kworker.0 00000100:00080000:3.0:1715330416.773261:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330386 00000100:00100000:3.0:1715330416.773276:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942541824 00000100:00100000:3.0:1715330416.773279:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942541824 00000100:00100000:3.0:1715330416.773301:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942542080 00000100:00100000:3.0:1715330416.773303:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942542080 00000100:00100000:3.0:1715330416.773314:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:00100000:3.0:1715330416.773318:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3690:x1798653942541824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330416.773348:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3690:x1798653942541824:12345-0@lo:400:kworker.0 Request processed in 29us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330416.773352:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00100000:3.0:1715330416.773362:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:3.0:1715330416.773366:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3690:x1798653942542080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330416.773390:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3690:x1798653942542080:12345-0@lo:400:kworker.0 Request processed in 23us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330416.773395:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00100000:3.0:1715330416.773431:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880134565180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3689:1798653942541888:0@lo:400:kworker.0 00000100:00100000:3.0:1715330416.773443:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880134567800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3689:1798653942542144:0@lo:400:kworker.0 00000100:00100000:3.0:1715330416.773454:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880134567100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942541952:0@lo:400:kworker.0 00000100:00100000:3.0:1715330416.773464:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880134567b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942542208:0@lo:400:kworker.0 00000100:00080000:3.0:1715330416.773491:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330386 00000100:00100000:1.0:1715330416.773631:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880134566680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942542016:0@lo:400:kworker.0 00000100:00100000:1.0:1715330416.773640:0:3690:0:(client.c:2956:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294970021 gen 2 00000004:00080000:1.0:1715330416.773646:0:3690:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d609f80, transno 4294970021 00000100:00100000:1.0:1715330416.774118:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880134566d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942542272:0@lo:400:kworker.0 00000100:00100000:1.0:1715330416.774137:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880134565880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3690:1798653942541824:0@lo:400:kworker.0 00000100:00100000:1.0:1715330416.774144:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880134565c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3690:1798653942542080:0@lo:400:kworker.0 00000100:00100000:0.0:1715330416.787281:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d55d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942542336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1715330416.787338:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330416.787450:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942542336 00000100:00100000:2.0:1715330416.787456:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942542336 00000100:00100000:2.0:1715330416.787487:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1715330416.787489:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1715330416.787494:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d608e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942542336:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1715330416.787496:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d55dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942542400:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1715330416.787517:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1715330416.787518:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 172032 granted 317126336 pending 0 free 3923546112 avail 3692023808 00000100:00100000:3.0:1715330416.787537:0:9401:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942542400 00000100:00100000:3.0:1715330416.787540:0:9401:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942542400 00000100:00100000:2.0:1715330416.787548:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d608e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942542336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330416.787554:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1715330416.787562:0:9401:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1715330416.787566:0:9401:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d55f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942542400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1715330416.787574:0:9401:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 172032 granted 317126336 pending 0 free 3923546112 avail 3692023808 00000100:00100000:3.0:1715330416.787598:0:9401:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d55f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942542400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 31us (80us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330416.787603:0:9401:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1715330416.787630:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d55d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942542336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1715330416.787693:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d55dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942542400:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1715330416.844930:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330416.845042:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938134336 00000100:00100000:2.0:1715330416.845052:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938134336 00000100:00100000:2.0:1715330416.845107:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23856 00000100:00100000:2.0:1715330416.845114:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d60bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+16:22085:x1798653938134336:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:2.0:1715330416.845130:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330416.845147:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6880/0xd895711d66dbeb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbf5a expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330416.845309:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7600/0xd895711d66dbebd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330416.845322:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7600/0xd895711d66dbebd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330416.845335:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7600/0xd895711d66dbebd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00000004:00200000:2.0:1715330416.845375:0:25569:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 270336 00000004:00200000:2.0:1715330416.845378:0:25569:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1715330416.845393:0:25569:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7600/0xd895711d66dbebd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330416.845411:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6880/0xd895711d66dbeb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf5a expref: 18 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330416.845506:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7600/0xd895711d66dbebd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf5a expref: 17 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330416.845514:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:2.0:1715330416.845516:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1715330416.845519:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938b7600, rc 0) 00000100:00100000:2.0:1715330416.845571:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d60bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+17:22085:x1798653938134336:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 457us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330416.845677:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23856 00000100:00100000:0.0:1715330416.848336:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330416.848398:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938134400 00000100:00100000:2.0:1715330416.848405:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938134400 00000100:00100000:2.0:1715330416.848448:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23857 00000100:00100000:2.0:1715330416.848455:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d60b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+17:22085:x1798653938134400:12345-192.168.204.49@tcp:41:lfs.0 00000004:00000024:2.0:1715330416.848488:0:25569:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444089856 avail 1314627584 00000100:00100000:2.0:1715330416.849124:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d60b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+17:22085:x1798653938134400:12345-192.168.204.49@tcp:41:lfs.0 Request processed in 82us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330416.849132:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23857 00000100:00100000:0.0:1715330416.850123:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330416.850255:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938134464 00000100:00100000:2.0:1715330416.850261:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938134464 00000100:00100000:2.0:1715330416.850290:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23858 00000100:00100000:2.0:1715330416.850295:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d608a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+6:22085:x1798653938134464:12345-192.168.204.49@tcp:41:lfs.0 00000004:00000024:2.0:1715330416.850321:0:25569:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445060608 avail 1315598336 00000100:00100000:2.0:1715330416.851076:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d608a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+6:22085:x1798653938134464:12345-192.168.204.49@tcp:41:lfs.0 Request processed in 776us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330416.851086:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23858 00000100:00100000:0.0:1715330416.854323:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330416.854644:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938134528 00000100:00100000:1.0:1715330416.854655:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938134528 00000100:00100000:1.0:1715330416.854715:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 246 00000100:00100000:1.0:1715330416.854722:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d609880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:72de1896-1df4-4b3a-930a-9116d2c66168+6:22085:x1798653938134528:12345-192.168.204.49@tcp:13:lfs.0 00002000:00000024:1.0:1715330416.854780:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1715330416.854835:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d609880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:72de1896-1df4-4b3a-930a-9116d2c66168+6:22085:x1798653938134528:12345-192.168.204.49@tcp:13:lfs.0 Request processed in 113us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330416.854841:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 246 00000100:00100000:0.0:1715330416.857593:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330416.857758:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938134592 00000100:00100000:1.0:1715330416.857768:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938134592 00000100:00100000:1.0:1715330416.857824:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 247 00000100:00100000:1.0:1715330416.857832:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d60b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:72de1896-1df4-4b3a-930a-9116d2c66168+6:22085:x1798653938134592:12345-192.168.204.49@tcp:13:lfs.0 00002000:00000024:1.0:1715330416.857859:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 172032 granted 317126336 pending 0 free 3923546112 avail 3692023808 00000100:00100000:1.0:1715330416.857925:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d60b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:72de1896-1df4-4b3a-930a-9116d2c66168+6:22085:x1798653938134592:12345-192.168.204.49@tcp:13:lfs.0 Request processed in 93us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330416.857931:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 247 00010000:00010000:2.0:1715330417.506538:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330418.213290:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1715330418.213313:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942542464:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1715330418.213386:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330418.213526:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942542464 00000100:00100000:1.0:1715330418.213534:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942542464 00000100:00100000:1.0:1715330418.213579:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3128 00000100:00100000:1.0:1715330418.213586:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d609500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942542464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1715330418.213629:0:19960:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444089856 avail 1314627584 00000100:00100000:1.0:1715330418.213671:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d609500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942542464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330418.213677:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3128 00000100:00100000:0.0:1715330418.213766:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942542464:0@lo:41:osp-pre-0-1.0 00000001:00080000:2.0:1715330418.232397:0:9395:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0000: transno 4294969952 is committed 00000001:00080000:0.0:1715330418.233597:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984126 is committed 00010000:00010000:1.0:1715330418.507183:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330419.510400:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330419.651973:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1715330419.652001:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942542528:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1715330419.652608:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330419.652704:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942542528 00000100:00100000:2.0:1715330419.652714:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942542528 00000100:00100000:2.0:1715330419.652806:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3129 00000100:00100000:2.0:1715330419.652816:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942542528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1715330419.652865:0:8592:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445060608 avail 1315598336 00000100:00100000:2.0:1715330419.652922:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942542528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330419.652929:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3129 00000100:00100000:0.0:1715330419.653040:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942542528:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1715330420.511526:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330420.547151:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d55dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942542656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1715330420.547226:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330420.547277:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942542656 00000100:00100000:0.0:1715330420.547284:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942542656 00000100:00100000:0.0:1715330420.547323:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1715330420.547330:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d60b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942542656:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1715330420.547339:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330390 00002000:00000024:0.0:1715330420.547365:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1715330420.547373:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1715330420.547384:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942542592:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1715330420.547411:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d60b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942542656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330420.547415:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330420.547418:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1715330420.547432:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942542592 00000100:00100000:0.0:1715330420.547435:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942542592 00000100:00100000:1.0:1715330420.547440:0:3691:0:(client.c:2956:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969952 gen 2 00000100:00080000:2.0:1715330420.547447:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330390 00000004:00080000:1.0:1715330420.547447:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134564380, transno 4294969952 00000100:00100000:0.0:1715330420.547454:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1715330420.547457:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134565c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942542592:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1715330420.547463:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d55dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942542656:0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1715330420.547465:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1715330420.547481:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134565c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942542592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 24us (66us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330420.547486:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1715330420.547664:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942542592:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1715330421.298139:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330421.298175:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330421.298191:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330421.298211:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330421.298236:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330421.298261:0:17198:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938134848 00000100:00100000:1.0:1715330421.298270:0:17198:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938134848 00000100:00100000:1.0:1715330421.298312:0:17198:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938134912 00000100:00100000:1.0:1715330421.298314:0:17198:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938134912 00000100:00100000:1.0:1715330421.298330:0:17198:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 314 00000100:00100000:1.0:1715330421.298336:0:17198:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938134848:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:1.0:1715330421.298404:0:17198:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938134848:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 68us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330421.298411:0:17198:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 314 00000100:00100000:1.0:1715330421.298427:0:17198:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 315 00000100:00100000:1.0:1715330421.298431:0:17198:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938134912:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:1.0:1715330421.298449:0:17198:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938134912:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 17us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330421.298453:0:17198:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 315 00000100:00100000:3.0:1715330421.298507:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938134784 00000100:00100000:3.0:1715330421.298511:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938134784 00000100:00100000:3.0:1715330421.298534:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938134720 00000100:00080000:2.0:1715330421.298534:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330391 00000100:00100000:3.0:1715330421.298536:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938134720 00000100:00080000:2.0:1715330421.298540:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330391 00000100:00080000:2.0:1715330421.298541:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330391 00000100:00080000:2.0:1715330421.298542:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330391 00000100:00100000:3.0:1715330421.298551:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 444 00000100:00100000:3.0:1715330421.298553:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938134784:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:3.0:1715330421.298577:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938134784:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 23us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330421.298582:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 444 00000100:00100000:3.0:1715330421.298592:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 445 00000100:00100000:3.0:1715330421.298595:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+16:2013:x1798653938134720:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:3.0:1715330421.298611:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+16:2013:x1798653938134720:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 16us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330421.298615:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 445 00000100:00100000:0.0:1715330421.298793:0:7130:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938134656 00000100:00100000:0.0:1715330421.298797:0:7130:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938134656 00000100:00100000:0.0:1715330421.298836:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 382 00000100:00100000:0.0:1715330421.298839:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dcaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2013:x1798653938134656:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:0.0:1715330421.298860:0:7130:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dcaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2013:x1798653938134656:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 21us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330421.298865:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 382 00000100:00080000:3.0:1715330421.299167:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330391 00010000:00010000:3.0:1715330421.517020:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330421.783585:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3688:1798653942542912:0@lo:400:kworker.0 00000100:00100000:0.0:1715330421.783644:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330421.783663:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942543168:0@lo:400:kworker.0 00000100:00100000:0.0:1715330421.783680:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330421.783690:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942543424:0@lo:400:kworker.0 00000100:00100000:0.0:1715330421.783702:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330421.783716:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1715330421.783722:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3688:1798653942542720:0@lo:400:kworker.0 00000100:00100000:0.0:1715330421.783758:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330421.783768:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942542976:0@lo:400:kworker.0 00000100:00100000:0.0:1715330421.783784:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330421.783792:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942543232:0@lo:400:kworker.0 00000100:00100000:0.0:1715330421.783804:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330421.783813:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942543488:0@lo:400:kworker.0 00000100:00100000:0.0:1715330421.783825:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330421.783842:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942542912 00000100:00100000:0.0:1715330421.783847:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942542912 00000100:00100000:0.0:1715330421.783876:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:0.0:1715330421.783883:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3688:x1798653942542912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330421.783920:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3688:x1798653942542912:12345-0@lo:400:kworker.0 Request processed in 38us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330421.783925:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000100:00100000:0.0:1715330421.783942:0:17197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942543168 00000100:00100000:0.0:1715330421.783944:0:17197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942543168 00000100:00100000:0.0:1715330421.783957:0:17197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942543424 00000100:00100000:0.0:1715330421.783959:0:17197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942543424 00000100:00100000:0.0:1715330421.783971:0:17197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942543232 00000100:00100000:0.0:1715330421.783972:0:17197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942543232 00000100:00100000:0.0:1715330421.783980:0:17197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942543488 00000100:00100000:0.0:1715330421.783981:0:17197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942543488 00000100:00100000:0.0:1715330421.783992:0:17197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1715330421.783995:0:17197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942543168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330421.784015:0:17197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942543168:12345-0@lo:400:kworker.0 Request processed in 20us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330421.784019:0:17197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1715330421.784026:0:17197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1715330421.784028:0:17197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942543424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330421.784044:0:17197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942543424:12345-0@lo:400:kworker.0 Request processed in 15us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330421.784047:0:17197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1715330421.784054:0:17197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1715330421.784057:0:17197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f578a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942543232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330421.784073:0:17197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f578a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942543232:12345-0@lo:400:kworker.0 Request processed in 16us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330421.784077:0:17197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1715330421.784085:0:17197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1715330421.784087:0:17197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942543488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330421.784116:0:17197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942543488:12345-0@lo:400:kworker.0 Request processed in 28us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330421.784120:0:17197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1715330421.784149:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942543232:0@lo:400:kworker.0 00000100:00100000:0.0:1715330421.784156:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942543488:0@lo:400:kworker.0 00000100:00100000:0.0:1715330421.784161:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3688:1798653942542912:0@lo:400:kworker.0 00000100:00100000:0.0:1715330421.784166:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942543168:0@lo:400:kworker.0 00000100:00100000:0.0:1715330421.784170:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942543424:0@lo:400:kworker.0 00000100:00100000:2.0:1715330421.786165:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3690:1798653942542784:0@lo:400:kworker.0 00000100:00100000:2.0:1715330421.786210:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330421.786227:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3690:1798653942543040:0@lo:400:kworker.0 00000100:00100000:2.0:1715330421.786238:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330421.786247:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3690:1798653942543296:0@lo:400:kworker.0 00000100:00100000:2.0:1715330421.786259:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330421.786271:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1715330421.786275:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d60a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942542848:0@lo:400:kworker.0 00000100:00100000:2.0:1715330421.786289:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330421.786297:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3690:1798653942543104:0@lo:400:kworker.0 00000100:00100000:2.0:1715330421.786306:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330421.786323:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3690:1798653942543360:0@lo:400:kworker.0 00000100:00100000:2.0:1715330421.786333:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330421.786355:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942542784 00000100:00100000:2.0:1715330421.786361:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942542784 00000100:00100000:2.0:1715330421.786379:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942543040 00000100:00100000:2.0:1715330421.786381:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942543040 00000100:00100000:2.0:1715330421.786387:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942543296 00000100:00100000:2.0:1715330421.786388:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942543296 00000100:00100000:2.0:1715330421.786394:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942543104 00000100:00100000:2.0:1715330421.786395:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942543104 00000100:00100000:2.0:1715330421.786400:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942543360 00000100:00100000:2.0:1715330421.786401:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942543360 00000100:00100000:2.0:1715330421.786409:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00000100:00100000:2.0:1715330421.786413:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134564380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3690:x1798653942542784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330421.786445:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134564380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3690:x1798653942542784:12345-0@lo:400:kworker.0 Request processed in 32us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330421.786450:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00000100:00100000:2.0:1715330421.786462:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00000100:00100000:2.0:1715330421.786465:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134565880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3690:x1798653942543040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330421.786482:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134565880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3690:x1798653942543040:12345-0@lo:400:kworker.0 Request processed in 18us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330421.786490:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00000100:00100000:2.0:1715330421.786497:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 449 00000100:00100000:2.0:1715330421.786499:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134566d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3690:x1798653942543296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330421.786514:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134566d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3690:x1798653942543296:12345-0@lo:400:kworker.0 Request processed in 14us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330421.786518:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 449 00000100:00100000:2.0:1715330421.786525:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00000100:00100000:2.0:1715330421.786527:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134566300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3690:x1798653942543104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330421.786540:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134566300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3690:x1798653942543104:12345-0@lo:400:kworker.0 Request processed in 13us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330421.786544:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00000100:00100000:2.0:1715330421.786550:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 451 00000100:00100000:2.0:1715330421.786552:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134567b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3690:x1798653942543360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330421.786564:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134567b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3690:x1798653942543360:12345-0@lo:400:kworker.0 Request processed in 12us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330421.786567:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 451 00000100:00100000:2.0:1715330421.786582:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942542976 00000100:00100000:2.0:1715330421.786584:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942542976 00000100:00100000:2.0:1715330421.786598:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942542848 00000100:00100000:2.0:1715330421.786599:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942542848 00000100:00100000:2.0:1715330421.786609:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3130 00000100:00100000:2.0:1715330421.786612:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f578000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942542976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330421.786637:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f578000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942542976:12345-0@lo:400:kworker.0 Request processed in 25us (2852us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330421.786642:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3130 00000100:00100000:2.0:1715330421.786650:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3131 00000100:00100000:2.0:1715330421.786652:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134566680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942542848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330421.786667:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134566680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942542848:12345-0@lo:400:kworker.0 Request processed in 14us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330421.786671:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3131 00000100:00100000:2.0:1715330421.786696:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d60a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942542848:0@lo:400:kworker.0 00000100:00100000:2.0:1715330421.786703:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3690:1798653942543104:0@lo:400:kworker.0 00000100:00100000:2.0:1715330421.786709:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3690:1798653942543360:0@lo:400:kworker.0 00000100:00100000:2.0:1715330421.786715:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3690:1798653942542784:0@lo:400:kworker.0 00000100:00100000:2.0:1715330421.786720:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3690:1798653942543040:0@lo:400:kworker.0 00000100:00100000:2.0:1715330421.786726:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3690:1798653942543296:0@lo:400:kworker.0 00000100:00100000:1.0:1715330421.787143:0:7129:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942542720 00000100:00100000:1.0:1715330421.787147:0:7129:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942542720 00000100:00100000:1.0:1715330421.787170:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1715330421.787173:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dcab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3688:x1798653942542720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330421.787199:0:7129:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dcab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3688:x1798653942542720:12345-0@lo:400:kworker.0 Request processed in 25us (3441us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330421.787206:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00080000:2.0:1715330421.787795:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330391 00000100:00080000:2.0:1715330421.787798:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330391 00000100:00080000:2.0:1715330421.787800:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330391 00000100:00080000:2.0:1715330421.787801:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330391 00000100:00100000:0.0:1715330421.788840:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3688:1798653942542720:0@lo:400:kworker.0 00000100:00100000:0.0:1715330421.788855:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942542976:0@lo:400:kworker.0 00000100:00100000:1.0:1715330421.800151:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1715330421.800172:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d55d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942543552:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1715330421.800227:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330421.800706:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880134567100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942543616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1715330421.800725:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330421.802871:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942543552 00000100:00100000:1.0:1715330421.802883:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942543552 00000100:00100000:1.0:1715330421.802925:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942543616 00000100:00100000:1.0:1715330421.802927:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942543616 00000100:00100000:1.0:1715330421.802940:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1715330421.802945:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942543552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1715330421.802970:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 172032 granted 317126336 pending 0 free 3923546112 avail 3692023808 00000100:00100000:1.0:1715330421.803017:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942543552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (2791us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330421.803022:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1715330421.803032:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1715330421.803035:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942543616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1715330421.803041:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 172032 granted 317126336 pending 0 free 3923546112 avail 3692023808 00000100:00100000:1.0:1715330421.803055:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942543616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 19us (2330us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330421.803059:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1715330421.803090:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880134567100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942543616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1715330421.803112:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d55d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942543552:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1715330422.519432:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330423.219131:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1715330423.219154:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942543680:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1715330423.219206:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330423.219709:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942543680 00000100:00100000:1.0:1715330423.219716:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942543680 00000100:00100000:1.0:1715330423.219973:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3132 00000100:00100000:1.0:1715330423.219979:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134567800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3689:x1798653942543680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1715330423.220006:0:19960:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444089856 avail 1314627584 00000100:00100000:1.0:1715330423.220263:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134567800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3689:x1798653942543680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 283us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330423.220270:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3132 00000100:00100000:2.0:1715330423.220327:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942543680:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1715330423.520989:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1715330423.654297:0:481:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 64a: verify filter grant calculations (in kernel) =============================================================== 04:40:22 (1715330422) 00000100:00100000:0.0:1715330423.701966:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330423.702040:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938134976 00000100:00100000:2.0:1715330423.702050:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938134976 00000100:00100000:2.0:1715330423.702162:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23859 00000100:00100000:2.0:1715330423.702170:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+16:22722:x1798653938134976:12345-192.168.204.49@tcp:41:lfs.0 00000004:00000024:2.0:1715330423.702211:0:7133:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444089856 avail 1314627584 00000100:00080000:3.0:1715330423.702310:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330393 00000100:00100000:2.0:1715330423.702486:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+16:22722:x1798653938134976:12345-192.168.204.49@tcp:41:lfs.0 Request processed in 316us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330423.702494:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23859 00000100:00100000:0.0:1715330423.705294:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330423.705421:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938135040 00000100:00100000:2.0:1715330423.705433:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938135040 00000100:00100000:2.0:1715330423.705491:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23860 00000100:00100000:2.0:1715330423.705499:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+6:22722:x1798653938135040:12345-192.168.204.49@tcp:41:lfs.0 00000004:00000024:2.0:1715330423.705547:0:9622:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445060608 avail 1315598336 00000100:00080000:3.0:1715330423.705629:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330393 00000100:00100000:2.0:1715330423.705631:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+6:22722:x1798653938135040:12345-192.168.204.49@tcp:41:lfs.0 Request processed in 132us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330423.705639:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23860 00000100:00100000:0.0:1715330423.711503:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330423.711798:0:9401:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938135104 00000100:00100000:3.0:1715330423.711812:0:9401:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938135104 00000100:00080000:2.0:1715330423.711880:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330393 00000100:00100000:3.0:1715330423.711890:0:9401:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 252 00000100:00100000:3.0:1715330423.711898:0:9401:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:72de1896-1df4-4b3a-930a-9116d2c66168+6:22722:x1798653938135104:12345-192.168.204.49@tcp:13:lfs.0 00002000:00000024:3.0:1715330423.711937:0:9401:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1715330423.714319:0:9401:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:72de1896-1df4-4b3a-930a-9116d2c66168+6:22722:x1798653938135104:12345-192.168.204.49@tcp:13:lfs.0 Request processed in 2400us (2808us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330423.714334:0:9401:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 252 00000100:00100000:2.0:1715330423.725010:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330423.725095:0:9401:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938135168 00000100:00100000:3.0:1715330423.725108:0:9401:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938135168 00000100:00080000:2.0:1715330423.725701:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330393 00000100:00100000:3.0:1715330423.726112:0:9401:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 253 00000100:00100000:3.0:1715330423.726120:0:9401:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134565180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:72de1896-1df4-4b3a-930a-9116d2c66168+6:22722:x1798653938135168:12345-192.168.204.49@tcp:13:lfs.0 00002000:00000024:3.0:1715330423.726157:0:9401:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 172032 granted 317126336 pending 0 free 3923546112 avail 3692023808 00000100:00100000:3.0:1715330423.726218:0:9401:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134565180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:72de1896-1df4-4b3a-930a-9116d2c66168+6:22722:x1798653938135168:12345-192.168.204.49@tcp:13:lfs.0 Request processed in 99us (1220us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330423.726225:0:9401:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 253 00010000:00010000:0.0:1715330424.523863:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330424.658964:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942543744:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1715330424.659040:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330424.659095:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942543744 00000100:00100000:3.0:1715330424.659102:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942543744 00000100:00100000:3.0:1715330424.659140:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3133 00000100:00100000:3.0:1715330424.659146:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134567100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942543744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1715330424.659177:0:19960:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445060608 avail 1315598336 00000100:00100000:3.0:1715330424.659209:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134567100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942543744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330424.659214:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3133 00000100:00100000:2.0:1715330424.659533:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942543744:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1715330425.526049:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330425.555148:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1715330425.555168:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942543808:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1715330425.555224:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330425.555375:0:9401:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942543808 00000100:00100000:2.0:1715330425.555381:0:9401:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942543808 00000100:00100000:2.0:1715330425.555418:0:9401:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1715330425.555425:0:9401:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942543808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1715330425.555455:0:9401:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1715330425.555492:0:9401:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942543808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330425.555499:0:9401:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00080000:2.0:1715330425.555518:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330395 00000100:00100000:1.0:1715330425.556161:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d55d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942543872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1715330425.556185:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330425.556244:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942543808:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1715330425.556328:0:9400:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942543872 00000100:00100000:2.0:1715330425.556332:0:9400:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942543872 00000100:00100000:2.0:1715330425.556364:0:9400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1715330425.556368:0:9400:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d644a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942543872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1715330425.556378:0:9400:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923509248 avail 3691986944 00000100:00080000:3.0:1715330425.556440:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330395 00000100:00100000:2.0:1715330425.557167:0:9400:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d644a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942543872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 796us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330425.557173:0:9400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1715330425.557227:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d55d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942543872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1715330426.303835:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330426.303878:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330426.303901:0:7130:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938135232 00000100:00100000:2.0:1715330426.303909:0:7130:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938135232 00000100:00100000:0.0:1715330426.303909:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330426.303934:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330426.303945:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 384 00000100:00100000:2.0:1715330426.303952:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097aecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2013:x1798653938135232:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:0.0:1715330426.303961:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330426.303992:0:17205:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938135488 00000100:00100000:0.0:1715330426.303995:0:17205:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938135488 00000100:00100000:2.0:1715330426.304004:0:7130:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097aecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2013:x1798653938135232:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 52us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330426.304010:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 384 00000100:00100000:0.0:1715330426.304014:0:17205:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938135424 00000100:00100000:0.0:1715330426.304029:0:17205:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938135424 00000100:00100000:0.0:1715330426.304044:0:17205:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 320 00000100:00100000:2.0:1715330426.304046:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938135360 00000100:00100000:2.0:1715330426.304048:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938135360 00000100:00100000:0.0:1715330426.304049:0:17205:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d60a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938135488:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:2.0:1715330426.304067:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938135296 00000100:00100000:2.0:1715330426.304068:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938135296 00000100:00100000:0.0:1715330426.304075:0:17205:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d60a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938135488:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 26us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330426.304080:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 452 00000100:00100000:0.0:1715330426.304080:0:17205:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 320 00000100:00100000:2.0:1715330426.304084:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938135360:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:0.0:1715330426.304088:0:17205:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 321 00000100:00100000:0.0:1715330426.304091:0:17205:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d608380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938135424:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:2.0:1715330426.304105:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938135360:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 20us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330426.304105:0:17205:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d608380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938135424:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 13us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330426.304110:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 452 00000100:00100000:0.0:1715330426.304110:0:17205:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 321 00000100:00100000:2.0:1715330426.304117:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 453 00000100:00100000:2.0:1715330426.304120:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+16:2013:x1798653938135296:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:2.0:1715330426.304138:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+16:2013:x1798653938135296:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 16us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330426.304143:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 453 00000100:00080000:2.0:1715330426.304156:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330396 00000100:00080000:2.0:1715330426.304159:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330396 00000100:00080000:2.0:1715330426.304161:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330396 00000100:00080000:2.0:1715330426.304162:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330396 00000100:00080000:2.0:1715330426.304163:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330396 00010000:00010000:1.0:1715330426.527093:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330426.786970:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3689:1798653942544000:0@lo:400:kworker.0 00000100:00100000:0.0:1715330426.786985:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3691:1798653942544128:0@lo:400:kworker.0 00000100:00100000:1.0:1715330426.786988:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3688:1798653942543936:0@lo:400:kworker.0 00000100:00100000:2.0:1715330426.787048:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330426.787048:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330426.787056:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942544064:0@lo:400:kworker.0 00000100:00100000:1.0:1715330426.787077:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942544192:0@lo:400:kworker.0 00000100:00100000:0.0:1715330426.787081:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330426.787085:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3689:1798653942544256:0@lo:400:kworker.0 00000100:00100000:1.0:1715330426.787095:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330426.787098:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3690:1798653942544320:0@lo:400:kworker.0 00000100:00100000:2.0:1715330426.787101:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330426.787104:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942544448:0@lo:400:kworker.0 00000100:00100000:2.0:1715330426.787109:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3689:1798653942544512:0@lo:400:kworker.0 00000100:00100000:0.0:1715330426.787116:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330426.787118:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330426.787128:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942544704:0@lo:400:kworker.0 00000100:00100000:2.0:1715330426.787129:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942544000 00000100:00100000:0.0:1715330426.787130:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3690:1798653942544576:0@lo:400:kworker.0 00000100:00100000:2.0:1715330426.787134:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942544000 00000100:00100000:1.0:1715330426.787140:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330426.787145:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330426.787161:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942544064 00000100:00100000:2.0:1715330426.787162:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942544256 00000100:00100000:2.0:1715330426.787164:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942544256 00000100:00100000:1.0:1715330426.787164:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942544064 00000100:00100000:0.0:1715330426.787167:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942544320 00000100:00100000:0.0:1715330426.787169:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942544320 00000100:00100000:3.0:1715330426.787176:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942544576 00000100:00100000:2.0:1715330426.787178:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:3.0:1715330426.787179:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942544576 00000100:00100000:1.0:1715330426.787179:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942544192 00000100:00100000:1.0:1715330426.787181:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942544192 00000100:00100000:2.0:1715330426.787183:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1798653942544000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330426.787187:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00000100:00100000:1.0:1715330426.787192:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3134 00000100:00100000:0.0:1715330426.787192:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1798653942544256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330426.787195:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:00100000:1.0:1715330426.787197:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942544064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330426.787198:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3690:x1798653942544320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330426.788268:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1798653942544256:12345-0@lo:400:kworker.0 Request processed in 1073us (1163us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330426.788324:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3690:x1798653942544320:12345-0@lo:400:kworker.0 Request processed in 1124us (1206us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330426.788331:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00100000:3.0:1715330426.788348:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 457 00000100:00100000:3.0:1715330426.788352:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3690:x1798653942544576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330426.788375:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3690:x1798653942544576:12345-0@lo:400:kworker.0 Request processed in 23us (1230us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330426.788380:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 457 00000100:00100000:3.0:1715330426.788398:0:7130:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942543936 00000100:00100000:3.0:1715330426.788403:0:7130:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942543936 00000100:00100000:3.0:1715330426.788423:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1715330426.788426:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097aec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3688:x1798653942543936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330426.788452:0:7130:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097aec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3688:x1798653942543936:12345-0@lo:400:kworker.0 Request processed in 25us (1404us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330426.788457:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1715330426.788480:0:7139:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3135 00000100:00100000:3.0:1715330426.788484:0:7139:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942544192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330426.788507:0:7139:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942544192:12345-0@lo:400:kworker.0 Request processed in 22us (1411us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330426.788511:0:7139:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3135 00000100:00080000:3.0:1715330426.788546:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330396 00000100:00080000:3.0:1715330426.788549:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330396 00000100:00080000:3.0:1715330426.788550:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330396 00000100:00100000:3.0:1715330426.788562:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330426.788591:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3689:1798653942544256:0@lo:400:kworker.0 00000100:00100000:3.0:1715330426.788611:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942544512 00000100:00100000:3.0:1715330426.788613:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942544512 00000100:00100000:3.0:1715330426.788628:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458 00000100:00100000:3.0:1715330426.788631:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d55dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3689:x1798653942544512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330426.788724:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942544064:12345-0@lo:400:kworker.0 Request processed in 1526us (1641us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330426.788743:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3134 00000100:00100000:1.0:1715330426.788765:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942544448 00000100:00100000:1.0:1715330426.788767:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942544448 00000100:00100000:1.0:1715330426.788783:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942544704 00000100:00100000:1.0:1715330426.788785:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942544704 00000100:00100000:1.0:1715330426.788797:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1715330426.788801:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d645500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942544448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330426.788824:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455 00000100:00100000:1.0:1715330426.788825:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d645500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942544448:12345-0@lo:400:kworker.0 Request processed in 23us (1706us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330426.788830:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1715330426.788838:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1715330426.788841:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d646300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942544704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330426.788851:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330426.788860:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d646300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942544704:12345-0@lo:400:kworker.0 Request processed in 19us (1719us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330426.788865:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1715330426.788867:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942544384:0@lo:400:kworker.0 00000100:00100000:1.0:1715330426.788892:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3688:1798653942543936:0@lo:400:kworker.0 00000100:00100000:0.0:1715330426.788894:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330426.788902:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942544192:0@lo:400:kworker.0 00000100:00100000:0.0:1715330426.788905:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942544640:0@lo:400:kworker.0 00000100:00100000:1.0:1715330426.788913:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942544448:0@lo:400:kworker.0 00000100:00100000:1.0:1715330426.788922:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942544704:0@lo:400:kworker.0 00000100:00100000:0.0:1715330426.788922:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330426.788940:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942544128 00000100:00100000:1.0:1715330426.788943:0:17215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942544384 00000100:00100000:0.0:1715330426.788943:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942544128 00000100:00100000:1.0:1715330426.788945:0:17215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942544384 00000100:00100000:1.0:1715330426.788958:0:17215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942544640 00000100:00100000:0.0:1715330426.788958:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:1.0:1715330426.788959:0:17215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942544640 00000100:00100000:0.0:1715330426.788963:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3691:x1798653942544128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330426.788969:0:17215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1715330426.788973:0:17215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942544384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330426.788988:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3691:x1798653942544128:12345-0@lo:400:kworker.0 Request processed in 25us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330426.788993:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00100000:1.0:1715330426.788997:0:17215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942544384:12345-0@lo:400:kworker.0 Request processed in 23us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330426.789002:0:17215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1715330426.789024:0:17198:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1715330426.789028:0:17198:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942544640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330426.789051:0:17198:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942544640:12345-0@lo:400:kworker.0 Request processed in 23us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330426.789293:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d55dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3689:x1798653942544512:12345-0@lo:400:kworker.0 Request processed in 24us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330426.789300:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458 00000100:00100000:2.0:1715330426.789314:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1798653942544000:12345-0@lo:400:kworker.0 Request processed in 2128us (2264us total) trans 0 rc 0/0 00000100:00080000:3.0:1715330426.789315:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330396 00000100:00080000:3.0:1715330426.789317:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330396 00000100:00100000:2.0:1715330426.789322:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00000100:00100000:3.0:1715330426.789337:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3689:1798653942544000:0@lo:400:kworker.0 00000100:00100000:3.0:1715330426.789347:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3689:1798653942544512:0@lo:400:kworker.0 00000100:00100000:2.0:1715330426.789360:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942544064:0@lo:400:kworker.0 00000100:00100000:2.0:1715330426.789372:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3690:1798653942544320:0@lo:400:kworker.0 00000100:00100000:2.0:1715330426.789381:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3690:1798653942544576:0@lo:400:kworker.0 00000100:00100000:0.0:1715330426.789875:0:17198:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1715330426.789903:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3691:1798653942544128:0@lo:400:kworker.0 00000100:00100000:0.0:1715330426.789916:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942544384:0@lo:400:kworker.0 00000100:00100000:0.0:1715330426.789922:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942544640:0@lo:400:kworker.0 00000100:00100000:0.0:1715330426.821924:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1715330426.821954:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942544768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1715330426.822080:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330426.822311:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d55d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942544832:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1715330426.822487:0:9400:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942544768 00000100:00100000:2.0:1715330426.822494:0:9400:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942544768 00000100:00100000:2.0:1715330426.822543:0:9400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1715330426.822550:0:9400:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942544768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1715330426.822580:0:9400:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 172032 granted 317126336 pending 0 free 3923546112 avail 3692023808 00000100:00100000:2.0:1715330426.822626:0:9400:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942544768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330426.822632:0:9400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1715330426.822703:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942544768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1715330426.822808:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330426.822867:0:9401:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942544832 00000100:00100000:0.0:1715330426.822871:0:9401:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942544832 00000100:00100000:0.0:1715330426.823030:0:9401:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1715330426.823035:0:9401:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942544832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1715330426.823047:0:9401:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 172032 granted 317126336 pending 0 free 3923546112 avail 3692023808 00000100:00100000:0.0:1715330426.823337:0:9401:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942544832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 300us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330426.823342:0:9401:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1715330426.823471:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d55d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942544832:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1715330427.530761:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330428.227095:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1715330428.227122:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942544896:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1715330428.227188:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330428.227604:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942544896 00000100:00100000:0.0:1715330428.227612:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942544896 00000100:00100000:0.0:1715330428.228469:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3136 00000100:00100000:0.0:1715330428.228477:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942544896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1715330428.228510:0:8592:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444089856 avail 1314627584 00000100:00100000:0.0:1715330428.228564:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942544896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (1376us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330428.228570:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3136 00000100:00100000:3.0:1715330428.228611:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942544896:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1715330428.530826:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1715330429.420800:0:975:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_64b skipping SLOW test 64b 00010000:00010000:2.0:1715330429.533371:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330429.668009:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093b59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942544960:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1715330429.668066:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330429.668941:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942544960 00000100:00100000:0.0:1715330429.668950:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942544960 00000100:00100000:0.0:1715330429.669232:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3137 00000100:00100000:0.0:1715330429.669237:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942544960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1715330429.669271:0:8592:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445060608 avail 1315598336 00000100:00100000:0.0:1715330429.669511:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942544960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 272us (1442us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330429.669519:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3137 00000100:00100000:1.0:1715330429.669693:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093b59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942544960:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1715330430.536928:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330430.564294:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942545024:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1715330430.564377:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330430.564445:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1715330430.564453:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942545088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1715330430.564477:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330430.564500:0:9401:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942545024 00000100:00100000:0.0:1715330430.564506:0:9401:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942545024 00000100:00100000:0.0:1715330430.564535:0:9401:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942545088 00000100:00100000:0.0:1715330430.564537:0:9401:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942545088 00000100:00100000:0.0:1715330430.564549:0:9401:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1715330430.564553:0:9401:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942545024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1715330430.564592:0:9401:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1715330430.564620:0:9401:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942545024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330430.564625:0:9401:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1715330430.564636:0:9401:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1715330430.564638:0:9401:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942545088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1715330430.564645:0:9401:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1715330430.564657:0:9401:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942545088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 18us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330430.564661:0:9401:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1715330430.564684:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942545088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1715330430.564700:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942545024:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1715330430.564817:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330400 00000100:00100000:0.0:1715330431.315328:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330431.315355:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330431.315371:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938135616 00000100:00100000:0.0:1715330431.315373:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330431.315378:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938135616 00000100:00100000:0.0:1715330431.315385:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330431.315412:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938135680 00000100:00100000:3.0:1715330431.315414:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938135680 00000100:00100000:3.0:1715330431.315429:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 460 00000100:00100000:3.0:1715330431.315435:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+16:2013:x1798653938135616:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:3.0:1715330431.315489:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+16:2013:x1798653938135616:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 53us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330431.315495:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 460 00000100:00100000:3.0:1715330431.315508:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 461 00000100:00100000:3.0:1715330431.315511:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938135680:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:3.0:1715330431.315530:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938135680:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 18us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330431.315534:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 461 00000100:00100000:0.0:1715330431.315592:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330431.315764:0:7129:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938135552 00000100:00100000:3.0:1715330431.315768:0:7129:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938135552 00000100:00100000:3.0:1715330431.315803:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 386 00000100:00100000:3.0:1715330431.315807:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097aec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2013:x1798653938135552:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:3.0:1715330431.315825:0:7129:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097aec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2013:x1798653938135552:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 18us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330431.315830:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 386 00000100:00080000:3.0:1715330431.315845:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330401 00000100:00080000:3.0:1715330431.315848:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330401 00000100:00080000:3.0:1715330431.315849:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330401 00000100:00100000:0.0:1715330431.316460:0:17198:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938135744 00000100:00100000:0.0:1715330431.316464:0:17198:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938135744 00000100:00100000:0.0:1715330431.316486:0:17198:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938135808 00000100:00100000:0.0:1715330431.316488:0:17198:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938135808 00000100:00100000:0.0:1715330431.316501:0:17198:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 326 00000100:00100000:0.0:1715330431.316505:0:17198:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938135744:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:0.0:1715330431.316530:0:17198:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938135744:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 24us (1174us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330431.316535:0:17198:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 326 00000100:00100000:0.0:1715330431.316544:0:17198:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 327 00000100:00100000:0.0:1715330431.316547:0:17198:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938135808:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:0.0:1715330431.316565:0:17198:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938135808:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 17us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330431.316569:0:17198:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 327 00000100:00080000:3.0:1715330431.318079:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330401 00000100:00080000:3.0:1715330431.318084:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330401 00010000:00010000:2.0:1715330431.543380:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330431.795378:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3691:1798653942545152:0@lo:400:kworker.0 00000100:00100000:0.0:1715330431.795448:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330431.795467:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942545408:0@lo:400:kworker.0 00000100:00100000:0.0:1715330431.795485:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330431.795494:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942545664:0@lo:400:kworker.0 00000100:00100000:0.0:1715330431.795509:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330431.795516:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942545920:0@lo:400:kworker.0 00000100:00100000:0.0:1715330431.795528:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330431.795542:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1715330431.795546:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3691:1798653942545344:0@lo:400:kworker.0 00000100:00100000:0.0:1715330431.795562:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330431.795570:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942545600:0@lo:400:kworker.0 00000100:00100000:0.0:1715330431.795580:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330431.795587:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091f38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942545856:0@lo:400:kworker.0 00000100:00100000:0.0:1715330431.795598:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330431.795611:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942545280:0@lo:400:kworker.0 00000100:00100000:0.0:1715330431.795624:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330431.795631:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3689:1798653942545536:0@lo:400:kworker.0 00000100:00100000:0.0:1715330431.795642:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330431.795649:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091f38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3689:1798653942545792:0@lo:400:kworker.0 00000100:00100000:0.0:1715330431.795659:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330431.795668:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1715330431.795671:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3689:1798653942545216:0@lo:400:kworker.0 00000100:00100000:0.0:1715330431.795683:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330431.795690:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3689:1798653942545472:0@lo:400:kworker.0 00000100:00100000:0.0:1715330431.795702:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330431.795709:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3689:1798653942545728:0@lo:400:kworker.0 00000100:00100000:0.0:1715330431.795720:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330431.795750:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942545408 00000100:00100000:0.0:1715330431.795756:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942545408 00000100:00100000:0.0:1715330431.795787:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942545280 00000100:00100000:0.0:1715330431.795788:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942545280 00000100:00100000:0.0:1715330431.795800:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3138 00000100:00100000:0.0:1715330431.795806:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942545408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330431.795845:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942545408:12345-0@lo:400:kworker.0 Request processed in 38us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330431.795851:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3138 00000100:00100000:0.0:1715330431.795863:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3139 00000100:00100000:0.0:1715330431.795866:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:3689:x1798653942545280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330431.795882:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:3689:x1798653942545280:12345-0@lo:400:kworker.0 Request processed in 16us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330431.795887:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3139 00000100:00100000:0.0:1715330431.795899:0:17215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942545664 00000100:00100000:0.0:1715330431.795901:0:17215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942545664 00000100:00100000:0.0:1715330431.795915:0:17215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942545920 00000100:00100000:0.0:1715330431.795926:0:17215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942545920 00000100:00100000:0.0:1715330431.795940:0:17215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942545600 00000100:00100000:0.0:1715330431.795942:0:17215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942545600 00000100:00100000:0.0:1715330431.795950:0:17215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942545856 00000100:00100000:0.0:1715330431.795951:0:17215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942545856 00000100:00100000:0.0:1715330431.795960:0:17215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1715330431.795964:0:17215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942545664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330431.795985:0:17215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942545664:12345-0@lo:400:kworker.0 Request processed in 21us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330431.795989:0:17215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1715330431.795995:0:17215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1715330431.795998:0:17215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942545920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330431.796011:0:17215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942545920:12345-0@lo:400:kworker.0 Request processed in 13us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330431.796015:0:17215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1715330431.796020:0:17215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1715330431.796023:0:17215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942545600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330431.796035:0:17215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942545600:12345-0@lo:400:kworker.0 Request processed in 12us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330431.796042:0:17215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1715330431.796048:0:17215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1715330431.796050:0:17215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942545856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330431.796066:0:17215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942545856:12345-0@lo:400:kworker.0 Request processed in 15us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330431.796070:0:17215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1715330431.796089:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942545344 00000100:00100000:0.0:1715330431.796091:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942545344 00000100:00100000:0.0:1715330431.796102:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942545536 00000100:00100000:0.0:1715330431.796104:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942545536 00000100:00100000:0.0:1715330431.796110:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942545792 00000100:00100000:0.0:1715330431.796111:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942545792 00000100:00100000:0.0:1715330431.796116:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942545216 00000100:00100000:0.0:1715330431.796117:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942545216 00000100:00100000:0.0:1715330431.796122:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942545472 00000100:00100000:0.0:1715330431.796123:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942545472 00000100:00100000:0.0:1715330431.796129:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942545728 00000100:00100000:0.0:1715330431.796130:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942545728 00000100:00100000:0.0:1715330431.796137:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:00100000:0.0:1715330431.796139:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3691:x1798653942545344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330431.796157:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3691:x1798653942545344:12345-0@lo:400:kworker.0 Request processed in 17us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330431.796161:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00000100:00100000:0.0:1715330431.796166:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 00000100:00100000:0.0:1715330431.796169:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1798653942545536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330431.796182:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1798653942545536:12345-0@lo:400:kworker.0 Request processed in 12us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330431.796186:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 00000100:00100000:0.0:1715330431.796191:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:0.0:1715330431.796194:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3689:x1798653942545792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330431.796214:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3689:x1798653942545792:12345-0@lo:400:kworker.0 Request processed in 19us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330431.796219:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000100:00100000:0.0:1715330431.796225:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 465 00000100:00100000:0.0:1715330431.796228:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1798653942545216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330431.796240:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1798653942545216:12345-0@lo:400:kworker.0 Request processed in 12us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330431.796244:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 465 00000100:00100000:0.0:1715330431.796250:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 466 00000100:00100000:0.0:1715330431.796252:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1798653942545472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330431.796264:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1798653942545472:12345-0@lo:400:kworker.0 Request processed in 11us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330431.796268:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 466 00000100:00100000:0.0:1715330431.796273:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467 00000100:00100000:0.0:1715330431.796275:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3689:x1798653942545728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330431.796287:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3689:x1798653942545728:12345-0@lo:400:kworker.0 Request processed in 11us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330431.796291:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467 00000100:00100000:0.0:1715330431.796331:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3689:1798653942545216:0@lo:400:kworker.0 00000100:00100000:0.0:1715330431.796337:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3689:1798653942545472:0@lo:400:kworker.0 00000100:00100000:0.0:1715330431.796343:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3689:1798653942545728:0@lo:400:kworker.0 00000100:00100000:0.0:1715330431.796349:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942545280:0@lo:400:kworker.0 00000100:00100000:0.0:1715330431.796356:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3689:1798653942545536:0@lo:400:kworker.0 00000100:00100000:0.0:1715330431.796361:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091f38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3689:1798653942545792:0@lo:400:kworker.0 00000100:00100000:0.0:1715330431.796383:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3691:1798653942545344:0@lo:400:kworker.0 00000100:00100000:0.0:1715330431.796389:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942545600:0@lo:400:kworker.0 00000100:00100000:0.0:1715330431.796394:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091f38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942545856:0@lo:400:kworker.0 00000100:00100000:0.0:1715330431.796400:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942545408:0@lo:400:kworker.0 00000100:00100000:0.0:1715330431.796405:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942545664:0@lo:400:kworker.0 00000100:00100000:0.0:1715330431.796411:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942545920:0@lo:400:kworker.0 00000100:00100000:3.0:1715330431.796657:0:7130:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942545152 00000100:00100000:3.0:1715330431.796660:0:7130:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942545152 00000100:00100000:3.0:1715330431.797125:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1715330431.797131:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097aec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3691:x1798653942545152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330431.797496:0:7130:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880097aec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3691:x1798653942545152:12345-0@lo:400:kworker.0 Request processed in 366us (2049us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330431.797502:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00080000:3.0:1715330431.797543:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330401 00000100:00080000:3.0:1715330431.797547:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330401 00000100:00080000:3.0:1715330431.797548:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330401 00000100:00080000:3.0:1715330431.797550:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330401 00000100:00100000:1.0:1715330431.797594:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3691:1798653942545152:0@lo:400:kworker.0 00000100:00100000:1.0:1715330431.828117:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942545984:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1715330431.828190:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330431.832061:0:9400:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942545984 00000100:00100000:3.0:1715330431.832076:0:9400:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942545984 00000100:00100000:3.0:1715330431.832127:0:9400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1715330431.832134:0:9400:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942545984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1715330431.834760:0:9400:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 172032 granted 317126336 pending 0 free 3923546112 avail 3692023808 00000100:00100000:0.0:1715330431.834783:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942546048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1715330431.834818:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330431.834829:0:9400:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942545984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2694us (6638us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330431.834838:0:9400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1715330431.834847:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942546048 00000100:00100000:0.0:1715330431.834852:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942546048 00000100:00100000:0.0:1715330431.835504:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1715330431.835509:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942546048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1715330431.835527:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 172032 granted 317126336 pending 0 free 3923546112 avail 3692023808 00000100:00100000:0.0:1715330431.835563:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942546048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330431.835568:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1715330431.835601:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942545984:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1715330431.835603:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942546048:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1715330432.543489:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1715330432.828342:0:1299:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 64c: verify grant shrink ================== 04:40:32 (1715330432) 00000100:00100000:1.0:1715330432.856926:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330432.860202:0:17197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938135872 00000100:00100000:0.0:1715330432.860213:0:17197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938135872 00000100:00100000:2.0:1715330432.861335:0:9398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5349 00000100:00100000:2.0:1715330432.861347:0:9398:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938135872:12345-192.168.204.49@tcp:17:lctl.0 00000100:00100000:2.0:1715330432.861493:0:9398:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938135872:12345-192.168.204.49@tcp:17:lctl.0 Request processed in 149us (4573us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330432.861500:0:9398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5349 00000100:00100000:0.0:1715330433.234912:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1715330433.234933:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093b5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942546112:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1715330433.234989:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330433.236967:0:7139:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942546112 00000100:00100000:3.0:1715330433.236979:0:7139:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942546112 00000100:00100000:3.0:1715330433.237035:0:7139:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3140 00000100:00100000:3.0:1715330433.237043:0:7139:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:3691:x1798653942546112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1715330433.237077:0:7139:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444089856 avail 1314627584 00000100:00100000:3.0:1715330433.237140:0:7139:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:3691:x1798653942546112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (2151us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330433.237147:0:7139:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3140 00000100:00100000:1.0:1715330433.238671:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093b5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942546112:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1715330433.546389:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330433.945705:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330433.945784:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938135936 00000100:00100000:3.0:1715330433.945795:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938135936 00000100:00080000:0.0:1715330433.945822:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330403 00000100:00100000:3.0:1715330433.945864:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23861 00000100:00100000:3.0:1715330433.945872:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+16:23892:x1798653938135936:12345-192.168.204.49@tcp:41:lfs.0 00000004:00000024:3.0:1715330433.945948:0:7133:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444089856 avail 1314627584 00000100:00100000:2.0:1715330433.947857:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+16:23892:x1798653938135936:12345-192.168.204.49@tcp:41:lfs.0 Request processed in 1976us (2157us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330433.947872:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23861 00000100:00100000:0.0:1715330433.953713:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330433.955179:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938136000 00000100:00100000:2.0:1715330433.955188:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938136000 00000100:00100000:2.0:1715330433.955244:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23862 00000100:00100000:2.0:1715330433.955250:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+6:23892:x1798653938136000:12345-192.168.204.49@tcp:41:lfs.0 00000004:00000024:2.0:1715330433.955280:0:7133:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445060608 avail 1315598336 00000100:00100000:2.0:1715330433.955328:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+6:23892:x1798653938136000:12345-192.168.204.49@tcp:41:lfs.0 Request processed in 78us (1624us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330433.955334:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23862 00000100:00080000:0.0:1715330433.955385:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330403 00000100:00100000:1.0:1715330433.960949:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330433.961020:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938136064 00000100:00100000:0.0:1715330433.961028:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938136064 00000100:00080000:2.0:1715330433.961796:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330403 00000100:00100000:0.0:1715330433.961858:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 262 00000100:00100000:0.0:1715330433.961866:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:72de1896-1df4-4b3a-930a-9116d2c66168+6:23892:x1798653938136064:12345-192.168.204.49@tcp:13:lfs.0 00002000:00000024:0.0:1715330433.961895:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84264640 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1715330433.961950:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:72de1896-1df4-4b3a-930a-9116d2c66168+6:23892:x1798653938136064:12345-192.168.204.49@tcp:13:lfs.0 Request processed in 84us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330433.961957:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 262 00000100:00100000:0.0:1715330433.964007:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330433.964202:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938136128 00000100:00100000:3.0:1715330433.964212:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938136128 00000100:00100000:3.0:1715330433.964274:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 263 00000100:00100000:3.0:1715330433.964281:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:72de1896-1df4-4b3a-930a-9116d2c66168+6:23892:x1798653938136128:12345-192.168.204.49@tcp:13:lfs.0 00002000:00000024:3.0:1715330433.964313:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 172032 granted 317126336 pending 0 free 3923546112 avail 3692023808 00000100:00100000:3.0:1715330433.964369:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:72de1896-1df4-4b3a-930a-9116d2c66168+6:23892:x1798653938136128:12345-192.168.204.49@tcp:13:lfs.0 Request processed in 88us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330433.964375:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 263 00000100:00080000:2.0:1715330433.964406:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330403 00010000:00010000:1.0:1715330434.548552:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330434.675319:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093b59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942546176:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1715330434.675367:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330434.676106:0:7139:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942546176 00000100:00100000:3.0:1715330434.676113:0:7139:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942546176 00000100:00100000:3.0:1715330434.676149:0:7139:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3141 00000100:00100000:3.0:1715330434.676155:0:7139:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942546176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1715330434.676182:0:7139:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445060608 avail 1315598336 00000100:00100000:3.0:1715330434.676217:0:7139:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942546176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330434.676222:0:7139:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3141 00000100:00100000:1.0:1715330434.676302:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093b59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942546176:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1715330435.550893:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330435.572177:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942546240:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1715330435.572281:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330435.573453:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942546240 00000100:00100000:0.0:1715330435.573466:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942546240 00000100:00100000:0.0:1715330435.573526:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1715330435.573534:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942546240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1715330435.573564:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84264640 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1715330435.573630:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942546240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (1349us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330435.573636:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1715330435.573675:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942546240:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1715330435.574686:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1715330435.574704:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942546304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1715330435.574764:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330435.574786:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942546304 00000100:00100000:0.0:1715330435.574788:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942546304 00000100:00100000:0.0:1715330435.574810:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1715330435.574814:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942546304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1715330435.574825:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84264640 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1715330435.574859:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942546304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330435.574865:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1715330435.574891:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942546304:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1715330435.576450:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330405 00000100:00100000:1.0:1715330436.321890:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330436.321925:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330436.322510:0:7130:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938136192 00000100:00100000:2.0:1715330436.322517:0:7130:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938136192 00000100:00100000:2.0:1715330436.323218:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 388 00000100:00100000:2.0:1715330436.323225:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2014:x1798653938136192:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:2.0:1715330436.323275:0:7130:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2014:x1798653938136192:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 50us (1392us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330436.323281:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 388 00000100:00100000:1.0:1715330436.323435:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330436.323461:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330436.323476:0:17197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938136384 00000100:00100000:1.0:1715330436.323479:0:17197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938136384 00000100:00100000:1.0:1715330436.323501:0:17197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 332 00000100:00100000:1.0:1715330436.323506:0:17197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938136384:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:1.0:1715330436.323528:0:17197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938136384:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 22us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330436.323533:0:17197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 332 00000100:00100000:0.0:1715330436.323751:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938136256 00000100:00100000:0.0:1715330436.323755:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938136256 00000100:00100000:0.0:1715330436.323781:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938136320 00000100:00100000:0.0:1715330436.323782:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938136320 00000100:00100000:0.0:1715330436.323794:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 468 00000100:00100000:0.0:1715330436.323798:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+16:2013:x1798653938136256:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:3.0:1715330436.323908:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 469 00000100:00100000:3.0:1715330436.323914:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938136320:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:0.0:1715330436.324062:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+16:2013:x1798653938136256:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 263us (2135us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330436.324068:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 468 00000100:00080000:0.0:1715330436.324083:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330406 00000100:00080000:0.0:1715330436.324086:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330406 00000100:00080000:0.0:1715330436.324087:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330406 00000100:00080000:0.0:1715330436.324089:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330406 00000100:00100000:3.0:1715330436.324113:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938136320:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 199us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330436.324118:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 469 00000100:00100000:1.0:1715330436.326911:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330436.326971:0:9398:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938136448 00000100:00100000:2.0:1715330436.326980:0:9398:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938136448 00000100:00100000:2.0:1715330436.327016:0:9398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 333 00000100:00100000:2.0:1715330436.327021:0:9398:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938136448:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:2.0:1715330436.327080:0:9398:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938136448:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 58us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330436.327086:0:9398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 333 00000100:00080000:0.0:1715330436.327147:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330406 00010000:00010000:1.0:1715330436.553097:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330436.803010:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3691:1798653942546432:0@lo:400:kworker.0 00000100:00100000:0.0:1715330436.803084:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942546496:0@lo:400:kworker.0 00000100:00100000:1.0:1715330436.803111:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330436.803123:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330436.803176:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3691:1798653942546688:0@lo:400:kworker.0 00000100:00100000:1.0:1715330436.803197:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330436.803210:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091124380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3691:1798653942546944:0@lo:400:kworker.0 00000100:00100000:1.0:1715330436.803232:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330436.803251:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1715330436.803259:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009b5ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3691:1798653942546368:0@lo:400:kworker.0 00000100:00100000:3.0:1715330436.803290:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942546432 00000100:00100000:1.0:1715330436.803294:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330436.803300:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942546432 00000100:00100000:0.0:1715330436.803582:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3688:1798653942546752:0@lo:400:kworker.0 00000100:00100000:1.0:1715330436.803584:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942546624:0@lo:400:kworker.0 00000100:00100000:0.0:1715330436.803605:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330436.803606:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330436.803625:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942546880:0@lo:400:kworker.0 00000100:00100000:1.0:1715330436.803659:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330436.803674:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942547136:0@lo:400:kworker.0 00000100:00100000:1.0:1715330436.803691:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330436.803801:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3688:1798653942547008:0@lo:400:kworker.0 00000100:00100000:0.0:1715330436.803836:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330436.803889:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942546688 00000100:00100000:3.0:1715330436.803892:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942546688 00000100:00100000:1.0:1715330436.803906:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942546944 00000100:00100000:1.0:1715330436.803910:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942546944 00000100:00100000:2.0:1715330436.803925:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942546752 00000100:00100000:2.0:1715330436.803930:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942546752 00000100:00100000:1.0:1715330436.803963:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942547008 00000100:00100000:0.0:1715330436.803964:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1715330436.803969:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942547008 00000100:00100000:0.0:1715330436.803969:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3688:1798653942546560:0@lo:400:kworker.0 00000100:00100000:1.0:1715330436.803981:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00000100:00100000:0.0:1715330436.803988:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330436.803992:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3691:x1798653942546432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330436.803996:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942546816:0@lo:400:kworker.0 00000100:00100000:0.0:1715330436.804010:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330436.804019:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942547072:0@lo:400:kworker.0 00000100:00100000:0.0:1715330436.804035:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330436.804044:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3691:x1798653942546432:12345-0@lo:400:kworker.0 Request processed in 55us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330436.804050:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00000100:00100000:0.0:1715330436.804058:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942546560 00000100:00100000:0.0:1715330436.804060:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942546560 00000100:00100000:1.0:1715330436.804065:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 471 00000100:00100000:1.0:1715330436.804069:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3691:x1798653942546688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330436.804075:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:0.0:1715330436.804080:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3691:x1798653942546944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330436.804087:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3691:x1798653942546688:12345-0@lo:400:kworker.0 Request processed in 18us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330436.804091:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 471 00000100:00100000:1.0:1715330436.804097:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 473 00000100:00100000:1.0:1715330436.804100:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3688:x1798653942547008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330436.804104:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3691:x1798653942546944:12345-0@lo:400:kworker.0 Request processed in 24us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330436.804109:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:1.0:1715330436.804117:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3688:x1798653942547008:12345-0@lo:400:kworker.0 Request processed in 16us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330436.804122:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00000100:00100000:1.0:1715330436.804125:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 473 00000100:00100000:0.0:1715330436.804125:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3688:x1798653942546560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330436.804142:0:17197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942546880 00000100:00100000:0.0:1715330436.804144:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3688:x1798653942546560:12345-0@lo:400:kworker.0 Request processed in 18us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330436.804145:0:17197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942546880 00000100:00100000:0.0:1715330436.804152:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00000100:00100000:1.0:1715330436.804161:0:17197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942547136 00000100:00100000:1.0:1715330436.804163:0:17197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942547136 00000100:00100000:0.0:1715330436.804172:0:12304:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942546816 00000100:00100000:0.0:1715330436.804175:0:12304:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942546816 00000100:00100000:1.0:1715330436.804177:0:17197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942547072 00000100:00100000:1.0:1715330436.804179:0:17197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942547072 00000100:00100000:0.0:1715330436.804191:0:12304:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1715330436.804195:0:17197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1715330436.804195:0:12304:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942546880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330436.804199:0:17197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942547136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330436.804223:0:12304:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942546880:12345-0@lo:400:kworker.0 Request processed in 27us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330436.804226:0:17197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942547136:12345-0@lo:400:kworker.0 Request processed in 25us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330436.804229:0:12304:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1715330436.804232:0:17197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1715330436.804237:0:12304:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1715330436.804241:0:17197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1715330436.804241:0:12304:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091125f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942546816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330436.804245:0:17197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942547072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330436.804259:0:12304:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091125f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942546816:12345-0@lo:400:kworker.0 Request processed in 17us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330436.804264:0:12304:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1715330436.804266:0:17197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942547072:12345-0@lo:400:kworker.0 Request processed in 20us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330436.804270:0:17197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1715330436.804307:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942546880:0@lo:400:kworker.0 00000100:00100000:0.0:1715330436.804308:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3688:1798653942546560:0@lo:400:kworker.0 00000100:00100000:1.0:1715330436.804316:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942547136:0@lo:400:kworker.0 00000100:00100000:0.0:1715330436.804317:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942546816:0@lo:400:kworker.0 00000100:00100000:1.0:1715330436.804324:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3691:1798653942546688:0@lo:400:kworker.0 00000100:00100000:0.0:1715330436.804325:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942547072:0@lo:400:kworker.0 00000100:00100000:1.0:1715330436.804331:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091124380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3691:1798653942546944:0@lo:400:kworker.0 00000100:00100000:0.0:1715330436.804333:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3688:1798653942547008:0@lo:400:kworker.0 00000100:00100000:1.0:1715330436.804339:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3691:1798653942546432:0@lo:400:kworker.0 00000100:00100000:0.0:1715330436.804367:0:7129:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942546368 00000100:00100000:1.0:1715330436.804370:0:7139:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942546496 00000100:00100000:0.0:1715330436.804370:0:7129:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942546368 00000100:00100000:1.0:1715330436.804373:0:7139:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942546496 00000100:00100000:0.0:1715330436.804391:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1715330436.804392:0:7139:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942546624 00000100:00100000:1.0:1715330436.804394:0:7139:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942546624 00000100:00100000:0.0:1715330436.804395:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3691:x1798653942546368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330436.804405:0:7139:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3142 00000100:00100000:1.0:1715330436.804408:0:7139:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942546496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330436.804420:0:7129:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3691:x1798653942546368:12345-0@lo:400:kworker.0 Request processed in 24us (1124us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330436.804425:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1715330436.804436:0:7139:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942546496:12345-0@lo:400:kworker.0 Request processed in 26us (1312us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330436.804441:0:7139:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3142 00000100:00100000:1.0:1715330436.804450:0:7139:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3143 00000100:00100000:1.0:1715330436.804453:0:7139:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942546624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330436.804465:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942546496:0@lo:400:kworker.0 00000100:00100000:1.0:1715330436.804471:0:7139:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942546624:12345-0@lo:400:kworker.0 Request processed in 17us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330436.804476:0:7139:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3143 00000100:00080000:0.0:1715330436.804484:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330406 00000100:00080000:0.0:1715330436.804487:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330406 00000100:00080000:0.0:1715330436.804489:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330406 00000100:00100000:1.0:1715330436.804491:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009b5ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3691:1798653942546368:0@lo:400:kworker.0 00000100:00080000:0.0:1715330436.804491:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330406 00000100:00100000:1.0:1715330436.804500:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942546624:0@lo:400:kworker.0 00000100:00100000:2.0:1715330436.804976:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 475 00000100:00100000:2.0:1715330436.804981:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3688:x1798653942546752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330436.805025:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3688:x1798653942546752:12345-0@lo:400:kworker.0 Request processed in 43us (1419us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330436.805031:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 475 00000100:00100000:0.0:1715330436.805137:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3688:1798653942546752:0@lo:400:kworker.0 00000100:00100000:2.0:1715330436.851125:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942547200:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1715330436.851240:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330436.851292:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942547200 00000100:00100000:1.0:1715330436.851304:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942547200 00000100:00100000:1.0:1715330436.851368:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1715330436.851377:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942547200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1715330436.851416:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 172032 granted 317126336 pending 0 free 3923546112 avail 3692023808 00000100:00100000:1.0:1715330436.851458:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942547200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330436.851465:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1715330436.851932:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942547264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1715330436.851960:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330436.852645:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942547200:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1715330436.852824:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942547264 00000100:00100000:0.0:1715330436.852838:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942547264 00000100:00100000:0.0:1715330436.852866:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1715330436.852871:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942547264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1715330436.852886:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 172032 granted 317126336 pending 0 free 3923546112 avail 3692023808 00000100:00100000:0.0:1715330436.852937:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942547264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330436.852943:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1715330436.853073:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942547264:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1715330437.557609:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330438.248447:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942547328:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1715330438.248501:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330438.248542:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942547328 00000100:00100000:0.0:1715330438.248547:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942547328 00000100:00100000:0.0:1715330438.248578:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3144 00000100:00100000:0.0:1715330438.248583:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942547328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1715330438.248610:0:7138:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444089856 avail 1314627584 00000100:00100000:0.0:1715330438.248638:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942547328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 54us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330438.248643:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3144 00000100:00100000:0.0:1715330438.248675:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942547328:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1715330438.560563:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330439.562950:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330439.685643:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942547392:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1715330439.685728:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330439.685800:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942547392 00000100:00100000:2.0:1715330439.685809:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942547392 00000100:00100000:2.0:1715330439.685899:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3145 00000100:00100000:2.0:1715330439.685926:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942547392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1715330439.685966:0:19960:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445060608 avail 1315598336 00000100:00100000:2.0:1715330439.686015:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942547392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330439.686021:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3145 00000100:00100000:0.0:1715330439.686083:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942547392:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1715330440.577551:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330440.579293:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942547520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1715330440.579365:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330440.579434:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1715330440.579440:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091126a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942547456:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1715330440.579460:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330440.579572:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942547520 00000100:00100000:0.0:1715330440.579579:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942547520 00000100:00100000:0.0:1715330440.579615:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942547456 00000100:00100000:0.0:1715330440.579617:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942547456 00000100:00100000:0.0:1715330440.579631:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1715330440.579637:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942547520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1715330440.579663:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84264640 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1715330440.579700:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942547520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330440.579705:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1715330440.579718:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1715330440.579723:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942547456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1715330440.579754:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 84264640 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1715330440.579782:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942547456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330440.579786:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00080000:2.0:1715330440.579837:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330410 00000100:00100000:2.0:1715330440.579873:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091126a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942547456:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1715330440.579885:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942547520:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1715330440.801193:0:2015:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 64d: check grant limit exceed ============= 04:40:40 (1715330440) 00000100:00100000:1.0:1715330441.087039:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330441.087151:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938136576 00000100:00100000:3.0:1715330441.087164:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938136576 00000100:00100000:3.0:1715330441.087235:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23863 00000100:00100000:3.0:1715330441.087242:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+16:24564:x1798653938136576:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:3.0:1715330441.087264:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330441.087268:0:7134:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1715330441.087292:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7600/0xd895711d66dbebd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf5a expref: 16 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330441.087312:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:3.0:1715330441.087316:0:7134:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715330441.087348:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80900/0xd895711d66dbec4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbf61 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330441.087453:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82f40/0xd895711d66dbecb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330441.087463:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82f40/0xd895711d66dbecb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330441.087471:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82f40/0xd895711d66dbecb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330441.087482:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83cc0/0xd895711d66dbed2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x67bc6aa0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330441.087486:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83cc0/0xd895711d66dbed2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x67bc6aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330441.087490:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83cc0/0xd895711d66dbed2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x67bc6aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330441.087870:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82d00/0xd895711d66dbed9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x159c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330441.087878:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82d00/0xd895711d66dbed9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x159c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330441.087883:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82d00/0xd895711d66dbed9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x159c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000004:00200000:3.0:1715330441.087896:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x159c:0x0]: returning size 0 00010000:00010000:3.0:1715330441.087920:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82f40/0xd895711d66dbecb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330441.087926:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82f40/0xd895711d66dbecb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330441.087932:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82f40/0xd895711d66dbecb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330441.087939:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82f40/0xd895711d66dbecb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330441.087943:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da82f40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330441.087946:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82f40/0xd895711d66dbecb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330441.087951:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82f40/0xd895711d66dbecb lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330441.087957:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:3.0:1715330441.087959:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330441.087962:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82f40/0xd895711d66dbecb lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330441.087966:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82f40/0xd895711d66dbecb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00000004:00010000:3.0:1715330441.087976:0:7134:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880091d84e00 reply state ffff88012fbdc000 transno 4294984127 ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83cc0/0xd895711d66dbed2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x67bc6aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330441.087982:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83cc0/0xd895711d66dbed2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x67bc6aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:3.0:1715330441.087986:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x67bc6aa0 (ffff88008d68e100) 00010000:00010000:3.0:1715330441.087988:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715330441.087990:0:7134:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715330441.088007:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da80900/0xd895711d66dbec4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf61 expref: 18 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330441.088022:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82d00/0xd895711d66dbed9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x159c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf61 expref: 17 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330441.088029:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159c:0x0].0x0 (ffff88008d68ee00) 00010000:00010000:3.0:1715330441.088030:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715330441.088032:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011da82d00, rc 0) 00000100:00100000:3.0:1715330441.088085:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+18:24564:x1798653938136576:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 842us (1055us total) trans 4294984127 rc 0/0 00000100:00100000:3.0:1715330441.088091:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23863 00000100:00080000:2.0:1715330441.088226:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330411 00000100:00100000:0.0:1715330441.094708:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330441.094823:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938136704 00000100:00100000:2.0:1715330441.094836:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938136704 00000100:00100000:2.0:1715330441.094916:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23864 00000100:00100000:2.0:1715330441.094923:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+18:24564:x1798653938136704:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:2.0:1715330441.094945:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330441.094965:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b46c0/0xd895711d66dbee7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbf68 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330441.095100:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5b00/0xd895711d66dbeee lrc: 3/0,1 mode: --/EX res: [0x200000402:0x159c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330441.095112:0:25569:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82d00/0xd895711d66dbed9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x159c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf61 expref: 19 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330441.095119:0:25569:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5b00/0xd895711d66dbeee lrc: 4/0,1 mode: --/EX res: [0x200000402:0x159c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:2.0:1715330441.095150:0:25569:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82d00/0xd895711d66dbed9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x159c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf61 expref: 19 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330441.095162:0:25569:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82d00/0xd895711d66dbed9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x159c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf61 expref: 19 pid: 7134 timeout: 515 lvb_type: 0 00000100:00100000:2.0:1715330441.095179:0:25569:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093b58a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:25569:1798653942547584:192.168.204.49@tcp:104: 00000100:00100000:2.0:1715330441.095255:0:25569:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091f68cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1715330441.108555:0:25569:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093b58a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:25569:1798653942547584:192.168.204.49@tcp:104: 00010000:00010000:2.0:1715330441.108595:0:25569:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5b00/0xd895711d66dbeee lrc: 3/0,1 mode: --/EX res: [0x200000402:0x159c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00000100:00100000:1.0:1715330441.111616:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330441.113292:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938136768 00000100:00100000:3.0:1715330441.113307:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938136768 00010000:00010000:3.0:1715330441.113349:0:10674:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82d00/0xd895711d66dbed9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x159c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf61 expref: 20 pid: 7134 timeout: 515 lvb_type: 0 00000100:00100000:3.0:1715330441.113394:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1592 00000100:00100000:3.0:1715330441.113401:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:72de1896-1df4-4b3a-930a-9116d2c66168+20:2013:x1798653938136768:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1715330441.113416:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330441.113422:0:10674:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82d00/0xd895711d66dbed9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x159c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf61 expref: 20 pid: 7134 timeout: 515 lvb_type: 0 00010000:00010000:3.0:1715330441.113433:0:10674:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82d00/0xd895711d66dbed9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x159c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf61 expref: 20 pid: 7134 timeout: 515 lvb_type: 0 00010000:00010000:3.0:1715330441.113456:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da82d00/0xd895711d66dbed9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x159c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf61 expref: 20 pid: 7134 timeout: 515 lvb_type: 0 00010000:00010000:3.0:1715330441.113479:0:10674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159c:0x0].0x0 (ffff88008d68ee00) 00010000:00010000:3.0:1715330441.113484:0:10674:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5b00/0xd895711d66dbeee lrc: 3/0,1 mode: --/EX res: [0x200000402:0x159c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330441.113493:0:10674:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5b00/0xd895711d66dbeee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330441.113499:0:10674:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5b00/0xd895711d66dbeee lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x159c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330441.113520:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715330441.113574:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:72de1896-1df4-4b3a-930a-9116d2c66168+19:2013:x1798653938136768:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 173us (1971us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330441.113580:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1592 00010000:00010000:3.0:1715330441.113620:0:25569:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5b00/0xd895711d66dbeee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330441.113627:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5b00/0xd895711d66dbeee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00000004:00200000:3.0:1715330441.113644:0:25569:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x159c:0x0]: returning size 0 00000004:00080000:3.0:1715330441.113833:0:25569:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa02:0x0], index 0: 0 00010000:00010000:3.0:1715330441.113934:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5b00/0xd895711d66dbeee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330441.113941:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5b00/0xd895711d66dbeee lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x159c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330441.113947:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5b00/0xd895711d66dbeee lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x159c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330441.113952:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b5b00 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330441.113956:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5b00/0xd895711d66dbeee lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x159c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330441.113966:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5b00/0xd895711d66dbeee lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x159c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330441.113973:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159c:0x0].0x0 (ffff88008d68ee00) 00010000:00010000:3.0:1715330441.113976:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1715330441.113979:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5b00/0xd895711d66dbeee lrc: 2/0,0 mode: --/EX res: [0x200000402:0x159c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330441.113983:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5b00/0xd895711d66dbeee lrc: 0/0,0 mode: --/EX res: [0x200000402:0x159c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330441.114035:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b46c0/0xd895711d66dbee7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf68 expref: 19 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330441.114043:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b46c0/0xd895711d66dbee7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf68 expref: 19 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330441.114051:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938b46c0, rc 0) 00000100:00100000:3.0:1715330441.114074:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+18:24564:x1798653938136704:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 19152us (19379us total) trans 4294984128 rc 301/301 00000100:00100000:3.0:1715330441.114081:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23864 00000100:00100000:1.0:1715330441.118890:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330441.118993:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938136896 00000100:00100000:0.0:1715330441.119002:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938136896 00000100:00100000:3.0:1715330441.121354:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5223 00000100:00100000:3.0:1715330441.121369:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+18:24564:x1798653938136896:12345-192.168.204.49@tcp:35:lfs.0 00000100:00100000:3.0:1715330441.121612:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+19:24564:x1798653938136896:12345-192.168.204.49@tcp:35:lfs.0 Request processed in 247us (2732us total) trans 4294984129 rc 0/0 00000100:00100000:3.0:1715330441.121619:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5223 00000100:00100000:0.0:1715330441.126296:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330441.128369:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938136960 00000100:00100000:3.0:1715330441.128387:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938136960 00000100:00100000:2.0:1715330441.129770:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23865 00000100:00100000:2.0:1715330441.129782:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+19:24564:x1798653938136960:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:2.0:1715330441.129821:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330441.129852:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b46c0/0xd895711d66dbefc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x159c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbf6f expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330441.129936:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b46c0/0xd895711d66dbefc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x159c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf6f expref: 20 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330441.129951:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b46c0/0xd895711d66dbefc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x159c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf6f expref: 20 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330441.129970:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159c:0x0].0x0 (ffff88009d618e00) 00010000:00010000:2.0:1715330441.129973:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1715330441.129977:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938b46c0, rc 0) 00000100:00100000:2.0:1715330441.130062:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+20:24564:x1798653938136960:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 282us (3781us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330441.130069:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23865 00000100:00100000:0.0:1715330441.134941:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330441.135017:0:15159:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938137088 00000100:00100000:2.0:1715330441.135029:0:15159:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938137088 00000100:00100000:2.0:1715330441.135079:0:15159:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5224 00000100:00100000:2.0:1715330441.135087:0:15159:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007acb2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+20:24564:x1798653938137088:12345-192.168.204.49@tcp:35:lfs.0 00000100:00100000:2.0:1715330441.135317:0:15159:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007acb2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:72de1896-1df4-4b3a-930a-9116d2c66168+21:24564:x1798653938137088:12345-192.168.204.49@tcp:35:lfs.0 Request processed in 230us (386us total) trans 4294984130 rc 0/0 00000100:00100000:2.0:1715330441.135324:0:15159:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5224 00000100:00100000:0.0:1715330441.145572:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330441.145667:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938137152 00000100:00100000:3.0:1715330441.145681:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938137152 00000100:00100000:2.0:1715330441.147695:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23866 00000100:00100000:2.0:1715330441.147714:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+21:24565:x1798653938137152:12345-192.168.204.49@tcp:101:dd.0 00010000:00010000:2.0:1715330441.147775:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330441.147804:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5b00/0xd895711d66dbf03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbf76 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330441.147878:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5680/0xd895711d66dbf0a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330441.147893:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5680/0xd895711d66dbf0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330441.147907:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5680/0xd895711d66dbf0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000004:00200000:2.0:1715330441.147968:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 270336 00000004:00200000:2.0:1715330441.147972:0:7134:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1715330441.147995:0:7134:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5680/0xd895711d66dbf0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330441.148018:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5b00/0xd895711d66dbf03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf76 expref: 23 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330441.148696:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5680/0xd895711d66dbf0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf76 expref: 22 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330441.148708:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:2.0:1715330441.148711:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1715330441.148715:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938b5680, rc 0) 00000100:00100000:2.0:1715330441.150957:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+22:24565:x1798653938137152:12345-192.168.204.49@tcp:101:dd.0 Request processed in 3237us (5391us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330441.150971:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23866 00000100:00100000:1.0:1715330441.152260:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330441.152431:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938137280 00000100:00100000:2.0:1715330441.152441:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938137280 00000100:00100000:2.0:1715330441.152766:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23867 00000100:00100000:2.0:1715330441.152773:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+22:24565:x1798653938137280:12345-192.168.204.49@tcp:101:dd.0 00010000:00010000:2.0:1715330441.152796:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330441.152800:0:7134:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1715330441.152827:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b5680/0xd895711d66dbf0a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf76 expref: 22 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330441.153012:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:2.0:1715330441.153018:0:7134:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330441.153033:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b73c0/0xd895711d66dbf11 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbf7d expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330441.153157:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66dbf18 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330441.153170:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66dbf18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330441.153179:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66dbf18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330441.153192:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6f40/0xd895711d66dbf1f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x67bc6aa0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330441.153198:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6f40/0xd895711d66dbf1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67bc6aa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330441.153202:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6f40/0xd895711d66dbf1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67bc6aa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330441.153250:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7cc0/0xd895711d66dbf26 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x159c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330441.153256:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7cc0/0xd895711d66dbf26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x159c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330441.153261:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7cc0/0xd895711d66dbf26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x159c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000004:00200000:2.0:1715330441.153269:0:7134:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x159c:0x0]: returning size 0 00010000:00010000:2.0:1715330441.153348:0:7134:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66dbf18 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330441.153354:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66dbf18 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330441.153360:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66dbf18 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330441.153366:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66dbf18 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330441.153371:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b7840 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330441.153375:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66dbf18 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330441.153384:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66dbf18 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330441.153392:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:2.0:1715330441.153394:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330441.153398:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66dbf18 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330441.153403:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66dbf18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330441.153411:0:7134:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6f40/0xd895711d66dbf1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67bc6aa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330441.153416:0:7134:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6f40/0xd895711d66dbf1f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67bc6aa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330441.153421:0:7134:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6f40/0xd895711d66dbf1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67bc6aa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330441.153425:0:7134:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b6f40 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:2.0:1715330441.153427:0:7134:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6f40/0xd895711d66dbf1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67bc6aa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330441.153431:0:7134:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6f40/0xd895711d66dbf1f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67bc6aa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330441.153436:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x67bc6aa0 (ffff88008d68e100) 00010000:00010000:2.0:1715330441.153438:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715330441.153441:0:7134:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6f40/0xd895711d66dbf1f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x67bc6aa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330441.153445:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6f40/0xd895711d66dbf1f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x67bc6aa0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330441.153473:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b73c0/0xd895711d66dbf11 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf7d expref: 24 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330441.153484:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7cc0/0xd895711d66dbf26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x159c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf7d expref: 23 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330441.153490:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159c:0x0].0x0 (ffff88009d618e00) 00010000:00010000:2.0:1715330441.153492:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330441.153494:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938b7cc0, rc 0) 00000100:00100000:2.0:1715330441.154292:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+23:24565:x1798653938137280:12345-192.168.204.49@tcp:101:dd.0 Request processed in 1516us (2033us total) trans 4294984131 rc 0/0 00000100:00100000:2.0:1715330441.154300:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23867 00000100:00100000:0.0:1715330441.158378:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330441.158455:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938137344 00000100:00100000:2.0:1715330441.158466:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938137344 00000100:00100000:2.0:1715330441.158522:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23868 00000100:00100000:2.0:1715330441.158530:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+23:24565:x1798653938137344:12345-192.168.204.49@tcp:101:dd.0 00010000:00010000:2.0:1715330441.158556:0:7134:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330441.158577:0:7134:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b73c0/0xd895711d66dbf34 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x159c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbf84 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330441.158612:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6f40/0xd895711d66dbf3b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x159c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330441.158626:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6f40/0xd895711d66dbf3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x159c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330441.158637:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6f40/0xd895711d66dbf3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x159c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330441.158832:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b73c0/0xd895711d66dbf34 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x159c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf84 expref: 25 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330441.159044:0:7134:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6f40/0xd895711d66dbf3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x159c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf84 expref: 24 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330441.159052:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159c:0x0].0x0 (ffff88009d618e00) 00010000:00010000:2.0:1715330441.159055:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1715330441.159058:0:7134:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938b6f40, rc 0) 00000100:00100000:2.0:1715330441.159411:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+24:24565:x1798653938137344:12345-192.168.204.49@tcp:101:dd.0 Request processed in 880us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330441.159418:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23868 00000100:00100000:0.0:1715330441.162634:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330441.162773:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938137472 00000100:00100000:2.0:1715330441.162782:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938137472 00000100:00100000:2.0:1715330441.162897:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23869 00000100:00100000:2.0:1715330441.162906:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+24:24565:x1798653938137472:12345-192.168.204.49@tcp:36:dd.0 00010000:00010000:2.0:1715330441.163097:0:7134:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330441.163123:0:7134:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7cc0/0xd895711d66dbf26 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x159c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf7d expref: 24 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330441.163196:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159c:0x0].0x0 (ffff88009d618e00) 00010000:00010000:2.0:1715330441.163201:0:7134:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715330441.163356:0:7134:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66dbf42 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x159c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330441.163369:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66dbf42 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x159c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330441.163382:0:7134:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66dbf42 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x159c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00000001:00080000:2.0:1715330441.163411:0:7134:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294984132 00000004:00010000:2.0:1715330441.163425:0:7134:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff880091127b80 reply state ffff88009d47c000 transno 4294984133 ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66dbf42 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x159c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330441.163431:0:7134:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66dbf42 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x159c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:2.0:1715330441.163435:0:7134:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159c:0x0].0x0 (ffff88009d618e00) 00010000:00010000:2.0:1715330441.163437:0:7134:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715330441.163439:0:7134:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1715330441.163506:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+26:24565:x1798653938137472:12345-192.168.204.49@tcp:36:dd.0 Request processed in 601us (885us total) trans 4294984133 rc 0/0 00000100:00100000:2.0:1715330441.163513:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23869 00000020:00080000:2.0:1715330441.163517:0:7134:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1715330441.164538:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330441.164563:0:9398:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938137536 00000100:00100000:0.0:1715330441.164569:0:9398:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938137536 00000100:00100000:0.0:1715330441.164627:0:9398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5350 00000100:00100000:0.0:1715330441.164634:0:9398:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72de1896-1df4-4b3a-930a-9116d2c66168+6:24565:x1798653938137536:12345-192.168.204.49@tcp:101:dd.0 00010000:00010000:0.0:1715330441.164649:0:9398:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330441.164668:0:9398:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800877261c0/0xd895711d66dbf49 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa02:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbf8b expref: -99 pid: 9398 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1715330441.164811:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330411 00002000:00010000:0.0:1715330441.165481:0:9398:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000401:0xa02:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1715330441.165517:0:9398:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330441.165520:0:9398:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715330441.165531:0:9398:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800877261c0/0xd895711d66dbf49 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf8b expref: 7 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330441.165549:0:9398:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800877261c0/0xd895711d66dbf49 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf8b expref: 7 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330441.165560:0:9398:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800877261c0, rc 0) 00000100:00100000:0.0:1715330441.166569:0:9398:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72de1896-1df4-4b3a-930a-9116d2c66168+7:24565:x1798653938137536:12345-192.168.204.49@tcp:101:dd.0 Request processed in 1931us (2029us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330441.166577:0:9398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5350 00000100:00100000:0.0:1715330441.169590:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330441.171078:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938137600 00000100:00100000:2.0:1715330441.171088:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938137600 00002000:00010000:2.0:1715330441.171115:0:31376:0:(ofd_dev.c:2731:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/2562 (0->18446744073709551615) 00002000:00100000:2.0:1715330441.171119:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091126a00 with x1798653938137600 ext(0->18446744073709551615) 00002000:00010000:2.0:1715330441.171128:0:31376:0:(ofd_dev.c:2736:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091126a00. 00000100:00100000:2.0:1715330441.171156:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 87 00000100:00100000:2.0:1715330441.171162:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091126a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+7:2011:x1798653938137600:12345-192.168.204.49@tcp:10:dd.0 00002000:00010000:2.0:1715330441.171375:0:31376:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0xa02:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1715330441.171378:0:31376:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xa02:0x0] updating lvb mtime from disk: 0 -> 1715330441 00002000:00010000:2.0:1715330441.171380:0:31376:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000401:0xa02:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1715330441.171382:0:31376:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000401:0xa02:0x0] updating lvb ctime from disk: 0 -> 1715330441 00002000:00010000:2.0:1715330441.171384:0:31376:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000401:0xa02:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1715330441.171443:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091126a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+8:2011:x1798653938137600:12345-192.168.204.49@tcp:10:dd.0 Request processed in 280us (1858us total) trans 4294969953 rc 0/0 00000100:00100000:2.0:1715330441.171450:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 87 00002000:00010000:2.0:1715330441.171453:0:31376:0:(ofd_dev.c:2731:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/2562 (0->18446744073709551615) 00002000:00100000:2.0:1715330441.171455:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091126a00 with x1798653938137600 ext(0->18446744073709551615) 00002000:00010000:2.0:1715330441.171459:0:31376:0:(ofd_dev.c:2736:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091126a00. 00000100:00100000:2.0:1715330441.258507:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330441.258634:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938137728 00000100:00100000:1.0:1715330441.258648:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938137728 00002000:00100000:1.0:1715330441.258943:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (0->4194303) req@ffff880093b58a80 x1798653938137728/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:652/0 lens 488/0 e 0 to 0 dl 1715330452 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330441.258953:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b58a80 with x1798653938137728 ext(0->4194303) 00002000:00010000:1.0:1715330441.258960:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b58a80 00000100:00100000:2.0:1715330441.259660:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 88 00000100:00100000:2.0:1715330441.259671:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+8:2011:x1798653938137728:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330441.333389:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330441.333643:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938137984 00000100:00100000:3.0:1715330441.333654:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938137984 00000100:00100000:3.0:1715330441.333705:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 476 00000100:00100000:3.0:1715330441.333712:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+26:2013:x1798653938137984:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:3.0:1715330441.335535:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+26:2013:x1798653938137984:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 1804us (2138us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330441.335544:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330441.335549:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 476 00000100:00100000:3.0:1715330441.335613:0:9398:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938138112 00000100:00100000:3.0:1715330441.335621:0:9398:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938138112 00000100:00100000:3.0:1715330441.335657:0:9398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 338 00000100:00100000:3.0:1715330441.335663:0:9398:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72de1896-1df4-4b3a-930a-9116d2c66168+10:2013:x1798653938138112:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:3.0:1715330441.335710:0:9398:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72de1896-1df4-4b3a-930a-9116d2c66168+10:2013:x1798653938138112:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 47us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330441.335715:0:9398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 338 00000100:00100000:1.0:1715330441.336360:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330441.336385:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330441.336417:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330441.336438:0:17215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938138176 00000100:00100000:1.0:1715330441.336442:0:17215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938138176 00000100:00100000:1.0:1715330441.336466:0:17215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 339 00000100:00100000:1.0:1715330441.336470:0:17215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938138176:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:1.0:1715330441.336498:0:17215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938138176:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 27us (80us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330441.336504:0:17215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 339 00000100:00080000:1.0:1715330441.336580:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330411 00000100:00100000:2.0:1715330441.336728:0:7130:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938137920 00000100:00100000:2.0:1715330441.336756:0:7130:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938137920 00000100:00100000:2.0:1715330441.336785:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 390 00000100:00100000:2.0:1715330441.336790:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2013:x1798653938137920:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:2.0:1715330441.336816:0:7130:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2013:x1798653938137920:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 25us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330441.336821:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 390 00000100:00100000:3.0:1715330441.337930:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938138048 00000100:00100000:3.0:1715330441.337938:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938138048 00000100:00100000:3.0:1715330441.337984:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 477 00000100:00100000:3.0:1715330441.337990:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938138048:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:3.0:1715330441.338028:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938138048:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 39us (1643us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330441.338034:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 477 00000100:00080000:1.0:1715330441.338998:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330411 00000100:00080000:1.0:1715330441.339003:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330411 00000100:00100000:2.0:1715330441.352151:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330441.352242:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938137856 00000100:00100000:0.0:1715330441.352253:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938137856 00002000:00100000:0.0:1715330441.352298:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (4194304->8388607) req@ffff880093b5aa00 x1798653938137856/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:652/0 lens 488/0 e 0 to 0 dl 1715330452 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330441.352309:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b5aa00 with x1798653938137856 ext(4194304->8388607) 00002000:00010000:0.0:1715330441.352317:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b5aa00 00000100:00100000:0.0:1715330441.352341:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 89 00000100:00100000:0.0:1715330441.352349:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+10:2011:x1798653938137856:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330441.382145:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+12:2011:x1798653938137728:12345-192.168.204.49@tcp:4:dd.0 Request processed in 122467us (123643us total) trans 4294969954 rc 0/0 00000100:00100000:2.0:1715330441.382159:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 88 00002000:00100000:2.0:1715330441.382171:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (0->4194303) req@ffff880093b58a80 x1798653938137728/t4294969954(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:652/0 lens 488/448 e 0 to 0 dl 1715330452 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330441.382181:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b58a80 with x1798653938137728 ext(0->4194303) 00002000:00010000:2.0:1715330441.382189:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b58a80 00000100:00100000:0.0:1715330441.435380:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+12:2011:x1798653938137856:12345-192.168.204.49@tcp:4:dd.0 Request processed in 83014us (83226us total) trans 4294969955 rc 0/0 00000100:00100000:0.0:1715330441.435398:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 89 00002000:00100000:0.0:1715330441.435415:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (4194304->8388607) req@ffff880093b5aa00 x1798653938137856/t4294969955(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:652/0 lens 488/448 e 0 to 0 dl 1715330452 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330441.435426:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b5aa00 with x1798653938137856 ext(4194304->8388607) 00002000:00010000:0.0:1715330441.435434:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b5aa00 00000100:00100000:1.0:1715330441.435566:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330441.436137:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938138304 00000100:00100000:0.0:1715330441.436145:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938138304 00002000:00100000:0.0:1715330441.436178:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (8388608->12582911) req@ffff880091d86680 x1798653938138304/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:652/0 lens 488/0 e 0 to 0 dl 1715330452 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330441.436186:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d86680 with x1798653938138304 ext(8388608->12582911) 00002000:00010000:0.0:1715330441.436190:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d86680 00000100:00100000:0.0:1715330441.436225:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 90 00000100:00100000:0.0:1715330441.436231:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+12:2014:x1798653938138304:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330441.502136:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+14:2014:x1798653938138304:12345-192.168.204.49@tcp:4:dd.0 Request processed in 65895us (66563us total) trans 4294969956 rc 0/0 00000100:00100000:0.0:1715330441.502149:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 90 00002000:00100000:0.0:1715330441.502160:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (8388608->12582911) req@ffff880091d86680 x1798653938138304/t4294969956(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:652/0 lens 488/448 e 0 to 0 dl 1715330452 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330441.502170:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d86680 with x1798653938138304 ext(8388608->12582911) 00002000:00010000:0.0:1715330441.502176:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d86680 00000100:00100000:3.0:1715330441.511789:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330441.512067:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938138432 00000100:00100000:0.0:1715330441.512077:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938138432 00002000:00100000:0.0:1715330441.512118:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (12582912->16777215) req@ffff88008d4fbb80 x1798653938138432/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:652/0 lens 488/0 e 0 to 0 dl 1715330452 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330441.512127:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d4fbb80 with x1798653938138432 ext(12582912->16777215) 00002000:00010000:0.0:1715330441.512132:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d4fbb80 00000100:00100000:0.0:1715330441.512167:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 91 00000100:00100000:0.0:1715330441.512174:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+14:2013:x1798653938138432:12345-192.168.204.49@tcp:4:dd.0 00010000:00010000:3.0:1715330441.583253:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330441.583862:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330441.584871:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938138560 00000100:00100000:2.0:1715330441.584884:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938138560 00002000:00100000:2.0:1715330441.584936:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (16777216->20971519) req@ffff880091d86a00 x1798653938138560/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:652/0 lens 488/0 e 0 to 0 dl 1715330452 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330441.584946:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d86a00 with x1798653938138560 ext(16777216->20971519) 00002000:00010000:2.0:1715330441.584953:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d86a00 00000100:00100000:2.0:1715330441.584986:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 92 00000100:00100000:2.0:1715330441.584993:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+16:2011:x1798653938138560:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330441.605698:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+18:2013:x1798653938138432:12345-192.168.204.49@tcp:4:dd.0 Request processed in 93514us (93966us total) trans 4294969957 rc 0/0 00000100:00100000:3.0:1715330441.605710:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 91 00002000:00100000:3.0:1715330441.605721:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (12582912->16777215) req@ffff88008d4fbb80 x1798653938138432/t4294969957(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:652/0 lens 488/448 e 0 to 0 dl 1715330452 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330441.605773:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d4fbb80 with x1798653938138432 ext(12582912->16777215) 00002000:00010000:3.0:1715330441.605780:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d4fbb80 00000100:00100000:0.0:1715330441.680328:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330441.680550:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938138688 00000100:00100000:3.0:1715330441.680564:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938138688 00002000:00100000:3.0:1715330441.680605:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (20971520->25165823) req@ffff880091124380 x1798653938138688/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:652/0 lens 488/0 e 0 to 0 dl 1715330452 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330441.680615:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091124380 with x1798653938138688 ext(20971520->25165823) 00002000:00010000:3.0:1715330441.680620:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091124380 00000100:00100000:2.0:1715330441.682130:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+19:2011:x1798653938138560:12345-192.168.204.49@tcp:4:dd.0 Request processed in 97123us (98263us total) trans 4294969958 rc 0/0 00000100:00100000:2.0:1715330441.682145:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 92 00002000:00100000:2.0:1715330441.682157:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (16777216->20971519) req@ffff880091d86a00 x1798653938138560/t4294969958(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:652/0 lens 488/448 e 0 to 0 dl 1715330452 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330441.682166:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d86a00 with x1798653938138560 ext(16777216->20971519) 00002000:00010000:2.0:1715330441.682171:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d86a00 00000100:00100000:2.0:1715330441.682199:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 93 00000100:00100000:2.0:1715330441.682205:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091124380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+18:2013:x1798653938138688:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330441.763488:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330441.766584:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938138816 00000100:00100000:3.0:1715330441.766599:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938138816 00002000:00100000:3.0:1715330441.766645:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (25165824->29360127) req@ffff880091d86d80 x1798653938138816/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:652/0 lens 488/0 e 0 to 0 dl 1715330452 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330441.766654:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d86d80 with x1798653938138816 ext(25165824->29360127) 00002000:00010000:3.0:1715330441.766660:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d86d80 00000100:00100000:3.0:1715330441.766696:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 94 00000100:00100000:3.0:1715330441.766702:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+22:2014:x1798653938138816:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330441.774021:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091124380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+21:2013:x1798653938138688:12345-192.168.204.49@tcp:4:dd.0 Request processed in 91806us (93699us total) trans 4294969959 rc 0/0 00000100:00100000:2.0:1715330441.774036:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 93 00002000:00100000:2.0:1715330441.774049:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (20971520->25165823) req@ffff880091124380 x1798653938138688/t4294969959(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:652/0 lens 488/448 e 0 to 0 dl 1715330452 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330441.774057:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091124380 with x1798653938138688 ext(20971520->25165823) 00002000:00010000:2.0:1715330441.774064:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091124380 00000100:00100000:0.0:1715330441.810988:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3691:1798653942547840:0@lo:400:kworker.0 00000100:00100000:0.0:1715330441.811038:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330441.811058:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942548096:0@lo:400:kworker.0 00000100:00100000:0.0:1715330441.811076:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330441.811087:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009327ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942548352:0@lo:400:kworker.0 00000100:00100000:0.0:1715330441.811101:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330441.811115:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1715330441.811119:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942547776:0@lo:400:kworker.0 00000100:00100000:0.0:1715330441.811135:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330441.811143:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3691:1798653942548032:0@lo:400:kworker.0 00000100:00100000:0.0:1715330441.811155:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330441.811163:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009327c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3691:1798653942548288:0@lo:400:kworker.0 00000100:00100000:0.0:1715330441.811175:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330441.811199:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942547840 00000100:00100000:0.0:1715330441.811207:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942547840 00000100:00100000:0.0:1715330441.811237:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942548032 00000100:00100000:0.0:1715330441.811240:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942548032 00000100:00100000:0.0:1715330441.811253:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942548288 00000100:00100000:0.0:1715330441.811255:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942548288 00000100:00100000:0.0:1715330441.811266:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:0.0:1715330441.811271:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009327d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3691:x1798653942547840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330441.811307:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009327d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3691:x1798653942547840:12345-0@lo:400:kworker.0 Request processed in 35us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330441.811312:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00100000:0.0:1715330441.811325:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00000100:00100000:0.0:1715330441.811328:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009327df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3691:x1798653942548032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330441.811345:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009327df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3691:x1798653942548032:12345-0@lo:400:kworker.0 Request processed in 16us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330441.811349:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00000100:00100000:0.0:1715330441.811356:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 480 00000100:00100000:0.0:1715330441.811359:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009327e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3691:x1798653942548288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330441.811374:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009327e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3691:x1798653942548288:12345-0@lo:400:kworker.0 Request processed in 15us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330441.811378:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 480 00000100:00100000:0.0:1715330441.811410:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3691:1798653942548032:0@lo:400:kworker.0 00000100:00100000:0.0:1715330441.811418:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009327c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3691:1798653942548288:0@lo:400:kworker.0 00000100:00100000:0.0:1715330441.811424:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3691:1798653942547840:0@lo:400:kworker.0 00000100:00080000:0.0:1715330441.811446:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330411 00000100:00100000:0.0:1715330441.811462:0:17215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942548096 00000100:00100000:0.0:1715330441.811464:0:17215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942548096 00000100:00100000:0.0:1715330441.811479:0:17215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942548352 00000100:00100000:0.0:1715330441.811480:0:17215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942548352 00000100:00100000:0.0:1715330441.811492:0:17215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1715330441.811496:0:17215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009327d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942548096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330441.811519:0:17215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009327d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942548096:12345-0@lo:400:kworker.0 Request processed in 22us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330441.811523:0:17215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1715330441.811531:0:17215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1715330441.811534:0:17215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009327d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942548352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330441.811550:0:17215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009327d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942548352:12345-0@lo:400:kworker.0 Request processed in 15us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330441.811554:0:17215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00080000:0.0:1715330441.811565:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330411 00000100:00100000:0.0:1715330441.811576:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942548096:0@lo:400:kworker.0 00000100:00100000:0.0:1715330441.811582:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009327ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942548352:0@lo:400:kworker.0 00000100:00100000:0.0:1715330441.811608:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942547776 00000100:00100000:0.0:1715330441.811611:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942547776 00000100:00100000:0.0:1715330441.811627:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3146 00000100:00100000:0.0:1715330441.811631:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009327dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3691:x1798653942547776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330441.811652:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009327dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3691:x1798653942547776:12345-0@lo:400:kworker.0 Request processed in 21us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330441.811656:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3146 00000100:00100000:0.0:1715330441.811671:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942547776:0@lo:400:kworker.0 00000100:00100000:2.0:1715330441.811766:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3688:1798653942547648:0@lo:400:kworker.0 00000100:00100000:2.0:1715330441.811799:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330441.811812:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942547904:0@lo:400:kworker.0 00000100:00100000:2.0:1715330441.811827:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330441.811845:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009327c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942548160:0@lo:400:kworker.0 00000100:00100000:2.0:1715330441.811860:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330441.811867:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009327ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942548416:0@lo:400:kworker.0 00000100:00100000:2.0:1715330441.811878:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330441.811887:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1715330441.811891:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3688:1798653942547712:0@lo:400:kworker.0 00000100:00100000:2.0:1715330441.811904:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330441.811912:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3688:1798653942547968:0@lo:400:kworker.0 00000100:00100000:2.0:1715330441.811924:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330441.811930:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009327c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3688:1798653942548224:0@lo:400:kworker.0 00000100:00100000:2.0:1715330441.811942:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330441.811957:0:7129:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942547648 00000100:00100000:2.0:1715330441.811959:0:7129:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942547648 00000100:00100000:2.0:1715330441.811978:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1715330441.811982:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3688:x1798653942547648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330441.812002:0:7129:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3688:x1798653942547648:12345-0@lo:400:kworker.0 Request processed in 20us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330441.812006:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1715330441.812026:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942547712 00000100:00100000:2.0:1715330441.812029:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942547712 00000100:00100000:2.0:1715330441.812039:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942547968 00000100:00100000:2.0:1715330441.812041:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942547968 00000100:00100000:2.0:1715330441.812048:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942548224 00000100:00100000:2.0:1715330441.812049:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942548224 00000100:00100000:2.0:1715330441.812056:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 481 00000100:00100000:2.0:1715330441.812059:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3688:x1798653942547712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330441.812077:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3688:x1798653942547712:12345-0@lo:400:kworker.0 Request processed in 17us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330441.812081:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 481 00000100:00100000:2.0:1715330441.812087:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 482 00000100:00100000:2.0:1715330441.812090:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1798653942547968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330441.812102:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1798653942547968:12345-0@lo:400:kworker.0 Request processed in 11us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330441.812106:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 482 00000100:00100000:2.0:1715330441.812111:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 483 00000100:00100000:2.0:1715330441.812114:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3688:x1798653942548224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330441.812126:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3688:x1798653942548224:12345-0@lo:400:kworker.0 Request processed in 11us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330441.812130:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 483 00000100:00080000:2.0:1715330441.812141:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330411 00000100:00080000:2.0:1715330441.812143:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330411 00000100:00100000:2.0:1715330441.812154:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3688:1798653942547712:0@lo:400:kworker.0 00000100:00100000:2.0:1715330441.812160:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3688:1798653942547968:0@lo:400:kworker.0 00000100:00100000:2.0:1715330441.812166:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009327c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3688:1798653942548224:0@lo:400:kworker.0 00000100:00100000:2.0:1715330441.812171:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3688:1798653942547648:0@lo:400:kworker.0 00000100:00100000:1.0:1715330441.812310:0:9398:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942548160 00000100:00100000:1.0:1715330441.812315:0:9398:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942548160 00000100:00100000:1.0:1715330441.812332:0:9398:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942548416 00000100:00100000:1.0:1715330441.812334:0:9398:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942548416 00000100:00100000:1.0:1715330441.812360:0:9398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1715330441.812364:0:9398:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942548160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330441.812392:0:9398:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942548160:12345-0@lo:400:kworker.0 Request processed in 28us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330441.812397:0:9398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1715330441.812408:0:9398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1715330441.812412:0:9398:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942548416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330441.812431:0:9398:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942548416:12345-0@lo:400:kworker.0 Request processed in 19us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330441.812435:0:9398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1715330441.812543:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942547904 00000100:00100000:0.0:1715330441.812546:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942547904 00000100:00100000:0.0:1715330441.812574:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3147 00000100:00100000:0.0:1715330441.812578:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942547904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330441.812604:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942547904:12345-0@lo:400:kworker.0 Request processed in 26us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330441.812609:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3147 00000100:00080000:2.0:1715330441.813797:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330411 00000100:00100000:2.0:1715330441.813847:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942547904:0@lo:400:kworker.0 00000100:00100000:2.0:1715330441.813859:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009327c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942548160:0@lo:400:kworker.0 00000100:00100000:2.0:1715330441.813871:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009327ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942548416:0@lo:400:kworker.0 00000100:00100000:2.0:1715330441.845202:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+22:2014:x1798653938138816:12345-192.168.204.49@tcp:4:dd.0 Request processed in 78490us (81713us total) trans 4294969960 rc 0/0 00000100:00100000:2.0:1715330441.845215:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 94 00002000:00100000:2.0:1715330441.845229:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (25165824->29360127) req@ffff880091d86d80 x1798653938138816/t4294969960(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:652/0 lens 488/448 e 0 to 0 dl 1715330452 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330441.845238:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d86d80 with x1798653938138816 ext(25165824->29360127) 00002000:00010000:2.0:1715330441.845243:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d86d80 00000100:00100000:1.0:1715330441.859416:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330441.863615:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938138944 00000100:00100000:2.0:1715330441.863633:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938138944 00002000:00100000:2.0:1715330441.863696:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (29360128->33554431) req@ffff880091d87100 x1798653938138944/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:652/0 lens 488/0 e 0 to 0 dl 1715330452 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330441.863707:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d87100 with x1798653938138944 ext(29360128->33554431) 00002000:00010000:2.0:1715330441.863714:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d87100 00000100:00100000:1.0:1715330441.864126:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942548480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1715330441.864196:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330441.864235:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942548480 00000100:00100000:1.0:1715330441.864238:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942548480 00000100:00100000:2.0:1715330441.868395:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 95 00000100:00100000:2.0:1715330441.868409:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+22:2013:x1798653938138944:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330441.875305:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1715330441.875328:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009327ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942548544:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1715330441.875384:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330441.876026:0:9400:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942548544 00000100:00100000:3.0:1715330441.876033:0:9400:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942548544 00000100:00100000:0.0:1715330441.876035:0:9401:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1715330441.876041:0:9401:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942548480:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1715330441.876059:0:9400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1715330441.876062:0:9400:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009327c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942548544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1715330441.876069:0:9400:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 172032 granted 317126336 pending 0 free 3923546112 avail 3692023808 00002000:00000024:0.0:1715330441.876069:0:9401:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 172032 granted 317126336 pending 0 free 3923546112 avail 3692023808 00000100:00100000:3.0:1715330441.876102:0:9400:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009327c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942548544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330441.876102:0:9401:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942548480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (11908us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330441.876108:0:9400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1715330441.876110:0:9401:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1715330441.876141:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009327ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942548544:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1715330441.876172:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942548480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1715330441.938894:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330441.938933:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938139072 00000100:00100000:1.0:1715330441.938942:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938139072 00002000:00100000:1.0:1715330441.938984:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (33554432->37748735) req@ffff880091d87b80 x1798653938139072/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:652/0 lens 488/0 e 0 to 0 dl 1715330452 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330441.938994:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d87b80 with x1798653938139072 ext(33554432->37748735) 00002000:00010000:1.0:1715330441.938999:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d87b80 00000100:00100000:1.0:1715330441.944057:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 96 00000100:00100000:1.0:1715330441.944070:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+24:2014:x1798653938139072:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330441.969471:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+26:2013:x1798653938138944:12345-192.168.204.49@tcp:4:dd.0 Request processed in 101054us (110051us total) trans 4294969961 rc 0/0 00000100:00100000:3.0:1715330441.969486:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 95 00002000:00100000:3.0:1715330441.969501:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (29360128->33554431) req@ffff880091d87100 x1798653938138944/t4294969961(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:652/0 lens 488/448 e 0 to 0 dl 1715330452 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330441.969512:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d87100 with x1798653938138944 ext(29360128->33554431) 00002000:00010000:3.0:1715330441.969519:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d87100 00000100:00100000:2.0:1715330442.003709:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+26:2014:x1798653938139072:12345-192.168.204.49@tcp:4:dd.0 Request processed in 59630us (64812us total) trans 4294969962 rc 0/0 00000100:00100000:2.0:1715330442.003722:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 96 00002000:00100000:2.0:1715330442.003762:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (33554432->37748735) req@ffff880091d87b80 x1798653938139072/t4294969962(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:652/0 lens 488/448 e 0 to 0 dl 1715330452 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330442.003772:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d87b80 with x1798653938139072 ext(33554432->37748735) 00002000:00010000:2.0:1715330442.003779:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d87b80 00000100:00100000:2.0:1715330442.023727:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330442.024444:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938139200 00000100:00100000:0.0:1715330442.024458:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938139200 00002000:00100000:2.0:1715330442.024543:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (37748736->41943039) req@ffff880093b59c00 x1798653938139200/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:653/0 lens 488/0 e 0 to 0 dl 1715330453 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330442.024555:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b59c00 with x1798653938139200 ext(37748736->41943039) 00002000:00010000:2.0:1715330442.024561:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b59c00 00000100:00100000:2.0:1715330442.024597:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 97 00000100:00100000:2.0:1715330442.024603:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+26:2014:x1798653938139200:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330442.084036:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+28:2014:x1798653938139200:12345-192.168.204.49@tcp:4:dd.0 Request processed in 59422us (60310us total) trans 4294969963 rc 0/0 00000100:00100000:2.0:1715330442.084051:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 97 00002000:00100000:2.0:1715330442.084063:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (37748736->41943039) req@ffff880093b59c00 x1798653938139200/t4294969963(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:653/0 lens 488/448 e 0 to 0 dl 1715330453 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330442.084071:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b59c00 with x1798653938139200 ext(37748736->41943039) 00002000:00010000:2.0:1715330442.084077:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b59c00 00000100:00100000:1.0:1715330442.091812:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330442.091946:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938139328 00000100:00100000:2.0:1715330442.091954:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938139328 00002000:00100000:2.0:1715330442.091991:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (41943040->46137343) req@ffff880091d87480 x1798653938139328/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:653/0 lens 488/0 e 0 to 0 dl 1715330453 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330442.092002:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d87480 with x1798653938139328 ext(41943040->46137343) 00002000:00010000:2.0:1715330442.092008:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d87480 00000100:00100000:2.0:1715330442.092041:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 98 00000100:00100000:2.0:1715330442.092050:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+28:2014:x1798653938139328:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330442.143603:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+30:2014:x1798653938139328:12345-192.168.204.49@tcp:4:dd.0 Request processed in 51544us (51790us total) trans 4294969964 rc 0/0 00000100:00100000:3.0:1715330442.143615:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 98 00002000:00100000:3.0:1715330442.143627:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (41943040->46137343) req@ffff880091d87480 x1798653938139328/t4294969964(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:653/0 lens 488/448 e 0 to 0 dl 1715330453 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330442.143635:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d87480 with x1798653938139328 ext(41943040->46137343) 00002000:00010000:3.0:1715330442.143641:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d87480 00000100:00100000:3.0:1715330442.152983:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330442.154438:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938139456 00000100:00100000:0.0:1715330442.154448:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938139456 00002000:00100000:0.0:1715330442.154487:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (46137344->50331647) req@ffff88008d4fb800 x1798653938139456/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:653/0 lens 488/0 e 0 to 0 dl 1715330453 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330442.154496:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d4fb800 with x1798653938139456 ext(46137344->50331647) 00002000:00010000:0.0:1715330442.154501:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d4fb800 00000100:00100000:0.0:1715330442.154528:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 99 00000100:00100000:0.0:1715330442.154534:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+30:2012:x1798653938139456:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330442.223603:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330442.223694:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938139584 00000100:00100000:3.0:1715330442.223710:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938139584 00002000:00100000:3.0:1715330442.223827:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (50331648->54525951) req@ffff88009327ca80 x1798653938139584/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:653/0 lens 488/0 e 0 to 0 dl 1715330453 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330442.223838:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009327ca80 with x1798653938139584 ext(50331648->54525951) 00002000:00010000:3.0:1715330442.223845:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009327ca80 00000100:00100000:3.0:1715330442.223878:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 100 00000100:00100000:3.0:1715330442.223890:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009327ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+34:2011:x1798653938139584:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330442.237161:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+33:2012:x1798653938139456:12345-192.168.204.49@tcp:4:dd.0 Request processed in 82611us (84169us total) trans 4294969965 rc 0/0 00000100:00100000:1.0:1715330442.237178:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 99 00002000:00100000:1.0:1715330442.237193:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (46137344->50331647) req@ffff88008d4fb800 x1798653938139456/t4294969965(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:653/0 lens 488/448 e 0 to 0 dl 1715330453 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330442.237203:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d4fb800 with x1798653938139456 ext(46137344->50331647) 00002000:00010000:1.0:1715330442.237210:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d4fb800 00000100:00100000:0.0:1715330442.281018:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330442.285550:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938139712 00000100:00100000:1.0:1715330442.285562:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938139712 00002000:00100000:1.0:1715330442.285606:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (54525952->58720255) req@ffff88009327e680 x1798653938139712/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:653/0 lens 488/0 e 0 to 0 dl 1715330453 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330442.285616:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009327e680 with x1798653938139712 ext(54525952->58720255) 00002000:00010000:1.0:1715330442.285620:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009327e680 00000100:00100000:1.0:1715330442.285646:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 101 00000100:00100000:1.0:1715330442.285652:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009327e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+34:2012:x1798653938139712:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330442.338807:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009327ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+36:2011:x1798653938139584:12345-192.168.204.49@tcp:4:dd.0 Request processed in 114902us (115209us total) trans 4294969966 rc 0/0 00000100:00100000:1.0:1715330442.338820:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 100 00002000:00100000:1.0:1715330442.338832:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (50331648->54525951) req@ffff88009327ca80 x1798653938139584/t4294969966(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:653/0 lens 488/448 e 0 to 0 dl 1715330453 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330442.338841:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009327ca80 with x1798653938139584 ext(50331648->54525951) 00002000:00010000:1.0:1715330442.338847:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009327ca80 00000100:00100000:1.0:1715330442.354293:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009327e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+36:2012:x1798653938139712:12345-192.168.204.49@tcp:4:dd.0 Request processed in 68633us (73276us total) trans 4294969967 rc 0/0 00000100:00100000:1.0:1715330442.354305:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 101 00002000:00100000:1.0:1715330442.354318:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (54525952->58720255) req@ffff88009327e680 x1798653938139712/t4294969967(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:653/0 lens 488/448 e 0 to 0 dl 1715330453 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330442.354326:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009327e680 with x1798653938139712 ext(54525952->58720255) 00002000:00010000:1.0:1715330442.354332:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009327e680 00000100:00100000:3.0:1715330442.359227:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330442.361463:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938139840 00000100:00100000:1.0:1715330442.361481:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938139840 00002000:00100000:1.0:1715330442.361542:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (58720256->62914559) req@ffff88008d4f9180 x1798653938139840/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:653/0 lens 488/0 e 0 to 0 dl 1715330453 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330442.361555:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d4f9180 with x1798653938139840 ext(58720256->62914559) 00002000:00010000:1.0:1715330442.361562:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d4f9180 00000100:00100000:1.0:1715330442.361601:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 102 00000100:00100000:1.0:1715330442.361608:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+36:2011:x1798653938139840:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330442.416060:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+38:2011:x1798653938139840:12345-192.168.204.49@tcp:4:dd.0 Request processed in 54438us (56831us total) trans 4294969968 rc 0/0 00000100:00100000:2.0:1715330442.416061:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330442.416075:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 102 00002000:00100000:1.0:1715330442.416088:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (58720256->62914559) req@ffff88008d4f9180 x1798653938139840/t4294969968(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:653/0 lens 488/448 e 0 to 0 dl 1715330453 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00000100:00100000:2.0:1715330442.416091:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938139968 00000100:00100000:2.0:1715330442.416097:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938139968 00002000:00100000:1.0:1715330442.416097:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d4f9180 with x1798653938139840 ext(58720256->62914559) 00002000:00010000:1.0:1715330442.416104:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d4f9180 00002000:00100000:2.0:1715330442.416126:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (62914560->67108863) req@ffff880093b5a680 x1798653938139968/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:653/0 lens 488/0 e 0 to 0 dl 1715330453 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330442.416134:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b5a680 with x1798653938139968 ext(62914560->67108863) 00002000:00010000:2.0:1715330442.416137:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b5a680 00000100:00100000:2.0:1715330442.416147:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 103 00000100:00100000:2.0:1715330442.416151:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+38:2012:x1798653938139968:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330442.487161:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+40:2012:x1798653938139968:12345-192.168.204.49@tcp:4:dd.0 Request processed in 70997us (71090us total) trans 4294969969 rc 0/0 00000100:00100000:2.0:1715330442.487173:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 103 00002000:00100000:2.0:1715330442.487184:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (62914560->67108863) req@ffff880093b5a680 x1798653938139968/t4294969969(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:653/0 lens 488/448 e 0 to 0 dl 1715330453 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330442.487192:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b5a680 with x1798653938139968 ext(62914560->67108863) 00002000:00010000:2.0:1715330442.487198:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b5a680 00000100:00100000:2.0:1715330442.494178:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330442.494267:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938140096 00000100:00100000:0.0:1715330442.494279:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938140096 00002000:00100000:0.0:1715330442.494330:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (67108864->71303167) req@ffff880091124e00 x1798653938140096/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:653/0 lens 488/0 e 0 to 0 dl 1715330453 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330442.494339:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091124e00 with x1798653938140096 ext(67108864->71303167) 00002000:00010000:0.0:1715330442.494344:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091124e00 00000100:00100000:0.0:1715330442.494380:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 104 00000100:00100000:0.0:1715330442.494386:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+40:2011:x1798653938140096:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330442.533659:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330442.533810:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938140224 00000100:00100000:1.0:1715330442.533819:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938140224 00002000:00100000:1.0:1715330442.533854:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (71303168->75497471) req@ffff88009327ea00 x1798653938140224/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:653/0 lens 488/0 e 0 to 0 dl 1715330453 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330442.533864:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009327ea00 with x1798653938140224 ext(71303168->75497471) 00002000:00010000:1.0:1715330442.533870:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009327ea00 00000100:00100000:1.0:1715330442.533897:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 105 00000100:00100000:1.0:1715330442.533903:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009327ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+42:2013:x1798653938140224:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330442.572665:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+44:2011:x1798653938140096:12345-192.168.204.49@tcp:4:dd.0 Request processed in 78259us (78478us total) trans 4294969970 rc 0/0 00000100:00100000:0.0:1715330442.572686:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 104 00002000:00100000:0.0:1715330442.572704:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (67108864->71303167) req@ffff880091124e00 x1798653938140096/t4294969970(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:653/0 lens 488/448 e 0 to 0 dl 1715330453 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330442.572716:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091124e00 with x1798653938140096 ext(67108864->71303167) 00002000:00010000:0.0:1715330442.574239:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091124e00 00010000:00010000:1.0:1715330442.595565:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330442.602379:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330442.602919:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938140352 00000100:00100000:0.0:1715330442.602929:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938140352 00002000:00100000:0.0:1715330442.602969:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (75497472->79691775) req@ffff880091124000 x1798653938140352/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:653/0 lens 488/0 e 0 to 0 dl 1715330453 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330442.602979:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091124000 with x1798653938140352 ext(75497472->79691775) 00002000:00010000:0.0:1715330442.602984:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091124000 00000100:00100000:0.0:1715330442.603013:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 106 00000100:00100000:0.0:1715330442.603019:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+44:2013:x1798653938140352:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330442.621151:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009327ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+46:2013:x1798653938140224:12345-192.168.204.49@tcp:4:dd.0 Request processed in 87234us (87486us total) trans 4294969971 rc 0/0 00000100:00100000:1.0:1715330442.621165:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 105 00002000:00100000:1.0:1715330442.621178:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (71303168->75497471) req@ffff88009327ea00 x1798653938140224/t4294969971(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:653/0 lens 488/448 e 0 to 0 dl 1715330453 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330442.621186:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009327ea00 with x1798653938140224 ext(71303168->75497471) 00002000:00010000:1.0:1715330442.621192:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009327ea00 00000100:00100000:2.0:1715330442.682127:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330442.682195:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938140480 00000100:00100000:1.0:1715330442.682205:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938140480 00002000:00100000:1.0:1715330442.682241:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (79691776->83886079) req@ffff88009ba67800 x1798653938140480/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:653/0 lens 488/0 e 0 to 0 dl 1715330453 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330442.682251:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba67800 with x1798653938140480 ext(79691776->83886079) 00002000:00010000:1.0:1715330442.682256:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba67800 00000100:00100000:1.0:1715330442.682273:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 107 00000100:00100000:1.0:1715330442.682279:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+46:2014:x1798653938140480:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330442.702256:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+48:2013:x1798653938140352:12345-192.168.204.49@tcp:4:dd.0 Request processed in 99220us (99866us total) trans 4294969972 rc 0/0 00000100:00100000:3.0:1715330442.702272:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 106 00002000:00100000:3.0:1715330442.702291:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (75497472->79691775) req@ffff880091124000 x1798653938140352/t4294969972(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:653/0 lens 488/448 e 0 to 0 dl 1715330453 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330442.702301:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091124000 with x1798653938140352 ext(75497472->79691775) 00002000:00010000:3.0:1715330442.702308:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091124000 00000100:00100000:0.0:1715330442.758371:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+48:2014:x1798653938140480:12345-192.168.204.49@tcp:4:dd.0 Request processed in 76077us (76238us total) trans 4294969973 rc 0/0 00000100:00100000:0.0:1715330442.758386:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 107 00002000:00100000:0.0:1715330442.758404:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (79691776->83886079) req@ffff88009ba67800 x1798653938140480/t4294969973(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:653/0 lens 488/448 e 0 to 0 dl 1715330453 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330442.758413:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba67800 with x1798653938140480 ext(79691776->83886079) 00002000:00010000:0.0:1715330442.758420:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba67800 00000100:00100000:1.0:1715330442.771933:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330442.772017:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938140608 00000100:00100000:0.0:1715330442.772027:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938140608 00002000:00100000:0.0:1715330442.772074:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (83886080->88080383) req@ffff880091d85500 x1798653938140608/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:653/0 lens 488/0 e 0 to 0 dl 1715330453 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330442.772086:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d85500 with x1798653938140608 ext(83886080->88080383) 00002000:00010000:0.0:1715330442.772092:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d85500 00000100:00100000:0.0:1715330442.778457:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 108 00000100:00100000:0.0:1715330442.778476:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+48:2013:x1798653938140608:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330442.829581:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+50:2013:x1798653938140608:12345-192.168.204.49@tcp:4:dd.0 Request processed in 51094us (57644us total) trans 4294969974 rc 0/0 00000100:00100000:1.0:1715330442.829598:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 108 00002000:00100000:1.0:1715330442.829614:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (83886080->88080383) req@ffff880091d85500 x1798653938140608/t4294969974(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:653/0 lens 488/448 e 0 to 0 dl 1715330453 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330442.829625:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d85500 with x1798653938140608 ext(83886080->88080383) 00002000:00010000:1.0:1715330442.829632:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d85500 00000100:00100000:2.0:1715330442.845962:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330442.846046:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938140736 00000100:00100000:1.0:1715330442.846057:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938140736 00002000:00100000:1.0:1715330442.846108:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (88080384->92274687) req@ffff880134564000 x1798653938140736/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:653/0 lens 488/0 e 0 to 0 dl 1715330453 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330442.846119:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880134564000 with x1798653938140736 ext(88080384->92274687) 00002000:00010000:1.0:1715330442.846124:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134564000 00000100:00100000:3.0:1715330442.853149:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 109 00000100:00100000:3.0:1715330442.853167:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134564000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+50:2013:x1798653938140736:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330442.917858:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134564000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+52:2013:x1798653938140736:12345-192.168.204.49@tcp:4:dd.0 Request processed in 64688us (71900us total) trans 4294969975 rc 0/0 00000100:00100000:3.0:1715330442.917869:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 109 00002000:00100000:3.0:1715330442.917880:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (88080384->92274687) req@ffff880134564000 x1798653938140736/t4294969975(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:653/0 lens 488/448 e 0 to 0 dl 1715330453 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330442.917888:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880134564000 with x1798653938140736 ext(88080384->92274687) 00002000:00010000:3.0:1715330442.917894:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134564000 00000100:00100000:2.0:1715330442.927704:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330442.928043:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938140864 00000100:00100000:3.0:1715330442.928052:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938140864 00002000:00100000:3.0:1715330442.928103:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (92274688->96468991) req@ffff880091cc9500 x1798653938140864/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:653/0 lens 488/0 e 0 to 0 dl 1715330453 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330442.928113:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091cc9500 with x1798653938140864 ext(92274688->96468991) 00002000:00010000:3.0:1715330442.928119:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091cc9500 00000100:00100000:3.0:1715330442.928926:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 110 00000100:00100000:3.0:1715330442.928934:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+52:2014:x1798653938140864:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330442.991197:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330442.993506:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938140992 00000100:00100000:1.0:1715330442.993520:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938140992 00002000:00100000:1.0:1715330442.993582:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (96468992->100663295) req@ffff88012fa4f100 x1798653938140992/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:653/0 lens 488/0 e 0 to 0 dl 1715330453 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330442.993594:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fa4f100 with x1798653938140992 ext(96468992->100663295) 00002000:00010000:1.0:1715330442.993602:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fa4f100 00000100:00100000:1.0:1715330442.993664:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 111 00000100:00100000:1.0:1715330442.993672:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+56:2013:x1798653938140992:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330443.012446:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+56:2014:x1798653938140864:12345-192.168.204.49@tcp:4:dd.0 Request processed in 83502us (84742us total) trans 4294969976 rc 0/0 00000100:00100000:2.0:1715330443.012464:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 110 00002000:00100000:2.0:1715330443.012475:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (92274688->96468991) req@ffff880091cc9500 x1798653938140864/t4294969976(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:653/0 lens 488/448 e 0 to 0 dl 1715330453 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330443.012485:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091cc9500 with x1798653938140864 ext(92274688->96468991) 00002000:00010000:2.0:1715330443.012491:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091cc9500 00000100:00100000:3.0:1715330443.043969:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330443.044058:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938141120 00000100:00100000:2.0:1715330443.044067:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938141120 00002000:00100000:2.0:1715330443.044124:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (100663296->104857599) req@ffff88008d55d880 x1798653938141120/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:654/0 lens 488/0 e 0 to 0 dl 1715330454 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330443.044134:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d55d880 with x1798653938141120 ext(100663296->104857599) 00002000:00010000:2.0:1715330443.044139:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d55d880 00000100:00100000:2.0:1715330443.044157:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 112 00000100:00100000:2.0:1715330443.044164:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d55d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+56:2012:x1798653938141120:12345-192.168.204.49@tcp:4:dd.0 00000100:00080000:3.0:1715330443.045103:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330413 00000100:00100000:0.0:1715330443.058059:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+57:2013:x1798653938140992:12345-192.168.204.49@tcp:4:dd.0 Request processed in 64373us (66856us total) trans 4294969977 rc 0/0 00000100:00100000:0.0:1715330443.058074:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 111 00002000:00100000:0.0:1715330443.058088:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (96468992->100663295) req@ffff88012fa4f100 x1798653938140992/t4294969977(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:653/0 lens 488/448 e 0 to 0 dl 1715330453 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330443.058098:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fa4f100 with x1798653938140992 ext(96468992->100663295) 00002000:00010000:0.0:1715330443.058105:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fa4f100 00000100:00100000:0.0:1715330443.114386:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330443.115321:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938141248 00000100:00100000:1.0:1715330443.115331:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938141248 00002000:00100000:1.0:1715330443.115380:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (104857600->109051903) req@ffff88009327ed80 x1798653938141248/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:654/0 lens 488/0 e 0 to 0 dl 1715330454 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330443.115391:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009327ed80 with x1798653938141248 ext(104857600->109051903) 00002000:00010000:1.0:1715330443.115399:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009327ed80 00000100:00100000:1.0:1715330443.115555:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 113 00000100:00100000:1.0:1715330443.115564:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009327ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+58:2012:x1798653938141248:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330443.158384:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d55d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+60:2012:x1798653938141120:12345-192.168.204.49@tcp:4:dd.0 Request processed in 114202us (114407us total) trans 4294969978 rc 0/0 00000100:00100000:1.0:1715330443.158404:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 112 00002000:00100000:1.0:1715330443.158424:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (100663296->104857599) req@ffff88008d55d880 x1798653938141120/t4294969978(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:654/0 lens 488/448 e 0 to 0 dl 1715330454 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330443.158435:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d55d880 with x1798653938141120 ext(100663296->104857599) 00002000:00010000:1.0:1715330443.158443:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d55d880 00000100:00100000:2.0:1715330443.183668:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330443.185176:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938141376 00000100:00100000:1.0:1715330443.185186:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938141376 00002000:00100000:1.0:1715330443.185223:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (109051904->113246207) req@ffff88012fa4d880 x1798653938141376/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:654/0 lens 488/0 e 0 to 0 dl 1715330454 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330443.185233:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fa4d880 with x1798653938141376 ext(109051904->113246207) 00002000:00010000:1.0:1715330443.185237:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fa4d880 00000100:00100000:1.0:1715330443.185269:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 114 00000100:00100000:1.0:1715330443.185275:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+62:2011:x1798653938141376:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330443.192670:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009327ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+62:2012:x1798653938141248:12345-192.168.204.49@tcp:4:dd.0 Request processed in 77096us (78287us total) trans 4294969979 rc 0/0 00000100:00100000:1.0:1715330443.192682:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 113 00002000:00100000:1.0:1715330443.192693:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (104857600->109051903) req@ffff88009327ed80 x1798653938141248/t4294969979(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:654/0 lens 488/448 e 0 to 0 dl 1715330454 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330443.192707:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009327ed80 with x1798653938141248 ext(104857600->109051903) 00002000:00010000:1.0:1715330443.192722:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009327ed80 00000100:00100000:1.0:1715330443.251505:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+62:2011:x1798653938141376:12345-192.168.204.49@tcp:4:dd.0 Request processed in 66218us (67833us total) trans 4294969980 rc 0/0 00000100:00100000:1.0:1715330443.251520:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 114 00002000:00100000:1.0:1715330443.251532:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (109051904->113246207) req@ffff88012fa4d880 x1798653938141376/t4294969980(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:654/0 lens 488/448 e 0 to 0 dl 1715330454 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330443.251544:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fa4d880 with x1798653938141376 ext(109051904->113246207) 00002000:00010000:1.0:1715330443.251550:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fa4d880 00000100:00100000:1.0:1715330443.251906:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009327f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942548608:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1715330443.252330:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330443.255658:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942548608 00000100:00100000:2.0:1715330443.255672:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942548608 00000100:00100000:2.0:1715330443.255768:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3148 00000100:00100000:2.0:1715330443.255775:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3691:x1798653942548608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1715330443.255808:0:19960:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444089856 avail 1314627584 00000100:00100000:2.0:1715330443.255895:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3691:x1798653942548608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (3562us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330443.255901:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3148 00000100:00100000:1.0:1715330443.256058:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009327f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942548608:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1715330443.266323:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330443.266456:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938141504 00000100:00100000:1.0:1715330443.266468:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938141504 00002000:00100000:1.0:1715330443.266507:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (113246208->117440511) req@ffff88009327f480 x1798653938141504/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:654/0 lens 488/0 e 0 to 0 dl 1715330454 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330443.266517:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009327f480 with x1798653938141504 ext(113246208->117440511) 00002000:00010000:1.0:1715330443.266522:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009327f480 00000100:00100000:1.0:1715330443.266557:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 115 00000100:00100000:1.0:1715330443.266563:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009327f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+62:2011:x1798653938141504:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330443.307047:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330443.308312:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938141632 00000100:00100000:3.0:1715330443.308324:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938141632 00002000:00100000:3.0:1715330443.308381:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (117440512->121634815) req@ffff88012fa4e300 x1798653938141632/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:654/0 lens 488/0 e 0 to 0 dl 1715330454 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330443.308390:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fa4e300 with x1798653938141632 ext(117440512->121634815) 00002000:00010000:3.0:1715330443.308396:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fa4e300 00000100:00100000:3.0:1715330443.308507:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 116 00000100:00100000:3.0:1715330443.308515:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+64:2012:x1798653938141632:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330443.349110:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009327f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+66:2011:x1798653938141504:12345-192.168.204.49@tcp:4:dd.0 Request processed in 82537us (82787us total) trans 4294969981 rc 0/0 00000100:00100000:3.0:1715330443.349124:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 115 00002000:00100000:3.0:1715330443.349137:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (113246208->117440511) req@ffff88009327f480 x1798653938141504/t4294969981(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:654/0 lens 488/448 e 0 to 0 dl 1715330454 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330443.349147:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009327f480 with x1798653938141504 ext(113246208->117440511) 00002000:00010000:3.0:1715330443.349152:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009327f480 00000100:00100000:3.0:1715330443.398147:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+66:2012:x1798653938141632:12345-192.168.204.49@tcp:4:dd.0 Request processed in 89617us (91097us total) trans 4294969982 rc 0/0 00000100:00100000:3.0:1715330443.398163:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 116 00002000:00100000:3.0:1715330443.398178:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (117440512->121634815) req@ffff88012fa4e300 x1798653938141632/t4294969982(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:654/0 lens 488/448 e 0 to 0 dl 1715330454 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330443.398190:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fa4e300 with x1798653938141632 ext(117440512->121634815) 00002000:00010000:3.0:1715330443.398197:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fa4e300 00000100:00100000:0.0:1715330443.398352:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330443.398544:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938141760 00000100:00100000:3.0:1715330443.398553:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938141760 00002000:00100000:3.0:1715330443.398582:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (121634816->125829119) req@ffff88009327f800 x1798653938141760/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:654/0 lens 488/0 e 0 to 0 dl 1715330454 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330443.398589:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009327f800 with x1798653938141760 ext(121634816->125829119) 00002000:00010000:3.0:1715330443.398592:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009327f800 00000100:00100000:3.0:1715330443.398836:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 117 00000100:00100000:3.0:1715330443.398841:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009327f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+66:2011:x1798653938141760:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330443.461717:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330443.463001:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938141888 00000100:00100000:0.0:1715330443.463018:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938141888 00002000:00100000:0.0:1715330443.463079:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (125829120->130023423) req@ffff88012fa4d180 x1798653938141888/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:654/0 lens 488/0 e 0 to 0 dl 1715330454 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330443.463089:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fa4d180 with x1798653938141888 ext(125829120->130023423) 00002000:00010000:0.0:1715330443.463094:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fa4d180 00000100:00100000:0.0:1715330443.464277:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 118 00000100:00100000:0.0:1715330443.464287:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+70:2012:x1798653938141888:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330443.476049:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009327f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+70:2011:x1798653938141760:12345-192.168.204.49@tcp:4:dd.0 Request processed in 77195us (77685us total) trans 4294969983 rc 0/0 00000100:00100000:3.0:1715330443.476064:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 117 00002000:00100000:3.0:1715330443.476076:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (121634816->125829119) req@ffff88009327f800 x1798653938141760/t4294969983(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:654/0 lens 488/448 e 0 to 0 dl 1715330454 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330443.476086:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009327f800 with x1798653938141760 ext(121634816->125829119) 00002000:00010000:3.0:1715330443.476092:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009327f800 00000100:00100000:2.0:1715330443.515587:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330443.516272:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938142016 00000100:00100000:3.0:1715330443.516280:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938142016 00002000:00100000:3.0:1715330443.516321:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (130023424->134217727) req@ffff88012fa4ce00 x1798653938142016/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:654/0 lens 488/0 e 0 to 0 dl 1715330454 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330443.516330:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fa4ce00 with x1798653938142016 ext(130023424->134217727) 00002000:00010000:3.0:1715330443.516339:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fa4ce00 00000100:00100000:3.0:1715330443.516924:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 119 00000100:00100000:3.0:1715330443.516932:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+70:2011:x1798653938142016:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330443.528756:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+72:2012:x1798653938141888:12345-192.168.204.49@tcp:4:dd.0 Request processed in 64443us (67032us total) trans 4294969984 rc 0/0 00000100:00100000:1.0:1715330443.528773:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 118 00002000:00100000:1.0:1715330443.528787:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (125829120->130023423) req@ffff88012fa4d180 x1798653938141888/t4294969984(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:654/0 lens 488/448 e 0 to 0 dl 1715330454 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330443.528797:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fa4d180 with x1798653938141888 ext(125829120->130023423) 00002000:00010000:1.0:1715330443.528803:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fa4d180 00000100:00100000:0.0:1715330443.569634:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330443.569921:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938142144 00000100:00100000:1.0:1715330443.569930:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938142144 00002000:00100000:1.0:1715330443.569964:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (134217728->138412031) req@ffff88009327fb80 x1798653938142144/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:654/0 lens 488/0 e 0 to 0 dl 1715330454 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330443.569974:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009327fb80 with x1798653938142144 ext(134217728->138412031) 00002000:00010000:1.0:1715330443.569978:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009327fb80 00000100:00100000:1.0:1715330443.569996:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 120 00000100:00100000:1.0:1715330443.570002:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009327fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+72:2014:x1798653938142144:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330443.579802:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+74:2011:x1798653938142016:12345-192.168.204.49@tcp:4:dd.0 Request processed in 62796us (64151us total) trans 4294969985 rc 0/0 00000100:00100000:2.0:1715330443.579816:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 119 00002000:00100000:2.0:1715330443.579826:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (130023424->134217727) req@ffff88012fa4ce00 x1798653938142016/t4294969985(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:654/0 lens 488/448 e 0 to 0 dl 1715330454 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330443.579836:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fa4ce00 with x1798653938142016 ext(130023424->134217727) 00002000:00010000:2.0:1715330443.579841:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fa4ce00 00010000:00010000:2.0:1715330443.602544:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330443.619888:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330443.620012:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938142272 00000100:00100000:2.0:1715330443.620025:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938142272 00002000:00100000:2.0:1715330443.620083:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (138412032->142606335) req@ffff88013458a300 x1798653938142272/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:654/0 lens 488/0 e 0 to 0 dl 1715330454 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330443.620095:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88013458a300 with x1798653938142272 ext(138412032->142606335) 00002000:00010000:2.0:1715330443.620102:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013458a300 00000100:00100000:2.0:1715330443.620148:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 121 00000100:00100000:2.0:1715330443.620156:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013458a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+76:2014:x1798653938142272:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330443.626393:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009327fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+75:2014:x1798653938142144:12345-192.168.204.49@tcp:4:dd.0 Request processed in 56380us (56756us total) trans 4294969986 rc 0/0 00000100:00100000:2.0:1715330443.626407:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 120 00002000:00100000:2.0:1715330443.626423:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (134217728->138412031) req@ffff88009327fb80 x1798653938142144/t4294969986(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:654/0 lens 488/448 e 0 to 0 dl 1715330454 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330443.626432:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009327fb80 with x1798653938142144 ext(134217728->138412031) 00002000:00010000:2.0:1715330443.626438:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009327fb80 00000100:00100000:3.0:1715330443.669131:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330443.670887:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938142400 00000100:00100000:0.0:1715330443.670899:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938142400 00002000:00100000:0.0:1715330443.670947:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (142606336->146800639) req@ffff880134589880 x1798653938142400/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:654/0 lens 488/0 e 0 to 0 dl 1715330454 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330443.670960:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880134589880 with x1798653938142400 ext(142606336->146800639) 00002000:00010000:0.0:1715330443.670967:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134589880 00000100:00100000:0.0:1715330443.671003:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 122 00000100:00100000:0.0:1715330443.671009:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+76:2014:x1798653938142400:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330443.681714:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013458a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+78:2014:x1798653938142272:12345-192.168.204.49@tcp:4:dd.0 Request processed in 61537us (61817us total) trans 4294969987 rc 0/0 00000100:00100000:2.0:1715330443.682192:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 121 00002000:00100000:2.0:1715330443.682213:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (138412032->142606335) req@ffff88013458a300 x1798653938142272/t4294969987(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:654/0 lens 488/448 e 0 to 0 dl 1715330454 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330443.682224:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88013458a300 with x1798653938142272 ext(138412032->142606335) 00002000:00010000:2.0:1715330443.682232:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013458a300 00000100:00100000:0.0:1715330443.729924:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+78:2014:x1798653938142400:12345-192.168.204.49@tcp:4:dd.0 Request processed in 58903us (60792us total) trans 4294969988 rc 0/0 00000100:00100000:0.0:1715330443.729937:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 122 00002000:00100000:0.0:1715330443.729949:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (142606336->146800639) req@ffff880134589880 x1798653938142400/t4294969988(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:654/0 lens 488/448 e 0 to 0 dl 1715330454 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330443.729958:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880134589880 with x1798653938142400 ext(142606336->146800639) 00002000:00010000:0.0:1715330443.729964:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134589880 00000100:00100000:2.0:1715330443.744994:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330443.745052:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938142528 00000100:00100000:0.0:1715330443.745061:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938142528 00002000:00100000:0.0:1715330443.745100:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (146800640->150994943) req@ffff88012fa4fb80 x1798653938142528/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:654/0 lens 488/0 e 0 to 0 dl 1715330454 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330443.745109:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fa4fb80 with x1798653938142528 ext(146800640->150994943) 00002000:00010000:0.0:1715330443.745114:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fa4fb80 00000100:00100000:0.0:1715330443.745143:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 123 00000100:00100000:0.0:1715330443.745149:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+78:2011:x1798653938142528:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330443.780934:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+80:2011:x1798653938142528:12345-192.168.204.49@tcp:4:dd.0 Request processed in 35771us (35936us total) trans 4294969989 rc 0/0 00000100:00100000:2.0:1715330443.780952:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 123 00002000:00100000:2.0:1715330443.780966:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (146800640->150994943) req@ffff88012fa4fb80 x1798653938142528/t4294969989(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:654/0 lens 488/448 e 0 to 0 dl 1715330454 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330443.780976:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fa4fb80 with x1798653938142528 ext(146800640->150994943) 00002000:00010000:2.0:1715330443.780982:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fa4fb80 00000100:00100000:2.0:1715330443.813217:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330443.813293:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938142656 00000100:00100000:0.0:1715330443.813302:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938142656 00002000:00100000:0.0:1715330443.813344:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (150994944->155189247) req@ffff88012fa4dc00 x1798653938142656/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:654/0 lens 488/0 e 0 to 0 dl 1715330454 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330443.813354:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fa4dc00 with x1798653938142656 ext(150994944->155189247) 00002000:00010000:0.0:1715330443.813358:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fa4dc00 00000100:00100000:0.0:1715330443.813385:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 124 00000100:00100000:0.0:1715330443.813391:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+80:2011:x1798653938142656:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330443.881227:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+82:2011:x1798653938142656:12345-192.168.204.49@tcp:4:dd.0 Request processed in 67823us (68005us total) trans 4294969990 rc 0/0 00000100:00100000:2.0:1715330443.881242:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 124 00002000:00100000:2.0:1715330443.881256:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (150994944->155189247) req@ffff88012fa4dc00 x1798653938142656/t4294969990(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:654/0 lens 488/448 e 0 to 0 dl 1715330454 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330443.881265:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fa4dc00 with x1798653938142656 ext(150994944->155189247) 00002000:00010000:2.0:1715330443.881272:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fa4dc00 00000100:00100000:2.0:1715330443.885945:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330443.886570:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938142784 00000100:00100000:0.0:1715330443.886579:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938142784 00002000:00100000:0.0:1715330443.886617:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (155189248->159383551) req@ffff88012fa4d500 x1798653938142784/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:654/0 lens 488/0 e 0 to 0 dl 1715330454 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330443.886626:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fa4d500 with x1798653938142784 ext(155189248->159383551) 00002000:00010000:0.0:1715330443.886632:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fa4d500 00000100:00100000:0.0:1715330443.886661:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 125 00000100:00100000:0.0:1715330443.886667:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+82:2011:x1798653938142784:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330443.950426:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330443.950530:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938142912 00000100:00100000:2.0:1715330443.950540:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938142912 00002000:00100000:2.0:1715330443.950588:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (159383552->163577855) req@ffff880091d84700 x1798653938142912/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:654/0 lens 488/0 e 0 to 0 dl 1715330454 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330443.950599:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d84700 with x1798653938142912 ext(159383552->163577855) 00002000:00010000:2.0:1715330443.950605:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d84700 00000100:00100000:2.0:1715330443.950640:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 126 00000100:00100000:2.0:1715330443.950648:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+84:2012:x1798653938142912:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330443.960599:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+85:2011:x1798653938142784:12345-192.168.204.49@tcp:4:dd.0 Request processed in 73919us (74648us total) trans 4294969991 rc 0/0 00000100:00100000:3.0:1715330443.960612:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 125 00002000:00100000:3.0:1715330443.960623:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (155189248->159383551) req@ffff88012fa4d500 x1798653938142784/t4294969991(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:654/0 lens 488/448 e 0 to 0 dl 1715330454 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330443.960633:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fa4d500 with x1798653938142784 ext(155189248->159383551) 00002000:00010000:3.0:1715330443.960638:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fa4d500 00000100:00100000:1.0:1715330444.008963:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330444.009806:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938143040 00000100:00100000:3.0:1715330444.009819:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938143040 00002000:00100000:3.0:1715330444.009870:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (163577856->167772159) req@ffff88009b5ee680 x1798653938143040/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:655/0 lens 488/0 e 0 to 0 dl 1715330455 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330444.009880:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b5ee680 with x1798653938143040 ext(163577856->167772159) 00002000:00010000:3.0:1715330444.009886:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b5ee680 00000100:00100000:3.0:1715330444.011912:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 127 00000100:00100000:3.0:1715330444.011924:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+88:2013:x1798653938143040:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330444.014972:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+87:2012:x1798653938142912:12345-192.168.204.49@tcp:4:dd.0 Request processed in 64312us (64549us total) trans 4294969992 rc 0/0 00000100:00100000:2.0:1715330444.014988:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 126 00002000:00100000:2.0:1715330444.015000:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (159383552->163577855) req@ffff880091d84700 x1798653938142912/t4294969992(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:654/0 lens 488/448 e 0 to 0 dl 1715330454 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330444.015010:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d84700 with x1798653938142912 ext(159383552->163577855) 00002000:00010000:2.0:1715330444.015016:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d84700 00000100:00100000:3.0:1715330444.064986:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+88:2013:x1798653938143040:12345-192.168.204.49@tcp:4:dd.0 Request processed in 53053us (56024us total) trans 4294969993 rc 0/0 00000100:00100000:3.0:1715330444.065001:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 127 00002000:00100000:3.0:1715330444.065016:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (163577856->167772159) req@ffff88009b5ee680 x1798653938143040/t4294969993(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:655/0 lens 488/448 e 0 to 0 dl 1715330455 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330444.065029:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b5ee680 with x1798653938143040 ext(163577856->167772159) 00002000:00010000:3.0:1715330444.065035:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b5ee680 00000100:00100000:1.0:1715330444.125157:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330444.135201:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938143168 00000100:00100000:3.0:1715330444.135215:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938143168 00002000:00100000:3.0:1715330444.135266:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (167772160->171966463) req@ffff880091f38a80 x1798653938143168/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:655/0 lens 488/0 e 0 to 0 dl 1715330455 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330444.135276:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091f38a80 with x1798653938143168 ext(167772160->171966463) 00002000:00010000:3.0:1715330444.135282:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091f38a80 00000100:00100000:3.0:1715330444.135327:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 128 00000100:00100000:3.0:1715330444.135335:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+88:2014:x1798653938143168:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330444.186667:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330444.186704:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938143296 00000100:00100000:2.0:1715330444.186713:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938143296 00002000:00100000:2.0:1715330444.186764:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (171966464->176160767) req@ffff88012fa4ed80 x1798653938143296/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:655/0 lens 488/0 e 0 to 0 dl 1715330455 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330444.186774:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fa4ed80 with x1798653938143296 ext(171966464->176160767) 00002000:00010000:2.0:1715330444.186779:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fa4ed80 00000100:00100000:2.0:1715330444.186811:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 129 00000100:00100000:2.0:1715330444.186817:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+90:2013:x1798653938143296:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330444.209009:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+92:2014:x1798653938143168:12345-192.168.204.49@tcp:4:dd.0 Request processed in 73664us (83852us total) trans 4294969994 rc 0/0 00000100:00100000:3.0:1715330444.209024:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 128 00002000:00100000:3.0:1715330444.209035:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (167772160->171966463) req@ffff880091f38a80 x1798653938143168/t4294969994(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:655/0 lens 488/448 e 0 to 0 dl 1715330455 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330444.209044:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091f38a80 with x1798653938143168 ext(167772160->171966463) 00002000:00010000:3.0:1715330444.209049:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091f38a80 00000100:00100000:2.0:1715330444.235478:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+92:2013:x1798653938143296:12345-192.168.204.49@tcp:4:dd.0 Request processed in 48649us (48809us total) trans 4294969995 rc 0/0 00000100:00100000:2.0:1715330444.235491:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 129 00002000:00100000:2.0:1715330444.235506:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (171966464->176160767) req@ffff88012fa4ed80 x1798653938143296/t4294969995(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:655/0 lens 488/448 e 0 to 0 dl 1715330455 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330444.235515:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fa4ed80 with x1798653938143296 ext(171966464->176160767) 00002000:00010000:2.0:1715330444.235520:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fa4ed80 00000100:00100000:1.0:1715330444.259869:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330444.259944:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938143424 00000100:00100000:2.0:1715330444.259952:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938143424 00002000:00100000:2.0:1715330444.259992:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (176160768->180355071) req@ffff8800969b8000 x1798653938143424/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:655/0 lens 488/0 e 0 to 0 dl 1715330455 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330444.260001:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800969b8000 with x1798653938143424 ext(176160768->180355071) 00002000:00010000:2.0:1715330444.260006:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800969b8000 00000100:00100000:2.0:1715330444.260348:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 130 00000100:00100000:2.0:1715330444.260355:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800969b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+92:2014:x1798653938143424:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330444.323913:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330444.324105:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938143552 00000100:00100000:3.0:1715330444.324114:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938143552 00002000:00100000:3.0:1715330444.324152:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (180355072->184549375) req@ffff88009327f100 x1798653938143552/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:655/0 lens 488/0 e 0 to 0 dl 1715330455 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330444.324161:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009327f100 with x1798653938143552 ext(180355072->184549375) 00002000:00010000:3.0:1715330444.324166:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009327f100 00000100:00100000:3.0:1715330444.324193:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 131 00000100:00100000:3.0:1715330444.324199:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009327f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+96:2011:x1798653938143552:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330444.330129:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800969b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+95:2014:x1798653938143424:12345-192.168.204.49@tcp:4:dd.0 Request processed in 69763us (70258us total) trans 4294969996 rc 0/0 00000100:00100000:2.0:1715330444.330142:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 130 00002000:00100000:2.0:1715330444.330153:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (176160768->180355071) req@ffff8800969b8000 x1798653938143424/t4294969996(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:655/0 lens 488/448 e 0 to 0 dl 1715330455 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330444.330162:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800969b8000 with x1798653938143424 ext(176160768->180355071) 00002000:00010000:2.0:1715330444.330167:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800969b8000 00000100:00100000:3.0:1715330444.376123:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009327f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+96:2011:x1798653938143552:12345-192.168.204.49@tcp:4:dd.0 Request processed in 51904us (52200us total) trans 4294969997 rc 0/0 00000100:00100000:3.0:1715330444.376143:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 131 00002000:00100000:3.0:1715330444.376162:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (180355072->184549375) req@ffff88009327f100 x1798653938143552/t4294969997(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:655/0 lens 488/448 e 0 to 0 dl 1715330455 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330444.376175:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009327f100 with x1798653938143552 ext(180355072->184549375) 00002000:00010000:3.0:1715330444.376183:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009327f100 00000100:00100000:2.0:1715330444.390663:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330444.390961:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938143680 00000100:00100000:3.0:1715330444.390970:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938143680 00002000:00100000:3.0:1715330444.391005:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (184549376->188743679) req@ffff88008d4ea300 x1798653938143680/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:655/0 lens 488/0 e 0 to 0 dl 1715330455 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330444.391013:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d4ea300 with x1798653938143680 ext(184549376->188743679) 00002000:00010000:3.0:1715330444.391019:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d4ea300 00000100:00100000:3.0:1715330444.391051:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 132 00000100:00100000:3.0:1715330444.391057:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+96:2012:x1798653938143680:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330444.441152:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+98:2012:x1798653938143680:12345-192.168.204.49@tcp:4:dd.0 Request processed in 50083us (50487us total) trans 4294969998 rc 0/0 00000100:00100000:3.0:1715330444.441168:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 132 00002000:00100000:3.0:1715330444.441186:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (184549376->188743679) req@ffff88008d4ea300 x1798653938143680/t4294969998(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:655/0 lens 488/448 e 0 to 0 dl 1715330455 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330444.441195:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d4ea300 with x1798653938143680 ext(184549376->188743679) 00002000:00010000:3.0:1715330444.441202:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d4ea300 00000100:00100000:2.0:1715330444.453684:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330444.455382:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938143808 00000100:00100000:3.0:1715330444.455393:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938143808 00002000:00100000:3.0:1715330444.455438:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (188743680->192937983) req@ffff88008d4e9880 x1798653938143808/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:655/0 lens 488/0 e 0 to 0 dl 1715330455 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330444.455450:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d4e9880 with x1798653938143808 ext(188743680->192937983) 00002000:00010000:3.0:1715330444.455456:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d4e9880 00000100:00100000:3.0:1715330444.455573:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 133 00000100:00100000:3.0:1715330444.455581:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+98:2013:x1798653938143808:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330444.505596:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+100:2013:x1798653938143808:12345-192.168.204.49@tcp:4:dd.0 Request processed in 50005us (51911us total) trans 4294969999 rc 0/0 00000100:00100000:3.0:1715330444.505611:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 133 00002000:00100000:3.0:1715330444.505624:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (188743680->192937983) req@ffff88008d4e9880 x1798653938143808/t4294969999(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:655/0 lens 488/448 e 0 to 0 dl 1715330455 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330444.505634:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d4e9880 with x1798653938143808 ext(188743680->192937983) 00002000:00010000:3.0:1715330444.505639:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d4e9880 00000100:00100000:1.0:1715330444.512125:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330444.512239:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938143936 00000100:00100000:3.0:1715330444.512247:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938143936 00002000:00100000:3.0:1715330444.512286:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (192937984->197132287) req@ffff8800969b8380 x1798653938143936/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:655/0 lens 488/0 e 0 to 0 dl 1715330455 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330444.512295:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800969b8380 with x1798653938143936 ext(192937984->197132287) 00002000:00010000:3.0:1715330444.512300:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800969b8380 00000100:00100000:3.0:1715330444.512336:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 134 00000100:00100000:3.0:1715330444.512341:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800969b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+100:2014:x1798653938143936:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330444.559233:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330444.562218:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938144064 00000100:00100000:2.0:1715330444.562237:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938144064 00002000:00100000:2.0:1715330444.562294:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (197132288->201326591) req@ffff8800969b8700 x1798653938144064/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:655/0 lens 488/0 e 0 to 0 dl 1715330455 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330444.562305:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800969b8700 with x1798653938144064 ext(197132288->201326591) 00002000:00010000:2.0:1715330444.562313:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800969b8700 00000100:00100000:2.0:1715330444.562367:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 135 00000100:00100000:2.0:1715330444.562376:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800969b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+104:2014:x1798653938144064:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330444.566763:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800969b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+104:2014:x1798653938143936:12345-192.168.204.49@tcp:4:dd.0 Request processed in 54403us (54628us total) trans 4294970000 rc 0/0 00000100:00100000:3.0:1715330444.566779:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 134 00002000:00100000:3.0:1715330444.566796:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (192937984->197132287) req@ffff8800969b8380 x1798653938143936/t4294970000(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:655/0 lens 488/448 e 0 to 0 dl 1715330455 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330444.566806:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800969b8380 with x1798653938143936 ext(192937984->197132287) 00002000:00010000:3.0:1715330444.566812:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800969b8380 00010000:00010000:1.0:1715330444.608827:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330444.631767:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800969b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+104:2014:x1798653938144064:12345-192.168.204.49@tcp:4:dd.0 Request processed in 69344us (72497us total) trans 4294970001 rc 0/0 00000100:00100000:2.0:1715330444.631782:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 135 00002000:00100000:2.0:1715330444.631794:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (197132288->201326591) req@ffff8800969b8700 x1798653938144064/t4294970001(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:655/0 lens 488/448 e 0 to 0 dl 1715330455 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330444.631804:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800969b8700 with x1798653938144064 ext(197132288->201326591) 00002000:00010000:2.0:1715330444.631810:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800969b8700 00000100:00100000:2.0:1715330444.648068:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330444.649284:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938144192 00000100:00100000:0.0:1715330444.649297:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938144192 00002000:00100000:0.0:1715330444.649350:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (201326592->205520895) req@ffff88008d4e9180 x1798653938144192/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:655/0 lens 488/0 e 0 to 0 dl 1715330455 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330444.649362:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d4e9180 with x1798653938144192 ext(201326592->205520895) 00002000:00010000:0.0:1715330444.649369:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d4e9180 00000100:00100000:0.0:1715330444.649405:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 136 00000100:00100000:0.0:1715330444.649412:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+104:2011:x1798653938144192:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330444.690931:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009327ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942548672:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1715330444.691002:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330444.691090:0:7138:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942548672 00000100:00100000:0.0:1715330444.691097:0:7138:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942548672 00000100:00100000:0.0:1715330444.691140:0:7138:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3149 00000100:00100000:0.0:1715330444.691146:0:7138:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942548672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1715330444.691178:0:7138:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445060608 avail 1315598336 00000100:00100000:0.0:1715330444.691229:0:7138:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942548672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330444.691235:0:7138:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3149 00000100:00100000:3.0:1715330444.691280:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009327ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942548672:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1715330444.712590:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330444.712659:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938144320 00000100:00100000:3.0:1715330444.712668:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938144320 00002000:00100000:3.0:1715330444.712711:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (205520896->209715199) req@ffff88009327c000 x1798653938144320/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:655/0 lens 488/0 e 0 to 0 dl 1715330455 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330444.712721:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009327c000 with x1798653938144320 ext(205520896->209715199) 00002000:00010000:3.0:1715330444.712726:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009327c000 00000100:00100000:3.0:1715330444.712768:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 137 00000100:00100000:3.0:1715330444.712774:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009327c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+106:2012:x1798653938144320:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330444.741179:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+108:2011:x1798653938144192:12345-192.168.204.49@tcp:4:dd.0 Request processed in 91756us (93112us total) trans 4294970002 rc 0/0 00000100:00100000:2.0:1715330444.741194:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 136 00002000:00100000:2.0:1715330444.741209:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (201326592->205520895) req@ffff88008d4e9180 x1798653938144192/t4294970002(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:655/0 lens 488/448 e 0 to 0 dl 1715330455 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330444.741225:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d4e9180 with x1798653938144192 ext(201326592->205520895) 00002000:00010000:2.0:1715330444.741231:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d4e9180 00000100:00100000:1.0:1715330444.791059:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330444.791163:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938144448 00000100:00100000:3.0:1715330444.791172:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938144448 00002000:00100000:3.0:1715330444.791211:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (209715200->213909503) req@ffff8800969b8a80 x1798653938144448/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:655/0 lens 488/0 e 0 to 0 dl 1715330455 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330444.791221:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800969b8a80 with x1798653938144448 ext(209715200->213909503) 00002000:00010000:3.0:1715330444.791227:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800969b8a80 00000100:00100000:3.0:1715330444.791372:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 138 00000100:00100000:3.0:1715330444.791380:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800969b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+110:2011:x1798653938144448:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330444.791525:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009327c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+109:2012:x1798653938144320:12345-192.168.204.49@tcp:4:dd.0 Request processed in 78749us (78941us total) trans 4294970003 rc 0/0 00000100:00100000:2.0:1715330444.791534:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 137 00002000:00100000:2.0:1715330444.791540:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (205520896->209715199) req@ffff88009327c000 x1798653938144320/t4294970003(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:655/0 lens 488/448 e 0 to 0 dl 1715330455 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330444.791547:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009327c000 with x1798653938144320 ext(205520896->209715199) 00002000:00010000:2.0:1715330444.791550:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009327c000 00000100:00100000:0.0:1715330444.831461:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800969b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+110:2011:x1798653938144448:12345-192.168.204.49@tcp:4:dd.0 Request processed in 40071us (40401us total) trans 4294970004 rc 0/0 00000100:00100000:0.0:1715330444.831475:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 138 00002000:00100000:0.0:1715330444.831487:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (209715200->213909503) req@ffff8800969b8a80 x1798653938144448/t4294970004(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:655/0 lens 488/448 e 0 to 0 dl 1715330455 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330444.831498:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800969b8a80 with x1798653938144448 ext(209715200->213909503) 00002000:00010000:0.0:1715330444.831503:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800969b8a80 00000100:00100000:2.0:1715330444.839423:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330444.839702:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938144576 00000100:00100000:0.0:1715330444.839710:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938144576 00002000:00100000:0.0:1715330444.839776:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (213909504->218103807) req@ffff88008d4eb480 x1798653938144576/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:655/0 lens 488/0 e 0 to 0 dl 1715330455 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330444.839785:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d4eb480 with x1798653938144576 ext(213909504->218103807) 00002000:00010000:0.0:1715330444.839791:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d4eb480 00000100:00100000:1.0:1715330444.839820:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 139 00000100:00100000:1.0:1715330444.839827:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+110:2014:x1798653938144576:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330444.884699:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330444.886963:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938144704 00000100:00100000:2.0:1715330444.886979:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938144704 00002000:00100000:2.0:1715330444.887024:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (218103808->222298111) req@ffff8800969b8e00 x1798653938144704/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:655/0 lens 488/0 e 0 to 0 dl 1715330455 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330444.887034:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800969b8e00 with x1798653938144704 ext(218103808->222298111) 00002000:00010000:2.0:1715330444.887039:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800969b8e00 00000100:00100000:2.0:1715330444.887077:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 140 00000100:00100000:2.0:1715330444.887082:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800969b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+114:2014:x1798653938144704:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330444.890292:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+114:2014:x1798653938144576:12345-192.168.204.49@tcp:4:dd.0 Request processed in 50456us (50868us total) trans 4294970005 rc 0/0 00000100:00100000:0.0:1715330444.890303:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 139 00002000:00100000:0.0:1715330444.890314:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (213909504->218103807) req@ffff88008d4eb480 x1798653938144576/t4294970005(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:655/0 lens 488/448 e 0 to 0 dl 1715330455 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330444.890323:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d4eb480 with x1798653938144576 ext(213909504->218103807) 00002000:00010000:0.0:1715330444.890328:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d4eb480 00000100:00100000:0.0:1715330444.939605:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800969b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+114:2014:x1798653938144704:12345-192.168.204.49@tcp:4:dd.0 Request processed in 52501us (54904us total) trans 4294970006 rc 0/0 00000100:00100000:0.0:1715330444.939625:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 140 00002000:00100000:0.0:1715330444.939643:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (218103808->222298111) req@ffff8800969b8e00 x1798653938144704/t4294970006(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:655/0 lens 488/448 e 0 to 0 dl 1715330455 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330444.939655:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800969b8e00 with x1798653938144704 ext(218103808->222298111) 00002000:00010000:0.0:1715330444.939662:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800969b8e00 00000100:00100000:1.0:1715330444.951495:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330444.951559:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938144832 00000100:00100000:0.0:1715330444.951568:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938144832 00002000:00100000:0.0:1715330444.951601:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (222298112->226492415) req@ffff8800969b9180 x1798653938144832/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:655/0 lens 488/0 e 0 to 0 dl 1715330455 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330444.951611:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800969b9180 with x1798653938144832 ext(222298112->226492415) 00002000:00010000:0.0:1715330444.951615:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800969b9180 00000100:00100000:2.0:1715330444.952582:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 141 00000100:00100000:2.0:1715330444.952590:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800969b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+114:2014:x1798653938144832:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330444.994432:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800969b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+116:2014:x1798653938144832:12345-192.168.204.49@tcp:4:dd.0 Request processed in 41830us (42935us total) trans 4294970007 rc 0/0 00000100:00100000:2.0:1715330444.994449:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 141 00002000:00100000:2.0:1715330444.994464:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (222298112->226492415) req@ffff8800969b9180 x1798653938144832/t4294970007(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:655/0 lens 488/448 e 0 to 0 dl 1715330455 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330444.994474:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800969b9180 with x1798653938144832 ext(222298112->226492415) 00002000:00010000:2.0:1715330444.994480:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800969b9180 00000100:00100000:0.0:1715330444.999192:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330444.999317:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938144960 00000100:00100000:2.0:1715330444.999329:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938144960 00002000:00100000:2.0:1715330444.999381:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (226492416->230686719) req@ffff88009327c380 x1798653938144960/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:655/0 lens 488/0 e 0 to 0 dl 1715330455 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330444.999391:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009327c380 with x1798653938144960 ext(226492416->230686719) 00002000:00010000:2.0:1715330444.999396:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009327c380 00000100:00100000:2.0:1715330445.000012:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 142 00000100:00100000:2.0:1715330445.000019:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009327c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+116:2013:x1798653938144960:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330445.061691:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330445.063674:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938145088 00000100:00100000:0.0:1715330445.063695:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938145088 00002000:00100000:0.0:1715330445.063773:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (230686720->234881023) req@ffff88008b318000 x1798653938145088/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:656/0 lens 488/0 e 0 to 0 dl 1715330456 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330445.063782:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b318000 with x1798653938145088 ext(230686720->234881023) 00002000:00010000:0.0:1715330445.063787:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008b318000 00000100:00100000:0.0:1715330445.063810:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 143 00000100:00100000:0.0:1715330445.063816:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b318000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+118:2014:x1798653938145088:12345-192.168.204.49@tcp:4:dd.0 00000100:00080000:3.0:1715330445.066919:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330415 00000100:00100000:3.0:1715330445.081489:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009327c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+120:2013:x1798653938144960:12345-192.168.204.49@tcp:4:dd.0 Request processed in 81455us (82294us total) trans 4294970008 rc 0/0 00000100:00100000:3.0:1715330445.081506:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 142 00002000:00100000:3.0:1715330445.081523:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (226492416->230686719) req@ffff88009327c380 x1798653938144960/t4294970008(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:655/0 lens 488/448 e 0 to 0 dl 1715330455 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330445.081533:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009327c380 with x1798653938144960 ext(226492416->230686719) 00002000:00010000:3.0:1715330445.081538:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009327c380 00000100:00100000:0.0:1715330445.114586:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b318000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+120:2014:x1798653938145088:12345-192.168.204.49@tcp:4:dd.0 Request processed in 50756us (52900us total) trans 4294970009 rc 0/0 00000100:00100000:0.0:1715330445.114600:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 143 00002000:00100000:0.0:1715330445.114612:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (230686720->234881023) req@ffff88008b318000 x1798653938145088/t4294970009(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:656/0 lens 488/448 e 0 to 0 dl 1715330456 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330445.114622:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b318000 with x1798653938145088 ext(230686720->234881023) 00002000:00010000:0.0:1715330445.114629:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008b318000 00000100:00100000:2.0:1715330445.122125:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330445.122200:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938145216 00000100:00100000:0.0:1715330445.122211:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938145216 00002000:00100000:0.0:1715330445.122253:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (234881024->239075327) req@ffff88008d4ea680 x1798653938145216/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:656/0 lens 488/0 e 0 to 0 dl 1715330456 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330445.122269:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d4ea680 with x1798653938145216 ext(234881024->239075327) 00002000:00010000:0.0:1715330445.122276:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d4ea680 00000100:00100000:0.0:1715330445.122314:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 144 00000100:00100000:0.0:1715330445.122322:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+120:2014:x1798653938145216:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330445.159494:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+122:2014:x1798653938145216:12345-192.168.204.49@tcp:4:dd.0 Request processed in 37162us (37367us total) trans 4294970010 rc 0/0 00000100:00100000:0.0:1715330445.159507:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 144 00002000:00100000:0.0:1715330445.159519:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (234881024->239075327) req@ffff88008d4ea680 x1798653938145216/t4294970010(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:656/0 lens 488/448 e 0 to 0 dl 1715330456 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330445.159528:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d4ea680 with x1798653938145216 ext(234881024->239075327) 00002000:00010000:0.0:1715330445.159533:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d4ea680 00000100:00100000:3.0:1715330445.183888:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330445.184291:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938145344 00000100:00100000:0.0:1715330445.184301:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938145344 00002000:00100000:0.0:1715330445.184337:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (239075328->243269631) req@ffff88008b31bb80 x1798653938145344/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:656/0 lens 488/0 e 0 to 0 dl 1715330456 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330445.184344:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b31bb80 with x1798653938145344 ext(239075328->243269631) 00002000:00010000:0.0:1715330445.184349:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008b31bb80 00000100:00100000:0.0:1715330445.184372:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 145 00000100:00100000:0.0:1715330445.184378:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b31bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+122:2014:x1798653938145344:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330445.226854:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b31bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+124:2014:x1798653938145344:12345-192.168.204.49@tcp:4:dd.0 Request processed in 42465us (42964us total) trans 4294970011 rc 0/0 00000100:00100000:1.0:1715330445.226867:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 145 00002000:00100000:1.0:1715330445.226879:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (239075328->243269631) req@ffff88008b31bb80 x1798653938145344/t4294970011(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:656/0 lens 488/448 e 0 to 0 dl 1715330456 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330445.226887:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b31bb80 with x1798653938145344 ext(239075328->243269631) 00002000:00010000:1.0:1715330445.226893:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008b31bb80 00000100:00100000:3.0:1715330445.259728:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330445.259875:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938145472 00000100:00100000:1.0:1715330445.259883:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938145472 00002000:00100000:1.0:1715330445.259919:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (243269632->247463935) req@ffff8801344c8000 x1798653938145472/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:656/0 lens 488/0 e 0 to 0 dl 1715330456 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330445.259928:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801344c8000 with x1798653938145472 ext(243269632->247463935) 00002000:00010000:1.0:1715330445.259933:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801344c8000 00000100:00100000:1.0:1715330445.259966:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 146 00000100:00100000:1.0:1715330445.259973:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+124:2011:x1798653938145472:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330445.315881:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+126:2011:x1798653938145472:12345-192.168.204.49@tcp:4:dd.0 Request processed in 55898us (56149us total) trans 4294970012 rc 0/0 00000100:00100000:1.0:1715330445.315894:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 146 00002000:00100000:1.0:1715330445.315906:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (243269632->247463935) req@ffff8801344c8000 x1798653938145472/t4294970012(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:656/0 lens 488/448 e 0 to 0 dl 1715330456 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330445.315916:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801344c8000 with x1798653938145472 ext(243269632->247463935) 00002000:00010000:1.0:1715330445.315921:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801344c8000 00000100:00100000:3.0:1715330445.335689:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330445.336427:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938145600 00000100:00100000:1.0:1715330445.336437:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938145600 00002000:00100000:1.0:1715330445.336484:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (247463936->251658239) req@ffff88007d634700 x1798653938145600/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:656/0 lens 488/0 e 0 to 0 dl 1715330456 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330445.336495:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88007d634700 with x1798653938145600 ext(247463936->251658239) 00002000:00010000:1.0:1715330445.336501:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007d634700 00000100:00100000:1.0:1715330445.336532:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 147 00000100:00100000:1.0:1715330445.336540:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+126:2011:x1798653938145600:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330445.416564:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330445.416656:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938145728 00000100:00100000:3.0:1715330445.416666:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938145728 00002000:00100000:3.0:1715330445.416712:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (251658240->255852543) req@ffff88008d4e8e00 x1798653938145728/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:656/0 lens 488/0 e 0 to 0 dl 1715330456 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330445.416722:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d4e8e00 with x1798653938145728 ext(251658240->255852543) 00002000:00010000:3.0:1715330445.416726:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d4e8e00 00000100:00100000:3.0:1715330445.418564:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 148 00000100:00100000:3.0:1715330445.418573:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+128:2012:x1798653938145728:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330445.439182:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+130:2011:x1798653938145600:12345-192.168.204.49@tcp:4:dd.0 Request processed in 102631us (103502us total) trans 4294970013 rc 0/0 00000100:00100000:1.0:1715330445.439197:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 147 00002000:00100000:1.0:1715330445.439214:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (247463936->251658239) req@ffff88007d634700 x1798653938145600/t4294970013(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:656/0 lens 488/448 e 0 to 0 dl 1715330456 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330445.439223:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88007d634700 with x1798653938145600 ext(247463936->251658239) 00002000:00010000:1.0:1715330445.439231:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007d634700 00000100:00100000:2.0:1715330445.494200:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330445.494314:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938145856 00000100:00100000:1.0:1715330445.494326:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938145856 00002000:00100000:1.0:1715330445.494378:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (255852544->260046847) req@ffff88008d4ead80 x1798653938145856/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:656/0 lens 488/0 e 0 to 0 dl 1715330456 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330445.494389:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d4ead80 with x1798653938145856 ext(255852544->260046847) 00002000:00010000:1.0:1715330445.494395:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d4ead80 00000100:00100000:1.0:1715330445.494428:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 149 00000100:00100000:1.0:1715330445.494434:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+130:2014:x1798653938145856:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330445.512604:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+132:2012:x1798653938145728:12345-192.168.204.49@tcp:4:dd.0 Request processed in 94019us (96035us total) trans 4294970014 rc 0/0 00000100:00100000:2.0:1715330445.512618:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 148 00002000:00100000:2.0:1715330445.512630:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (251658240->255852543) req@ffff88008d4e8e00 x1798653938145728/t4294970014(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:656/0 lens 488/448 e 0 to 0 dl 1715330456 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330445.512639:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d4e8e00 with x1798653938145728 ext(251658240->255852543) 00002000:00010000:2.0:1715330445.512644:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d4e8e00 00000100:00100000:1.0:1715330445.541978:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+132:2014:x1798653938145856:12345-192.168.204.49@tcp:4:dd.0 Request processed in 47533us (47783us total) trans 4294970015 rc 0/0 00000100:00100000:1.0:1715330445.541993:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 149 00002000:00100000:1.0:1715330445.542006:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (255852544->260046847) req@ffff88008d4ead80 x1798653938145856/t4294970015(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:656/0 lens 488/448 e 0 to 0 dl 1715330456 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330445.542015:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d4ead80 with x1798653938145856 ext(255852544->260046847) 00002000:00010000:1.0:1715330445.542021:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d4ead80 00000100:00100000:0.0:1715330445.558237:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330445.558336:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938145984 00000100:00100000:1.0:1715330445.558345:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938145984 00002000:00100000:1.0:1715330445.558386:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (260046848->264241151) req@ffff88009327ce00 x1798653938145984/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:656/0 lens 488/0 e 0 to 0 dl 1715330456 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330445.558395:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009327ce00 with x1798653938145984 ext(260046848->264241151) 00002000:00010000:1.0:1715330445.558400:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009327ce00 00000100:00100000:1.0:1715330445.558434:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 150 00000100:00100000:1.0:1715330445.558439:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009327ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+132:2014:x1798653938145984:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330445.587906:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ae8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942548800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1715330445.587968:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330445.588000:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1715330445.588007:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d4e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942548736:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1715330445.588025:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330445.588048:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942548800 00000100:00100000:2.0:1715330445.588054:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942548800 00000100:00080000:3.0:1715330445.588089:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330415 00000100:00100000:2.0:1715330445.588099:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942548736 00000100:00100000:2.0:1715330445.588101:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942548736 00000100:00100000:3.0:1715330445.588109:0:9401:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1715330445.588115:0:9401:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942548800:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1715330445.588126:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1715330445.588130:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942548736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1715330445.588138:0:9401:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 615843520 pending 265789440 free 3726376960 avail 3494854656 00002000:00000024:2.0:1715330445.588140:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 615843520 pending 265789440 free 3726376960 avail 3494854656 00000100:00100000:3.0:1715330445.588173:0:9401:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942548800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330445.588173:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942548736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330445.588179:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1715330445.588189:0:9401:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00080000:3.0:1715330445.588205:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330415 00000100:00100000:2.0:1715330445.588212:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d4e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942548736:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1715330445.588234:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ae8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942548800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1715330445.597595:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009327ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+134:2014:x1798653938145984:12345-192.168.204.49@tcp:4:dd.0 Request processed in 39145us (39355us total) trans 4294970016 rc 0/0 00000100:00100000:1.0:1715330445.597606:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 150 00002000:00100000:1.0:1715330445.597617:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (260046848->264241151) req@ffff88009327ce00 x1798653938145984/t4294970016(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:656/0 lens 488/448 e 0 to 0 dl 1715330456 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330445.597626:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009327ce00 with x1798653938145984 ext(260046848->264241151) 00002000:00010000:1.0:1715330445.597632:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009327ce00 00010000:00010000:3.0:1715330445.612239:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330445.630274:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330445.630502:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938146112 00000100:00100000:1.0:1715330445.630513:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938146112 00002000:00100000:1.0:1715330445.630561:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (264241152->268435455) req@ffff88012b55ea00 x1798653938146112/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:656/0 lens 488/0 e 0 to 0 dl 1715330456 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330445.630577:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b55ea00 with x1798653938146112 ext(264241152->268435455) 00002000:00010000:1.0:1715330445.630583:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b55ea00 00000100:00100000:1.0:1715330445.630678:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 151 00000100:00100000:1.0:1715330445.630685:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+134:2014:x1798653938146112:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330445.682470:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+136:2014:x1798653938146112:12345-192.168.204.49@tcp:4:dd.0 Request processed in 51775us (52196us total) trans 4294970017 rc 0/0 00000100:00100000:0.0:1715330445.682486:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 151 00002000:00100000:0.0:1715330445.682498:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (264241152->268435455) req@ffff88012b55ea00 x1798653938146112/t4294970017(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:656/0 lens 488/448 e 0 to 0 dl 1715330456 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330445.682507:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b55ea00 with x1798653938146112 ext(264241152->268435455) 00002000:00010000:0.0:1715330445.682513:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b55ea00 00000100:00100000:0.0:1715330445.693206:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330445.693341:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938146240 00000100:00100000:2.0:1715330445.693353:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938146240 00002000:00100000:2.0:1715330445.693403:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (268435456->272629759) req@ffff88012b55d180 x1798653938146240/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:656/0 lens 488/0 e 0 to 0 dl 1715330456 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330445.693413:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b55d180 with x1798653938146240 ext(268435456->272629759) 00002000:00010000:2.0:1715330445.693419:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b55d180 00000100:00100000:2.0:1715330445.693439:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 152 00000100:00100000:2.0:1715330445.693446:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+136:2013:x1798653938146240:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330445.755419:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+138:2013:x1798653938146240:12345-192.168.204.49@tcp:4:dd.0 Request processed in 61963us (62211us total) trans 4294970018 rc 0/0 00000100:00100000:0.0:1715330445.755431:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 152 00002000:00100000:0.0:1715330445.755442:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (268435456->272629759) req@ffff88012b55d180 x1798653938146240/t4294970018(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:656/0 lens 488/448 e 0 to 0 dl 1715330456 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330445.755451:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b55d180 with x1798653938146240 ext(268435456->272629759) 00002000:00010000:0.0:1715330445.755455:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b55d180 00000100:00100000:0.0:1715330445.764315:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330445.764408:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938146368 00000100:00100000:2.0:1715330445.764418:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938146368 00002000:00100000:2.0:1715330445.764463:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (272629760->276824063) req@ffff88012b55ce00 x1798653938146368/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:656/0 lens 488/0 e 0 to 0 dl 1715330456 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330445.764474:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b55ce00 with x1798653938146368 ext(272629760->276824063) 00002000:00010000:2.0:1715330445.764481:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b55ce00 00000100:00100000:2.0:1715330445.764503:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 153 00000100:00100000:2.0:1715330445.764509:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+138:2011:x1798653938146368:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330445.841328:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+140:2011:x1798653938146368:12345-192.168.204.49@tcp:4:dd.0 Request processed in 76807us (77015us total) trans 4294970019 rc 0/0 00000100:00100000:0.0:1715330445.841343:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 153 00002000:00100000:0.0:1715330445.841357:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (272629760->276824063) req@ffff88012b55ce00 x1798653938146368/t4294970019(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:656/0 lens 488/448 e 0 to 0 dl 1715330456 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330445.841368:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b55ce00 with x1798653938146368 ext(272629760->276824063) 00002000:00010000:0.0:1715330445.841374:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b55ce00 00000100:00100000:1.0:1715330445.846727:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330445.846856:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938146496 00000100:00100000:0.0:1715330445.846865:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938146496 00002000:00100000:0.0:1715330445.846908:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (276824064->281018367) req@ffff8800969b9500 x1798653938146496/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:656/0 lens 488/0 e 0 to 0 dl 1715330456 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330445.846919:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800969b9500 with x1798653938146496 ext(276824064->281018367) 00002000:00010000:0.0:1715330445.846927:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800969b9500 00000100:00100000:0.0:1715330445.847630:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 154 00000100:00100000:0.0:1715330445.847638:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800969b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+140:2012:x1798653938146496:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330445.910085:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800969b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+142:2012:x1798653938146496:12345-192.168.204.49@tcp:4:dd.0 Request processed in 62432us (63352us total) trans 4294970020 rc 0/0 00000100:00100000:0.0:1715330445.910100:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 154 00002000:00100000:0.0:1715330445.910115:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (276824064->281018367) req@ffff8800969b9500 x1798653938146496/t4294970020(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:656/0 lens 488/448 e 0 to 0 dl 1715330456 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330445.910124:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800969b9500 with x1798653938146496 ext(276824064->281018367) 00002000:00010000:0.0:1715330445.910132:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800969b9500 00000100:00100000:0.0:1715330445.931194:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330445.931305:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938146624 00000100:00100000:2.0:1715330445.931324:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938146624 00002000:00100000:2.0:1715330445.931368:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (281018368->285212671) req@ffff88012b55d500 x1798653938146624/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:656/0 lens 488/0 e 0 to 0 dl 1715330456 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330445.931377:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b55d500 with x1798653938146624 ext(281018368->285212671) 00002000:00010000:2.0:1715330445.931383:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b55d500 00000100:00100000:2.0:1715330445.932026:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 155 00000100:00100000:2.0:1715330445.932033:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+142:2012:x1798653938146624:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330445.987171:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+144:2012:x1798653938146624:12345-192.168.204.49@tcp:4:dd.0 Request processed in 55128us (55977us total) trans 4294970021 rc 0/0 00000100:00100000:0.0:1715330445.987183:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 155 00002000:00100000:0.0:1715330445.987195:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (281018368->285212671) req@ffff88012b55d500 x1798653938146624/t4294970021(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:656/0 lens 488/448 e 0 to 0 dl 1715330456 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330445.987203:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b55d500 with x1798653938146624 ext(281018368->285212671) 00002000:00010000:0.0:1715330445.987208:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b55d500 00000100:00100000:1.0:1715330445.987328:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330445.987628:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938146752 00000100:00100000:0.0:1715330445.987637:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938146752 00002000:00100000:0.0:1715330445.987689:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (285212672->289406975) req@ffff8800969b9880 x1798653938146752/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:656/0 lens 488/0 e 0 to 0 dl 1715330456 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330445.987696:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800969b9880 with x1798653938146752 ext(285212672->289406975) 00002000:00010000:0.0:1715330445.987699:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800969b9880 00000100:00100000:0.0:1715330445.987726:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 156 00000100:00100000:0.0:1715330445.987765:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800969b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+144:2012:x1798653938146752:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330446.035245:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800969b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+146:2012:x1798653938146752:12345-192.168.204.49@tcp:4:dd.0 Request processed in 47465us (47902us total) trans 4294970022 rc 0/0 00000100:00100000:0.0:1715330446.035259:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 156 00002000:00100000:0.0:1715330446.035277:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (285212672->289406975) req@ffff8800969b9880 x1798653938146752/t4294970022(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:656/0 lens 488/448 e 0 to 0 dl 1715330456 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330446.035288:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800969b9880 with x1798653938146752 ext(285212672->289406975) 00002000:00010000:0.0:1715330446.035297:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800969b9880 00000100:00100000:1.0:1715330446.040623:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330446.042175:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938146880 00000100:00100000:0.0:1715330446.042188:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938146880 00002000:00100000:2.0:1715330446.042894:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (289406976->293601279) req@ffff8800969b9c00 x1798653938146880/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:657/0 lens 488/0 e 0 to 0 dl 1715330457 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330446.042905:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800969b9c00 with x1798653938146880 ext(289406976->293601279) 00002000:00010000:2.0:1715330446.042911:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800969b9c00 00000100:00100000:2.0:1715330446.043475:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 157 00000100:00100000:2.0:1715330446.043482:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800969b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+146:2012:x1798653938146880:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330446.089426:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800969b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+148:2012:x1798653938146880:12345-192.168.204.49@tcp:4:dd.0 Request processed in 45933us (48804us total) trans 4294970023 rc 0/0 00000100:00100000:0.0:1715330446.089445:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 157 00002000:00100000:0.0:1715330446.089464:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (289406976->293601279) req@ffff8800969b9c00 x1798653938146880/t4294970023(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:657/0 lens 488/448 e 0 to 0 dl 1715330457 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330446.089475:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800969b9c00 with x1798653938146880 ext(289406976->293601279) 00002000:00010000:0.0:1715330446.089483:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800969b9c00 00000100:00100000:3.0:1715330446.089601:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330446.089832:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938147008 00000100:00100000:0.0:1715330446.089841:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938147008 00002000:00100000:0.0:1715330446.089874:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (293601280->297795583) req@ffff88009ae8ce00 x1798653938147008/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:657/0 lens 488/0 e 0 to 0 dl 1715330457 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330446.089887:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae8ce00 with x1798653938147008 ext(293601280->297795583) 00002000:00010000:0.0:1715330446.089890:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ae8ce00 00000100:00100000:0.0:1715330446.089921:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 158 00000100:00100000:0.0:1715330446.089926:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+148:2011:x1798653938147008:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330446.126195:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330446.126396:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938147136 00000100:00100000:2.0:1715330446.126406:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938147136 00002000:00100000:2.0:1715330446.126451:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (297795584->301989887) req@ffff8800969b9f80 x1798653938147136/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:657/0 lens 488/0 e 0 to 0 dl 1715330457 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330446.126461:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800969b9f80 with x1798653938147136 ext(297795584->301989887) 00002000:00010000:2.0:1715330446.126466:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800969b9f80 00000100:00100000:2.0:1715330446.126494:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 159 00000100:00100000:2.0:1715330446.126500:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800969b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+150:2014:x1798653938147136:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330446.144147:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+152:2011:x1798653938147008:12345-192.168.204.49@tcp:4:dd.0 Request processed in 54202us (54529us total) trans 4294970024 rc 0/0 00000100:00100000:0.0:1715330446.144162:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 158 00002000:00100000:0.0:1715330446.144180:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (293601280->297795583) req@ffff88009ae8ce00 x1798653938147008/t4294970024(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:657/0 lens 488/448 e 0 to 0 dl 1715330457 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330446.144191:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae8ce00 with x1798653938147008 ext(293601280->297795583) 00002000:00010000:0.0:1715330446.144201:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ae8ce00 00000100:00100000:2.0:1715330446.184513:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330446.184614:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938147264 00000100:00100000:0.0:1715330446.184626:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938147264 00002000:00100000:0.0:1715330446.184695:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (301989888->306184191) req@ffff88008d4e9500 x1798653938147264/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:657/0 lens 488/0 e 0 to 0 dl 1715330457 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330446.184708:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d4e9500 with x1798653938147264 ext(301989888->306184191) 00002000:00010000:0.0:1715330446.184716:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d4e9500 00000100:00100000:2.0:1715330446.184930:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 160 00000100:00100000:2.0:1715330446.184946:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+154:2014:x1798653938147264:12345-192.168.204.49@tcp:4:dd.0 00000001:00080000:3.0:1715330446.189680:0:9395:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0000: transno 4294970025 is committed 00000100:00100000:2.0:1715330446.191851:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800969b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+9:2014:x1798653938147136:12345-192.168.204.49@tcp:4:dd.0 Request processed in 65338us (65656us total) trans 4294970025 rc 0/0 00000100:00100000:2.0:1715330446.191864:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 159 00002000:00100000:2.0:1715330446.191876:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (297795584->301989887) req@ffff8800969b9f80 x1798653938147136/t4294970025(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:657/0 lens 488/448 e 0 to 0 dl 1715330457 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330446.191885:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800969b9f80 with x1798653938147136 ext(297795584->301989887) 00002000:00010000:2.0:1715330446.191891:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800969b9f80 00000100:00100000:2.0:1715330446.223320:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+9:2014:x1798653938147264:12345-192.168.204.49@tcp:4:dd.0 Request processed in 38368us (38810us total) trans 4294970026 rc 0/0 00000100:00100000:2.0:1715330446.223334:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 160 00002000:00100000:2.0:1715330446.223346:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (301989888->306184191) req@ffff88008d4e9500 x1798653938147264/t4294970026(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:657/0 lens 488/448 e 0 to 0 dl 1715330457 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330446.223355:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d4e9500 with x1798653938147264 ext(301989888->306184191) 00002000:00010000:2.0:1715330446.223362:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d4e9500 00000100:00100000:2.0:1715330446.233690:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330446.233846:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938147392 00000100:00100000:0.0:1715330446.233855:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938147392 00002000:00100000:0.0:1715330446.233895:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (306184192->310378495) req@ffff88008d776a00 x1798653938147392/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:657/0 lens 488/0 e 0 to 0 dl 1715330457 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330446.233904:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d776a00 with x1798653938147392 ext(306184192->310378495) 00002000:00010000:0.0:1715330446.233909:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d776a00 00000100:00100000:0.0:1715330446.233940:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 161 00000100:00100000:0.0:1715330446.233947:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d776a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+9:2014:x1798653938147392:12345-192.168.204.49@tcp:4:dd.0 00000001:00080000:3.0:1715330446.236123:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984133 is committed 00010000:00010000:0.0:1715330446.236215:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83cc0/0xd895711d66dbed2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x67bc6aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330446.236227:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83cc0/0xd895711d66dbed2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x67bc6aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330446.236235:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83cc0/0xd895711d66dbed2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x67bc6aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330446.236242:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88011da83cc0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330446.236247:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83cc0/0xd895711d66dbed2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x67bc6aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330446.236255:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83cc0/0xd895711d66dbed2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x67bc6aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330446.236273:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x67bc6aa0 (ffff88008d68e100) 00010000:00010000:0.0:1715330446.236275:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330446.236278:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83cc0/0xd895711d66dbed2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x67bc6aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330446.236283:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83cc0/0xd895711d66dbed2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x67bc6aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330446.239071:0:3674:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66dbf42 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x159c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330446.239084:0:3674:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66dbf42 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x159c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330446.239091:0:3674:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66dbf42 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x159c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330446.239096:0:3674:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b7840 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330446.239099:0:3674:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66dbf42 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x159c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330446.239104:0:3674:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66dbf42 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x159c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330446.239116:0:3674:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159c:0x0].0x0 (ffff88009d618e00) 00010000:00010000:0.0:1715330446.239119:0:3674:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330446.239122:0:3674:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66dbf42 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x159c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00010000:00010000:0.0:1715330446.239126:0:3674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b7840/0xd895711d66dbf42 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x159c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 00000100:00100000:2.0:1715330446.273474:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330446.273779:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938147520 00000100:00100000:1.0:1715330446.273789:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938147520 00002000:00100000:1.0:1715330446.273829:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (310378496->314572799) req@ffff88008d777480 x1798653938147520/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:657/0 lens 488/0 e 0 to 0 dl 1715330457 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330446.273838:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d777480 with x1798653938147520 ext(310378496->314572799) 00002000:00010000:1.0:1715330446.273844:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d777480 00000100:00100000:1.0:1715330446.273868:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 162 00000100:00100000:1.0:1715330446.273875:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d777480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+13:2013:x1798653938147520:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330446.279972:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d776a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+13:2014:x1798653938147392:12345-192.168.204.49@tcp:4:dd.0 Request processed in 46015us (46286us total) trans 4294970027 rc 0/0 00000100:00100000:1.0:1715330446.279984:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 161 00002000:00100000:1.0:1715330446.279995:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (306184192->310378495) req@ffff88008d776a00 x1798653938147392/t4294970027(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:657/0 lens 488/448 e 0 to 0 dl 1715330457 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330446.280003:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d776a00 with x1798653938147392 ext(306184192->310378495) 00002000:00010000:1.0:1715330446.280009:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d776a00 00000100:00100000:1.0:1715330446.308536:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d777480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+13:2013:x1798653938147520:12345-192.168.204.49@tcp:4:dd.0 Request processed in 34643us (35058us total) trans 4294970028 rc 0/0 00000100:00100000:1.0:1715330446.308552:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 162 00002000:00100000:1.0:1715330446.308564:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (310378496->314572799) req@ffff88008d777480 x1798653938147520/t4294970028(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:657/0 lens 488/448 e 0 to 0 dl 1715330457 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330446.308573:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d777480 with x1798653938147520 ext(310378496->314572799) 00002000:00010000:1.0:1715330446.308579:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d777480 00000100:00100000:2.0:1715330446.321203:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330446.321273:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938147648 00000100:00100000:1.0:1715330446.321281:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938147648 00002000:00100000:1.0:1715330446.321328:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (314572800->318767103) req@ffff88008d774000 x1798653938147648/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:657/0 lens 488/0 e 0 to 0 dl 1715330457 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330446.321338:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d774000 with x1798653938147648 ext(314572800->318767103) 00002000:00010000:1.0:1715330446.321345:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d774000 00000100:00100000:1.0:1715330446.321381:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 163 00000100:00100000:1.0:1715330446.321387:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d774000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+13:2014:x1798653938147648:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330446.338246:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330446.338281:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330446.338312:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330446.338322:0:7130:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938147712 00000100:00100000:2.0:1715330446.338333:0:7130:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938147712 00000100:00100000:3.0:1715330446.338351:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00080000:3.0:1715330446.338365:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330416 00000100:00100000:1.0:1715330446.338426:0:17198:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938147904 00000100:00100000:1.0:1715330446.338430:0:17198:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938147904 00000100:00100000:1.0:1715330446.338462:0:17198:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 344 00000100:00100000:1.0:1715330446.338467:0:17198:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:72de1896-1df4-4b3a-930a-9116d2c66168+6:2012:x1798653938147904:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:1.0:1715330446.339117:0:17198:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:72de1896-1df4-4b3a-930a-9116d2c66168+6:2012:x1798653938147904:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 647us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330446.339124:0:17198:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 344 00000100:00080000:3.0:1715330446.339125:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330416 00000100:00100000:2.0:1715330446.339129:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 392 00000100:00100000:2.0:1715330446.339134:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2011:x1798653938147712:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:1.0:1715330446.339154:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938147776 00000100:00100000:1.0:1715330446.339157:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938147776 00000100:00100000:2.0:1715330446.339161:0:7130:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2011:x1798653938147712:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 27us (880us total) trans 0 rc 0/0 00000100:00080000:3.0:1715330446.339171:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330416 00000100:00100000:1.0:1715330446.339183:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938147840 00000100:00100000:1.0:1715330446.339186:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938147840 00000100:00100000:1.0:1715330446.339207:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 484 00000100:00100000:1.0:1715330446.339211:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:2012:x1798653938147776:12345-192.168.204.49@tcp:400:kworker.0 00000100:00080000:3.0:1715330446.339225:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330416 00000100:00100000:0.0:1715330446.339232:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 485 00000100:00100000:1.0:1715330446.339237:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:2012:x1798653938147776:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 25us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330446.339238:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+6:2011:x1798653938147840:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:1.0:1715330446.339243:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 484 00000100:00100000:1.0:1715330446.339302:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72de1896-1df4-4b3a-930a-9116d2c66168+6:2011:x1798653938147840:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 63us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330446.339307:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 485 00000100:00100000:2.0:1715330446.340002:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 392 00000100:00100000:1.0:1715330446.353466:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d774000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+15:2014:x1798653938147648:12345-192.168.204.49@tcp:4:dd.0 Request processed in 32066us (32258us total) trans 4294970029 rc 0/0 00000100:00100000:1.0:1715330446.353481:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 163 00002000:00100000:1.0:1715330446.353495:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (314572800->318767103) req@ffff88008d774000 x1798653938147648/t4294970029(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:657/0 lens 488/448 e 0 to 0 dl 1715330457 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330446.353504:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d774000 with x1798653938147648 ext(314572800->318767103) 00002000:00010000:1.0:1715330446.353511:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d774000 00000100:00100000:3.0:1715330446.369224:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330446.369294:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938148032 00000100:00100000:1.0:1715330446.369302:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938148032 00002000:00100000:1.0:1715330446.369342:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (318767104->322961407) req@ffff880091d57480 x1798653938148032/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:657/0 lens 488/0 e 0 to 0 dl 1715330457 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330446.369351:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d57480 with x1798653938148032 ext(318767104->322961407) 00002000:00010000:1.0:1715330446.369356:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d57480 00000100:00100000:1.0:1715330446.371667:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 164 00000100:00100000:1.0:1715330446.371681:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+15:2014:x1798653938148032:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330446.409231:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+17:2014:x1798653938148032:12345-192.168.204.49@tcp:4:dd.0 Request processed in 37545us (40007us total) trans 4294970030 rc 0/0 00000100:00100000:1.0:1715330446.409246:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 164 00002000:00100000:1.0:1715330446.409258:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (318767104->322961407) req@ffff880091d57480 x1798653938148032/t4294970030(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:657/0 lens 488/448 e 0 to 0 dl 1715330457 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330446.409268:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d57480 with x1798653938148032 ext(318767104->322961407) 00002000:00010000:1.0:1715330446.409274:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d57480 00000100:00100000:0.0:1715330446.418722:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330446.418788:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938148160 00000100:00100000:1.0:1715330446.418797:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938148160 00002000:00100000:1.0:1715330446.418836:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (322961408->327155711) req@ffff88012b55ed80 x1798653938148160/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:657/0 lens 488/0 e 0 to 0 dl 1715330457 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330446.418845:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b55ed80 with x1798653938148160 ext(322961408->327155711) 00002000:00010000:1.0:1715330446.418849:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b55ed80 00000100:00100000:1.0:1715330446.418878:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 165 00000100:00100000:1.0:1715330446.418883:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+17:2014:x1798653938148160:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330446.443901:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330446.445542:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938148288 00000100:00100000:0.0:1715330446.445554:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938148288 00002000:00100000:0.0:1715330446.445934:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (327155712->331350015) req@ffff880091d57800 x1798653938148288/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:657/0 lens 488/0 e 0 to 0 dl 1715330457 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330446.445944:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d57800 with x1798653938148288 ext(327155712->331350015) 00002000:00010000:0.0:1715330446.445950:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d57800 00000100:00100000:0.0:1715330446.445993:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 166 00000100:00100000:0.0:1715330446.445999:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+19:2013:x1798653938148288:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330446.460952:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+21:2014:x1798653938148160:12345-192.168.204.49@tcp:4:dd.0 Request processed in 42056us (42225us total) trans 4294970031 rc 0/0 00000100:00100000:3.0:1715330446.460964:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 165 00002000:00100000:3.0:1715330446.460975:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (322961408->327155711) req@ffff88012b55ed80 x1798653938148160/t4294970031(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:657/0 lens 488/448 e 0 to 0 dl 1715330457 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330446.460982:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b55ed80 with x1798653938148160 ext(322961408->327155711) 00002000:00010000:3.0:1715330446.460987:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b55ed80 00000100:00100000:1.0:1715330446.480277:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+21:2013:x1798653938148288:12345-192.168.204.49@tcp:4:dd.0 Request processed in 34266us (36375us total) trans 4294970032 rc 0/0 00000100:00100000:1.0:1715330446.480292:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 166 00002000:00100000:1.0:1715330446.480315:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (327155712->331350015) req@ffff880091d57800 x1798653938148288/t4294970032(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:657/0 lens 488/448 e 0 to 0 dl 1715330457 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330446.480325:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d57800 with x1798653938148288 ext(327155712->331350015) 00002000:00010000:1.0:1715330446.480332:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d57800 00000100:00100000:0.0:1715330446.487240:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330446.487317:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938148416 00000100:00100000:1.0:1715330446.487326:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938148416 00002000:00100000:1.0:1715330446.487367:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (331350016->335544319) req@ffff88012b55d880 x1798653938148416/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:657/0 lens 488/0 e 0 to 0 dl 1715330457 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330446.487383:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b55d880 with x1798653938148416 ext(331350016->335544319) 00002000:00010000:1.0:1715330446.487388:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b55d880 00000100:00100000:1.0:1715330446.487413:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 167 00000100:00100000:1.0:1715330446.487418:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+21:2013:x1798653938148416:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330446.532179:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+23:2013:x1798653938148416:12345-192.168.204.49@tcp:4:dd.0 Request processed in 44748us (44939us total) trans 4294970033 rc 0/0 00000100:00100000:0.0:1715330446.532192:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 167 00002000:00100000:0.0:1715330446.532205:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (331350016->335544319) req@ffff88012b55d880 x1798653938148416/t4294970033(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:657/0 lens 488/448 e 0 to 0 dl 1715330457 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330446.532214:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b55d880 with x1798653938148416 ext(331350016->335544319) 00002000:00010000:0.0:1715330446.532219:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b55d880 00000100:00100000:0.0:1715330446.534834:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330446.535047:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938148544 00000100:00100000:2.0:1715330446.535055:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938148544 00002000:00100000:2.0:1715330446.535091:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (335544320->339738623) req@ffff880093680000 x1798653938148544/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:657/0 lens 488/0 e 0 to 0 dl 1715330457 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330446.535100:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093680000 with x1798653938148544 ext(335544320->339738623) 00002000:00010000:2.0:1715330446.535104:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093680000 00000100:00100000:2.0:1715330446.535132:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 168 00000100:00100000:2.0:1715330446.535137:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+23:2014:x1798653938148544:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330446.573185:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+25:2014:x1798653938148544:12345-192.168.204.49@tcp:4:dd.0 Request processed in 38037us (38349us total) trans 4294970034 rc 0/0 00000100:00100000:2.0:1715330446.573199:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 168 00002000:00100000:2.0:1715330446.573212:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (335544320->339738623) req@ffff880093680000 x1798653938148544/t4294970034(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:657/0 lens 488/448 e 0 to 0 dl 1715330457 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330446.573222:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093680000 with x1798653938148544 ext(335544320->339738623) 00002000:00010000:2.0:1715330446.573229:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093680000 00000100:00100000:0.0:1715330446.590070:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330446.590160:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938148672 00000100:00100000:2.0:1715330446.590169:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938148672 00002000:00100000:2.0:1715330446.590207:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (339738624->343932927) req@ffff880093680380 x1798653938148672/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:657/0 lens 488/0 e 0 to 0 dl 1715330457 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330446.590216:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093680380 with x1798653938148672 ext(339738624->343932927) 00002000:00010000:2.0:1715330446.590222:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093680380 00000100:00100000:2.0:1715330446.590256:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 169 00000100:00100000:2.0:1715330446.590262:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+25:2013:x1798653938148672:12345-192.168.204.49@tcp:4:dd.0 00010000:00010000:1.0:1715330446.616422:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330446.632031:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+27:2013:x1798653938148672:12345-192.168.204.49@tcp:4:dd.0 Request processed in 41759us (41960us total) trans 4294970035 rc 0/0 00000100:00100000:2.0:1715330446.632045:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 169 00002000:00100000:2.0:1715330446.632057:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (339738624->343932927) req@ffff880093680380 x1798653938148672/t4294970035(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:657/0 lens 488/448 e 0 to 0 dl 1715330457 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330446.632066:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093680380 with x1798653938148672 ext(339738624->343932927) 00002000:00010000:2.0:1715330446.632071:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093680380 00000100:00100000:1.0:1715330446.632115:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330446.632264:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938148800 00000100:00100000:2.0:1715330446.632273:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938148800 00002000:00100000:2.0:1715330446.632297:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (343932928->348127231) req@ffff8800969ba300 x1798653938148800/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:657/0 lens 488/0 e 0 to 0 dl 1715330457 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330446.632304:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800969ba300 with x1798653938148800 ext(343932928->348127231) 00002000:00010000:2.0:1715330446.632307:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800969ba300 00000100:00100000:2.0:1715330446.632332:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 170 00000100:00100000:2.0:1715330446.632337:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800969ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+27:2012:x1798653938148800:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330446.668571:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800969ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+29:2012:x1798653938148800:12345-192.168.204.49@tcp:4:dd.0 Request processed in 36221us (36445us total) trans 4294970036 rc 0/0 00000100:00100000:2.0:1715330446.668586:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 170 00002000:00100000:2.0:1715330446.668598:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (343932928->348127231) req@ffff8800969ba300 x1798653938148800/t4294970036(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:657/0 lens 488/448 e 0 to 0 dl 1715330457 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330446.668607:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800969ba300 with x1798653938148800 ext(343932928->348127231) 00002000:00010000:2.0:1715330446.668612:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800969ba300 00000100:00100000:0.0:1715330446.677674:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330446.677769:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938148928 00000100:00100000:2.0:1715330446.677779:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938148928 00002000:00100000:2.0:1715330446.677820:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (348127232->352321535) req@ffff880093680700 x1798653938148928/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:657/0 lens 488/0 e 0 to 0 dl 1715330457 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330446.677829:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093680700 with x1798653938148928 ext(348127232->352321535) 00002000:00010000:2.0:1715330446.677834:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093680700 00000100:00100000:2.0:1715330446.677863:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 171 00000100:00100000:2.0:1715330446.677870:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+29:2012:x1798653938148928:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330446.722309:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+31:2012:x1798653938148928:12345-192.168.204.49@tcp:4:dd.0 Request processed in 44424us (44629us total) trans 4294970037 rc 0/0 00000100:00100000:3.0:1715330446.722328:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 171 00002000:00100000:3.0:1715330446.722346:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (348127232->352321535) req@ffff880093680700 x1798653938148928/t4294970037(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:657/0 lens 488/448 e 0 to 0 dl 1715330457 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330446.722356:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093680700 with x1798653938148928 ext(348127232->352321535) 00002000:00010000:3.0:1715330446.722363:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093680700 00000100:00100000:0.0:1715330446.726504:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330446.726664:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938149056 00000100:00100000:3.0:1715330446.726680:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938149056 00002000:00100000:3.0:1715330446.726773:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (352321536->356515839) req@ffff880093680a80 x1798653938149056/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:657/0 lens 488/0 e 0 to 0 dl 1715330457 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330446.726785:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093680a80 with x1798653938149056 ext(352321536->356515839) 00002000:00010000:3.0:1715330446.726794:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093680a80 00000100:00100000:3.0:1715330446.726862:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 172 00000100:00100000:3.0:1715330446.726871:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+31:2011:x1798653938149056:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330446.773171:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330446.775699:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938149184 00000100:00100000:2.0:1715330446.775711:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938149184 00002000:00100000:2.0:1715330446.775794:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (356515840->360710143) req@ffff880093680e00 x1798653938149184/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:657/0 lens 488/0 e 0 to 0 dl 1715330457 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330446.775804:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093680e00 with x1798653938149184 ext(356515840->360710143) 00002000:00010000:2.0:1715330446.775809:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093680e00 00000100:00100000:2.0:1715330446.775841:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 173 00000100:00100000:2.0:1715330446.775847:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+35:2011:x1798653938149184:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330446.778923:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+35:2011:x1798653938149056:12345-192.168.204.49@tcp:4:dd.0 Request processed in 52042us (52427us total) trans 4294970038 rc 0/0 00000100:00100000:3.0:1715330446.778935:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 172 00002000:00100000:3.0:1715330446.778949:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (352321536->356515839) req@ffff880093680a80 x1798653938149056/t4294970038(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:657/0 lens 488/448 e 0 to 0 dl 1715330457 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330446.778957:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093680a80 with x1798653938149056 ext(352321536->356515839) 00002000:00010000:3.0:1715330446.778962:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093680a80 00000100:00100000:0.0:1715330446.819130:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942548992:0@lo:400:kworker.0 00000100:00100000:0.0:1715330446.819212:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330446.819235:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3689:1798653942549248:0@lo:400:kworker.0 00000100:00100000:0.0:1715330446.819258:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330446.819295:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093681180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3691:1798653942548864:0@lo:400:kworker.0 00000100:00100000:3.0:1715330446.819326:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330446.819341:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942549120:0@lo:400:kworker.0 00000100:00100000:3.0:1715330446.819357:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330446.819367:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942549376:0@lo:400:kworker.0 00000100:00100000:3.0:1715330446.819388:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330446.819975:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3690:1798653942549056:0@lo:400:kworker.0 00000100:00100000:2.0:1715330446.820005:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3688:1798653942548928:0@lo:400:kworker.0 00000100:00100000:1.0:1715330446.821136:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942548992 00000100:00100000:1.0:1715330446.821146:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942548992 00000100:00100000:1.0:1715330446.821189:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942549120 00000100:00100000:1.0:1715330446.821192:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942549120 00000100:00100000:1.0:1715330446.821209:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3150 00000100:00100000:1.0:1715330446.821216:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a104000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3689:x1798653942548992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330446.821298:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a104000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3689:x1798653942548992:12345-0@lo:400:kworker.0 Request processed in 80us (2085us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330446.821305:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3150 00000100:00100000:1.0:1715330446.821322:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3151 00000100:00100000:1.0:1715330446.821326:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942549120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330446.821348:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942549120:12345-0@lo:400:kworker.0 Request processed in 22us (1991us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330446.821353:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3151 00000100:00100000:1.0:1715330446.821399:0:7130:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942548864 00000100:00100000:1.0:1715330446.821403:0:7130:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942548864 00000100:00100000:1.0:1715330446.821431:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1715330446.821434:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3691:x1798653942548864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330446.821458:0:7130:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3691:x1798653942548864:12345-0@lo:400:kworker.0 Request processed in 22us (2131us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330446.821463:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00080000:1.0:1715330446.821492:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330416 00000100:00100000:3.0:1715330446.821601:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942549632:0@lo:400:kworker.0 00000100:00100000:3.0:1715330446.821627:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330446.821664:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093681180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3691:1798653942548864:0@lo:400:kworker.0 00000100:00100000:3.0:1715330446.821678:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942549120:0@lo:400:kworker.0 00000100:00100000:3.0:1715330446.821705:0:17198:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942549376 00000100:00100000:3.0:1715330446.821708:0:17198:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942549376 00000100:00100000:3.0:1715330446.821747:0:17198:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942549632 00000100:00100000:3.0:1715330446.821750:0:17198:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942549632 00000100:00100000:3.0:1715330446.821768:0:17198:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1715330446.821773:0:17198:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a7ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942549376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330446.821802:0:17198:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a7ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942549376:12345-0@lo:400:kworker.0 Request processed in 29us (2413us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330446.821808:0:17198:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1715330446.821817:0:17198:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1715330446.821820:0:17198:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a7ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942549632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330446.821838:0:17198:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a7ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942549632:12345-0@lo:400:kworker.0 Request processed in 17us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330446.821842:0:17198:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1715330446.821868:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942549376:0@lo:400:kworker.0 00000100:00100000:3.0:1715330446.821878:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942549632:0@lo:400:kworker.0 00000100:00100000:0.0:1715330446.822176:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330446.822198:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3689:1798653942549504:0@lo:400:kworker.0 00000100:00100000:0.0:1715330446.822223:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1715330446.822297:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330416 00000100:00100000:1.0:1715330446.822333:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938149312 00000100:00100000:1.0:1715330446.822336:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938149312 00002000:00100000:1.0:1715330446.822359:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (360710144->364904447) req@ffff88008a104700 x1798653938149312/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:657/0 lens 488/0 e 0 to 0 dl 1715330457 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330446.822370:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a104700 with x1798653938149312 ext(360710144->364904447) 00002000:00010000:1.0:1715330446.822375:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a104700 00000100:00100000:1.0:1715330446.822391:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 174 00000100:00100000:1.0:1715330446.822394:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a104700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+35:2012:x1798653938149312:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330446.824607:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942548992:0@lo:400:kworker.0 00000100:00100000:0.0:1715330446.824658:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330446.824672:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942549248 00000100:00100000:2.0:1715330446.824672:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942549504 00000100:00100000:3.0:1715330446.824678:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942549248 00000100:00100000:2.0:1715330446.824678:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942549504 00000100:00100000:2.0:1715330446.824746:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942548928 00000100:00100000:2.0:1715330446.824749:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942548928 00000100:00100000:0.0:1715330446.824760:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3688:1798653942549184:0@lo:400:kworker.0 00000100:00100000:2.0:1715330446.824765:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 486 00000100:00100000:2.0:1715330446.824771:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a104a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3689:x1798653942549504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330446.824812:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330446.824822:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a104a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3689:x1798653942549504:12345-0@lo:400:kworker.0 Request processed in 50us (2597us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330446.824822:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3688:1798653942549440:0@lo:400:kworker.0 00000100:00100000:2.0:1715330446.824827:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 486 00000100:00100000:0.0:1715330446.824837:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330446.824840:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942549184 00000100:00100000:2.0:1715330446.824841:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942549184 00000100:00100000:2.0:1715330446.824849:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942549440 00000100:00100000:2.0:1715330446.824851:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942549440 00000100:00100000:0.0:1715330446.824852:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330446.824857:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942549056 00000100:00100000:2.0:1715330446.824859:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942549056 00000100:00100000:0.0:1715330446.824862:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942549312:0@lo:400:kworker.0 00000100:00100000:2.0:1715330446.824867:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 487 00000100:00100000:2.0:1715330446.824870:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a104380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1798653942549248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330446.824882:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330446.824891:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942549568:0@lo:400:kworker.0 00000100:00100000:0.0:1715330446.824905:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330446.824922:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942549312 00000100:00100000:0.0:1715330446.824925:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942549312 00000100:00100000:0.0:1715330446.824939:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942549568 00000100:00100000:0.0:1715330446.824941:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942549568 00000100:00100000:0.0:1715330446.824952:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1715330446.824955:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a105c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942549312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330446.824980:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a105c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942549312:12345-0@lo:400:kworker.0 Request processed in 24us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330446.824985:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1715330446.824994:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1715330446.824997:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a105f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942549568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330446.825016:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a105f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942549568:12345-0@lo:400:kworker.0 Request processed in 18us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330446.825020:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1715330446.825040:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942549312:0@lo:400:kworker.0 00000100:00100000:0.0:1715330446.825047:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942549568:0@lo:400:kworker.0 00000100:00100000:0.0:1715330446.825065:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3689:1798653942549504:0@lo:400:kworker.0 00000100:00100000:0.0:1715330446.825099:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00000100:00100000:0.0:1715330446.825103:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a104e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3688:x1798653942548928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330446.825131:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a104e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3688:x1798653942548928:12345-0@lo:400:kworker.0 Request processed in 28us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330446.825137:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00000100:00100000:0.0:1715330446.825148:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 489 00000100:00100000:0.0:1715330446.825151:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a105180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1798653942549184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330446.825169:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a105180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1798653942549184:12345-0@lo:400:kworker.0 Request processed in 17us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330446.825173:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 489 00000100:00100000:0.0:1715330446.825180:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00000100:00100000:0.0:1715330446.825183:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a105500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3688:x1798653942549440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330446.825199:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a105500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3688:x1798653942549440:12345-0@lo:400:kworker.0 Request processed in 14us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330446.825202:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00000100:00100000:0.0:1715330446.825209:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491 00000100:00100000:0.0:1715330446.825212:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a105880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3690:x1798653942549056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330446.825232:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a105880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3690:x1798653942549056:12345-0@lo:400:kworker.0 Request processed in 19us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330446.825236:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491 00000100:00100000:0.0:1715330446.825262:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3688:1798653942548928:0@lo:400:kworker.0 00000100:00100000:0.0:1715330446.825270:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3688:1798653942549184:0@lo:400:kworker.0 00000100:00100000:0.0:1715330446.825277:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3688:1798653942549440:0@lo:400:kworker.0 00000100:00100000:0.0:1715330446.825296:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3690:1798653942549056:0@lo:400:kworker.0 00000100:00080000:3.0:1715330446.825386:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330416 00000100:00080000:3.0:1715330446.825389:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330416 00000100:00080000:3.0:1715330446.825391:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330416 00000100:00100000:2.0:1715330446.825466:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a104380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1798653942549248:12345-0@lo:400:kworker.0 Request processed in 593us (6206us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330446.825471:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 487 00000100:00100000:0.0:1715330446.825472:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3689:1798653942549248:0@lo:400:kworker.0 00000100:00100000:2.0:1715330446.825764:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+36:2011:x1798653938149184:12345-192.168.204.49@tcp:4:dd.0 Request processed in 49913us (52606us total) trans 4294970039 rc 0/0 00000100:00100000:2.0:1715330446.825773:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 173 00002000:00100000:2.0:1715330446.825785:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (356515840->360710143) req@ffff880093680e00 x1798653938149184/t4294970039(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:657/0 lens 488/448 e 0 to 0 dl 1715330457 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330446.825794:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093680e00 with x1798653938149184 ext(356515840->360710143) 00002000:00010000:2.0:1715330446.825801:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093680e00 00000100:00100000:3.0:1715330446.878629:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a104700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+37:2012:x1798653938149312:12345-192.168.204.49@tcp:4:dd.0 Request processed in 56219us (56440us total) trans 4294970040 rc 0/0 00000100:00100000:3.0:1715330446.878657:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 174 00002000:00100000:3.0:1715330446.878673:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (360710144->364904447) req@ffff88008a104700 x1798653938149312/t4294970040(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:657/0 lens 488/448 e 0 to 0 dl 1715330457 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330446.878683:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a104700 with x1798653938149312 ext(360710144->364904447) 00002000:00010000:3.0:1715330446.878690:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a104700 00000100:00100000:0.0:1715330446.883802:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1715330446.883824:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008a106300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942549696:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1715330446.883883:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330446.883917:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942549696 00000100:00100000:0.0:1715330446.883923:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942549696 00000100:00100000:0.0:1715330446.883966:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1715330446.883974:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a106680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942549696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1715330446.884000:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 172032 granted 317126336 pending 0 free 3923546112 avail 3692023808 00000100:00100000:0.0:1715330446.884035:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a106680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942549696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330446.884040:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1715330446.884076:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008a106300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942549696:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1715330446.886494:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800969ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942549760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1715330446.886562:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330446.887506:0:9400:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942549760 00000100:00100000:3.0:1715330446.887514:0:9400:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942549760 00000100:00100000:3.0:1715330446.887556:0:9400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1715330446.887561:0:9400:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a639b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942549760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1715330446.887582:0:9400:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 172032 granted 317126336 pending 0 free 3923546112 avail 3692023808 00000100:00100000:3.0:1715330446.890196:0:9400:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a639b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942549760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2625us (3624us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330446.890211:0:9400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1715330446.890681:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800969ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942549760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1715330446.899221:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330446.899697:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938149440 00000100:00100000:3.0:1715330446.899707:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938149440 00002000:00100000:3.0:1715330446.899761:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (364904448->369098751) req@ffff8800969baa00 x1798653938149440/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:657/0 lens 488/0 e 0 to 0 dl 1715330457 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330446.899771:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800969baa00 with x1798653938149440 ext(364904448->369098751) 00002000:00010000:3.0:1715330446.899776:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800969baa00 00000100:00100000:2.0:1715330446.901586:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 175 00000100:00100000:2.0:1715330446.901596:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800969baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+37:2011:x1798653938149440:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330446.957826:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800969baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+39:2011:x1798653938149440:12345-192.168.204.49@tcp:4:dd.0 Request processed in 56218us (58603us total) trans 4294970041 rc 0/0 00000100:00100000:2.0:1715330446.957840:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 175 00002000:00100000:2.0:1715330446.957851:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (364904448->369098751) req@ffff8800969baa00 x1798653938149440/t4294970041(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:657/0 lens 488/448 e 0 to 0 dl 1715330457 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330446.957861:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800969baa00 with x1798653938149440 ext(364904448->369098751) 00002000:00010000:2.0:1715330446.957866:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800969baa00 00000100:00100000:1.0:1715330446.965361:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330446.966308:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938149568 00000100:00100000:2.0:1715330446.966317:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938149568 00002000:00100000:2.0:1715330446.966353:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (369098752->373293055) req@ffff8800969bad80 x1798653938149568/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:657/0 lens 488/0 e 0 to 0 dl 1715330457 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330446.966362:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800969bad80 with x1798653938149568 ext(369098752->373293055) 00002000:00010000:2.0:1715330446.966367:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800969bad80 00000100:00100000:2.0:1715330446.966399:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 176 00000100:00100000:2.0:1715330446.966405:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800969bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+39:2013:x1798653938149568:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330447.029174:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330447.029948:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938149696 00000100:00100000:3.0:1715330447.029956:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938149696 00002000:00100000:3.0:1715330447.033155:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (373293056->377487359) req@ffff8800969bb100 x1798653938149696/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:658/0 lens 488/0 e 0 to 0 dl 1715330458 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330447.033166:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800969bb100 with x1798653938149696 ext(373293056->377487359) 00002000:00010000:3.0:1715330447.033173:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800969bb100 00000100:00100000:3.0:1715330447.033219:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 177 00000100:00100000:3.0:1715330447.033226:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800969bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+43:2014:x1798653938149696:12345-192.168.204.49@tcp:4:dd.0 00000100:00080000:0.0:1715330447.036521:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330417 00000100:00100000:2.0:1715330447.036901:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800969bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+43:2013:x1798653938149568:12345-192.168.204.49@tcp:4:dd.0 Request processed in 70486us (71539us total) trans 4294970042 rc 0/0 00000100:00100000:2.0:1715330447.036916:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 176 00002000:00100000:2.0:1715330447.036934:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (369098752->373293055) req@ffff8800969bad80 x1798653938149568/t4294970042(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:657/0 lens 488/448 e 0 to 0 dl 1715330457 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330447.036943:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800969bad80 with x1798653938149568 ext(369098752->373293055) 00002000:00010000:2.0:1715330447.036950:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800969bad80 00000100:00100000:3.0:1715330447.080311:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800969bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+43:2014:x1798653938149696:12345-192.168.204.49@tcp:4:dd.0 Request processed in 47064us (51122us total) trans 4294970043 rc 0/0 00000100:00100000:3.0:1715330447.080329:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 177 00002000:00100000:3.0:1715330447.080346:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (373293056->377487359) req@ffff8800969bb100 x1798653938149696/t4294970043(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:658/0 lens 488/448 e 0 to 0 dl 1715330458 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330447.080356:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800969bb100 with x1798653938149696 ext(373293056->377487359) 00002000:00010000:3.0:1715330447.080363:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800969bb100 00000100:00100000:1.0:1715330447.102390:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330447.102490:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938149824 00000100:00100000:3.0:1715330447.102499:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938149824 00002000:00100000:3.0:1715330447.102541:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (377487360->381681663) req@ffff8800969bb480 x1798653938149824/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:658/0 lens 488/0 e 0 to 0 dl 1715330458 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330447.102550:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800969bb480 with x1798653938149824 ext(377487360->381681663) 00002000:00010000:3.0:1715330447.102555:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800969bb480 00000100:00100000:2.0:1715330447.103726:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 178 00000100:00100000:2.0:1715330447.103748:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800969bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+43:2014:x1798653938149824:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330447.164139:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800969bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+45:2014:x1798653938149824:12345-192.168.204.49@tcp:4:dd.0 Request processed in 60382us (61746us total) trans 4294970044 rc 0/0 00000100:00100000:3.0:1715330447.164152:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 178 00002000:00100000:3.0:1715330447.164165:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (377487360->381681663) req@ffff8800969bb480 x1798653938149824/t4294970044(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:658/0 lens 488/448 e 0 to 0 dl 1715330458 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330447.164175:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800969bb480 with x1798653938149824 ext(377487360->381681663) 00002000:00010000:3.0:1715330447.164182:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800969bb480 00000100:00100000:1.0:1715330447.192564:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330447.192668:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938149952 00000100:00100000:3.0:1715330447.192678:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938149952 00002000:00100000:3.0:1715330447.192721:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (381681664->385875967) req@ffff8800969bb800 x1798653938149952/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:658/0 lens 488/0 e 0 to 0 dl 1715330458 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330447.192752:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800969bb800 with x1798653938149952 ext(381681664->385875967) 00002000:00010000:3.0:1715330447.192758:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800969bb800 00000100:00100000:0.0:1715330447.193913:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 179 00000100:00100000:0.0:1715330447.193922:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800969bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+45:2013:x1798653938149952:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330447.239679:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800969bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+47:2013:x1798653938149952:12345-192.168.204.49@tcp:4:dd.0 Request processed in 45740us (47105us total) trans 4294970045 rc 0/0 00000100:00100000:1.0:1715330447.239696:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 179 00002000:00100000:1.0:1715330447.239712:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (381681664->385875967) req@ffff8800969bb800 x1798653938149952/t4294970045(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:658/0 lens 488/448 e 0 to 0 dl 1715330458 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330447.239722:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800969bb800 with x1798653938149952 ext(381681664->385875967) 00002000:00010000:1.0:1715330447.239742:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800969bb800 00000100:00100000:1.0:1715330447.295646:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330447.297534:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938150080 00000100:00100000:2.0:1715330447.297545:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938150080 00002000:00100000:2.0:1715330447.297581:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (385875968->390070271) req@ffff8800969bbb80 x1798653938150080/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:658/0 lens 488/0 e 0 to 0 dl 1715330458 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330447.297591:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800969bbb80 with x1798653938150080 ext(385875968->390070271) 00002000:00010000:2.0:1715330447.297596:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800969bbb80 00000100:00100000:2.0:1715330447.297626:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 180 00000100:00100000:2.0:1715330447.297631:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800969bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+47:2014:x1798653938150080:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330447.354512:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800969bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+49:2014:x1798653938150080:12345-192.168.204.49@tcp:4:dd.0 Request processed in 56870us (58872us total) trans 4294970046 rc 0/0 00000100:00100000:3.0:1715330447.354526:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 180 00002000:00100000:3.0:1715330447.354539:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (385875968->390070271) req@ffff8800969bbb80 x1798653938150080/t4294970046(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:658/0 lens 488/448 e 0 to 0 dl 1715330458 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330447.354549:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800969bbb80 with x1798653938150080 ext(385875968->390070271) 00002000:00010000:3.0:1715330447.354554:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800969bbb80 00000100:00100000:0.0:1715330447.364880:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330447.364993:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938150208 00000100:00100000:3.0:1715330447.365003:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938150208 00002000:00100000:3.0:1715330447.365048:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (390070272->394264575) req@ffff88008a106300 x1798653938150208/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:658/0 lens 488/0 e 0 to 0 dl 1715330458 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330447.365058:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a106300 with x1798653938150208 ext(390070272->394264575) 00002000:00010000:3.0:1715330447.365064:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a106300 00000100:00100000:3.0:1715330447.366022:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 181 00000100:00100000:3.0:1715330447.366029:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a106300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+49:2014:x1798653938150208:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330447.404120:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a106300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+51:2014:x1798653938150208:12345-192.168.204.49@tcp:4:dd.0 Request processed in 38078us (39235us total) trans 4294970047 rc 0/0 00000100:00100000:3.0:1715330447.404134:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 181 00002000:00100000:3.0:1715330447.404147:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (390070272->394264575) req@ffff88008a106300 x1798653938150208/t4294970047(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:658/0 lens 488/448 e 0 to 0 dl 1715330458 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330447.404155:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a106300 with x1798653938150208 ext(390070272->394264575) 00002000:00010000:3.0:1715330447.404160:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a106300 00000100:00100000:0.0:1715330447.424386:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330447.424507:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938150336 00000100:00100000:3.0:1715330447.424517:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938150336 00002000:00100000:3.0:1715330447.424576:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (394264576->398458879) req@ffff88008a106a00 x1798653938150336/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:658/0 lens 488/0 e 0 to 0 dl 1715330458 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330447.424587:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a106a00 with x1798653938150336 ext(394264576->398458879) 00002000:00010000:3.0:1715330447.424591:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a106a00 00000100:00100000:3.0:1715330447.424609:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 182 00000100:00100000:3.0:1715330447.424615:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a106a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+51:2014:x1798653938150336:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330447.479810:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a106a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+53:2014:x1798653938150336:12345-192.168.204.49@tcp:4:dd.0 Request processed in 55182us (55423us total) trans 4294970048 rc 0/0 00000100:00100000:2.0:1715330447.479824:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 182 00002000:00100000:2.0:1715330447.479836:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (394264576->398458879) req@ffff88008a106a00 x1798653938150336/t4294970048(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:658/0 lens 488/448 e 0 to 0 dl 1715330458 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330447.479846:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a106a00 with x1798653938150336 ext(394264576->398458879) 00002000:00010000:2.0:1715330447.479852:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a106a00 00000100:00100000:0.0:1715330447.515680:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330447.518953:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938150464 00000100:00100000:2.0:1715330447.518968:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938150464 00002000:00100000:2.0:1715330447.519023:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (398458880->402653183) req@ffff88008a106d80 x1798653938150464/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:658/0 lens 488/0 e 0 to 0 dl 1715330458 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330447.519034:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a106d80 with x1798653938150464 ext(398458880->402653183) 00002000:00010000:2.0:1715330447.519040:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a106d80 00000100:00100000:2.0:1715330447.519096:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 183 00000100:00100000:2.0:1715330447.519104:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a106d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+53:2012:x1798653938150464:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330447.563288:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330447.563463:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938150592 00000100:00100000:1.0:1715330447.563476:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938150592 00002000:00100000:1.0:1715330447.563538:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (402653184->406847487) req@ffff88008a107100 x1798653938150592/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:658/0 lens 488/0 e 0 to 0 dl 1715330458 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330447.563550:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a107100 with x1798653938150592 ext(402653184->406847487) 00002000:00010000:1.0:1715330447.563630:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a107100 00000100:00100000:1.0:1715330447.563679:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 184 00000100:00100000:1.0:1715330447.563687:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a107100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+57:2011:x1798653938150592:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330447.564070:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a106d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+56:2012:x1798653938150464:12345-192.168.204.49@tcp:4:dd.0 Request processed in 44955us (48392us total) trans 4294970049 rc 0/0 00000100:00100000:3.0:1715330447.564083:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 183 00002000:00100000:3.0:1715330447.564100:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (398458880->402653183) req@ffff88008a106d80 x1798653938150464/t4294970049(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:658/0 lens 488/448 e 0 to 0 dl 1715330458 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330447.564110:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a106d80 with x1798653938150464 ext(398458880->402653183) 00002000:00010000:3.0:1715330447.564116:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a106d80 00000100:00100000:0.0:1715330447.612699:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330447.613909:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938150720 00000100:00100000:3.0:1715330447.613919:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938150720 00002000:00100000:3.0:1715330447.613966:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (406847488->411041791) req@ffff88008a107480 x1798653938150720/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:658/0 lens 488/0 e 0 to 0 dl 1715330458 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330447.613975:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a107480 with x1798653938150720 ext(406847488->411041791) 00002000:00010000:3.0:1715330447.613980:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a107480 00000100:00100000:3.0:1715330447.614772:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 185 00000100:00100000:3.0:1715330447.614781:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a107480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+57:2011:x1798653938150720:12345-192.168.204.49@tcp:4:dd.0 00010000:00010000:2.0:1715330447.618965:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330447.624884:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a107100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+59:2011:x1798653938150592:12345-192.168.204.49@tcp:4:dd.0 Request processed in 61182us (61596us total) trans 4294970050 rc 0/0 00000100:00100000:2.0:1715330447.624900:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 184 00002000:00100000:2.0:1715330447.624916:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (402653184->406847487) req@ffff88008a107100 x1798653938150592/t4294970050(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:658/0 lens 488/448 e 0 to 0 dl 1715330458 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330447.624926:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a107100 with x1798653938150592 ext(402653184->406847487) 00002000:00010000:2.0:1715330447.624934:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a107100 00000100:00100000:0.0:1715330447.669074:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a107480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+59:2011:x1798653938150720:12345-192.168.204.49@tcp:4:dd.0 Request processed in 54281us (56375us total) trans 4294970051 rc 0/0 00000100:00100000:0.0:1715330447.669090:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 185 00002000:00100000:0.0:1715330447.669102:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (406847488->411041791) req@ffff88008a107480 x1798653938150720/t4294970051(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:658/0 lens 488/448 e 0 to 0 dl 1715330458 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330447.669110:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a107480 with x1798653938150720 ext(406847488->411041791) 00002000:00010000:0.0:1715330447.669116:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a107480 00000100:00100000:1.0:1715330447.685201:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330447.685278:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938150848 00000100:00100000:0.0:1715330447.685289:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938150848 00002000:00100000:0.0:1715330447.685330:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (411041792->415236095) req@ffff8800969ba680 x1798653938150848/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:658/0 lens 488/0 e 0 to 0 dl 1715330458 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330447.685339:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800969ba680 with x1798653938150848 ext(411041792->415236095) 00002000:00010000:0.0:1715330447.685344:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800969ba680 00000100:00100000:0.0:1715330447.685409:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 186 00000100:00100000:0.0:1715330447.685415:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800969ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+59:2013:x1798653938150848:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330447.723135:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800969ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+61:2013:x1798653938150848:12345-192.168.204.49@tcp:4:dd.0 Request processed in 37702us (37929us total) trans 4294970052 rc 0/0 00000100:00100000:0.0:1715330447.723150:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 186 00002000:00100000:0.0:1715330447.723165:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (411041792->415236095) req@ffff8800969ba680 x1798653938150848/t4294970052(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:658/0 lens 488/448 e 0 to 0 dl 1715330458 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330447.723176:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800969ba680 with x1798653938150848 ext(411041792->415236095) 00002000:00010000:0.0:1715330447.723182:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800969ba680 00000100:00100000:2.0:1715330447.729247:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330447.729322:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938150976 00000100:00100000:0.0:1715330447.729332:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938150976 00002000:00100000:0.0:1715330447.729376:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (415236096->419430399) req@ffff88008d777b80 x1798653938150976/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:658/0 lens 488/0 e 0 to 0 dl 1715330458 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330447.729392:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d777b80 with x1798653938150976 ext(415236096->419430399) 00002000:00010000:0.0:1715330447.729398:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d777b80 00000100:00100000:0.0:1715330447.729429:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 187 00000100:00100000:0.0:1715330447.729435:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d777b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+61:2014:x1798653938150976:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330447.790363:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330447.790463:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938151104 00000100:00100000:2.0:1715330447.790470:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938151104 00002000:00100000:2.0:1715330447.790505:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (419430400->423624703) req@ffff880134565c00 x1798653938151104/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:658/0 lens 488/0 e 0 to 0 dl 1715330458 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330447.790515:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880134565c00 with x1798653938151104 ext(419430400->423624703) 00002000:00010000:2.0:1715330447.790521:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134565c00 00000100:00100000:2.0:1715330447.790550:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 188 00000100:00100000:2.0:1715330447.790555:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134565c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+65:2012:x1798653938151104:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330447.792842:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d777b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+64:2014:x1798653938150976:12345-192.168.204.49@tcp:4:dd.0 Request processed in 63394us (63593us total) trans 4294970053 rc 0/0 00000100:00100000:0.0:1715330447.792856:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 187 00002000:00100000:0.0:1715330447.793397:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (415236096->419430399) req@ffff88008d777b80 x1798653938150976/t4294970053(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:658/0 lens 488/448 e 0 to 0 dl 1715330458 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330447.793406:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d777b80 with x1798653938150976 ext(415236096->419430399) 00002000:00010000:0.0:1715330447.793412:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d777b80 00000100:00100000:1.0:1715330447.847297:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330447.847344:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938151232 00000100:00100000:0.0:1715330447.847354:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938151232 00002000:00100000:0.0:1715330447.847389:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (423624704->427819007) req@ffff880134565180 x1798653938151232/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:658/0 lens 488/0 e 0 to 0 dl 1715330458 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330447.847398:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880134565180 with x1798653938151232 ext(423624704->427819007) 00002000:00010000:0.0:1715330447.847403:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134565180 00000100:00100000:0.0:1715330447.847435:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 189 00000100:00100000:0.0:1715330447.847441:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134565180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+67:2011:x1798653938151232:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330447.853284:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134565c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+67:2012:x1798653938151104:12345-192.168.204.49@tcp:4:dd.0 Request processed in 62718us (62918us total) trans 4294970054 rc 0/0 00000100:00100000:2.0:1715330447.853301:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 188 00002000:00100000:2.0:1715330447.853312:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (419430400->423624703) req@ffff880134565c00 x1798653938151104/t4294970054(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:658/0 lens 488/448 e 0 to 0 dl 1715330458 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330447.853321:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880134565c00 with x1798653938151104 ext(419430400->423624703) 00002000:00010000:2.0:1715330447.853326:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134565c00 00000100:00100000:1.0:1715330447.904204:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880134565180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+67:2011:x1798653938151232:12345-192.168.204.49@tcp:4:dd.0 Request processed in 56748us (56905us total) trans 4294970055 rc 0/0 00000100:00100000:1.0:1715330447.904221:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 189 00002000:00100000:1.0:1715330447.904237:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (423624704->427819007) req@ffff880134565180 x1798653938151232/t4294970055(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:658/0 lens 488/448 e 0 to 0 dl 1715330458 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330447.904247:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880134565180 with x1798653938151232 ext(423624704->427819007) 00002000:00010000:1.0:1715330447.904253:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134565180 00000100:00100000:0.0:1715330447.904473:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330447.904680:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938151360 00000100:00100000:1.0:1715330447.904691:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938151360 00002000:00100000:1.0:1715330447.904723:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (427819008->432013311) req@ffff88008a107800 x1798653938151360/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:658/0 lens 488/0 e 0 to 0 dl 1715330458 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330447.904743:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a107800 with x1798653938151360 ext(427819008->432013311) 00002000:00010000:1.0:1715330447.904745:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a107800 00000100:00100000:1.0:1715330447.904768:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 190 00000100:00100000:1.0:1715330447.904775:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a107800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+67:2012:x1798653938151360:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330447.949805:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330447.949907:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938151488 00000100:00100000:2.0:1715330447.949917:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938151488 00002000:00100000:2.0:1715330447.949966:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (432013312->436207615) req@ffff88008a107b80 x1798653938151488/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:658/0 lens 488/0 e 0 to 0 dl 1715330458 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330447.949977:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a107b80 with x1798653938151488 ext(432013312->436207615) 00002000:00010000:2.0:1715330447.949982:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a107b80 00000100:00100000:2.0:1715330447.950005:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 191 00000100:00100000:2.0:1715330447.950013:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a107b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+69:2011:x1798653938151488:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330447.995064:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330447.995152:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938151616 00000100:00100000:0.0:1715330447.995164:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938151616 00002000:00100000:0.0:1715330447.995217:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (436207616->440401919) req@ffff88008a7ac700 x1798653938151616/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:658/0 lens 488/0 e 0 to 0 dl 1715330458 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330447.995229:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a7ac700 with x1798653938151616 ext(436207616->440401919) 00002000:00010000:0.0:1715330447.995235:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a7ac700 00000100:00100000:0.0:1715330447.995272:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 192 00000100:00100000:0.0:1715330447.995279:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a7ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+73:2014:x1798653938151616:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330448.008883:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a107800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+73:2012:x1798653938151360:12345-192.168.204.49@tcp:4:dd.0 Request processed in 104091us (104396us total) trans 4294970056 rc 0/0 00000100:00100000:2.0:1715330448.008899:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 190 00002000:00100000:2.0:1715330448.008912:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (427819008->432013311) req@ffff88008a107800 x1798653938151360/t4294970056(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:658/0 lens 488/448 e 0 to 0 dl 1715330458 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330448.008921:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a107800 with x1798653938151360 ext(427819008->432013311) 00002000:00010000:2.0:1715330448.008927:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a107800 00000100:00100000:2.0:1715330448.026972:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a107b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+73:2011:x1798653938151488:12345-192.168.204.49@tcp:4:dd.0 Request processed in 76950us (77172us total) trans 4294970057 rc 0/0 00000100:00100000:2.0:1715330448.026984:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 191 00002000:00100000:2.0:1715330448.026996:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (432013312->436207615) req@ffff88008a107b80 x1798653938151488/t4294970057(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:658/0 lens 488/448 e 0 to 0 dl 1715330458 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330448.027005:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a107b80 with x1798653938151488 ext(432013312->436207615) 00002000:00010000:2.0:1715330448.027010:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a107b80 00000100:00100000:1.0:1715330448.028790:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330448.028843:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938151744 00000100:00100000:2.0:1715330448.028850:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938151744 00002000:00100000:2.0:1715330448.028880:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (440401920->444596223) req@ffff88008d7b4000 x1798653938151744/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:659/0 lens 488/0 e 0 to 0 dl 1715330459 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330448.028889:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d7b4000 with x1798653938151744 ext(440401920->444596223) 00002000:00010000:2.0:1715330448.028893:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d7b4000 00000100:00100000:2.0:1715330448.028913:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 193 00000100:00100000:2.0:1715330448.028918:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+73:2013:x1798653938151744:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330448.057557:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a7ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+75:2014:x1798653938151616:12345-192.168.204.49@tcp:4:dd.0 Request processed in 62268us (62494us total) trans 4294970058 rc 0/0 00000100:00100000:3.0:1715330448.057571:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 192 00002000:00100000:3.0:1715330448.057583:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (436207616->440401919) req@ffff88008a7ac700 x1798653938151616/t4294970058(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:658/0 lens 488/448 e 0 to 0 dl 1715330458 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330448.057593:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a7ac700 with x1798653938151616 ext(436207616->440401919) 00002000:00010000:3.0:1715330448.057599:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a7ac700 00000100:00100000:2.0:1715330448.083098:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330448.087263:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938151872 00000100:00100000:3.0:1715330448.087276:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938151872 00002000:00100000:3.0:1715330448.087325:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (444596224->448790527) req@ffff88008d776d80 x1798653938151872/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:659/0 lens 488/0 e 0 to 0 dl 1715330459 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330448.087335:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d776d80 with x1798653938151872 ext(444596224->448790527) 00002000:00010000:3.0:1715330448.087340:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d776d80 00000100:00100000:3.0:1715330448.087952:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 194 00000100:00100000:3.0:1715330448.087960:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d776d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+77:2013:x1798653938151872:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330448.088118:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+76:2013:x1798653938151744:12345-192.168.204.49@tcp:4:dd.0 Request processed in 59197us (59332us total) trans 4294970059 rc 0/0 00000100:00100000:2.0:1715330448.088126:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 193 00002000:00100000:2.0:1715330448.088132:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (440401920->444596223) req@ffff88008d7b4000 x1798653938151744/t4294970059(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:659/0 lens 488/448 e 0 to 0 dl 1715330459 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330448.088139:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d7b4000 with x1798653938151744 ext(440401920->444596223) 00002000:00010000:2.0:1715330448.088143:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d7b4000 00000100:00100000:2.0:1715330448.139341:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330448.139418:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938152000 00000100:00100000:0.0:1715330448.139431:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938152000 00002000:00100000:0.0:1715330448.139494:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (448790528->452984831) req@ffff88008d777100 x1798653938152000/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:659/0 lens 488/0 e 0 to 0 dl 1715330459 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330448.139506:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d777100 with x1798653938152000 ext(448790528->452984831) 00002000:00010000:0.0:1715330448.139513:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d777100 00000100:00100000:0.0:1715330448.139552:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 195 00000100:00100000:0.0:1715330448.139560:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d777100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+77:2014:x1798653938152000:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330448.148309:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d776d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+79:2013:x1798653938151872:12345-192.168.204.49@tcp:4:dd.0 Request processed in 60068us (64938us total) trans 4294970060 rc 0/0 00000100:00100000:1.0:1715330448.148326:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 194 00002000:00100000:1.0:1715330448.148344:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (444596224->448790527) req@ffff88008d776d80 x1798653938151872/t4294970060(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:659/0 lens 488/448 e 0 to 0 dl 1715330459 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330448.148354:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d776d80 with x1798653938151872 ext(444596224->448790527) 00002000:00010000:1.0:1715330448.148362:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d776d80 00000100:00100000:0.0:1715330448.179303:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d777100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+79:2014:x1798653938152000:12345-192.168.204.49@tcp:4:dd.0 Request processed in 39731us (39960us total) trans 4294970061 rc 0/0 00000100:00100000:0.0:1715330448.179316:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 195 00002000:00100000:0.0:1715330448.179328:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (448790528->452984831) req@ffff88008d777100 x1798653938152000/t4294970061(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:659/0 lens 488/448 e 0 to 0 dl 1715330459 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330448.179337:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d777100 with x1798653938152000 ext(448790528->452984831) 00002000:00010000:0.0:1715330448.179343:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d777100 00000100:00100000:2.0:1715330448.188950:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330448.189017:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938152128 00000100:00100000:0.0:1715330448.189027:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938152128 00002000:00100000:0.0:1715330448.189063:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (452984832->457179135) req@ffff88008d774a80 x1798653938152128/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:659/0 lens 488/0 e 0 to 0 dl 1715330459 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330448.189074:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d774a80 with x1798653938152128 ext(452984832->457179135) 00002000:00010000:0.0:1715330448.189079:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d774a80 00000100:00100000:0.0:1715330448.189109:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 196 00000100:00100000:0.0:1715330448.189114:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d774a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+79:2014:x1798653938152128:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330448.220609:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d774a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+81:2014:x1798653938152128:12345-192.168.204.49@tcp:4:dd.0 Request processed in 31478us (31653us total) trans 4294970062 rc 0/0 00000100:00100000:1.0:1715330448.220633:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 196 00002000:00100000:1.0:1715330448.220649:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (452984832->457179135) req@ffff88008d774a80 x1798653938152128/t4294970062(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:659/0 lens 488/448 e 0 to 0 dl 1715330459 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330448.220661:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d774a80 with x1798653938152128 ext(452984832->457179135) 00002000:00010000:1.0:1715330448.220669:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d774a80 00000100:00100000:0.0:1715330448.243558:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330448.243873:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938152256 00000100:00100000:1.0:1715330448.243887:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938152256 00002000:00100000:1.0:1715330448.243940:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (457179136->461373439) req@ffff88008a106680 x1798653938152256/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:659/0 lens 488/0 e 0 to 0 dl 1715330459 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330448.243952:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a106680 with x1798653938152256 ext(457179136->461373439) 00002000:00010000:1.0:1715330448.243958:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a106680 00000100:00100000:1.0:1715330448.243988:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 197 00000100:00100000:1.0:1715330448.243995:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a106680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+81:2013:x1798653938152256:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330448.275235:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1715330448.275262:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942549824:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1715330448.275353:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330448.275450:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942549824 00000100:00100000:1.0:1715330448.275460:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942549824 00000100:00100000:1.0:1715330448.275519:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3152 00000100:00100000:1.0:1715330448.275525:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a7aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:3691:x1798653942549824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1715330448.275565:0:8592:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444089856 avail 1314627584 00000100:00100000:1.0:1715330448.275608:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a7aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:3691:x1798653942549824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330448.275614:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3152 00000100:00100000:3.0:1715330448.275694:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942549824:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1715330448.293357:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a106680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+83:2013:x1798653938152256:12345-192.168.204.49@tcp:4:dd.0 Request processed in 49346us (49797us total) trans 4294970063 rc 0/0 00000100:00100000:1.0:1715330448.293372:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 197 00002000:00100000:1.0:1715330448.293386:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (457179136->461373439) req@ffff88008a106680 x1798653938152256/t4294970063(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:659/0 lens 488/448 e 0 to 0 dl 1715330459 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330448.293395:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a106680 with x1798653938152256 ext(457179136->461373439) 00002000:00010000:1.0:1715330448.293401:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a106680 00000100:00100000:2.0:1715330448.295400:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330448.295551:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938152384 00000100:00100000:1.0:1715330448.295561:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938152384 00002000:00100000:1.0:1715330448.295599:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (461373440->465567743) req@ffff88008d777800 x1798653938152384/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:659/0 lens 488/0 e 0 to 0 dl 1715330459 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330448.295609:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d777800 with x1798653938152384 ext(461373440->465567743) 00002000:00010000:1.0:1715330448.295613:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d777800 00000100:00100000:1.0:1715330448.295654:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 198 00000100:00100000:1.0:1715330448.295661:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d777800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+83:2014:x1798653938152384:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330448.338864:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d777800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+85:2014:x1798653938152384:12345-192.168.204.49@tcp:4:dd.0 Request processed in 43189us (43459us total) trans 4294970064 rc 0/0 00000100:00100000:1.0:1715330448.338883:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 198 00002000:00100000:1.0:1715330448.338898:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (461373440->465567743) req@ffff88008d777800 x1798653938152384/t4294970064(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:659/0 lens 488/448 e 0 to 0 dl 1715330459 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330448.338909:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d777800 with x1798653938152384 ext(461373440->465567743) 00002000:00010000:1.0:1715330448.338916:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d777800 00000100:00100000:3.0:1715330448.364886:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330448.365020:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938152512 00000100:00100000:1.0:1715330448.365040:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938152512 00002000:00100000:1.0:1715330448.365115:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (465567744->469762047) req@ffff88008a7ace00 x1798653938152512/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:659/0 lens 488/0 e 0 to 0 dl 1715330459 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330448.365128:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a7ace00 with x1798653938152512 ext(465567744->469762047) 00002000:00010000:1.0:1715330448.365137:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a7ace00 00000100:00100000:2.0:1715330448.366664:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 199 00000100:00100000:2.0:1715330448.366676:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a7ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+85:2014:x1798653938152512:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330448.430005:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a7ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+87:2014:x1798653938152512:12345-192.168.204.49@tcp:4:dd.0 Request processed in 63323us (65129us total) trans 4294970065 rc 0/0 00000100:00100000:3.0:1715330448.430020:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 199 00002000:00100000:3.0:1715330448.430031:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (465567744->469762047) req@ffff88008a7ace00 x1798653938152512/t4294970065(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:659/0 lens 488/448 e 0 to 0 dl 1715330459 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330448.430041:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a7ace00 with x1798653938152512 ext(465567744->469762047) 00002000:00010000:3.0:1715330448.430046:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a7ace00 00000100:00100000:2.0:1715330448.491466:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330448.491785:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938152640 00000100:00100000:3.0:1715330448.491794:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938152640 00002000:00100000:3.0:1715330448.491835:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (469762048->473956351) req@ffff88008d775c00 x1798653938152640/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:659/0 lens 488/0 e 0 to 0 dl 1715330459 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330448.491844:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d775c00 with x1798653938152640 ext(469762048->473956351) 00002000:00010000:3.0:1715330448.491850:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d775c00 00000100:00100000:3.0:1715330448.491888:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 200 00000100:00100000:3.0:1715330448.491894:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d775c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+87:2013:x1798653938152640:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330448.560894:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330448.561324:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938152768 00000100:00100000:1.0:1715330448.561332:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938152768 00002000:00100000:1.0:1715330448.561365:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (473956352->478150655) req@ffff88008d776300 x1798653938152768/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:659/0 lens 488/0 e 0 to 0 dl 1715330459 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330448.561376:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d776300 with x1798653938152768 ext(473956352->478150655) 00002000:00010000:1.0:1715330448.561381:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d776300 00000100:00100000:1.0:1715330448.561397:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 201 00000100:00100000:1.0:1715330448.561403:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d776300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+89:2013:x1798653938152768:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330448.580420:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d775c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+91:2013:x1798653938152640:12345-192.168.204.49@tcp:4:dd.0 Request processed in 88516us (88957us total) trans 4294970066 rc 0/0 00000100:00100000:0.0:1715330448.580434:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 200 00002000:00100000:0.0:1715330448.580445:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (469762048->473956351) req@ffff88008d775c00 x1798653938152640/t4294970066(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:659/0 lens 488/448 e 0 to 0 dl 1715330459 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330448.580454:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d775c00 with x1798653938152640 ext(469762048->473956351) 00002000:00010000:0.0:1715330448.580459:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d775c00 00010000:00010000:2.0:1715330448.622421:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330448.636442:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d776300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+91:2013:x1798653938152768:12345-192.168.204.49@tcp:4:dd.0 Request processed in 75026us (75551us total) trans 4294970067 rc 0/0 00000100:00100000:1.0:1715330448.636455:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 201 00002000:00100000:1.0:1715330448.636468:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (473956352->478150655) req@ffff88008d776300 x1798653938152768/t4294970067(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:659/0 lens 488/448 e 0 to 0 dl 1715330459 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330448.636482:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d776300 with x1798653938152768 ext(473956352->478150655) 00002000:00010000:1.0:1715330448.636489:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d776300 00000100:00100000:2.0:1715330448.659068:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330448.660653:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938152896 00000100:00100000:1.0:1715330448.660662:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938152896 00002000:00100000:1.0:1715330448.660699:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (478150656->482344959) req@ffff88008d774700 x1798653938152896/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:659/0 lens 488/0 e 0 to 0 dl 1715330459 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330448.660709:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d774700 with x1798653938152896 ext(478150656->482344959) 00002000:00010000:1.0:1715330448.660713:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d774700 00000100:00100000:1.0:1715330448.660750:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 202 00000100:00100000:1.0:1715330448.660756:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d774700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+91:2014:x1798653938152896:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330448.709349:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d774700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+93:2014:x1798653938152896:12345-192.168.204.49@tcp:4:dd.0 Request processed in 48583us (50283us total) trans 4294970068 rc 0/0 00000100:00100000:0.0:1715330448.709363:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 202 00002000:00100000:0.0:1715330448.709374:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (478150656->482344959) req@ffff88008d774700 x1798653938152896/t4294970068(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:659/0 lens 488/448 e 0 to 0 dl 1715330459 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330448.709383:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d774700 with x1798653938152896 ext(478150656->482344959) 00002000:00010000:0.0:1715330448.709389:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d774700 00000100:00100000:3.0:1715330448.767039:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330448.767940:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938153088 00000100:00100000:0.0:1715330448.767955:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938153088 00002000:00100000:0.0:1715330448.768008:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (482344960->486539263) req@ffff88008a7ad180 x1798653938153088/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:659/0 lens 488/0 e 0 to 0 dl 1715330459 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330448.768025:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a7ad180 with x1798653938153088 ext(482344960->486539263) 00002000:00010000:0.0:1715330448.768031:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a7ad180 00000100:00100000:0.0:1715330448.768077:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 203 00000100:00100000:0.0:1715330448.768087:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a7ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+93:2014:x1798653938153088:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330448.803196:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a7ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+95:2014:x1798653938153088:12345-192.168.204.49@tcp:4:dd.0 Request processed in 35099us (37662us total) trans 4294970069 rc 0/0 00000100:00100000:2.0:1715330448.803210:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 203 00002000:00100000:2.0:1715330448.803222:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (482344960->486539263) req@ffff88008a7ad180 x1798653938153088/t4294970069(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:659/0 lens 488/448 e 0 to 0 dl 1715330459 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330448.803230:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a7ad180 with x1798653938153088 ext(482344960->486539263) 00002000:00010000:2.0:1715330448.803235:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a7ad180 00000100:00100000:2.0:1715330448.854881:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330448.855412:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938153216 00000100:00100000:0.0:1715330448.855420:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938153216 00002000:00100000:0.0:1715330448.855455:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (486539264->490733567) req@ffff880093980380 x1798653938153216/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:659/0 lens 488/0 e 0 to 0 dl 1715330459 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330448.855465:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093980380 with x1798653938153216 ext(486539264->490733567) 00002000:00010000:0.0:1715330448.855472:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093980380 00000100:00100000:0.0:1715330448.855501:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 204 00000100:00100000:0.0:1715330448.855508:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093980380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+95:2011:x1798653938153216:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330448.886635:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093980380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+97:2011:x1798653938153216:12345-192.168.204.49@tcp:4:dd.0 Request processed in 31101us (31737us total) trans 4294970070 rc 0/0 00000100:00100000:0.0:1715330448.886647:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 204 00002000:00100000:0.0:1715330448.886658:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (486539264->490733567) req@ffff880093980380 x1798653938153216/t4294970070(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:659/0 lens 488/448 e 0 to 0 dl 1715330459 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330448.886667:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093980380 with x1798653938153216 ext(486539264->490733567) 00002000:00010000:0.0:1715330448.886673:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093980380 00000100:00100000:2.0:1715330448.907138:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330448.907294:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938153344 00000100:00100000:0.0:1715330448.907304:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938153344 00002000:00100000:0.0:1715330448.907345:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (490733568->494927871) req@ffff880093981180 x1798653938153344/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:659/0 lens 488/0 e 0 to 0 dl 1715330459 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330448.907361:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093981180 with x1798653938153344 ext(490733568->494927871) 00002000:00010000:0.0:1715330448.907366:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093981180 00000100:00100000:0.0:1715330448.907393:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 205 00000100:00100000:0.0:1715330448.907398:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093981180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+97:2011:x1798653938153344:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330448.967520:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093981180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+99:2011:x1798653938153344:12345-192.168.204.49@tcp:4:dd.0 Request processed in 60112us (60386us total) trans 4294970071 rc 0/0 00000100:00100000:0.0:1715330448.967533:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 205 00002000:00100000:0.0:1715330448.967545:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (490733568->494927871) req@ffff880093981180 x1798653938153344/t4294970071(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:659/0 lens 488/448 e 0 to 0 dl 1715330459 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330448.967553:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093981180 with x1798653938153344 ext(490733568->494927871) 00002000:00010000:0.0:1715330448.967559:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093981180 00000100:00100000:2.0:1715330448.985884:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330448.986442:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938153472 00000100:00100000:0.0:1715330448.986452:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938153472 00002000:00100000:0.0:1715330448.986490:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (494927872->499122175) req@ffff880093981880 x1798653938153472/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:659/0 lens 488/0 e 0 to 0 dl 1715330459 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330448.986499:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093981880 with x1798653938153472 ext(494927872->499122175) 00002000:00010000:0.0:1715330448.986504:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093981880 00000100:00100000:0.0:1715330448.986529:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 206 00000100:00100000:0.0:1715330448.986535:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093981880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+99:2011:x1798653938153472:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330449.023184:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330449.023893:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938153600 00000100:00100000:2.0:1715330449.023905:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938153600 00002000:00100000:2.0:1715330449.023967:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (499122176->503316479) req@ffff88008a7ad500 x1798653938153600/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:660/0 lens 488/0 e 0 to 0 dl 1715330460 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00000100:00080000:0.0:1715330449.023969:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330419 00002000:00100000:2.0:1715330449.023978:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a7ad500 with x1798653938153600 ext(499122176->503316479) 00002000:00010000:2.0:1715330449.023983:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a7ad500 00000100:00100000:2.0:1715330449.024015:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 207 00000100:00100000:2.0:1715330449.024022:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a7ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+103:2012:x1798653938153600:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330449.025895:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093981880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+102:2011:x1798653938153472:12345-192.168.204.49@tcp:4:dd.0 Request processed in 39354us (40014us total) trans 4294970072 rc 0/0 00000100:00100000:1.0:1715330449.025906:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 206 00002000:00100000:1.0:1715330449.025914:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (494927872->499122175) req@ffff880093981880 x1798653938153472/t4294970072(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:659/0 lens 488/448 e 0 to 0 dl 1715330459 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330449.025922:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093981880 with x1798653938153472 ext(494927872->499122175) 00002000:00010000:1.0:1715330449.025926:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093981880 00000100:00100000:3.0:1715330449.058469:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a7ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+103:2012:x1798653938153600:12345-192.168.204.49@tcp:4:dd.0 Request processed in 34435us (35283us total) trans 4294970073 rc 0/0 00000100:00100000:3.0:1715330449.058484:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 207 00002000:00100000:3.0:1715330449.058495:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (499122176->503316479) req@ffff88008a7ad500 x1798653938153600/t4294970073(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:660/0 lens 488/448 e 0 to 0 dl 1715330460 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330449.058505:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a7ad500 with x1798653938153600 ext(499122176->503316479) 00002000:00010000:3.0:1715330449.058510:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a7ad500 00000100:00100000:3.0:1715330449.069785:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330449.069876:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938153728 00000100:00100000:0.0:1715330449.069886:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938153728 00002000:00100000:0.0:1715330449.069930:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (503316480->507510783) req@ffff88008a7ad880 x1798653938153728/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:660/0 lens 488/0 e 0 to 0 dl 1715330460 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330449.069940:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a7ad880 with x1798653938153728 ext(503316480->507510783) 00002000:00010000:0.0:1715330449.069944:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a7ad880 00000100:00100000:0.0:1715330449.069979:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 208 00000100:00100000:0.0:1715330449.069985:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a7ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+103:2011:x1798653938153728:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330449.122945:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a7ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+105:2011:x1798653938153728:12345-192.168.204.49@tcp:4:dd.0 Request processed in 52947us (53159us total) trans 4294970074 rc 0/0 00000100:00100000:1.0:1715330449.122961:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 208 00002000:00100000:1.0:1715330449.122974:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (503316480->507510783) req@ffff88008a7ad880 x1798653938153728/t4294970074(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:660/0 lens 488/448 e 0 to 0 dl 1715330460 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330449.122988:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a7ad880 with x1798653938153728 ext(503316480->507510783) 00002000:00010000:1.0:1715330449.122995:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a7ad880 00000100:00100000:0.0:1715330449.137573:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330449.137700:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938153856 00000100:00100000:1.0:1715330449.137712:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938153856 00002000:00100000:1.0:1715330449.137802:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (507510784->511705087) req@ffff88009d646a00 x1798653938153856/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:660/0 lens 488/0 e 0 to 0 dl 1715330460 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330449.137813:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d646a00 with x1798653938153856 ext(507510784->511705087) 00002000:00010000:1.0:1715330449.137819:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d646a00 00000100:00100000:1.0:1715330449.137856:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 209 00000100:00100000:1.0:1715330449.137864:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d646a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+105:2011:x1798653938153856:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330449.188788:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d646a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+107:2011:x1798653938153856:12345-192.168.204.49@tcp:4:dd.0 Request processed in 50914us (51222us total) trans 4294970075 rc 0/0 00000100:00100000:1.0:1715330449.188801:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 209 00002000:00100000:1.0:1715330449.188812:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (507510784->511705087) req@ffff88009d646a00 x1798653938153856/t4294970075(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:660/0 lens 488/448 e 0 to 0 dl 1715330460 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330449.188820:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d646a00 with x1798653938153856 ext(507510784->511705087) 00002000:00010000:1.0:1715330449.188826:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d646a00 00000100:00100000:2.0:1715330449.196708:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330449.197885:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938153984 00000100:00100000:1.0:1715330449.197898:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938153984 00002000:00100000:1.0:1715330449.197939:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (511705088->515899391) req@ffff880093982d80 x1798653938153984/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:660/0 lens 488/0 e 0 to 0 dl 1715330460 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330449.197948:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093982d80 with x1798653938153984 ext(511705088->515899391) 00002000:00010000:1.0:1715330449.197953:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093982d80 00000100:00100000:1.0:1715330449.198001:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 210 00000100:00100000:1.0:1715330449.198007:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093982d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+107:2011:x1798653938153984:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330449.231131:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093982d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+109:2011:x1798653938153984:12345-192.168.204.49@tcp:4:dd.0 Request processed in 33109us (34421us total) trans 4294970076 rc 0/0 00000100:00100000:1.0:1715330449.231148:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 210 00002000:00100000:1.0:1715330449.231162:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (511705088->515899391) req@ffff880093982d80 x1798653938153984/t4294970076(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:660/0 lens 488/448 e 0 to 0 dl 1715330460 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330449.231172:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093982d80 with x1798653938153984 ext(511705088->515899391) 00002000:00010000:1.0:1715330449.231178:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093982d80 00000100:00100000:1.0:1715330449.278820:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330449.278945:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938154112 00000100:00100000:2.0:1715330449.278956:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938154112 00002000:00100000:2.0:1715330449.279006:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (515899392->520093695) req@ffff88008d7b5c00 x1798653938154112/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:660/0 lens 488/0 e 0 to 0 dl 1715330460 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330449.279016:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d7b5c00 with x1798653938154112 ext(515899392->520093695) 00002000:00010000:2.0:1715330449.279021:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d7b5c00 00000100:00100000:2.0:1715330449.279043:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 211 00000100:00100000:2.0:1715330449.279049:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+109:2011:x1798653938154112:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330449.335183:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+111:2011:x1798653938154112:12345-192.168.204.49@tcp:4:dd.0 Request processed in 56122us (56366us total) trans 4294970077 rc 0/0 00000100:00100000:2.0:1715330449.335196:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 211 00002000:00100000:2.0:1715330449.335207:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (515899392->520093695) req@ffff88008d7b5c00 x1798653938154112/t4294970077(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:660/0 lens 488/448 e 0 to 0 dl 1715330460 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330449.335216:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d7b5c00 with x1798653938154112 ext(515899392->520093695) 00002000:00010000:2.0:1715330449.335221:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d7b5c00 00000100:00100000:3.0:1715330449.344764:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330449.345157:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938154240 00000100:00100000:2.0:1715330449.345169:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938154240 00002000:00100000:2.0:1715330449.345221:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (520093696->524287999) req@ffff88008a7adc00 x1798653938154240/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:660/0 lens 488/0 e 0 to 0 dl 1715330460 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330449.345230:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a7adc00 with x1798653938154240 ext(520093696->524287999) 00002000:00010000:2.0:1715330449.345235:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a7adc00 00000100:00100000:2.0:1715330449.346151:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 212 00000100:00100000:2.0:1715330449.346158:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a7adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+111:2012:x1798653938154240:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330449.398969:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a7adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+113:2012:x1798653938154240:12345-192.168.204.49@tcp:4:dd.0 Request processed in 52799us (54230us total) trans 4294970078 rc 0/0 00000100:00100000:2.0:1715330449.398986:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 212 00002000:00100000:2.0:1715330449.399000:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (520093696->524287999) req@ffff88008a7adc00 x1798653938154240/t4294970078(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:660/0 lens 488/448 e 0 to 0 dl 1715330460 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330449.399009:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a7adc00 with x1798653938154240 ext(520093696->524287999) 00002000:00010000:2.0:1715330449.399015:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a7adc00 00000100:00100000:0.0:1715330449.401830:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330449.401924:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938154368 00000100:00100000:2.0:1715330449.401934:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938154368 00002000:00100000:2.0:1715330449.401980:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (524288000->528482303) req@ffff88009d644a80 x1798653938154368/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:660/0 lens 488/0 e 0 to 0 dl 1715330460 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330449.401990:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d644a80 with x1798653938154368 ext(524288000->528482303) 00002000:00010000:2.0:1715330449.401996:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d644a80 00000100:00100000:2.0:1715330449.402377:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 213 00000100:00100000:2.0:1715330449.402383:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d644a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+113:2014:x1798653938154368:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330449.461375:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d644a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+115:2014:x1798653938154368:12345-192.168.204.49@tcp:4:dd.0 Request processed in 58982us (59545us total) trans 4294970079 rc 0/0 00000100:00100000:2.0:1715330449.461388:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 213 00002000:00100000:2.0:1715330449.461399:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (524288000->528482303) req@ffff88009d644a80 x1798653938154368/t4294970079(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:660/0 lens 488/448 e 0 to 0 dl 1715330460 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330449.461408:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d644a80 with x1798653938154368 ext(524288000->528482303) 00002000:00010000:2.0:1715330449.461413:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d644a80 00000100:00100000:3.0:1715330449.494589:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330449.494670:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938154496 00000100:00100000:2.0:1715330449.494680:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938154496 00002000:00100000:2.0:1715330449.494720:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (528482304->532676607) req@ffff88008a7adf80 x1798653938154496/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:660/0 lens 488/0 e 0 to 0 dl 1715330460 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330449.494830:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a7adf80 with x1798653938154496 ext(528482304->532676607) 00002000:00010000:2.0:1715330449.494835:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a7adf80 00000100:00100000:2.0:1715330449.494905:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 214 00000100:00100000:2.0:1715330449.494912:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a7adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+115:2011:x1798653938154496:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330449.549402:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a7adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+117:2011:x1798653938154496:12345-192.168.204.49@tcp:4:dd.0 Request processed in 54480us (54813us total) trans 4294970080 rc 0/0 00000100:00100000:3.0:1715330449.549415:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 214 00002000:00100000:3.0:1715330449.549428:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (528482304->532676607) req@ffff88008a7adf80 x1798653938154496/t4294970080(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:660/0 lens 488/448 e 0 to 0 dl 1715330460 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330449.549436:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a7adf80 with x1798653938154496 ext(528482304->532676607) 00002000:00010000:3.0:1715330449.549442:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a7adf80 00000100:00100000:1.0:1715330449.570495:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330449.571661:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938154624 00000100:00100000:3.0:1715330449.571671:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938154624 00002000:00100000:3.0:1715330449.571714:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (532676608->536870911) req@ffff88008d7b7100 x1798653938154624/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:660/0 lens 488/0 e 0 to 0 dl 1715330460 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330449.571724:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d7b7100 with x1798653938154624 ext(532676608->536870911) 00002000:00010000:3.0:1715330449.571752:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d7b7100 00000100:00100000:3.0:1715330449.571788:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 215 00000100:00100000:3.0:1715330449.571795:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+117:2012:x1798653938154624:12345-192.168.204.49@tcp:4:dd.0 00010000:00010000:3.0:1715330449.622961:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330449.623614:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+119:2012:x1798653938154624:12345-192.168.204.49@tcp:4:dd.0 Request processed in 51795us (53103us total) trans 4294970081 rc 0/0 00000100:00100000:0.0:1715330449.623626:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 215 00002000:00100000:0.0:1715330449.623638:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (532676608->536870911) req@ffff88008d7b7100 x1798653938154624/t4294970081(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:660/0 lens 488/448 e 0 to 0 dl 1715330460 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330449.623646:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d7b7100 with x1798653938154624 ext(532676608->536870911) 00002000:00010000:0.0:1715330449.623651:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d7b7100 00000100:00100000:0.0:1715330449.639999:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330449.640103:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938154752 00000100:00100000:2.0:1715330449.640113:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938154752 00002000:00100000:2.0:1715330449.640157:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (536870912->541065215) req@ffff88009b4c2680 x1798653938154752/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:660/0 lens 488/0 e 0 to 0 dl 1715330460 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330449.640166:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b4c2680 with x1798653938154752 ext(536870912->541065215) 00002000:00010000:2.0:1715330449.640171:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b4c2680 00000100:00100000:2.0:1715330449.640191:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 216 00000100:00100000:2.0:1715330449.640196:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+119:2011:x1798653938154752:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330449.700121:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1715330449.700144:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008a7ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942549888:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1715330449.700210:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330449.700289:0:7139:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942549888 00000100:00100000:3.0:1715330449.700297:0:7139:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942549888 00000100:00100000:3.0:1715330449.700353:0:7139:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3153 00000100:00100000:3.0:1715330449.700360:0:7139:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942549888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1715330449.700400:0:7139:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445060608 avail 1315598336 00000100:00100000:3.0:1715330449.700440:0:7139:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942549888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330449.700447:0:7139:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3153 00000100:00100000:1.0:1715330449.700532:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008a7ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942549888:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1715330449.711265:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330449.711334:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938154880 00000100:00100000:0.0:1715330449.711342:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938154880 00002000:00100000:0.0:1715330449.711382:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (541065216->545259519) req@ffff880093983100 x1798653938154880/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:660/0 lens 488/0 e 0 to 0 dl 1715330460 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330449.711392:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093983100 with x1798653938154880 ext(541065216->545259519) 00002000:00010000:0.0:1715330449.711397:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093983100 00000100:00100000:0.0:1715330449.711426:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 217 00000100:00100000:0.0:1715330449.711431:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093983100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+123:2011:x1798653938154880:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330449.741777:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+123:2011:x1798653938154752:12345-192.168.204.49@tcp:4:dd.0 Request processed in 96932us (97138us total) trans 4294970082 rc 0/0 00000100:00100000:0.0:1715330449.747536:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 216 00002000:00100000:0.0:1715330449.747560:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (536870912->541065215) req@ffff88009b4c2680 x1798653938154752/t4294970082(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:660/0 lens 488/448 e 0 to 0 dl 1715330460 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330449.747570:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b4c2680 with x1798653938154752 ext(536870912->541065215) 00002000:00010000:0.0:1715330449.747577:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b4c2680 00000100:00100000:0.0:1715330449.791630:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330449.791771:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938155008 00000100:00100000:2.0:1715330449.791783:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938155008 00002000:00100000:2.0:1715330449.791835:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (545259520->549453823) req@ffff88009b4c1f80 x1798653938155008/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:660/0 lens 488/0 e 0 to 0 dl 1715330460 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330449.791846:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b4c1f80 with x1798653938155008 ext(545259520->549453823) 00002000:00010000:2.0:1715330449.791853:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b4c1f80 00000100:00100000:2.0:1715330449.792010:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 218 00000100:00100000:2.0:1715330449.792018:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+125:2012:x1798653938155008:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330449.802880:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093983100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+125:2011:x1798653938154880:12345-192.168.204.49@tcp:4:dd.0 Request processed in 91436us (91615us total) trans 4294970083 rc 0/0 00000100:00100000:1.0:1715330449.802894:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 217 00002000:00100000:1.0:1715330449.802907:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (541065216->545259519) req@ffff880093983100 x1798653938154880/t4294970083(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:660/0 lens 488/448 e 0 to 0 dl 1715330460 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330449.802916:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093983100 with x1798653938154880 ext(541065216->545259519) 00002000:00010000:1.0:1715330449.802923:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093983100 00000100:00100000:0.0:1715330449.835271:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+125:2012:x1798653938155008:12345-192.168.204.49@tcp:4:dd.0 Request processed in 43237us (43633us total) trans 4294970084 rc 0/0 00000100:00100000:0.0:1715330449.835286:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 218 00002000:00100000:0.0:1715330449.835303:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (545259520->549453823) req@ffff88009b4c1f80 x1798653938155008/t4294970084(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:660/0 lens 488/448 e 0 to 0 dl 1715330460 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330449.835313:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b4c1f80 with x1798653938155008 ext(545259520->549453823) 00002000:00010000:0.0:1715330449.835319:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b4c1f80 00000100:00100000:0.0:1715330449.859051:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330449.862500:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938155136 00000100:00100000:2.0:1715330449.862512:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938155136 00002000:00100000:2.0:1715330449.862560:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (549453824->553648127) req@ffff88008d4f9c00 x1798653938155136/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:660/0 lens 488/0 e 0 to 0 dl 1715330460 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330449.862570:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d4f9c00 with x1798653938155136 ext(549453824->553648127) 00002000:00010000:2.0:1715330449.862576:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d4f9c00 00000100:00100000:2.0:1715330449.862689:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 219 00000100:00100000:2.0:1715330449.862695:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+125:2013:x1798653938155136:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330449.917445:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330449.917516:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938155264 00000100:00100000:1.0:1715330449.917524:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938155264 00002000:00100000:1.0:1715330449.917560:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (553648128->557842431) req@ffff880093983b80 x1798653938155264/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:660/0 lens 488/0 e 0 to 0 dl 1715330460 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330449.917571:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093983b80 with x1798653938155264 ext(553648128->557842431) 00002000:00010000:1.0:1715330449.917577:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093983b80 00000100:00100000:1.0:1715330449.917689:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 220 00000100:00100000:1.0:1715330449.917695:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093983b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+129:2014:x1798653938155264:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330449.938257:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+129:2013:x1798653938155136:12345-192.168.204.49@tcp:4:dd.0 Request processed in 75551us (79207us total) trans 4294970085 rc 0/0 00000100:00100000:0.0:1715330449.938271:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 219 00002000:00100000:0.0:1715330449.938284:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (549453824->553648127) req@ffff88008d4f9c00 x1798653938155136/t4294970085(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:660/0 lens 488/448 e 0 to 0 dl 1715330460 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330449.938293:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d4f9c00 with x1798653938155136 ext(549453824->553648127) 00002000:00010000:0.0:1715330449.938298:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d4f9c00 00000100:00100000:1.0:1715330449.962994:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093983b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+129:2014:x1798653938155264:12345-192.168.204.49@tcp:4:dd.0 Request processed in 45284us (45544us total) trans 4294970086 rc 0/0 00000100:00100000:1.0:1715330449.963011:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 220 00002000:00100000:1.0:1715330449.963024:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (553648128->557842431) req@ffff880093983b80 x1798653938155264/t4294970086(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:660/0 lens 488/448 e 0 to 0 dl 1715330460 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330449.963033:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093983b80 with x1798653938155264 ext(553648128->557842431) 00002000:00010000:1.0:1715330449.963040:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093983b80 00000100:00100000:3.0:1715330449.982084:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330449.982177:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938155392 00000100:00100000:1.0:1715330449.982186:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938155392 00002000:00100000:1.0:1715330449.982230:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (557842432->562036735) req@ffff88008a7ae680 x1798653938155392/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:660/0 lens 488/0 e 0 to 0 dl 1715330460 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330449.982240:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a7ae680 with x1798653938155392 ext(557842432->562036735) 00002000:00010000:1.0:1715330449.982246:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a7ae680 00000100:00100000:1.0:1715330449.982272:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 221 00000100:00100000:1.0:1715330449.982279:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a7ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+129:2013:x1798653938155392:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330450.021556:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330450.021640:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938155520 00000100:00100000:0.0:1715330450.021648:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938155520 00002000:00100000:0.0:1715330450.021682:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (562036736->566231039) req@ffff880093983800 x1798653938155520/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:661/0 lens 488/0 e 0 to 0 dl 1715330461 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330450.021692:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093983800 with x1798653938155520 ext(562036736->566231039) 00002000:00010000:0.0:1715330450.021697:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093983800 00000100:00100000:0.0:1715330450.021728:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 222 00000100:00100000:0.0:1715330450.021753:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+133:2014:x1798653938155520:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330450.025898:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a7ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+133:2013:x1798653938155392:12345-192.168.204.49@tcp:4:dd.0 Request processed in 43611us (43815us total) trans 4294970087 rc 0/0 00000100:00100000:1.0:1715330450.025909:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 221 00002000:00100000:1.0:1715330450.025921:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (557842432->562036735) req@ffff88008a7ae680 x1798653938155392/t4294970087(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:660/0 lens 488/448 e 0 to 0 dl 1715330460 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330450.025930:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a7ae680 with x1798653938155392 ext(557842432->562036735) 00002000:00010000:1.0:1715330450.025935:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a7ae680 00000100:00100000:0.0:1715330450.062185:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330450.062836:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+133:2014:x1798653938155520:12345-192.168.204.49@tcp:4:dd.0 Request processed in 41081us (41285us total) trans 4294970088 rc 0/0 00000100:00100000:1.0:1715330450.062848:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 222 00002000:00100000:1.0:1715330450.062859:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (562036736->566231039) req@ffff880093983800 x1798653938155520/t4294970088(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:661/0 lens 488/448 e 0 to 0 dl 1715330461 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330450.062868:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093983800 with x1798653938155520 ext(562036736->566231039) 00002000:00010000:1.0:1715330450.062874:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093983800 00000100:00100000:1.0:1715330450.064514:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938155648 00000100:00100000:1.0:1715330450.064524:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938155648 00002000:00100000:1.0:1715330450.064560:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (566231040->570425343) req@ffff88008d4f9500 x1798653938155648/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:661/0 lens 488/0 e 0 to 0 dl 1715330461 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330450.064568:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d4f9500 with x1798653938155648 ext(566231040->570425343) 00002000:00010000:1.0:1715330450.064572:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d4f9500 00000100:00100000:1.0:1715330450.064586:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 223 00000100:00100000:1.0:1715330450.064602:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+133:2013:x1798653938155648:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330450.105080:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330450.105454:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938155776 00000100:00100000:0.0:1715330450.105463:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938155776 00002000:00100000:0.0:1715330450.105504:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (570425344->574619647) req@ffff88008a7aea00 x1798653938155776/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:661/0 lens 488/0 e 0 to 0 dl 1715330461 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330450.105513:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a7aea00 with x1798653938155776 ext(570425344->574619647) 00002000:00010000:0.0:1715330450.105519:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a7aea00 00000100:00100000:0.0:1715330450.105550:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 224 00000100:00100000:0.0:1715330450.105556:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a7aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+135:2011:x1798653938155776:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330450.116221:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+136:2013:x1798653938155648:12345-192.168.204.49@tcp:4:dd.0 Request processed in 51608us (54033us total) trans 4294970089 rc 0/0 00000100:00100000:2.0:1715330450.116235:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 223 00002000:00100000:2.0:1715330450.116247:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (566231040->570425343) req@ffff88008d4f9500 x1798653938155648/t4294970089(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:661/0 lens 488/448 e 0 to 0 dl 1715330461 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330450.116256:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d4f9500 with x1798653938155648 ext(566231040->570425343) 00002000:00010000:2.0:1715330450.116262:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d4f9500 00000100:00100000:3.0:1715330450.163891:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330450.164745:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a7aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+137:2011:x1798653938155776:12345-192.168.204.49@tcp:4:dd.0 Request processed in 59168us (59657us total) trans 4294970090 rc 0/0 00000100:00100000:0.0:1715330450.164759:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 224 00002000:00100000:0.0:1715330450.164772:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (570425344->574619647) req@ffff88008a7aea00 x1798653938155776/t4294970090(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:661/0 lens 488/448 e 0 to 0 dl 1715330461 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330450.164781:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a7aea00 with x1798653938155776 ext(570425344->574619647) 00002000:00010000:0.0:1715330450.164788:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a7aea00 00000100:00100000:0.0:1715330450.164815:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938155904 00000100:00100000:0.0:1715330450.164822:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938155904 00002000:00100000:0.0:1715330450.164850:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (574619648->578813951) req@ffff88008a7aed80 x1798653938155904/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:661/0 lens 488/0 e 0 to 0 dl 1715330461 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330450.164856:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a7aed80 with x1798653938155904 ext(574619648->578813951) 00002000:00010000:0.0:1715330450.164859:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a7aed80 00000100:00100000:0.0:1715330450.164885:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 225 00000100:00100000:0.0:1715330450.164891:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a7aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+137:2012:x1798653938155904:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330450.216366:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330450.216428:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938156032 00000100:00100000:0.0:1715330450.216436:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938156032 00002000:00100000:0.0:1715330450.216468:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (578813952->583008255) req@ffff88008a7af100 x1798653938156032/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:661/0 lens 488/0 e 0 to 0 dl 1715330461 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330450.216477:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a7af100 with x1798653938156032 ext(578813952->583008255) 00002000:00010000:0.0:1715330450.216482:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a7af100 00000100:00100000:0.0:1715330450.216506:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 226 00000100:00100000:0.0:1715330450.216512:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a7af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+141:2012:x1798653938156032:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330450.230636:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a7aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+141:2012:x1798653938155904:12345-192.168.204.49@tcp:4:dd.0 Request processed in 65728us (66738us total) trans 4294970091 rc 0/0 00000100:00100000:1.0:1715330450.230653:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 225 00002000:00100000:1.0:1715330450.230671:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (574619648->578813951) req@ffff88008a7aed80 x1798653938155904/t4294970091(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:661/0 lens 488/448 e 0 to 0 dl 1715330461 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330450.230687:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a7aed80 with x1798653938155904 ext(574619648->578813951) 00002000:00010000:1.0:1715330450.230693:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a7aed80 00000100:00100000:3.0:1715330450.263593:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330450.263697:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938156160 00000100:00100000:0.0:1715330450.263708:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938156160 00002000:00100000:0.0:1715330450.263811:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (583008256->587202559) req@ffff88008a7af480 x1798653938156160/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:661/0 lens 488/0 e 0 to 0 dl 1715330461 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330450.263822:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a7af480 with x1798653938156160 ext(583008256->587202559) 00002000:00010000:0.0:1715330450.263828:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a7af480 00000100:00100000:0.0:1715330450.263884:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 227 00000100:00100000:0.0:1715330450.263942:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a7af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+143:2011:x1798653938156160:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330450.276767:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a7af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+143:2012:x1798653938156032:12345-192.168.204.49@tcp:4:dd.0 Request processed in 60244us (60397us total) trans 4294970092 rc 0/0 00000100:00100000:0.0:1715330450.276784:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 226 00002000:00100000:0.0:1715330450.276795:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (578813952->583008255) req@ffff88008a7af100 x1798653938156032/t4294970092(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:661/0 lens 488/448 e 0 to 0 dl 1715330461 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330450.276803:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a7af100 with x1798653938156032 ext(578813952->583008255) 00002000:00010000:0.0:1715330450.276808:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a7af100 00000100:00100000:0.0:1715330450.296846:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a7af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+143:2011:x1798653938156160:12345-192.168.204.49@tcp:4:dd.0 Request processed in 32896us (33262us total) trans 4294970093 rc 0/0 00000100:00100000:0.0:1715330450.296860:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 227 00002000:00100000:0.0:1715330450.296872:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (583008256->587202559) req@ffff88008a7af480 x1798653938156160/t4294970093(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:661/0 lens 488/448 e 0 to 0 dl 1715330461 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330450.296881:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a7af480 with x1798653938156160 ext(583008256->587202559) 00002000:00010000:0.0:1715330450.296887:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a7af480 00000100:00100000:3.0:1715330450.310848:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330450.310915:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938156288 00000100:00100000:0.0:1715330450.310923:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938156288 00002000:00100000:0.0:1715330450.310957:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (587202560->591396863) req@ffff88008a7af800 x1798653938156288/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:661/0 lens 488/0 e 0 to 0 dl 1715330461 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330450.310965:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a7af800 with x1798653938156288 ext(587202560->591396863) 00002000:00010000:0.0:1715330450.310969:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a7af800 00000100:00100000:0.0:1715330450.310991:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 228 00000100:00100000:0.0:1715330450.310996:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a7af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+143:2013:x1798653938156288:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330450.367786:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a7af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+145:2013:x1798653938156288:12345-192.168.204.49@tcp:4:dd.0 Request processed in 56777us (56933us total) trans 4294970094 rc 0/0 00000100:00100000:0.0:1715330450.367799:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 228 00002000:00100000:0.0:1715330450.367814:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (587202560->591396863) req@ffff88008a7af800 x1798653938156288/t4294970094(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:661/0 lens 488/448 e 0 to 0 dl 1715330461 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330450.367822:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a7af800 with x1798653938156288 ext(587202560->591396863) 00002000:00010000:0.0:1715330450.367839:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a7af800 00000100:00100000:3.0:1715330450.369509:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330450.369563:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938156416 00000100:00100000:0.0:1715330450.369570:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938156416 00002000:00100000:0.0:1715330450.369610:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (591396864->595591167) req@ffff88008a7afb80 x1798653938156416/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:661/0 lens 488/0 e 0 to 0 dl 1715330461 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330450.369617:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a7afb80 with x1798653938156416 ext(591396864->595591167) 00002000:00010000:0.0:1715330450.369621:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a7afb80 00000100:00100000:0.0:1715330450.369644:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 229 00000100:00100000:0.0:1715330450.369650:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a7afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+145:2013:x1798653938156416:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330450.414821:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a7afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+147:2013:x1798653938156416:12345-192.168.204.49@tcp:4:dd.0 Request processed in 45159us (45304us total) trans 4294970095 rc 0/0 00000100:00100000:1.0:1715330450.414835:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 229 00002000:00100000:1.0:1715330450.414848:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (591396864->595591167) req@ffff88008a7afb80 x1798653938156416/t4294970095(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:661/0 lens 488/448 e 0 to 0 dl 1715330461 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330450.414856:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a7afb80 with x1798653938156416 ext(591396864->595591167) 00002000:00010000:1.0:1715330450.414862:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a7afb80 00000100:00100000:3.0:1715330450.447456:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330450.447557:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938156544 00000100:00100000:1.0:1715330450.447567:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938156544 00002000:00100000:1.0:1715330450.447624:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (595591168->599785471) req@ffff88008a7ae300 x1798653938156544/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:661/0 lens 488/0 e 0 to 0 dl 1715330461 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330450.447634:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a7ae300 with x1798653938156544 ext(595591168->599785471) 00002000:00010000:1.0:1715330450.447640:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a7ae300 00000100:00100000:1.0:1715330450.447859:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 230 00000100:00100000:1.0:1715330450.447865:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a7ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+147:2013:x1798653938156544:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330450.499086:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a7ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+149:2013:x1798653938156544:12345-192.168.204.49@tcp:4:dd.0 Request processed in 51207us (51626us total) trans 4294970096 rc 0/0 00000100:00100000:0.0:1715330450.499100:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 230 00002000:00100000:0.0:1715330450.499111:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (595591168->599785471) req@ffff88008a7ae300 x1798653938156544/t4294970096(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:661/0 lens 488/448 e 0 to 0 dl 1715330461 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330450.499121:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a7ae300 with x1798653938156544 ext(595591168->599785471) 00002000:00010000:0.0:1715330450.499129:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a7ae300 00000100:00100000:2.0:1715330450.524357:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330450.524435:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938156672 00000100:00100000:0.0:1715330450.524445:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938156672 00002000:00100000:0.0:1715330450.524494:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (599785472->603979775) req@ffff880093980700 x1798653938156672/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:661/0 lens 488/0 e 0 to 0 dl 1715330461 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330450.524505:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093980700 with x1798653938156672 ext(599785472->603979775) 00002000:00010000:0.0:1715330450.524512:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093980700 00000100:00100000:0.0:1715330450.524549:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 231 00000100:00100000:0.0:1715330450.524557:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093980700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+149:2014:x1798653938156672:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330450.567402:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093980700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+151:2014:x1798653938156672:12345-192.168.204.49@tcp:4:dd.0 Request processed in 42836us (43044us total) trans 4294970097 rc 0/0 00000100:00100000:0.0:1715330450.567414:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 231 00002000:00100000:0.0:1715330450.567425:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (599785472->603979775) req@ffff880093980700 x1798653938156672/t4294970097(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:661/0 lens 488/448 e 0 to 0 dl 1715330461 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330450.567433:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093980700 with x1798653938156672 ext(599785472->603979775) 00002000:00010000:0.0:1715330450.567438:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093980700 00000100:00100000:1.0:1715330450.597896:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1715330450.597928:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093982300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942549952:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1715330450.597990:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330450.598064:0:9400:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942549952 00000100:00100000:2.0:1715330450.598072:0:9400:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942549952 00000100:00100000:2.0:1715330450.598112:0:9400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1715330450.598118:0:9400:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942549952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1715330450.598140:0:9400:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 793847488 pending 303759360 free 3323719680 avail 3092197376 00000100:00100000:2.0:1715330450.598173:0:9400:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942549952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330450.598178:0:9400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1715330450.598208:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093982300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942549952:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1715330450.600033:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1715330450.600050:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f57a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942550016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1715330450.600098:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1715330450.600174:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330420 00000100:00100000:3.0:1715330450.600269:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942550016 00000100:00100000:3.0:1715330450.600278:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942550016 00000100:00100000:3.0:1715330450.600764:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1715330450.600770:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942550016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1715330450.600790:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 793847488 pending 303759360 free 3323719680 avail 3092197376 00000100:00100000:3.0:1715330450.600829:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942550016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330450.600834:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00080000:1.0:1715330450.600937:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330420 00000100:00100000:0.0:1715330450.601034:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f57a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942550016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1715330450.601471:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330450.601527:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938156800 00000100:00100000:0.0:1715330450.601530:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938156800 00002000:00100000:0.0:1715330450.601553:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (603979776->608174079) req@ffff880093982300 x1798653938156800/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:661/0 lens 488/0 e 0 to 0 dl 1715330461 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330450.601563:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093982300 with x1798653938156800 ext(603979776->608174079) 00002000:00010000:0.0:1715330450.601567:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093982300 00000100:00100000:0.0:1715330450.601592:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 232 00000100:00100000:0.0:1715330450.601597:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093982300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+151:2014:x1798653938156800:12345-192.168.204.49@tcp:4:dd.0 00010000:00010000:1.0:1715330450.625454:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330450.652284:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093982300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+153:2014:x1798653938156800:12345-192.168.204.49@tcp:4:dd.0 Request processed in 50673us (50802us total) trans 4294970098 rc 0/0 00000100:00100000:0.0:1715330450.652301:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 232 00002000:00100000:0.0:1715330450.652322:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (603979776->608174079) req@ffff880093982300 x1798653938156800/t4294970098(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:661/0 lens 488/448 e 0 to 0 dl 1715330461 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330450.652334:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093982300 with x1798653938156800 ext(603979776->608174079) 00002000:00010000:0.0:1715330450.652342:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093982300 00000100:00100000:0.0:1715330450.683987:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330450.684131:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938156928 00000100:00100000:2.0:1715330450.684139:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938156928 00002000:00100000:2.0:1715330450.684177:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (608174080->612368383) req@ffff880091c3ed80 x1798653938156928/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:661/0 lens 488/0 e 0 to 0 dl 1715330461 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330450.684186:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c3ed80 with x1798653938156928 ext(608174080->612368383) 00002000:00010000:2.0:1715330450.684191:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091c3ed80 00000100:00100000:2.0:1715330450.684221:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 233 00000100:00100000:2.0:1715330450.684226:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+153:2013:x1798653938156928:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330450.738786:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+155:2013:x1798653938156928:12345-192.168.204.49@tcp:4:dd.0 Request processed in 54542us (54792us total) trans 4294970099 rc 0/0 00000100:00100000:0.0:1715330450.738803:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 233 00002000:00100000:0.0:1715330450.738824:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (608174080->612368383) req@ffff880091c3ed80 x1798653938156928/t4294970099(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:661/0 lens 488/448 e 0 to 0 dl 1715330461 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330450.738833:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c3ed80 with x1798653938156928 ext(608174080->612368383) 00002000:00010000:0.0:1715330450.738840:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091c3ed80 00000100:00100000:2.0:1715330450.752124:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330450.752202:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938157056 00000100:00100000:0.0:1715330450.752212:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938157056 00002000:00100000:0.0:1715330450.752255:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (612368384->616562687) req@ffff880093980000 x1798653938157056/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:661/0 lens 488/0 e 0 to 0 dl 1715330461 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330450.752265:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093980000 with x1798653938157056 ext(612368384->616562687) 00002000:00010000:0.0:1715330450.752272:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093980000 00000100:00100000:0.0:1715330450.752308:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 234 00000100:00100000:0.0:1715330450.752315:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+155:2013:x1798653938157056:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330450.798633:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+157:2013:x1798653938157056:12345-192.168.204.49@tcp:4:dd.0 Request processed in 46306us (46509us total) trans 4294970100 rc 0/0 00000100:00100000:0.0:1715330450.798653:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 234 00002000:00100000:0.0:1715330450.798667:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (612368384->616562687) req@ffff880093980000 x1798653938157056/t4294970100(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:661/0 lens 488/448 e 0 to 0 dl 1715330461 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330450.798676:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093980000 with x1798653938157056 ext(612368384->616562687) 00002000:00010000:0.0:1715330450.798682:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093980000 00000100:00100000:2.0:1715330450.824719:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330450.825225:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938157184 00000100:00100000:0.0:1715330450.825233:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938157184 00002000:00100000:0.0:1715330450.825271:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (616562688->620756991) req@ffff880093982680 x1798653938157184/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:661/0 lens 488/0 e 0 to 0 dl 1715330461 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330450.825280:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093982680 with x1798653938157184 ext(616562688->620756991) 00002000:00010000:0.0:1715330450.825285:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093982680 00000100:00100000:0.0:1715330450.825314:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 235 00000100:00100000:0.0:1715330450.825320:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093982680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+157:2014:x1798653938157184:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330450.866973:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093982680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+159:2014:x1798653938157184:12345-192.168.204.49@tcp:4:dd.0 Request processed in 41639us (42248us total) trans 4294970101 rc 0/0 00000100:00100000:0.0:1715330450.866990:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 235 00002000:00100000:0.0:1715330450.867005:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (616562688->620756991) req@ffff880093982680 x1798653938157184/t4294970101(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:661/0 lens 488/448 e 0 to 0 dl 1715330461 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330450.867014:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093982680 with x1798653938157184 ext(616562688->620756991) 00002000:00010000:0.0:1715330450.867020:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093982680 00000100:00100000:1.0:1715330450.880877:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330450.881008:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938157312 00000100:00100000:2.0:1715330450.881017:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938157312 00002000:00100000:2.0:1715330450.881052:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (620756992->624951295) req@ffff880091f38700 x1798653938157312/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:661/0 lens 488/0 e 0 to 0 dl 1715330461 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330450.881062:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091f38700 with x1798653938157312 ext(620756992->624951295) 00002000:00010000:2.0:1715330450.881067:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091f38700 00000100:00100000:2.0:1715330450.881126:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 236 00000100:00100000:2.0:1715330450.881133:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+159:2013:x1798653938157312:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330450.924003:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+161:2013:x1798653938157312:12345-192.168.204.49@tcp:4:dd.0 Request processed in 42860us (43126us total) trans 4294970102 rc 0/0 00000100:00100000:0.0:1715330450.924017:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 236 00002000:00100000:0.0:1715330450.924030:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (620756992->624951295) req@ffff880091f38700 x1798653938157312/t4294970102(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:661/0 lens 488/448 e 0 to 0 dl 1715330461 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330450.924040:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091f38700 with x1798653938157312 ext(620756992->624951295) 00002000:00010000:0.0:1715330450.924046:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091f38700 00000100:00100000:1.0:1715330450.931272:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330450.931580:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938157440 00000100:00100000:0.0:1715330450.931591:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938157440 00002000:00100000:0.0:1715330450.931635:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (624951296->629145599) req@ffff880091f3bb80 x1798653938157440/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:661/0 lens 488/0 e 0 to 0 dl 1715330461 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330450.931644:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091f3bb80 with x1798653938157440 ext(624951296->629145599) 00002000:00010000:0.0:1715330450.931650:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091f3bb80 00000100:00100000:0.0:1715330450.931684:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 237 00000100:00100000:0.0:1715330450.931691:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+161:2014:x1798653938157440:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330450.987043:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+163:2014:x1798653938157440:12345-192.168.204.49@tcp:4:dd.0 Request processed in 55344us (55770us total) trans 4294970103 rc 0/0 00000100:00100000:0.0:1715330450.987055:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 237 00002000:00100000:0.0:1715330450.987067:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (624951296->629145599) req@ffff880091f3bb80 x1798653938157440/t4294970103(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:661/0 lens 488/448 e 0 to 0 dl 1715330461 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330450.987076:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091f3bb80 with x1798653938157440 ext(624951296->629145599) 00002000:00010000:0.0:1715330450.987082:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091f3bb80 00000100:00100000:1.0:1715330451.019450:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330451.019522:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938157568 00000100:00100000:0.0:1715330451.019531:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938157568 00002000:00100000:0.0:1715330451.020413:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (629145600->633339903) req@ffff880093b58380 x1798653938157568/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:662/0 lens 488/0 e 0 to 0 dl 1715330462 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330451.020422:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b58380 with x1798653938157568 ext(629145600->633339903) 00002000:00010000:0.0:1715330451.020428:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b58380 00000100:00080000:1.0:1715330451.020970:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330421 00000100:00100000:3.0:1715330451.022221:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 238 00000100:00100000:3.0:1715330451.022230:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+163:2012:x1798653938157568:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330451.089829:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+165:2012:x1798653938157568:12345-192.168.204.49@tcp:4:dd.0 Request processed in 67587us (70374us total) trans 4294970104 rc 0/0 00000100:00100000:3.0:1715330451.089849:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 238 00002000:00100000:3.0:1715330451.089865:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (629145600->633339903) req@ffff880093b58380 x1798653938157568/t4294970104(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:662/0 lens 488/448 e 0 to 0 dl 1715330462 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330451.089874:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b58380 with x1798653938157568 ext(629145600->633339903) 00002000:00010000:3.0:1715330451.089881:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b58380 00000100:00100000:1.0:1715330451.113855:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330451.113960:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938157696 00000100:00100000:3.0:1715330451.113968:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938157696 00002000:00100000:3.0:1715330451.114005:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (633339904->637534207) req@ffff880093b59880 x1798653938157696/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:662/0 lens 488/0 e 0 to 0 dl 1715330462 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330451.114014:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b59880 with x1798653938157696 ext(633339904->637534207) 00002000:00010000:3.0:1715330451.114019:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b59880 00000100:00100000:3.0:1715330451.114692:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 239 00000100:00100000:3.0:1715330451.114698:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+165:2011:x1798653938157696:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330451.162361:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+167:2011:x1798653938157696:12345-192.168.204.49@tcp:4:dd.0 Request processed in 47653us (48505us total) trans 4294970105 rc 0/0 00000100:00100000:3.0:1715330451.162374:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 239 00002000:00100000:3.0:1715330451.162385:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (633339904->637534207) req@ffff880093b59880 x1798653938157696/t4294970105(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:662/0 lens 488/448 e 0 to 0 dl 1715330462 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330451.162393:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b59880 with x1798653938157696 ext(633339904->637534207) 00002000:00010000:3.0:1715330451.162398:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b59880 00000100:00100000:1.0:1715330451.220099:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330451.221658:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938157824 00000100:00100000:3.0:1715330451.221667:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938157824 00002000:00100000:3.0:1715330451.221705:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (637534208->641728511) req@ffff880093b58e00 x1798653938157824/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:662/0 lens 488/0 e 0 to 0 dl 1715330462 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330451.221720:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b58e00 with x1798653938157824 ext(637534208->641728511) 00002000:00010000:3.0:1715330451.221725:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b58e00 00000100:00100000:0.0:1715330451.223971:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 240 00000100:00100000:0.0:1715330451.223982:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+167:2014:x1798653938157824:12345-192.168.204.49@tcp:4:dd.0 00000001:00080000:3.0:1715330451.260642:0:9395:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0000: transno 4294970105 is committed 00000100:00100000:0.0:1715330451.271015:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+9:2014:x1798653938157824:12345-192.168.204.49@tcp:4:dd.0 Request processed in 47020us (50908us total) trans 4294970106 rc 0/0 00000100:00100000:0.0:1715330451.271029:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 240 00002000:00100000:0.0:1715330451.271041:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (637534208->641728511) req@ffff880093b58e00 x1798653938157824/t4294970106(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:662/0 lens 488/448 e 0 to 0 dl 1715330462 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330451.271051:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b58e00 with x1798653938157824 ext(637534208->641728511) 00002000:00010000:0.0:1715330451.271058:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b58e00 00000100:00100000:1.0:1715330451.290848:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330451.291319:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938157952 00000100:00100000:0.0:1715330451.291329:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938157952 00002000:00100000:0.0:1715330451.291369:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (641728512->645922815) req@ffff880093b5bb80 x1798653938157952/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:662/0 lens 488/0 e 0 to 0 dl 1715330462 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330451.291379:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b5bb80 with x1798653938157952 ext(641728512->645922815) 00002000:00010000:0.0:1715330451.291384:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b5bb80 00000100:00100000:0.0:1715330451.292369:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 241 00000100:00100000:0.0:1715330451.292377:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+9:2012:x1798653938157952:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330451.338851:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330451.339539:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938158080 00000100:00100000:3.0:1715330451.339547:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938158080 00002000:00100000:3.0:1715330451.339593:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (645922816->650117119) req@ffff88009b5ee300 x1798653938158080/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:662/0 lens 488/0 e 0 to 0 dl 1715330462 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330451.339603:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b5ee300 with x1798653938158080 ext(645922816->650117119) 00002000:00010000:3.0:1715330451.339607:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b5ee300 00000100:00100000:3.0:1715330451.340605:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 242 00000100:00100000:3.0:1715330451.340613:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+12:2011:x1798653938158080:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330451.343673:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+13:2012:x1798653938157952:12345-192.168.204.49@tcp:4:dd.0 Request processed in 51287us (52826us total) trans 4294970107 rc 0/0 00000100:00100000:0.0:1715330451.343686:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 241 00002000:00100000:0.0:1715330451.343699:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (641728512->645922815) req@ffff880093b5bb80 x1798653938157952/t4294970107(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:662/0 lens 488/448 e 0 to 0 dl 1715330462 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330451.343717:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b5bb80 with x1798653938157952 ext(641728512->645922815) 00002000:00010000:0.0:1715330451.343724:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b5bb80 00000100:00100000:1.0:1715330451.347592:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330451.347648:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330451.347684:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330451.347719:0:7129:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938158144 00000100:00100000:1.0:1715330451.347727:0:7129:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938158144 00000100:00100000:1.0:1715330451.347808:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 394 00000100:00100000:1.0:1715330451.347817:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2013:x1798653938158144:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:1.0:1715330451.347888:0:7129:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2013:x1798653938158144:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 70us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330451.347895:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 394 00000100:00080000:1.0:1715330451.347924:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330421 00000100:00100000:1.0:1715330451.347973:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330451.348011:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938158208 00000100:00100000:1.0:1715330451.348014:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938158208 00000100:00100000:1.0:1715330451.348061:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938158272 00000100:00100000:1.0:1715330451.348064:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938158272 00000100:00100000:1.0:1715330451.348082:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 492 00000100:00100000:1.0:1715330451.348086:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:2014:x1798653938158208:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:1.0:1715330451.348116:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+17:2014:x1798653938158208:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 29us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330451.348122:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 492 00000100:00100000:1.0:1715330451.348132:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 493 00000100:00100000:1.0:1715330451.348137:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009327c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938158272:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:1.0:1715330451.348156:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009327c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72de1896-1df4-4b3a-930a-9116d2c66168+6:2013:x1798653938158272:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 18us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330451.348160:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 493 00000100:00080000:1.0:1715330451.348169:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330421 00000100:00080000:1.0:1715330451.348171:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330421 00000100:00100000:2.0:1715330451.348261:0:17198:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938158336 00000100:00100000:2.0:1715330451.348266:0:17198:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938158336 00000100:00100000:2.0:1715330451.348306:0:17198:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 349 00000100:00100000:2.0:1715330451.348311:0:17198:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b5ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938158336:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:2.0:1715330451.348336:0:17198:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938158336:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 25us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330451.348343:0:17198:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 349 00000100:00080000:1.0:1715330451.348405:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330421 00000100:00100000:3.0:1715330451.384970:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b5ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+13:2011:x1798653938158080:12345-192.168.204.49@tcp:4:dd.0 Request processed in 44346us (46115us total) trans 4294970108 rc 0/0 00000100:00100000:3.0:1715330451.384985:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 242 00002000:00100000:3.0:1715330451.384999:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (645922816->650117119) req@ffff88009b5ee300 x1798653938158080/t4294970108(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:662/0 lens 488/448 e 0 to 0 dl 1715330462 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330451.385007:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b5ee300 with x1798653938158080 ext(645922816->650117119) 00002000:00010000:3.0:1715330451.385014:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b5ee300 00000100:00100000:2.0:1715330451.426786:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330451.427715:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938158464 00000100:00100000:3.0:1715330451.427728:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938158464 00002000:00100000:3.0:1715330451.427794:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (650117120->654311423) req@ffff880093982a00 x1798653938158464/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:662/0 lens 488/0 e 0 to 0 dl 1715330462 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330451.427805:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093982a00 with x1798653938158464 ext(650117120->654311423) 00002000:00010000:3.0:1715330451.427813:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093982a00 00000100:00100000:3.0:1715330451.427847:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 243 00000100:00100000:3.0:1715330451.427854:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+13:2011:x1798653938158464:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330451.472064:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+15:2011:x1798653938158464:12345-192.168.204.49@tcp:4:dd.0 Request processed in 44200us (45276us total) trans 4294970109 rc 0/0 00000100:00100000:3.0:1715330451.472077:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 243 00002000:00100000:3.0:1715330451.472088:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (650117120->654311423) req@ffff880093982a00 x1798653938158464/t4294970109(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:662/0 lens 488/448 e 0 to 0 dl 1715330462 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330451.472097:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093982a00 with x1798653938158464 ext(650117120->654311423) 00002000:00010000:3.0:1715330451.472103:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093982a00 00000100:00100000:2.0:1715330451.479726:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330451.479832:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938158592 00000100:00100000:3.0:1715330451.479842:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938158592 00002000:00100000:3.0:1715330451.479885:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (654311424->658505727) req@ffff880093981c00 x1798653938158592/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:662/0 lens 488/0 e 0 to 0 dl 1715330462 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330451.479893:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093981c00 with x1798653938158592 ext(654311424->658505727) 00002000:00010000:3.0:1715330451.479899:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093981c00 00000100:00100000:3.0:1715330451.479929:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 244 00000100:00100000:3.0:1715330451.479937:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+15:2012:x1798653938158592:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330451.526693:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330451.527647:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938158720 00000100:00100000:0.0:1715330451.527657:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938158720 00002000:00100000:0.0:1715330451.527697:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (658505728->662700031) req@ffff880093980e00 x1798653938158720/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:662/0 lens 488/0 e 0 to 0 dl 1715330462 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330451.527706:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093980e00 with x1798653938158720 ext(658505728->662700031) 00002000:00010000:0.0:1715330451.527712:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093980e00 00000100:00100000:0.0:1715330451.527747:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 245 00000100:00100000:0.0:1715330451.527755:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093980e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+17:2012:x1798653938158720:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330451.546676:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+19:2012:x1798653938158592:12345-192.168.204.49@tcp:4:dd.0 Request processed in 66730us (66949us total) trans 4294970110 rc 0/0 00000100:00100000:0.0:1715330451.546690:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 244 00002000:00100000:0.0:1715330451.546700:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (654311424->658505727) req@ffff880093981c00 x1798653938158592/t4294970110(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:662/0 lens 488/448 e 0 to 0 dl 1715330462 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330451.546708:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093981c00 with x1798653938158592 ext(654311424->658505727) 00002000:00010000:0.0:1715330451.546713:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093981c00 00000100:00100000:2.0:1715330451.566111:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093980e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+19:2012:x1798653938158720:12345-192.168.204.49@tcp:4:dd.0 Request processed in 38345us (39413us total) trans 4294970111 rc 0/0 00000100:00100000:2.0:1715330451.566128:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 245 00002000:00100000:2.0:1715330451.566140:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (658505728->662700031) req@ffff880093980e00 x1798653938158720/t4294970111(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:662/0 lens 488/448 e 0 to 0 dl 1715330462 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330451.566149:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093980e00 with x1798653938158720 ext(658505728->662700031) 00002000:00010000:2.0:1715330451.566156:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093980e00 00000100:00100000:2.0:1715330451.594334:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330451.594433:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938158848 00000100:00100000:0.0:1715330451.594445:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938158848 00002000:00100000:0.0:1715330451.594493:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (662700032->666894335) req@ffff880093980a80 x1798653938158848/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:662/0 lens 488/0 e 0 to 0 dl 1715330462 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330451.594503:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093980a80 with x1798653938158848 ext(662700032->666894335) 00002000:00010000:0.0:1715330451.594509:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093980a80 00000100:00100000:0.0:1715330451.594539:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 246 00000100:00100000:0.0:1715330451.594547:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093980a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+19:2012:x1798653938158848:12345-192.168.204.49@tcp:4:dd.0 00010000:00010000:2.0:1715330451.628428:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330451.634041:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330451.636159:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938158976 00000100:00100000:2.0:1715330451.636170:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938158976 00002000:00100000:2.0:1715330451.636209:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (666894336->671088639) req@ffff880093682680 x1798653938158976/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:662/0 lens 488/0 e 0 to 0 dl 1715330462 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330451.636219:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093682680 with x1798653938158976 ext(666894336->671088639) 00002000:00010000:2.0:1715330451.636224:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093682680 00000100:00100000:2.0:1715330451.636257:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 247 00000100:00100000:2.0:1715330451.636262:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+23:2013:x1798653938158976:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330451.639280:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093980a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+23:2012:x1798653938158848:12345-192.168.204.49@tcp:4:dd.0 Request processed in 44725us (44950us total) trans 4294970112 rc 0/0 00000100:00100000:0.0:1715330451.639291:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 246 00002000:00100000:0.0:1715330451.639301:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (662700032->666894335) req@ffff880093980a80 x1798653938158848/t4294970112(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:662/0 lens 488/448 e 0 to 0 dl 1715330462 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330451.639310:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093980a80 with x1798653938158848 ext(662700032->666894335) 00002000:00010000:0.0:1715330451.639315:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093980a80 00000100:00100000:0.0:1715330451.680354:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+23:2013:x1798653938158976:12345-192.168.204.49@tcp:4:dd.0 Request processed in 44080us (46313us total) trans 4294970113 rc 0/0 00000100:00100000:0.0:1715330451.680369:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 247 00002000:00100000:0.0:1715330451.680383:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (666894336->671088639) req@ffff880093682680 x1798653938158976/t4294970113(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:662/0 lens 488/448 e 0 to 0 dl 1715330462 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330451.680393:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093682680 with x1798653938158976 ext(666894336->671088639) 00002000:00010000:0.0:1715330451.680399:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093682680 00000100:00100000:2.0:1715330451.690648:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330451.690723:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938159104 00000100:00100000:0.0:1715330451.690753:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938159104 00002000:00100000:0.0:1715330451.690792:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (671088640->675282943) req@ffff880093981f80 x1798653938159104/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:662/0 lens 488/0 e 0 to 0 dl 1715330462 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330451.690802:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093981f80 with x1798653938159104 ext(671088640->675282943) 00002000:00010000:0.0:1715330451.690807:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093981f80 00000100:00100000:0.0:1715330451.691228:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 248 00000100:00100000:0.0:1715330451.691236:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093981f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+23:2014:x1798653938159104:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330451.723367:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093981f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+25:2014:x1798653938159104:12345-192.168.204.49@tcp:4:dd.0 Request processed in 32121us (32717us total) trans 4294970114 rc 0/0 00000100:00100000:0.0:1715330451.723379:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 248 00002000:00100000:0.0:1715330451.723391:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (671088640->675282943) req@ffff880093981f80 x1798653938159104/t4294970114(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:662/0 lens 488/448 e 0 to 0 dl 1715330462 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330451.723399:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093981f80 with x1798653938159104 ext(671088640->675282943) 00002000:00010000:0.0:1715330451.723404:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093981f80 00000100:00100000:1.0:1715330451.739937:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330451.740424:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938159232 00000100:00100000:0.0:1715330451.740432:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938159232 00002000:00100000:0.0:1715330451.740469:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (675282944->679477247) req@ffff880093681c00 x1798653938159232/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:662/0 lens 488/0 e 0 to 0 dl 1715330462 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330451.740479:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093681c00 with x1798653938159232 ext(675282944->679477247) 00002000:00010000:0.0:1715330451.740484:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093681c00 00000100:00100000:0.0:1715330451.741441:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 249 00000100:00100000:0.0:1715330451.741449:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093681c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+25:2013:x1798653938159232:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330451.779068:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093681c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+27:2013:x1798653938159232:12345-192.168.204.49@tcp:4:dd.0 Request processed in 37610us (39133us total) trans 4294970115 rc 0/0 00000100:00100000:0.0:1715330451.779080:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 249 00002000:00100000:0.0:1715330451.779092:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (675282944->679477247) req@ffff880093681c00 x1798653938159232/t4294970115(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:662/0 lens 488/448 e 0 to 0 dl 1715330462 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330451.779100:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093681c00 with x1798653938159232 ext(675282944->679477247) 00002000:00010000:0.0:1715330451.779106:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093681c00 00000100:00100000:1.0:1715330451.794511:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330451.794609:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938159360 00000100:00100000:0.0:1715330451.794617:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938159360 00002000:00100000:0.0:1715330451.794657:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (679477248->683671551) req@ffff880093683100 x1798653938159360/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:662/0 lens 488/0 e 0 to 0 dl 1715330462 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330451.794666:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093683100 with x1798653938159360 ext(679477248->683671551) 00002000:00010000:0.0:1715330451.794670:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093683100 00000100:00100000:0.0:1715330451.794707:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 250 00000100:00100000:0.0:1715330451.794713:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093683100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+27:2013:x1798653938159360:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330451.831515:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091eee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942550208:0@lo:400:kworker.0 00000100:00100000:3.0:1715330451.831593:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330451.831618:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3688:1798653942550464:0@lo:400:kworker.0 00000100:00100000:3.0:1715330451.831640:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330451.831652:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3688:1798653942550720:0@lo:400:kworker.0 00000100:00100000:3.0:1715330451.831669:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330451.831688:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1715330451.831693:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b31aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3688:1798653942550272:0@lo:400:kworker.0 00000100:00100000:3.0:1715330451.831707:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330451.831717:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942550528:0@lo:400:kworker.0 00000100:00100000:3.0:1715330451.831765:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330451.831776:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d7f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942550784:0@lo:400:kworker.0 00000100:00100000:3.0:1715330451.831793:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330451.831819:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942550208 00000100:00100000:3.0:1715330451.831828:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942550208 00000100:00100000:3.0:1715330451.831865:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3154 00000100:00100000:3.0:1715330451.831873:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009132ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942550208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330451.831924:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009132ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942550208:12345-0@lo:400:kworker.0 Request processed in 50us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330451.831930:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3154 00000100:00100000:3.0:1715330451.831951:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942550464 00000100:00100000:3.0:1715330451.831954:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942550464 00000100:00100000:3.0:1715330451.831974:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942550720 00000100:00100000:3.0:1715330451.831977:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942550720 00000100:00100000:3.0:1715330451.831989:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942550272 00000100:00100000:3.0:1715330451.831990:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942550272 00000100:00100000:3.0:1715330451.832001:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:3.0:1715330451.832004:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009132dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3688:x1798653942550464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330451.832028:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009132dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3688:x1798653942550464:12345-0@lo:400:kworker.0 Request processed in 23us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330451.832033:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00000100:00100000:3.0:1715330451.832041:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 495 00000100:00100000:3.0:1715330451.832045:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009132df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3688:x1798653942550720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330451.832061:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009132df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3688:x1798653942550720:12345-0@lo:400:kworker.0 Request processed in 15us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330451.832065:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 495 00000100:00100000:3.0:1715330451.832072:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 496 00000100:00100000:3.0:1715330451.832075:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009132e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3688:x1798653942550272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330451.832092:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009132e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3688:x1798653942550272:12345-0@lo:400:kworker.0 Request processed in 16us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330451.832097:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 496 00000100:00100000:3.0:1715330451.832110:0:17198:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942550528 00000100:00100000:3.0:1715330451.832112:0:17198:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942550528 00000100:00100000:3.0:1715330451.832126:0:17198:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942550784 00000100:00100000:3.0:1715330451.832128:0:17198:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942550784 00000100:00100000:3.0:1715330451.832139:0:17198:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1715330451.832143:0:17198:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942550528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330451.832164:0:17198:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942550528:12345-0@lo:400:kworker.0 Request processed in 21us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330451.832170:0:17198:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1715330451.832177:0:17198:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1715330451.832179:0:17198:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942550784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330451.832196:0:17198:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942550784:12345-0@lo:400:kworker.0 Request processed in 16us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330451.832201:0:17198:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1715330451.832230:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b31aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3688:1798653942550272:0@lo:400:kworker.0 00000100:00100000:3.0:1715330451.832238:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942550528:0@lo:400:kworker.0 00000100:00100000:3.0:1715330451.832246:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d7f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942550784:0@lo:400:kworker.0 00000100:00100000:3.0:1715330451.832253:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091eee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942550208:0@lo:400:kworker.0 00000100:00100000:3.0:1715330451.832260:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3688:1798653942550464:0@lo:400:kworker.0 00000100:00100000:3.0:1715330451.832266:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3688:1798653942550720:0@lo:400:kworker.0 00000100:00080000:3.0:1715330451.832324:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330421 00000100:00080000:3.0:1715330451.832328:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330421 00000100:00100000:0.0:1715330451.832497:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f57a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3691:1798653942550144:0@lo:400:kworker.0 00000100:00100000:0.0:1715330451.832526:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330451.832547:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b0c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3691:1798653942550400:0@lo:400:kworker.0 00000100:00100000:0.0:1715330451.832573:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330451.832583:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3691:1798653942550656:0@lo:400:kworker.0 00000100:00100000:0.0:1715330451.832597:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330451.832607:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1715330451.832612:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f578700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3691:1798653942550080:0@lo:400:kworker.0 00000100:00100000:0.0:1715330451.832631:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330451.832642:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b318e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942550336:0@lo:400:kworker.0 00000100:00100000:0.0:1715330451.832656:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330451.832664:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942550592:0@lo:400:kworker.0 00000100:00100000:0.0:1715330451.832679:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330451.832688:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009132ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942550848:0@lo:400:kworker.0 00000100:00100000:0.0:1715330451.832701:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330451.832717:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942550592 00000100:00100000:0.0:1715330451.832719:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942550592 00000100:00100000:0.0:1715330451.833367:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942550848 00000100:00100000:0.0:1715330451.833372:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942550848 00000100:00100000:0.0:1715330451.833394:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1715330451.833400:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942550592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330451.833444:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942550592:12345-0@lo:400:kworker.0 Request processed in 44us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330451.833531:0:7130:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942550080 00000100:00100000:1.0:1715330451.833535:0:7130:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942550080 00000100:00100000:1.0:1715330451.833575:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1715330451.833579:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3691:x1798653942550080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330451.833610:0:7130:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3691:x1798653942550080:12345-0@lo:400:kworker.0 Request processed in 30us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330451.833617:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1715330451.833680:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f578700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3691:1798653942550080:0@lo:400:kworker.0 00000100:00100000:1.0:1715330451.833696:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942550592:0@lo:400:kworker.0 00000100:00100000:3.0:1715330451.834068:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942550144 00000100:00100000:3.0:1715330451.834073:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942550144 00000100:00100000:3.0:1715330451.834107:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942550400 00000100:00100000:3.0:1715330451.834110:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942550400 00000100:00100000:3.0:1715330451.834122:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942550656 00000100:00100000:3.0:1715330451.834124:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942550656 00000100:00100000:3.0:1715330451.834137:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 497 00000100:00100000:3.0:1715330451.834142:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3691:x1798653942550144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330451.834177:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3691:x1798653942550144:12345-0@lo:400:kworker.0 Request processed in 36us (1651us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330451.834183:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 497 00000100:00100000:3.0:1715330451.834193:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 498 00000100:00100000:3.0:1715330451.834197:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3691:x1798653942550400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330451.834218:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3691:x1798653942550400:12345-0@lo:400:kworker.0 Request processed in 21us (1645us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330451.834223:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 498 00000100:00100000:3.0:1715330451.834229:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 499 00000100:00100000:3.0:1715330451.834232:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3691:x1798653942550656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330451.834294:0:17215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1715330451.834300:0:17215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942550848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330451.834331:0:17215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942550848:12345-0@lo:400:kworker.0 Request processed in 31us (1628us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330451.834336:0:17215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1715330451.834369:0:7139:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942550336 00000100:00100000:2.0:1715330451.834373:0:7139:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942550336 00000100:00100000:2.0:1715330451.834395:0:7139:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3155 00000100:00100000:2.0:1715330451.834399:0:7139:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942550336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330451.834427:0:7139:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942550336:12345-0@lo:400:kworker.0 Request processed in 28us (1770us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330451.834432:0:7139:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3155 00000100:00100000:0.0:1715330451.834975:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00080000:0.0:1715330451.834989:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330421 00000100:00080000:0.0:1715330451.834992:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330421 00000100:00080000:0.0:1715330451.834994:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330421 00000100:00100000:3.0:1715330451.835550:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3691:x1798653942550656:12345-0@lo:400:kworker.0 Request processed in 1314us (2950us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330451.835567:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 499 00000100:00100000:1.0:1715330451.835669:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b318e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942550336:0@lo:400:kworker.0 00000100:00100000:1.0:1715330451.835685:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009132ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942550848:0@lo:400:kworker.0 00000100:00100000:1.0:1715330451.835700:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f57a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3691:1798653942550144:0@lo:400:kworker.0 00000100:00100000:1.0:1715330451.835710:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b0c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3691:1798653942550400:0@lo:400:kworker.0 00000100:00100000:1.0:1715330451.835719:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ba64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3691:1798653942550656:0@lo:400:kworker.0 00000100:00100000:1.0:1715330451.854862:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330451.854940:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938159488 00000100:00100000:3.0:1715330451.854948:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938159488 00002000:00100000:3.0:1715330451.854984:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (683671552->687865855) req@ffff880093682300 x1798653938159488/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:662/0 lens 488/0 e 0 to 0 dl 1715330462 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330451.854994:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093682300 with x1798653938159488 ext(683671552->687865855) 00002000:00010000:3.0:1715330451.854999:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093682300 00000100:00100000:3.0:1715330451.855018:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 251 00000100:00100000:3.0:1715330451.855024:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093682300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+29:2013:x1798653938159488:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330451.881164:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093683100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+31:2013:x1798653938159360:12345-192.168.204.49@tcp:4:dd.0 Request processed in 86441us (86652us total) trans 4294970116 rc 0/0 00000100:00100000:2.0:1715330451.881178:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 250 00002000:00100000:2.0:1715330451.881191:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (679477248->683671551) req@ffff880093683100 x1798653938159360/t4294970116(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:662/0 lens 488/448 e 0 to 0 dl 1715330462 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330451.881199:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093683100 with x1798653938159360 ext(679477248->683671551) 00002000:00010000:2.0:1715330451.881204:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093683100 00000100:00100000:0.0:1715330451.890876:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1715330451.890899:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d48ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942550912:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1715330451.891005:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330451.891072:0:9400:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942550912 00000100:00100000:2.0:1715330451.891080:0:9400:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942550912 00000100:00100000:2.0:1715330451.891114:0:9400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1715330451.891120:0:9400:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942550912:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1715330451.891134:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1715330451.891142:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942550976:0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1715330451.891148:0:9400:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 172032 granted 317126336 pending 0 free 3923546112 avail 3692023808 00000100:00100000:1.0:1715330451.891165:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330451.891177:0:9400:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942550912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330451.891183:0:9400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1715330451.891183:0:9401:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942550976 00000100:00100000:1.0:1715330451.891186:0:9401:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942550976 00000100:00100000:2.0:1715330451.891197:0:9400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1715330451.891200:0:9400:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093683480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942550976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1715330451.891208:0:9400:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 172032 granted 317126336 pending 0 free 3923546112 avail 3692023808 00000100:00100000:2.0:1715330451.891224:0:9400:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093683480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942550976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 23us (58us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330451.891228:0:9400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1715330451.891245:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942550976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1715330451.891709:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d48ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942550912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1715330451.901895:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093682300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+31:2013:x1798653938159488:12345-192.168.204.49@tcp:4:dd.0 Request processed in 46860us (47032us total) trans 4294970117 rc 0/0 00000100:00100000:3.0:1715330451.901907:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 251 00002000:00100000:3.0:1715330451.901918:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (683671552->687865855) req@ffff880093682300 x1798653938159488/t4294970117(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:662/0 lens 488/448 e 0 to 0 dl 1715330462 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330451.901927:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093682300 with x1798653938159488 ext(683671552->687865855) 00002000:00010000:3.0:1715330451.901932:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093682300 00000100:00100000:3.0:1715330451.922058:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330451.922162:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938159616 00000100:00100000:0.0:1715330451.922171:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938159616 00002000:00100000:0.0:1715330451.922206:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (687865856->692060159) req@ffff880093b72a00 x1798653938159616/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:662/0 lens 488/0 e 0 to 0 dl 1715330462 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330451.922215:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b72a00 with x1798653938159616 ext(687865856->692060159) 00002000:00010000:0.0:1715330451.922220:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b72a00 00000100:00100000:0.0:1715330451.922267:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 252 00000100:00100000:0.0:1715330451.922274:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+31:2013:x1798653938159616:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330451.961895:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+33:2013:x1798653938159616:12345-192.168.204.49@tcp:4:dd.0 Request processed in 39611us (39835us total) trans 4294970118 rc 0/0 00000100:00100000:1.0:1715330451.961909:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 252 00002000:00100000:1.0:1715330451.961921:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (687865856->692060159) req@ffff880093b72a00 x1798653938159616/t4294970118(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:662/0 lens 488/448 e 0 to 0 dl 1715330462 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330451.961931:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b72a00 with x1798653938159616 ext(687865856->692060159) 00002000:00010000:1.0:1715330451.961936:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b72a00 00000100:00100000:0.0:1715330451.982612:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330451.983226:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938159744 00000100:00100000:1.0:1715330451.983234:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938159744 00002000:00100000:1.0:1715330451.983270:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (692060160->696254463) req@ffff88008d48ca80 x1798653938159744/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:662/0 lens 488/0 e 0 to 0 dl 1715330462 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330451.983279:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d48ca80 with x1798653938159744 ext(692060160->696254463) 00002000:00010000:1.0:1715330451.983285:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d48ca80 00000100:00100000:1.0:1715330451.983317:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 253 00000100:00100000:1.0:1715330451.983324:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+33:2014:x1798653938159744:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330452.018009:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+35:2014:x1798653938159744:12345-192.168.204.49@tcp:4:dd.0 Request processed in 34676us (35396us total) trans 4294970119 rc 0/0 00000100:00100000:2.0:1715330452.018023:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 253 00002000:00100000:2.0:1715330452.018034:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (692060160->696254463) req@ffff88008d48ca80 x1798653938159744/t4294970119(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:662/0 lens 488/448 e 0 to 0 dl 1715330462 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330452.018042:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d48ca80 with x1798653938159744 ext(692060160->696254463) 00002000:00010000:2.0:1715330452.018047:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d48ca80 00000100:00100000:0.0:1715330452.051188:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330452.051297:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938159872 00000100:00100000:2.0:1715330452.051306:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938159872 00002000:00100000:2.0:1715330452.051341:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (696254464->700448767) req@ffff88008d48f480 x1798653938159872/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:663/0 lens 488/0 e 0 to 0 dl 1715330463 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330452.051350:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d48f480 with x1798653938159872 ext(696254464->700448767) 00002000:00010000:2.0:1715330452.051355:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d48f480 00000100:00100000:2.0:1715330452.051375:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 254 00000100:00100000:2.0:1715330452.051381:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d48f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+35:2013:x1798653938159872:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330452.090522:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d48f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+37:2013:x1798653938159872:12345-192.168.204.49@tcp:4:dd.0 Request processed in 39131us (39336us total) trans 4294970120 rc 0/0 00000100:00100000:3.0:1715330452.090535:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 254 00002000:00100000:3.0:1715330452.090546:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (696254464->700448767) req@ffff88008d48f480 x1798653938159872/t4294970120(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:663/0 lens 488/448 e 0 to 0 dl 1715330463 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330452.090564:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d48f480 with x1798653938159872 ext(696254464->700448767) 00002000:00010000:3.0:1715330452.090569:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d48f480 00000100:00100000:0.0:1715330452.116591:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330452.116702:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938160000 00000100:00100000:3.0:1715330452.116711:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938160000 00002000:00100000:3.0:1715330452.116864:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (700448768->704643071) req@ffff8801213d0000 x1798653938160000/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:663/0 lens 488/0 e 0 to 0 dl 1715330463 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330452.116872:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801213d0000 with x1798653938160000 ext(700448768->704643071) 00002000:00010000:3.0:1715330452.116877:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801213d0000 00000100:00100000:3.0:1715330452.117935:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 255 00000100:00100000:3.0:1715330452.117944:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801213d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+37:2013:x1798653938160000:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330452.182355:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330452.182447:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938160128 00000100:00100000:1.0:1715330452.182455:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938160128 00002000:00100000:1.0:1715330452.182490:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (704643072->708837375) req@ffff8801213d0380 x1798653938160128/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:663/0 lens 488/0 e 0 to 0 dl 1715330463 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330452.182499:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801213d0380 with x1798653938160128 ext(704643072->708837375) 00002000:00010000:1.0:1715330452.182505:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801213d0380 00000100:00100000:1.0:1715330452.182522:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 256 00000100:00100000:1.0:1715330452.182528:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801213d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+39:2012:x1798653938160128:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330452.216887:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801213d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+41:2013:x1798653938160000:12345-192.168.204.49@tcp:4:dd.0 Request processed in 98934us (100294us total) trans 4294970121 rc 0/0 00000100:00100000:3.0:1715330452.216900:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 255 00002000:00100000:3.0:1715330452.216912:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (700448768->704643071) req@ffff8801213d0000 x1798653938160000/t4294970121(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:663/0 lens 488/448 e 0 to 0 dl 1715330463 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330452.216921:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801213d0000 with x1798653938160000 ext(700448768->704643071) 00002000:00010000:3.0:1715330452.216926:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801213d0000 00000100:00100000:2.0:1715330452.239399:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801213d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+41:2012:x1798653938160128:12345-192.168.204.49@tcp:4:dd.0 Request processed in 56860us (57042us total) trans 4294970122 rc 0/0 00000100:00100000:2.0:1715330452.239414:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 256 00002000:00100000:2.0:1715330452.239428:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (704643072->708837375) req@ffff8801213d0380 x1798653938160128/t4294970122(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:663/0 lens 488/448 e 0 to 0 dl 1715330463 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330452.239437:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801213d0380 with x1798653938160128 ext(704643072->708837375) 00002000:00010000:2.0:1715330452.239443:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801213d0380 00000100:00100000:0.0:1715330452.246006:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330452.246278:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938160256 00000100:00100000:3.0:1715330452.246287:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938160256 00002000:00100000:3.0:1715330452.246325:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (708837376->713031679) req@ffff8801213d0700 x1798653938160256/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:663/0 lens 488/0 e 0 to 0 dl 1715330463 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330452.246334:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801213d0700 with x1798653938160256 ext(708837376->713031679) 00002000:00010000:3.0:1715330452.246339:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801213d0700 00000100:00100000:3.0:1715330452.246356:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 257 00000100:00100000:3.0:1715330452.246361:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801213d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+41:2011:x1798653938160256:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330452.281815:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801213d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+43:2011:x1798653938160256:12345-192.168.204.49@tcp:4:dd.0 Request processed in 35441us (35807us total) trans 4294970123 rc 0/0 00000100:00100000:3.0:1715330452.281827:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 257 00002000:00100000:3.0:1715330452.281838:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (708837376->713031679) req@ffff8801213d0700 x1798653938160256/t4294970123(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:663/0 lens 488/448 e 0 to 0 dl 1715330463 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330452.281847:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801213d0700 with x1798653938160256 ext(708837376->713031679) 00002000:00010000:3.0:1715330452.281853:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801213d0700 00000100:00100000:1.0:1715330452.298607:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330452.298790:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938160384 00000100:00100000:3.0:1715330452.298799:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938160384 00002000:00100000:3.0:1715330452.298836:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (713031680->717225983) req@ffff880093681500 x1798653938160384/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:663/0 lens 488/0 e 0 to 0 dl 1715330463 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330452.298845:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093681500 with x1798653938160384 ext(713031680->717225983) 00002000:00010000:3.0:1715330452.298851:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093681500 00000100:00100000:3.0:1715330452.299702:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 258 00000100:00100000:3.0:1715330452.299709:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+43:2012:x1798653938160384:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330452.352619:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330452.352842:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938160512 00000100:00100000:2.0:1715330452.352854:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938160512 00002000:00100000:2.0:1715330452.352894:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (717225984->721420287) req@ffff8801213d0a80 x1798653938160512/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:663/0 lens 488/0 e 0 to 0 dl 1715330463 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330452.352904:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801213d0a80 with x1798653938160512 ext(717225984->721420287) 00002000:00010000:2.0:1715330452.352908:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801213d0a80 00000100:00100000:2.0:1715330452.352942:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 259 00000100:00100000:2.0:1715330452.352948:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801213d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+46:2011:x1798653938160512:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330452.352960:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+46:2012:x1798653938160384:12345-192.168.204.49@tcp:4:dd.0 Request processed in 53249us (54360us total) trans 4294970124 rc 0/0 00000100:00100000:0.0:1715330452.352968:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 258 00002000:00100000:0.0:1715330452.352975:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (713031680->717225983) req@ffff880093681500 x1798653938160384/t4294970124(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:663/0 lens 488/448 e 0 to 0 dl 1715330463 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330452.352982:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093681500 with x1798653938160384 ext(713031680->717225983) 00002000:00010000:0.0:1715330452.352985:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093681500 00000100:00100000:1.0:1715330452.403968:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330452.404055:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938160640 00000100:00100000:2.0:1715330452.404064:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938160640 00002000:00100000:2.0:1715330452.404100:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (721420288->725614591) req@ffff880093683800 x1798653938160640/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:663/0 lens 488/0 e 0 to 0 dl 1715330463 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330452.404111:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093683800 with x1798653938160640 ext(721420288->725614591) 00002000:00010000:2.0:1715330452.404116:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093683800 00000100:00100000:2.0:1715330452.404148:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 260 00000100:00100000:2.0:1715330452.404154:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+49:2011:x1798653938160640:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330452.413357:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801213d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+49:2011:x1798653938160512:12345-192.168.204.49@tcp:4:dd.0 Request processed in 60398us (60736us total) trans 4294970125 rc 0/0 00000100:00100000:3.0:1715330452.413371:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 259 00002000:00100000:3.0:1715330452.413383:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (717225984->721420287) req@ffff8801213d0a80 x1798653938160512/t4294970125(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:663/0 lens 488/448 e 0 to 0 dl 1715330463 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330452.413392:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801213d0a80 with x1798653938160512 ext(717225984->721420287) 00002000:00010000:3.0:1715330452.413397:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801213d0a80 00000100:00100000:2.0:1715330452.465233:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+49:2011:x1798653938160640:12345-192.168.204.49@tcp:4:dd.0 Request processed in 61068us (61264us total) trans 4294970126 rc 0/0 00000100:00100000:2.0:1715330452.465247:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 260 00002000:00100000:2.0:1715330452.465260:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (721420288->725614591) req@ffff880093683800 x1798653938160640/t4294970126(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:663/0 lens 488/448 e 0 to 0 dl 1715330463 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330452.465271:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093683800 with x1798653938160640 ext(721420288->725614591) 00002000:00010000:2.0:1715330452.465276:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093683800 00000100:00100000:1.0:1715330452.479060:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330452.480826:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938160768 00000100:00100000:2.0:1715330452.480838:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938160768 00002000:00100000:3.0:1715330452.480975:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (725614592->729808895) req@ffff880093682a00 x1798653938160768/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:663/0 lens 488/0 e 0 to 0 dl 1715330463 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330452.480987:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093682a00 with x1798653938160768 ext(725614592->729808895) 00002000:00010000:3.0:1715330452.480992:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093682a00 00000100:00100000:3.0:1715330452.481568:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 261 00000100:00100000:3.0:1715330452.481574:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+49:2012:x1798653938160768:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330452.547674:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+51:2012:x1798653938160768:12345-192.168.204.49@tcp:4:dd.0 Request processed in 66089us (68612us total) trans 4294970127 rc 0/0 00000100:00100000:3.0:1715330452.547688:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 261 00002000:00100000:3.0:1715330452.547701:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (725614592->729808895) req@ffff880093682a00 x1798653938160768/t4294970127(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:663/0 lens 488/448 e 0 to 0 dl 1715330463 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330452.547709:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093682a00 with x1798653938160768 ext(725614592->729808895) 00002000:00010000:3.0:1715330452.547714:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093682a00 00000100:00100000:0.0:1715330452.551520:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330452.551710:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938160896 00000100:00100000:3.0:1715330452.551720:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938160896 00002000:00100000:3.0:1715330452.551783:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (729808896->734003199) req@ffff8801213d0e00 x1798653938160896/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:663/0 lens 488/0 e 0 to 0 dl 1715330463 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330452.551792:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801213d0e00 with x1798653938160896 ext(729808896->734003199) 00002000:00010000:3.0:1715330452.551797:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801213d0e00 00000100:00100000:3.0:1715330452.553117:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 262 00000100:00100000:3.0:1715330452.553126:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801213d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+51:2012:x1798653938160896:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330452.602123:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330452.603563:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938161024 00000100:00100000:2.0:1715330452.603577:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938161024 00002000:00100000:2.0:1715330452.603628:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (734003200->738197503) req@ffff880093681880 x1798653938161024/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:663/0 lens 488/0 e 0 to 0 dl 1715330463 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330452.603638:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093681880 with x1798653938161024 ext(734003200->738197503) 00002000:00010000:2.0:1715330452.603643:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093681880 00000100:00100000:2.0:1715330452.603687:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 263 00000100:00100000:2.0:1715330452.603694:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+55:2014:x1798653938161024:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330452.613398:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801213d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+55:2012:x1798653938160896:12345-192.168.204.49@tcp:4:dd.0 Request processed in 60263us (61876us total) trans 4294970128 rc 0/0 00000100:00100000:0.0:1715330452.613411:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 262 00002000:00100000:0.0:1715330452.613424:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (729808896->734003199) req@ffff8801213d0e00 x1798653938160896/t4294970128(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:663/0 lens 488/448 e 0 to 0 dl 1715330463 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330452.613433:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801213d0e00 with x1798653938160896 ext(729808896->734003199) 00002000:00010000:0.0:1715330452.613438:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801213d0e00 00010000:00010000:2.0:1715330452.632975:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330452.659686:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+55:2014:x1798653938161024:12345-192.168.204.49@tcp:4:dd.0 Request processed in 55981us (57561us total) trans 4294970129 rc 0/0 00000100:00100000:0.0:1715330452.659699:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 263 00002000:00100000:0.0:1715330452.659710:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (734003200->738197503) req@ffff880093681880 x1798653938161024/t4294970129(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:663/0 lens 488/448 e 0 to 0 dl 1715330463 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330452.659719:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093681880 with x1798653938161024 ext(734003200->738197503) 00002000:00010000:0.0:1715330452.659724:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093681880 00000100:00100000:2.0:1715330452.676850:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330452.676900:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938161152 00000100:00100000:0.0:1715330452.676908:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938161152 00002000:00100000:0.0:1715330452.676958:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (738197504->742391807) req@ffff880093981500 x1798653938161152/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:663/0 lens 488/0 e 0 to 0 dl 1715330463 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330452.676967:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093981500 with x1798653938161152 ext(738197504->742391807) 00002000:00010000:0.0:1715330452.676972:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093981500 00000100:00100000:0.0:1715330452.677003:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 264 00000100:00100000:0.0:1715330452.677009:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093981500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+55:2013:x1798653938161152:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330452.732362:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330452.732392:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938161280 00000100:00100000:2.0:1715330452.732400:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938161280 00002000:00100000:2.0:1715330452.732429:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (742391808->746586111) req@ffff8801213d1180 x1798653938161280/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:663/0 lens 488/0 e 0 to 0 dl 1715330463 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330452.732438:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801213d1180 with x1798653938161280 ext(742391808->746586111) 00002000:00010000:2.0:1715330452.732443:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801213d1180 00000100:00100000:2.0:1715330452.732471:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 265 00000100:00100000:2.0:1715330452.732476:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801213d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+57:2014:x1798653938161280:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330452.737964:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093981500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+59:2013:x1798653938161152:12345-192.168.204.49@tcp:4:dd.0 Request processed in 60944us (61114us total) trans 4294970130 rc 0/0 00000100:00100000:0.0:1715330452.737976:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 264 00002000:00100000:0.0:1715330452.737986:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (738197504->742391807) req@ffff880093981500 x1798653938161152/t4294970130(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:663/0 lens 488/448 e 0 to 0 dl 1715330463 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330452.737994:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093981500 with x1798653938161152 ext(738197504->742391807) 00002000:00010000:0.0:1715330452.738000:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093981500 00000100:00100000:0.0:1715330452.774211:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801213d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+59:2014:x1798653938161280:12345-192.168.204.49@tcp:4:dd.0 Request processed in 41722us (41844us total) trans 4294970131 rc 0/0 00000100:00100000:0.0:1715330452.774225:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 265 00002000:00100000:0.0:1715330452.774241:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (742391808->746586111) req@ffff8801213d1180 x1798653938161280/t4294970131(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:663/0 lens 488/448 e 0 to 0 dl 1715330463 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330452.774250:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801213d1180 with x1798653938161280 ext(742391808->746586111) 00002000:00010000:0.0:1715330452.774255:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801213d1180 00000100:00100000:1.0:1715330452.796165:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330452.796238:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938161408 00000100:00100000:0.0:1715330452.796247:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938161408 00002000:00100000:0.0:1715330452.796282:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (746586112->750780415) req@ffff880093683b80 x1798653938161408/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:663/0 lens 488/0 e 0 to 0 dl 1715330463 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330452.796291:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093683b80 with x1798653938161408 ext(746586112->750780415) 00002000:00010000:0.0:1715330452.796296:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093683b80 00000100:00100000:0.0:1715330452.796329:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 266 00000100:00100000:0.0:1715330452.796336:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093683b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+59:2014:x1798653938161408:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330452.837279:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093683b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+61:2014:x1798653938161408:12345-192.168.204.49@tcp:4:dd.0 Request processed in 40934us (41114us total) trans 4294970132 rc 0/0 00000100:00100000:0.0:1715330452.837292:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 266 00002000:00100000:0.0:1715330452.837302:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (746586112->750780415) req@ffff880093683b80 x1798653938161408/t4294970132(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:663/0 lens 488/448 e 0 to 0 dl 1715330463 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330452.837311:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093683b80 with x1798653938161408 ext(746586112->750780415) 00002000:00010000:0.0:1715330452.837316:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093683b80 00000100:00100000:1.0:1715330452.871214:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330452.871275:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938161536 00000100:00100000:0.0:1715330452.871282:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938161536 00002000:00100000:0.0:1715330452.871323:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (750780416->754974719) req@ffff880093682d80 x1798653938161536/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:663/0 lens 488/0 e 0 to 0 dl 1715330463 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330452.871334:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093682d80 with x1798653938161536 ext(750780416->754974719) 00002000:00010000:0.0:1715330452.871339:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093682d80 00000100:00100000:0.0:1715330452.871368:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 267 00000100:00100000:0.0:1715330452.871374:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+61:2014:x1798653938161536:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330452.916262:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+63:2014:x1798653938161536:12345-192.168.204.49@tcp:4:dd.0 Request processed in 44878us (45048us total) trans 4294970133 rc 0/0 00000100:00100000:0.0:1715330452.916277:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 267 00002000:00100000:0.0:1715330452.916287:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (750780416->754974719) req@ffff880093682d80 x1798653938161536/t4294970133(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:663/0 lens 488/448 e 0 to 0 dl 1715330463 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330452.916295:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093682d80 with x1798653938161536 ext(750780416->754974719) 00002000:00010000:0.0:1715330452.916300:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093682d80 00000100:00100000:1.0:1715330452.949384:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330452.949470:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938161664 00000100:00100000:0.0:1715330452.949479:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938161664 00002000:00100000:0.0:1715330452.949513:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (754974720->759169023) req@ffff880093681f80 x1798653938161664/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:663/0 lens 488/0 e 0 to 0 dl 1715330463 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330452.949522:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093681f80 with x1798653938161664 ext(754974720->759169023) 00002000:00010000:0.0:1715330452.949527:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093681f80 00000100:00100000:0.0:1715330452.949769:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 268 00000100:00100000:0.0:1715330452.949776:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+63:2012:x1798653938161664:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330452.984290:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330452.986455:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938161792 00000100:00100000:2.0:1715330452.986466:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938161792 00002000:00100000:2.0:1715330452.986504:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (759169024->763363327) req@ffff880093b70700 x1798653938161792/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:663/0 lens 488/0 e 0 to 0 dl 1715330463 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330452.986513:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b70700 with x1798653938161792 ext(759169024->763363327) 00002000:00010000:2.0:1715330452.986517:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b70700 00000100:00100000:0.0:1715330452.987628:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 269 00000100:00100000:0.0:1715330452.987636:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+65:2011:x1798653938161792:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330452.995602:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+67:2012:x1798653938161664:12345-192.168.204.49@tcp:4:dd.0 Request processed in 45816us (46216us total) trans 4294970134 rc 0/0 00000100:00100000:0.0:1715330452.995614:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 268 00002000:00100000:0.0:1715330452.995626:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (754974720->759169023) req@ffff880093681f80 x1798653938161664/t4294970134(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:663/0 lens 488/448 e 0 to 0 dl 1715330463 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330452.995634:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093681f80 with x1798653938161664 ext(754974720->759169023) 00002000:00010000:0.0:1715330452.995640:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093681f80 00000100:00100000:0.0:1715330453.033908:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+67:2011:x1798653938161792:12345-192.168.204.49@tcp:4:dd.0 Request processed in 46262us (49615us total) trans 4294970135 rc 0/0 00000100:00100000:0.0:1715330453.033919:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 269 00002000:00100000:0.0:1715330453.033931:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (759169024->763363327) req@ffff880093b70700 x1798653938161792/t4294970135(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:663/0 lens 488/448 e 0 to 0 dl 1715330463 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330453.033940:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b70700 with x1798653938161792 ext(759169024->763363327) 00002000:00010000:0.0:1715330453.033946:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b70700 00000100:00100000:1.0:1715330453.034069:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330453.034375:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938161920 00000100:00100000:0.0:1715330453.034381:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938161920 00002000:00100000:0.0:1715330453.034418:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (763363328->767557631) req@ffff880093681180 x1798653938161920/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:664/0 lens 488/0 e 0 to 0 dl 1715330464 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330453.034425:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093681180 with x1798653938161920 ext(763363328->767557631) 00002000:00010000:0.0:1715330453.034428:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093681180 00000100:00100000:0.0:1715330453.034438:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 270 00000100:00100000:0.0:1715330453.034442:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+67:2011:x1798653938161920:12345-192.168.204.49@tcp:4:dd.0 00000100:00080000:1.0:1715330453.037152:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330423 00000100:00100000:1.0:1715330453.080393:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330453.080446:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938162048 00000100:00100000:0.0:1715330453.080454:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938162048 00002000:00100000:0.0:1715330453.080484:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (767557632->771751935) req@ffff88009ba64700 x1798653938162048/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:664/0 lens 488/0 e 0 to 0 dl 1715330464 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330453.080493:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba64700 with x1798653938162048 ext(767557632->771751935) 00002000:00010000:0.0:1715330453.080498:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba64700 00000100:00100000:0.0:1715330453.080523:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 271 00000100:00100000:0.0:1715330453.080528:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+70:2012:x1798653938162048:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330453.082968:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+71:2011:x1798653938161920:12345-192.168.204.49@tcp:4:dd.0 Request processed in 48517us (48892us total) trans 4294970136 rc 0/0 00000100:00100000:2.0:1715330453.082980:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 270 00002000:00100000:2.0:1715330453.082989:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (763363328->767557631) req@ffff880093681180 x1798653938161920/t4294970136(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:664/0 lens 488/448 e 0 to 0 dl 1715330464 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330453.082997:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093681180 with x1798653938161920 ext(763363328->767557631) 00002000:00010000:2.0:1715330453.083002:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093681180 00000100:00100000:0.0:1715330453.120134:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+71:2012:x1798653938162048:12345-192.168.204.49@tcp:4:dd.0 Request processed in 39592us (39737us total) trans 4294970137 rc 0/0 00000100:00100000:0.0:1715330453.120147:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 271 00002000:00100000:0.0:1715330453.120159:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (767557632->771751935) req@ffff88009ba64700 x1798653938162048/t4294970137(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:664/0 lens 488/448 e 0 to 0 dl 1715330464 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330453.120169:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba64700 with x1798653938162048 ext(767557632->771751935) 00002000:00010000:0.0:1715330453.120174:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba64700 00000100:00100000:3.0:1715330453.130950:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330453.132211:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938162176 00000100:00100000:0.0:1715330453.132221:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938162176 00002000:00100000:0.0:1715330453.132280:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (771751936->775946239) req@ffff880093b73800 x1798653938162176/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:664/0 lens 488/0 e 0 to 0 dl 1715330464 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330453.132290:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b73800 with x1798653938162176 ext(771751936->775946239) 00002000:00010000:0.0:1715330453.132295:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b73800 00000100:00100000:0.0:1715330453.132329:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 272 00000100:00100000:0.0:1715330453.132336:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+71:2012:x1798653938162176:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330453.181693:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330453.184802:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938162304 00000100:00100000:2.0:1715330453.184816:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938162304 00002000:00100000:2.0:1715330453.184866:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (775946240->780140543) req@ffff8801213d1500 x1798653938162304/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:664/0 lens 488/0 e 0 to 0 dl 1715330464 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330453.184875:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801213d1500 with x1798653938162304 ext(775946240->780140543) 00002000:00010000:2.0:1715330453.184881:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801213d1500 00000100:00100000:2.0:1715330453.184912:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 273 00000100:00100000:2.0:1715330453.184918:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801213d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+75:2013:x1798653938162304:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330453.185894:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+74:2012:x1798653938162176:12345-192.168.204.49@tcp:4:dd.0 Request processed in 53556us (54949us total) trans 4294970138 rc 0/0 00000100:00100000:1.0:1715330453.185902:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 272 00002000:00100000:1.0:1715330453.185909:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (771751936->775946239) req@ffff880093b73800 x1798653938162176/t4294970138(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:664/0 lens 488/448 e 0 to 0 dl 1715330464 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330453.185916:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b73800 with x1798653938162176 ext(771751936->775946239) 00002000:00010000:1.0:1715330453.185921:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b73800 00000100:00100000:0.0:1715330453.240067:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801213d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+75:2013:x1798653938162304:12345-192.168.204.49@tcp:4:dd.0 Request processed in 55139us (58373us total) trans 4294970139 rc 0/0 00000100:00100000:0.0:1715330453.240081:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 273 00002000:00100000:0.0:1715330453.240093:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (775946240->780140543) req@ffff8801213d1500 x1798653938162304/t4294970139(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:664/0 lens 488/448 e 0 to 0 dl 1715330464 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330453.240102:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801213d1500 with x1798653938162304 ext(775946240->780140543) 00002000:00010000:0.0:1715330453.240108:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801213d1500 00000100:00100000:0.0:1715330453.249890:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330453.250001:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938162432 00000100:00100000:2.0:1715330453.250010:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938162432 00002000:00100000:2.0:1715330453.250055:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (780140544->784334847) req@ffff8801213d1880 x1798653938162432/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:664/0 lens 488/0 e 0 to 0 dl 1715330464 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330453.250064:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801213d1880 with x1798653938162432 ext(780140544->784334847) 00002000:00010000:2.0:1715330453.250070:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801213d1880 00000100:00100000:1.0:1715330453.252367:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 274 00000100:00100000:1.0:1715330453.252378:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801213d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+75:2014:x1798653938162432:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330453.283539:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b55fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942551040:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1715330453.283646:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330453.286034:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942551040 00000100:00100000:2.0:1715330453.286044:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942551040 00000100:00100000:2.0:1715330453.286103:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3156 00000100:00100000:2.0:1715330453.286109:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009132ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:3689:x1798653942551040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1715330453.286163:0:8592:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444089856 avail 1314627584 00000100:00100000:2.0:1715330453.286227:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009132ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:3689:x1798653942551040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (2581us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330453.286233:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3156 00000100:00100000:1.0:1715330453.288984:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b55fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942551040:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1715330453.296909:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801213d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+77:2014:x1798653938162432:12345-192.168.204.49@tcp:4:dd.0 Request processed in 44525us (47018us total) trans 4294970140 rc 0/0 00000100:00100000:0.0:1715330453.296922:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 274 00002000:00100000:0.0:1715330453.296934:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (780140544->784334847) req@ffff8801213d1880 x1798653938162432/t4294970140(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:664/0 lens 488/448 e 0 to 0 dl 1715330464 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330453.296941:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801213d1880 with x1798653938162432 ext(780140544->784334847) 00002000:00010000:0.0:1715330453.296946:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801213d1880 00000100:00100000:0.0:1715330453.308839:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330453.308999:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938162560 00000100:00100000:2.0:1715330453.309007:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938162560 00002000:00100000:2.0:1715330453.309042:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (784334848->788529151) req@ffff8801213d1c00 x1798653938162560/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:664/0 lens 488/0 e 0 to 0 dl 1715330464 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330453.309051:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801213d1c00 with x1798653938162560 ext(784334848->788529151) 00002000:00010000:2.0:1715330453.309055:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801213d1c00 00000100:00100000:2.0:1715330453.309150:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 275 00000100:00100000:2.0:1715330453.309157:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801213d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+77:2011:x1798653938162560:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330453.358880:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330453.359583:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938162688 00000100:00100000:0.0:1715330453.359593:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938162688 00002000:00100000:0.0:1715330453.359632:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (788529152->792723455) req@ffff88012f57a300 x1798653938162688/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:664/0 lens 488/0 e 0 to 0 dl 1715330464 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330453.359642:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f57a300 with x1798653938162688 ext(788529152->792723455) 00002000:00010000:0.0:1715330453.359647:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f57a300 00000100:00100000:0.0:1715330453.359684:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 276 00000100:00100000:0.0:1715330453.359691:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f57a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+79:2011:x1798653938162688:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330453.404629:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801213d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+81:2011:x1798653938162560:12345-192.168.204.49@tcp:4:dd.0 Request processed in 95458us (95783us total) trans 4294970141 rc 0/0 00000100:00100000:0.0:1715330453.404644:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 275 00002000:00100000:0.0:1715330453.404659:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (784334848->788529151) req@ffff8801213d1c00 x1798653938162560/t4294970141(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:664/0 lens 488/448 e 0 to 0 dl 1715330464 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330453.404668:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801213d1c00 with x1798653938162560 ext(784334848->788529151) 00002000:00010000:0.0:1715330453.404675:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801213d1c00 00000100:00100000:0.0:1715330453.411759:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330453.414213:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938162816 00000100:00100000:0.0:1715330453.414224:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938162816 00002000:00100000:0.0:1715330453.414256:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (792723456->796917759) req@ffff8801213d1f80 x1798653938162816/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:664/0 lens 488/0 e 0 to 0 dl 1715330464 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330453.414266:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801213d1f80 with x1798653938162816 ext(792723456->796917759) 00002000:00010000:0.0:1715330453.414271:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801213d1f80 00000100:00100000:2.0:1715330453.419867:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 277 00000100:00100000:2.0:1715330453.419879:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801213d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+83:2011:x1798653938162816:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330453.423810:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f57a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+83:2011:x1798653938162688:12345-192.168.204.49@tcp:4:dd.0 Request processed in 64112us (64930us total) trans 4294970142 rc 0/0 00000100:00100000:0.0:1715330453.423821:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 276 00002000:00100000:0.0:1715330453.423830:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (788529152->792723455) req@ffff88012f57a300 x1798653938162688/t4294970142(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:664/0 lens 488/448 e 0 to 0 dl 1715330464 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330453.423839:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f57a300 with x1798653938162688 ext(788529152->792723455) 00002000:00010000:0.0:1715330453.423843:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f57a300 00000100:00100000:1.0:1715330453.471340:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801213d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+83:2011:x1798653938162816:12345-192.168.204.49@tcp:4:dd.0 Request processed in 51453us (59602us total) trans 4294970143 rc 0/0 00000100:00100000:1.0:1715330453.471355:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 277 00002000:00100000:1.0:1715330453.471366:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (792723456->796917759) req@ffff8801213d1f80 x1798653938162816/t4294970143(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:664/0 lens 488/448 e 0 to 0 dl 1715330464 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330453.471376:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801213d1f80 with x1798653938162816 ext(792723456->796917759) 00002000:00010000:1.0:1715330453.471383:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801213d1f80 00000100:00100000:2.0:1715330453.492982:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330453.493084:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938162944 00000100:00100000:1.0:1715330453.493095:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938162944 00002000:00100000:1.0:1715330453.493145:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (796917760->801112063) req@ffff8800877ec000 x1798653938162944/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:664/0 lens 488/0 e 0 to 0 dl 1715330464 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330453.493157:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800877ec000 with x1798653938162944 ext(796917760->801112063) 00002000:00010000:1.0:1715330453.493163:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800877ec000 00000100:00100000:1.0:1715330453.493185:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 278 00000100:00100000:1.0:1715330453.493191:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+83:2011:x1798653938162944:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330453.533304:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330453.534042:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938163072 00000100:00100000:0.0:1715330453.534052:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938163072 00002000:00100000:0.0:1715330453.534092:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (801112064->805306367) req@ffff8800877edf80 x1798653938163072/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:664/0 lens 488/0 e 0 to 0 dl 1715330464 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330453.534101:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800877edf80 with x1798653938163072 ext(801112064->805306367) 00002000:00010000:0.0:1715330453.534106:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800877edf80 00000100:00100000:0.0:1715330453.534141:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 279 00000100:00100000:0.0:1715330453.534147:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+87:2011:x1798653938163072:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330453.548470:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+87:2011:x1798653938162944:12345-192.168.204.49@tcp:4:dd.0 Request processed in 55268us (55490us total) trans 4294970144 rc 0/0 00000100:00100000:1.0:1715330453.548482:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 278 00002000:00100000:1.0:1715330453.548494:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (796917760->801112063) req@ffff8800877ec000 x1798653938162944/t4294970144(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:664/0 lens 488/448 e 0 to 0 dl 1715330464 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330453.548502:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800877ec000 with x1798653938162944 ext(796917760->801112063) 00002000:00010000:1.0:1715330453.548508:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800877ec000 00000100:00100000:0.0:1715330453.583639:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+87:2011:x1798653938163072:12345-192.168.204.49@tcp:4:dd.0 Request processed in 49481us (50333us total) trans 4294970145 rc 0/0 00000100:00100000:0.0:1715330453.583652:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 279 00002000:00100000:0.0:1715330453.583664:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (801112064->805306367) req@ffff8800877edf80 x1798653938163072/t4294970145(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:664/0 lens 488/448 e 0 to 0 dl 1715330464 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330453.583680:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800877edf80 with x1798653938163072 ext(801112064->805306367) 00002000:00010000:0.0:1715330453.583685:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800877edf80 00000100:00100000:3.0:1715330453.596489:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330453.596587:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938163200 00000100:00100000:1.0:1715330453.596596:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938163200 00002000:00100000:1.0:1715330453.596630:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (805306368->809500671) req@ffff88012b55fb80 x1798653938163200/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:664/0 lens 488/0 e 0 to 0 dl 1715330464 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330453.596639:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b55fb80 with x1798653938163200 ext(805306368->809500671) 00002000:00010000:1.0:1715330453.596644:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b55fb80 00000100:00100000:1.0:1715330453.596675:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 280 00000100:00100000:1.0:1715330453.596681:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+87:2012:x1798653938163200:12345-192.168.204.49@tcp:4:dd.0 00010000:00010000:2.0:1715330453.637407:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330453.652979:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330453.653074:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938163328 00000100:00100000:2.0:1715330453.653081:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938163328 00002000:00100000:2.0:1715330453.653111:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (809500672->813694975) req@ffff88008b0c3800 x1798653938163328/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:664/0 lens 488/0 e 0 to 0 dl 1715330464 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330453.653125:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b0c3800 with x1798653938163328 ext(809500672->813694975) 00002000:00010000:2.0:1715330453.653129:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008b0c3800 00000100:00100000:2.0:1715330453.653152:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 281 00000100:00100000:2.0:1715330453.653157:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+91:2011:x1798653938163328:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330453.664728:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+91:2012:x1798653938163200:12345-192.168.204.49@tcp:4:dd.0 Request processed in 68036us (68235us total) trans 4294970146 rc 0/0 00000100:00100000:1.0:1715330453.664751:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 280 00002000:00100000:1.0:1715330453.664764:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (805306368->809500671) req@ffff88012b55fb80 x1798653938163200/t4294970146(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:664/0 lens 488/448 e 0 to 0 dl 1715330464 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330453.664774:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b55fb80 with x1798653938163200 ext(805306368->809500671) 00002000:00010000:1.0:1715330453.664781:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b55fb80 00000100:00100000:0.0:1715330453.708332:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+91:2011:x1798653938163328:12345-192.168.204.49@tcp:4:dd.0 Request processed in 55166us (55353us total) trans 4294970147 rc 0/0 00000100:00100000:0.0:1715330453.708344:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 281 00002000:00100000:0.0:1715330453.708427:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (809500672->813694975) req@ffff88008b0c3800 x1798653938163328/t4294970147(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:664/0 lens 488/448 e 0 to 0 dl 1715330464 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330453.708436:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b0c3800 with x1798653938163328 ext(809500672->813694975) 00002000:00010000:0.0:1715330453.708442:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008b0c3800 00000100:00100000:2.0:1715330453.708491:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330453.708764:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938163456 00000100:00100000:0.0:1715330453.708874:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938163456 00002000:00100000:0.0:1715330453.708900:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (813694976->817889279) req@ffff8800877ee680 x1798653938163456/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:664/0 lens 488/0 e 0 to 0 dl 1715330464 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330453.708907:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800877ee680 with x1798653938163456 ext(813694976->817889279) 00002000:00010000:0.0:1715330453.708910:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800877ee680 00000100:00100000:0.0:1715330453.709350:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 282 00000100:00100000:0.0:1715330453.709356:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+91:2013:x1798653938163456:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330453.747439:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+93:2013:x1798653938163456:12345-192.168.204.49@tcp:4:dd.0 Request processed in 38073us (38948us total) trans 4294970148 rc 0/0 00000100:00100000:0.0:1715330453.747451:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 282 00002000:00100000:0.0:1715330453.747463:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (813694976->817889279) req@ffff8800877ee680 x1798653938163456/t4294970148(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:664/0 lens 488/448 e 0 to 0 dl 1715330464 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330453.747477:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800877ee680 with x1798653938163456 ext(813694976->817889279) 00002000:00010000:0.0:1715330453.747482:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800877ee680 00000100:00100000:3.0:1715330453.760054:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330453.760183:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938163584 00000100:00100000:0.0:1715330453.760191:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938163584 00002000:00100000:0.0:1715330453.760225:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (817889280->822083583) req@ffff88008b0c0700 x1798653938163584/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:664/0 lens 488/0 e 0 to 0 dl 1715330464 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330453.760234:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b0c0700 with x1798653938163584 ext(817889280->822083583) 00002000:00010000:0.0:1715330453.760238:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008b0c0700 00000100:00100000:0.0:1715330453.760266:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 283 00000100:00100000:0.0:1715330453.760272:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b0c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+93:2014:x1798653938163584:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330453.800932:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b0c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+95:2014:x1798653938163584:12345-192.168.204.49@tcp:4:dd.0 Request processed in 40649us (40876us total) trans 4294970149 rc 0/0 00000100:00100000:0.0:1715330453.800946:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 283 00002000:00100000:0.0:1715330453.800957:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (817889280->822083583) req@ffff88008b0c0700 x1798653938163584/t4294970149(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:664/0 lens 488/448 e 0 to 0 dl 1715330464 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330453.800967:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b0c0700 with x1798653938163584 ext(817889280->822083583) 00002000:00010000:0.0:1715330453.800975:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008b0c0700 00000100:00100000:2.0:1715330453.818287:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330453.818360:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938163712 00000100:00100000:0.0:1715330453.818368:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938163712 00002000:00100000:0.0:1715330453.818404:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (822083584->826277887) req@ffff8800877ef100 x1798653938163712/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:664/0 lens 488/0 e 0 to 0 dl 1715330464 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330453.818414:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800877ef100 with x1798653938163712 ext(822083584->826277887) 00002000:00010000:0.0:1715330453.818418:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800877ef100 00000100:00100000:0.0:1715330453.818583:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 284 00000100:00100000:0.0:1715330453.818590:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+95:2011:x1798653938163712:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330453.865609:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+97:2011:x1798653938163712:12345-192.168.204.49@tcp:4:dd.0 Request processed in 47006us (47318us total) trans 4294970150 rc 0/0 00000100:00100000:0.0:1715330453.865622:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 284 00002000:00100000:0.0:1715330453.865633:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (822083584->826277887) req@ffff8800877ef100 x1798653938163712/t4294970150(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:664/0 lens 488/448 e 0 to 0 dl 1715330464 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330453.865642:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800877ef100 with x1798653938163712 ext(822083584->826277887) 00002000:00010000:0.0:1715330453.865647:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800877ef100 00000100:00100000:2.0:1715330453.902768:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330453.902828:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938163840 00000100:00100000:0.0:1715330453.902837:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938163840 00002000:00100000:0.0:1715330453.902871:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (826277888->830472191) req@ffff8800877ef800 x1798653938163840/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:664/0 lens 488/0 e 0 to 0 dl 1715330464 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330453.902878:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800877ef800 with x1798653938163840 ext(826277888->830472191) 00002000:00010000:0.0:1715330453.902883:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800877ef800 00000100:00100000:0.0:1715330453.902914:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 285 00000100:00100000:0.0:1715330453.902920:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+97:2013:x1798653938163840:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330453.972974:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+99:2013:x1798653938163840:12345-192.168.204.49@tcp:4:dd.0 Request processed in 70042us (70231us total) trans 4294970151 rc 0/0 00000100:00100000:0.0:1715330453.972987:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 285 00002000:00100000:0.0:1715330453.972998:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (826277888->830472191) req@ffff8800877ef800 x1798653938163840/t4294970151(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:664/0 lens 488/448 e 0 to 0 dl 1715330464 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330453.973006:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800877ef800 with x1798653938163840 ext(826277888->830472191) 00002000:00010000:0.0:1715330453.973013:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800877ef800 00000100:00100000:2.0:1715330453.993122:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330453.993442:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938163968 00000100:00100000:0.0:1715330453.993450:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938163968 00002000:00100000:0.0:1715330453.993482:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (830472192->834666495) req@ffff8800877ee300 x1798653938163968/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:664/0 lens 488/0 e 0 to 0 dl 1715330464 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330453.993490:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800877ee300 with x1798653938163968 ext(830472192->834666495) 00002000:00010000:0.0:1715330453.993494:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800877ee300 00000100:00100000:0.0:1715330453.993528:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 286 00000100:00100000:0.0:1715330453.993533:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+99:2014:x1798653938163968:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330454.051232:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+101:2014:x1798653938163968:12345-192.168.204.49@tcp:4:dd.0 Request processed in 57690us (58110us total) trans 4294970152 rc 0/0 00000100:00100000:0.0:1715330454.051243:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 286 00002000:00100000:0.0:1715330454.051254:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (830472192->834666495) req@ffff8800877ee300 x1798653938163968/t4294970152(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:664/0 lens 488/448 e 0 to 0 dl 1715330464 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330454.051262:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800877ee300 with x1798653938163968 ext(830472192->834666495) 00002000:00010000:0.0:1715330454.051267:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800877ee300 00000100:00100000:3.0:1715330454.051825:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330454.052241:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938164096 00000100:00100000:0.0:1715330454.052250:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938164096 00002000:00100000:0.0:1715330454.052300:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (834666496->838860799) req@ffff880091eee680 x1798653938164096/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:665/0 lens 488/0 e 0 to 0 dl 1715330465 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330454.052309:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091eee680 with x1798653938164096 ext(834666496->838860799) 00002000:00010000:0.0:1715330454.052315:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091eee680 00000100:00100000:0.0:1715330454.053304:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 287 00000100:00100000:0.0:1715330454.053313:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091eee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+101:2011:x1798653938164096:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330454.094297:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091eee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+103:2011:x1798653938164096:12345-192.168.204.49@tcp:4:dd.0 Request processed in 40968us (42461us total) trans 4294970153 rc 0/0 00000100:00100000:0.0:1715330454.094314:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 287 00002000:00100000:0.0:1715330454.094329:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (834666496->838860799) req@ffff880091eee680 x1798653938164096/t4294970153(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:665/0 lens 488/448 e 0 to 0 dl 1715330465 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330454.094341:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091eee680 with x1798653938164096 ext(834666496->838860799) 00002000:00010000:0.0:1715330454.094348:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091eee680 00000100:00100000:2.0:1715330454.147653:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330454.147767:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938164224 00000100:00100000:0.0:1715330454.147779:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938164224 00002000:00100000:0.0:1715330454.147825:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (838860800->843055103) req@ffff8800877efb80 x1798653938164224/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:665/0 lens 488/0 e 0 to 0 dl 1715330465 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330454.147836:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800877efb80 with x1798653938164224 ext(838860800->843055103) 00002000:00010000:0.0:1715330454.147842:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800877efb80 00000100:00100000:0.0:1715330454.147881:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 288 00000100:00100000:0.0:1715330454.147888:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+103:2014:x1798653938164224:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330454.197392:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330454.197899:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938164352 00000100:00100000:1.0:1715330454.197908:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938164352 00002000:00100000:1.0:1715330454.197944:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (843055104->847249407) req@ffff88008d7f2d80 x1798653938164352/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:665/0 lens 488/0 e 0 to 0 dl 1715330465 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330454.197958:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d7f2d80 with x1798653938164352 ext(843055104->847249407) 00002000:00010000:1.0:1715330454.197963:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d7f2d80 00000100:00100000:1.0:1715330454.197993:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 289 00000100:00100000:1.0:1715330454.197999:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+105:2013:x1798653938164352:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330454.231305:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+107:2014:x1798653938164224:12345-192.168.204.49@tcp:4:dd.0 Request processed in 83407us (83654us total) trans 4294970154 rc 0/0 00000100:00100000:0.0:1715330454.231317:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 288 00002000:00100000:0.0:1715330454.231328:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (838860800->843055103) req@ffff8800877efb80 x1798653938164224/t4294970154(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:665/0 lens 488/448 e 0 to 0 dl 1715330465 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330454.231338:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800877efb80 with x1798653938164224 ext(838860800->843055103) 00002000:00010000:0.0:1715330454.231343:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800877efb80 00000100:00100000:1.0:1715330454.242941:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330454.243083:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938164480 00000100:00100000:0.0:1715330454.243092:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938164480 00002000:00100000:0.0:1715330454.243124:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (847249408->851443711) req@ffff88012f578700 x1798653938164480/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:665/0 lens 488/0 e 0 to 0 dl 1715330465 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330454.243133:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f578700 with x1798653938164480 ext(847249408->851443711) 00002000:00010000:0.0:1715330454.243137:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f578700 00000100:00100000:0.0:1715330454.243167:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 290 00000100:00100000:0.0:1715330454.243172:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f578700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+109:2013:x1798653938164480:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330454.245714:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+108:2013:x1798653938164352:12345-192.168.204.49@tcp:4:dd.0 Request processed in 47707us (48323us total) trans 4294970155 rc 0/0 00000100:00100000:1.0:1715330454.245725:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 289 00002000:00100000:1.0:1715330454.245762:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (843055104->847249407) req@ffff88008d7f2d80 x1798653938164352/t4294970155(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:665/0 lens 488/448 e 0 to 0 dl 1715330465 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330454.245771:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d7f2d80 with x1798653938164352 ext(843055104->847249407) 00002000:00010000:1.0:1715330454.245775:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d7f2d80 00000100:00100000:0.0:1715330454.276022:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f578700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+109:2013:x1798653938164480:12345-192.168.204.49@tcp:4:dd.0 Request processed in 32839us (33079us total) trans 4294970156 rc 0/0 00000100:00100000:0.0:1715330454.276035:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 290 00002000:00100000:0.0:1715330454.276047:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (847249408->851443711) req@ffff88012f578700 x1798653938164480/t4294970156(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:665/0 lens 488/448 e 0 to 0 dl 1715330465 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330454.276056:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f578700 with x1798653938164480 ext(847249408->851443711) 00002000:00010000:0.0:1715330454.276062:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f578700 00000100:00100000:1.0:1715330454.281643:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330454.282310:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938164608 00000100:00100000:0.0:1715330454.282320:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938164608 00002000:00100000:0.0:1715330454.282368:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (851443712->855638015) req@ffff88008d4eb100 x1798653938164608/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:665/0 lens 488/0 e 0 to 0 dl 1715330465 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330454.282379:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d4eb100 with x1798653938164608 ext(851443712->855638015) 00002000:00010000:0.0:1715330454.282385:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d4eb100 00000100:00100000:0.0:1715330454.282405:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 291 00000100:00100000:0.0:1715330454.282413:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+109:2013:x1798653938164608:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330454.318057:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+111:2013:x1798653938164608:12345-192.168.204.49@tcp:4:dd.0 Request processed in 35636us (36419us total) trans 4294970157 rc 0/0 00000100:00100000:0.0:1715330454.318072:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 291 00002000:00100000:0.0:1715330454.318083:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (851443712->855638015) req@ffff88008d4eb100 x1798653938164608/t4294970157(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:665/0 lens 488/448 e 0 to 0 dl 1715330465 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330454.318092:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d4eb100 with x1798653938164608 ext(851443712->855638015) 00002000:00010000:0.0:1715330454.318097:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d4eb100 00000100:00100000:2.0:1715330454.337418:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330454.337498:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938164736 00000100:00100000:0.0:1715330454.337508:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938164736 00002000:00100000:0.0:1715330454.337561:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (855638016->859832319) req@ffff8800877ec380 x1798653938164736/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:665/0 lens 488/0 e 0 to 0 dl 1715330465 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330454.337572:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800877ec380 with x1798653938164736 ext(855638016->859832319) 00002000:00010000:0.0:1715330454.337578:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800877ec380 00000100:00100000:0.0:1715330454.337611:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 292 00000100:00100000:0.0:1715330454.337618:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+111:2014:x1798653938164736:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330454.375086:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+113:2014:x1798653938164736:12345-192.168.204.49@tcp:4:dd.0 Request processed in 37458us (37667us total) trans 4294970158 rc 0/0 00000100:00100000:0.0:1715330454.375098:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 292 00002000:00100000:0.0:1715330454.375109:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (855638016->859832319) req@ffff8800877ec380 x1798653938164736/t4294970158(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:665/0 lens 488/448 e 0 to 0 dl 1715330465 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330454.375117:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800877ec380 with x1798653938164736 ext(855638016->859832319) 00002000:00010000:0.0:1715330454.375122:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800877ec380 00000100:00100000:2.0:1715330454.392572:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330454.395923:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938164864 00000100:00100000:0.0:1715330454.395935:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938164864 00002000:00100000:1.0:1715330454.396037:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (859832320->864026623) req@ffff8800877ed500 x1798653938164864/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:665/0 lens 488/0 e 0 to 0 dl 1715330465 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330454.396046:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800877ed500 with x1798653938164864 ext(859832320->864026623) 00002000:00010000:1.0:1715330454.396051:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800877ed500 00000100:00100000:1.0:1715330454.396146:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 293 00000100:00100000:1.0:1715330454.396152:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+113:2013:x1798653938164864:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330454.432980:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330454.433903:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938164992 00000100:00100000:0.0:1715330454.433912:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938164992 00002000:00100000:0.0:1715330454.433950:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (864026624->868220927) req@ffff8800877eca80 x1798653938164992/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:665/0 lens 488/0 e 0 to 0 dl 1715330465 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330454.433961:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800877eca80 with x1798653938164992 ext(864026624->868220927) 00002000:00010000:0.0:1715330454.433965:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800877eca80 00000100:00100000:0.0:1715330454.433995:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 294 00000100:00100000:0.0:1715330454.434002:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+115:2013:x1798653938164992:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330454.501756:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+117:2013:x1798653938164864:12345-192.168.204.49@tcp:4:dd.0 Request processed in 101436us (105023us total) trans 4294970159 rc 0/0 00000100:00100000:0.0:1715330454.501782:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 293 00002000:00100000:0.0:1715330454.501798:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (859832320->864026623) req@ffff8800877ed500 x1798653938164864/t4294970159(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:665/0 lens 488/448 e 0 to 0 dl 1715330465 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330454.501808:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800877ed500 with x1798653938164864 ext(859832320->864026623) 00002000:00010000:0.0:1715330454.501813:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800877ed500 00000100:00100000:0.0:1715330454.512953:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+117:2013:x1798653938164992:12345-192.168.204.49@tcp:4:dd.0 Request processed in 78942us (79974us total) trans 4294970160 rc 0/0 00000100:00100000:0.0:1715330454.512963:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 294 00002000:00100000:0.0:1715330454.512974:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (864026624->868220927) req@ffff8800877eca80 x1798653938164992/t4294970160(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:665/0 lens 488/448 e 0 to 0 dl 1715330465 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330454.512983:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800877eca80 with x1798653938164992 ext(864026624->868220927) 00002000:00010000:0.0:1715330454.512987:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800877eca80 00000100:00100000:2.0:1715330454.518643:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330454.519963:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938165120 00000100:00100000:0.0:1715330454.519974:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938165120 00002000:00100000:0.0:1715330454.520014:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (868220928->872415231) req@ffff8800877eed80 x1798653938165120/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:665/0 lens 488/0 e 0 to 0 dl 1715330465 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330454.520025:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800877eed80 with x1798653938165120 ext(868220928->872415231) 00002000:00010000:0.0:1715330454.520030:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800877eed80 00000100:00100000:1.0:1715330454.524803:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 295 00000100:00100000:1.0:1715330454.524816:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+117:2014:x1798653938165120:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330454.564867:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330454.566758:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938165248 00000100:00100000:3.0:1715330454.566767:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938165248 00002000:00100000:3.0:1715330454.566803:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (872415232->876609535) req@ffff8801213d2300 x1798653938165248/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:665/0 lens 488/0 e 0 to 0 dl 1715330465 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330454.566812:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801213d2300 with x1798653938165248 ext(872415232->876609535) 00002000:00010000:3.0:1715330454.566816:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801213d2300 00000100:00100000:3.0:1715330454.566833:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 296 00000100:00100000:3.0:1715330454.566838:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801213d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+119:2012:x1798653938165248:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330454.581280:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+121:2014:x1798653938165120:12345-192.168.204.49@tcp:4:dd.0 Request processed in 56458us (62635us total) trans 4294970161 rc 0/0 00000100:00100000:1.0:1715330454.581293:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 295 00002000:00100000:1.0:1715330454.581305:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (868220928->872415231) req@ffff8800877eed80 x1798653938165120/t4294970161(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:665/0 lens 488/448 e 0 to 0 dl 1715330465 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330454.581314:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800877eed80 with x1798653938165120 ext(868220928->872415231) 00002000:00010000:1.0:1715330454.581319:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800877eed80 00000100:00100000:1.0:1715330454.622034:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330454.623402:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938165376 00000100:00100000:0.0:1715330454.623410:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938165376 00002000:00100000:0.0:1715330454.623476:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (876609536->880803839) req@ffff88008d4ebb80 x1798653938165376/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:665/0 lens 488/0 e 0 to 0 dl 1715330465 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330454.623485:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d4ebb80 with x1798653938165376 ext(876609536->880803839) 00002000:00010000:0.0:1715330454.623491:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d4ebb80 00000100:00100000:0.0:1715330454.623526:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 297 00000100:00100000:0.0:1715330454.623532:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+121:2011:x1798653938165376:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330454.634154:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801213d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+123:2012:x1798653938165248:12345-192.168.204.49@tcp:4:dd.0 Request processed in 67305us (69284us total) trans 4294970162 rc 0/0 00000100:00100000:3.0:1715330454.634168:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 296 00002000:00100000:3.0:1715330454.634181:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (872415232->876609535) req@ffff8801213d2300 x1798653938165248/t4294970162(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:665/0 lens 488/448 e 0 to 0 dl 1715330465 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330454.634190:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801213d2300 with x1798653938165248 ext(872415232->876609535) 00002000:00010000:3.0:1715330454.634196:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801213d2300 00010000:00010000:1.0:1715330454.639884:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330454.678104:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+123:2011:x1798653938165376:12345-192.168.204.49@tcp:4:dd.0 Request processed in 54560us (56067us total) trans 4294970163 rc 0/0 00000100:00100000:0.0:1715330454.678116:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 297 00002000:00100000:0.0:1715330454.678128:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (876609536->880803839) req@ffff88008d4ebb80 x1798653938165376/t4294970163(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:665/0 lens 488/448 e 0 to 0 dl 1715330465 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330454.678136:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d4ebb80 with x1798653938165376 ext(876609536->880803839) 00002000:00010000:0.0:1715330454.678141:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d4ebb80 00000100:00100000:2.0:1715330454.685313:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330454.686554:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938165504 00000100:00100000:0.0:1715330454.686563:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938165504 00002000:00100000:0.0:1715330454.686600:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (880803840->884998143) req@ffff8800877ec700 x1798653938165504/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:665/0 lens 488/0 e 0 to 0 dl 1715330465 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330454.686609:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800877ec700 with x1798653938165504 ext(880803840->884998143) 00002000:00010000:0.0:1715330454.686614:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800877ec700 00000100:00100000:0.0:1715330454.686648:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 298 00000100:00100000:0.0:1715330454.686654:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+123:2011:x1798653938165504:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330454.709408:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1715330454.709430:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801344f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942551104:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1715330454.709546:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330454.709647:0:7139:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942551104 00000100:00100000:2.0:1715330454.709654:0:7139:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942551104 00000100:00100000:2.0:1715330454.709779:0:7139:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3157 00000100:00100000:2.0:1715330454.709784:0:7139:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942551104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1715330454.709814:0:7139:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445060608 avail 1315598336 00000100:00100000:2.0:1715330454.709848:0:7139:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942551104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330454.709854:0:7139:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3157 00000100:00100000:1.0:1715330454.709917:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801344f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942551104:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1715330454.738076:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+125:2011:x1798653938165504:12345-192.168.204.49@tcp:4:dd.0 Request processed in 51414us (52762us total) trans 4294970164 rc 0/0 00000100:00100000:0.0:1715330454.738088:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 298 00002000:00100000:0.0:1715330454.738100:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (880803840->884998143) req@ffff8800877ec700 x1798653938165504/t4294970164(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:665/0 lens 488/448 e 0 to 0 dl 1715330465 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330454.738109:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800877ec700 with x1798653938165504 ext(880803840->884998143) 00002000:00010000:0.0:1715330454.738114:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800877ec700 00000100:00100000:3.0:1715330454.741125:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330454.741185:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938165632 00000100:00100000:0.0:1715330454.741192:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938165632 00002000:00100000:0.0:1715330454.741224:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (884998144->889192447) req@ffff8801344f1c00 x1798653938165632/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:665/0 lens 488/0 e 0 to 0 dl 1715330465 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330454.741232:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801344f1c00 with x1798653938165632 ext(884998144->889192447) 00002000:00010000:0.0:1715330454.741236:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801344f1c00 00000100:00100000:0.0:1715330454.741262:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 299 00000100:00100000:0.0:1715330454.741267:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+125:2011:x1798653938165632:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330454.802872:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+127:2011:x1798653938165632:12345-192.168.204.49@tcp:4:dd.0 Request processed in 61594us (61743us total) trans 4294970165 rc 0/0 00000100:00100000:0.0:1715330454.802886:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 299 00002000:00100000:0.0:1715330454.802897:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (884998144->889192447) req@ffff8801344f1c00 x1798653938165632/t4294970165(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:665/0 lens 488/448 e 0 to 0 dl 1715330465 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330454.802911:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801344f1c00 with x1798653938165632 ext(884998144->889192447) 00002000:00010000:0.0:1715330454.802917:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801344f1c00 00000100:00100000:1.0:1715330454.803146:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330454.803596:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938165760 00000100:00100000:0.0:1715330454.803603:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938165760 00002000:00100000:0.0:1715330454.803628:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (889192448->893386751) req@ffff88006c454000 x1798653938165760/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:665/0 lens 488/0 e 0 to 0 dl 1715330465 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330454.803635:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88006c454000 with x1798653938165760 ext(889192448->893386751) 00002000:00010000:0.0:1715330454.803638:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88006c454000 00000100:00100000:0.0:1715330454.803659:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 300 00000100:00100000:0.0:1715330454.803664:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006c454000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+127:2011:x1798653938165760:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330454.842049:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006c454000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+129:2011:x1798653938165760:12345-192.168.204.49@tcp:4:dd.0 Request processed in 38374us (38894us total) trans 4294970166 rc 0/0 00000100:00100000:0.0:1715330454.842064:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 300 00002000:00100000:0.0:1715330454.842076:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (889192448->893386751) req@ffff88006c454000 x1798653938165760/t4294970166(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:665/0 lens 488/448 e 0 to 0 dl 1715330465 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330454.842086:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88006c454000 with x1798653938165760 ext(889192448->893386751) 00002000:00010000:0.0:1715330454.842092:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88006c454000 00000100:00100000:1.0:1715330454.865108:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330454.865811:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938165888 00000100:00100000:0.0:1715330454.865820:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938165888 00002000:00100000:0.0:1715330454.865856:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (893386752->897581055) req@ffff88006c454380 x1798653938165888/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:665/0 lens 488/0 e 0 to 0 dl 1715330465 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330454.865866:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88006c454380 with x1798653938165888 ext(893386752->897581055) 00002000:00010000:0.0:1715330454.865871:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88006c454380 00000100:00100000:0.0:1715330454.865902:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 301 00000100:00100000:0.0:1715330454.865908:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006c454380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+129:2014:x1798653938165888:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330454.909108:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006c454380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+131:2014:x1798653938165888:12345-192.168.204.49@tcp:4:dd.0 Request processed in 43188us (43999us total) trans 4294970167 rc 0/0 00000100:00100000:0.0:1715330454.909122:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 301 00002000:00100000:0.0:1715330454.909134:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (893386752->897581055) req@ffff88006c454380 x1798653938165888/t4294970167(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:665/0 lens 488/448 e 0 to 0 dl 1715330465 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330454.909144:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88006c454380 with x1798653938165888 ext(893386752->897581055) 00002000:00010000:0.0:1715330454.909150:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88006c454380 00000100:00100000:2.0:1715330454.960012:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330454.960231:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938166016 00000100:00100000:0.0:1715330454.960238:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938166016 00002000:00100000:0.0:1715330454.960273:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (897581056->901775359) req@ffff8800877edc00 x1798653938166016/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:665/0 lens 488/0 e 0 to 0 dl 1715330465 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330454.960283:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800877edc00 with x1798653938166016 ext(897581056->901775359) 00002000:00010000:0.0:1715330454.960288:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800877edc00 00000100:00100000:0.0:1715330454.960320:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 302 00000100:00100000:0.0:1715330454.960326:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+131:2013:x1798653938166016:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330455.007243:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+133:2013:x1798653938166016:12345-192.168.204.49@tcp:4:dd.0 Request processed in 46908us (47235us total) trans 4294970168 rc 0/0 00000100:00100000:0.0:1715330455.007255:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 302 00002000:00100000:0.0:1715330455.007266:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (897581056->901775359) req@ffff8800877edc00 x1798653938166016/t4294970168(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:665/0 lens 488/448 e 0 to 0 dl 1715330465 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330455.007274:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800877edc00 with x1798653938166016 ext(897581056->901775359) 00002000:00010000:0.0:1715330455.007280:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800877edc00 00000100:00100000:1.0:1715330455.025906:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330455.027480:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938166144 00000100:00100000:0.0:1715330455.027488:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938166144 00002000:00100000:0.0:1715330455.027563:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (901775360->905969663) req@ffff88006c454700 x1798653938166144/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:666/0 lens 488/0 e 0 to 0 dl 1715330466 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330455.027572:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88006c454700 with x1798653938166144 ext(901775360->905969663) 00002000:00010000:0.0:1715330455.027576:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88006c454700 00000100:00080000:1.0:1715330455.027658:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330425 00000100:00100000:1.0:1715330455.027810:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 303 00000100:00100000:1.0:1715330455.027816:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006c454700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+133:2011:x1798653938166144:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330455.082775:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006c454700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+135:2011:x1798653938166144:12345-192.168.204.49@tcp:4:dd.0 Request processed in 54951us (56870us total) trans 4294970169 rc 0/0 00000100:00100000:1.0:1715330455.082788:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 303 00002000:00100000:1.0:1715330455.082799:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (901775360->905969663) req@ffff88006c454700 x1798653938166144/t4294970169(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:666/0 lens 488/448 e 0 to 0 dl 1715330466 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330455.082812:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88006c454700 with x1798653938166144 ext(901775360->905969663) 00002000:00010000:1.0:1715330455.082817:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88006c454700 00000100:00100000:1.0:1715330455.101521:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330455.101613:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938166272 00000100:00100000:2.0:1715330455.101621:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938166272 00002000:00100000:2.0:1715330455.101658:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (905969664->910163967) req@ffff88006c454a80 x1798653938166272/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:666/0 lens 488/0 e 0 to 0 dl 1715330466 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330455.101667:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88006c454a80 with x1798653938166272 ext(905969664->910163967) 00002000:00010000:2.0:1715330455.101672:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88006c454a80 00000100:00100000:2.0:1715330455.101802:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 304 00000100:00100000:2.0:1715330455.101808:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006c454a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+135:2011:x1798653938166272:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330455.139399:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330455.139490:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938166400 00000100:00100000:3.0:1715330455.139507:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938166400 00002000:00100000:3.0:1715330455.139540:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (910163968->914358271) req@ffff88006c454e00 x1798653938166400/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:666/0 lens 488/0 e 0 to 0 dl 1715330466 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330455.139549:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88006c454e00 with x1798653938166400 ext(910163968->914358271) 00002000:00010000:3.0:1715330455.139554:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88006c454e00 00000100:00100000:3.0:1715330455.139573:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 305 00000100:00100000:3.0:1715330455.139579:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006c454e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+137:2011:x1798653938166400:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330455.186153:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006c454a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+139:2011:x1798653938166272:12345-192.168.204.49@tcp:4:dd.0 Request processed in 84335us (84645us total) trans 4294970170 rc 0/0 00000100:00100000:2.0:1715330455.186166:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 304 00002000:00100000:2.0:1715330455.186178:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (905969664->910163967) req@ffff88006c454a80 x1798653938166272/t4294970170(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:666/0 lens 488/448 e 0 to 0 dl 1715330466 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330455.186186:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88006c454a80 with x1798653938166272 ext(905969664->910163967) 00002000:00010000:2.0:1715330455.186192:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88006c454a80 00000100:00100000:3.0:1715330455.201754:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006c454e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+139:2011:x1798653938166400:12345-192.168.204.49@tcp:4:dd.0 Request processed in 62149us (62337us total) trans 4294970171 rc 0/0 00000100:00100000:3.0:1715330455.201770:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 305 00002000:00100000:3.0:1715330455.201784:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (910163968->914358271) req@ffff88006c454e00 x1798653938166400/t4294970171(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:666/0 lens 488/448 e 0 to 0 dl 1715330466 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330455.201794:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88006c454e00 with x1798653938166400 ext(910163968->914358271) 00002000:00010000:3.0:1715330455.201801:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88006c454e00 00000100:00100000:3.0:1715330455.232940:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330455.233107:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938166528 00000100:00100000:0.0:1715330455.233115:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938166528 00002000:00100000:0.0:1715330455.233152:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (914358272->918552575) req@ffff8801344f3480 x1798653938166528/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:666/0 lens 488/0 e 0 to 0 dl 1715330466 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330455.233161:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801344f3480 with x1798653938166528 ext(914358272->918552575) 00002000:00010000:0.0:1715330455.233166:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801344f3480 00000100:00100000:0.0:1715330455.233194:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 306 00000100:00100000:0.0:1715330455.233200:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801344f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+139:2013:x1798653938166528:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330455.298128:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801344f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+141:2013:x1798653938166528:12345-192.168.204.49@tcp:4:dd.0 Request processed in 64917us (65186us total) trans 4294970172 rc 0/0 00000100:00100000:1.0:1715330455.298140:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 306 00002000:00100000:1.0:1715330455.298154:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (914358272->918552575) req@ffff8801344f3480 x1798653938166528/t4294970172(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:666/0 lens 488/448 e 0 to 0 dl 1715330466 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330455.298164:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801344f3480 with x1798653938166528 ext(914358272->918552575) 00002000:00010000:1.0:1715330455.298171:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801344f3480 00000100:00100000:3.0:1715330455.300670:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330455.300961:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938166656 00000100:00100000:1.0:1715330455.300969:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938166656 00002000:00100000:1.0:1715330455.301002:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (918552576->922746879) req@ffff88008b318e00 x1798653938166656/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:666/0 lens 488/0 e 0 to 0 dl 1715330466 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330455.301012:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b318e00 with x1798653938166656 ext(918552576->922746879) 00002000:00010000:1.0:1715330455.301016:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008b318e00 00000100:00100000:1.0:1715330455.301045:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 307 00000100:00100000:1.0:1715330455.301051:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b318e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+141:2012:x1798653938166656:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330455.361688:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b318e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+143:2012:x1798653938166656:12345-192.168.204.49@tcp:4:dd.0 Request processed in 60624us (61011us total) trans 4294970173 rc 0/0 00000100:00100000:1.0:1715330455.361701:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 307 00002000:00100000:1.0:1715330455.361714:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (918552576->922746879) req@ffff88008b318e00 x1798653938166656/t4294970173(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:666/0 lens 488/448 e 0 to 0 dl 1715330466 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330455.361722:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b318e00 with x1798653938166656 ext(918552576->922746879) 00002000:00010000:1.0:1715330455.361755:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008b318e00 00000100:00100000:0.0:1715330455.365713:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330455.365887:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938166784 00000100:00100000:1.0:1715330455.365895:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938166784 00002000:00100000:1.0:1715330455.365934:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (922746880->926941183) req@ffff8801213d2680 x1798653938166784/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:666/0 lens 488/0 e 0 to 0 dl 1715330466 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330455.365944:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801213d2680 with x1798653938166784 ext(922746880->926941183) 00002000:00010000:1.0:1715330455.365949:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801213d2680 00000100:00100000:1.0:1715330455.365979:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 308 00000100:00100000:1.0:1715330455.365985:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801213d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+143:2012:x1798653938166784:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330455.425991:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330455.432331:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938166912 00000100:00100000:2.0:1715330455.432345:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938166912 00002000:00100000:2.0:1715330455.432390:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (926941184->931135487) req@ffff8801213d2a00 x1798653938166912/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:666/0 lens 488/0 e 0 to 0 dl 1715330466 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330455.432400:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801213d2a00 with x1798653938166912 ext(926941184->931135487) 00002000:00010000:2.0:1715330455.432407:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801213d2a00 00000100:00100000:2.0:1715330455.432459:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 309 00000100:00100000:2.0:1715330455.432466:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801213d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+147:2012:x1798653938166912:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330455.433901:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801213d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+146:2012:x1798653938166784:12345-192.168.204.49@tcp:4:dd.0 Request processed in 67903us (68188us total) trans 4294970174 rc 0/0 00000100:00100000:0.0:1715330455.433915:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 308 00002000:00100000:0.0:1715330455.433929:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (922746880->926941183) req@ffff8801213d2680 x1798653938166784/t4294970174(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:666/0 lens 488/448 e 0 to 0 dl 1715330466 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330455.433938:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801213d2680 with x1798653938166784 ext(922746880->926941183) 00002000:00010000:0.0:1715330455.433945:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801213d2680 00000100:00100000:3.0:1715330455.486859:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330455.489907:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938167040 00000100:00100000:1.0:1715330455.489919:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938167040 00002000:00100000:1.0:1715330455.489961:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (931135488->935329791) req@ffff88008b31aa00 x1798653938167040/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:666/0 lens 488/0 e 0 to 0 dl 1715330466 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330455.489971:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b31aa00 with x1798653938167040 ext(931135488->935329791) 00002000:00010000:1.0:1715330455.489975:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008b31aa00 00000100:00100000:1.0:1715330455.490009:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 310 00000100:00100000:1.0:1715330455.490016:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b31aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+149:2013:x1798653938167040:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330455.496391:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801213d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+149:2012:x1798653938166912:12345-192.168.204.49@tcp:4:dd.0 Request processed in 63916us (70404us total) trans 4294970175 rc 0/0 00000100:00100000:3.0:1715330455.496404:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 309 00002000:00100000:3.0:1715330455.496418:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (926941184->931135487) req@ffff8801213d2a00 x1798653938166912/t4294970175(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:666/0 lens 488/448 e 0 to 0 dl 1715330466 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330455.496427:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801213d2a00 with x1798653938166912 ext(926941184->931135487) 00002000:00010000:3.0:1715330455.496433:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801213d2a00 00000100:00100000:1.0:1715330455.544504:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b31aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+149:2013:x1798653938167040:12345-192.168.204.49@tcp:4:dd.0 Request processed in 54468us (57633us total) trans 4294970176 rc 0/0 00000100:00100000:1.0:1715330455.544518:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 310 00002000:00100000:1.0:1715330455.544529:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (931135488->935329791) req@ffff88008b31aa00 x1798653938167040/t4294970176(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:666/0 lens 488/448 e 0 to 0 dl 1715330466 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330455.544543:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b31aa00 with x1798653938167040 ext(931135488->935329791) 00002000:00010000:1.0:1715330455.544548:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008b31aa00 00000100:00100000:1.0:1715330455.553386:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330455.553452:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938167168 00000100:00100000:2.0:1715330455.553460:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938167168 00002000:00100000:2.0:1715330455.553505:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (935329792->939524095) req@ffff88006c455180 x1798653938167168/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:666/0 lens 488/0 e 0 to 0 dl 1715330466 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330455.553515:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88006c455180 with x1798653938167168 ext(935329792->939524095) 00002000:00010000:2.0:1715330455.553519:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88006c455180 00000100:00100000:2.0:1715330455.553546:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 311 00000100:00100000:2.0:1715330455.553552:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006c455180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+149:2014:x1798653938167168:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330455.597043:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006c455180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+151:2014:x1798653938167168:12345-192.168.204.49@tcp:4:dd.0 Request processed in 43483us (43830us total) trans 4294970177 rc 0/0 00000100:00100000:3.0:1715330455.597055:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 311 00002000:00100000:3.0:1715330455.597065:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (935329792->939524095) req@ffff88006c455180 x1798653938167168/t4294970177(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:666/0 lens 488/448 e 0 to 0 dl 1715330466 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330455.597080:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88006c455180 with x1798653938167168 ext(935329792->939524095) 00002000:00010000:3.0:1715330455.597085:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88006c455180 00000100:00100000:1.0:1715330455.602947:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801213d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942551168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1715330455.603006:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330455.603103:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942551168 00000100:00100000:3.0:1715330455.603110:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942551168 00000100:00100000:3.0:1715330455.603151:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1715330455.603158:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006c455500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942551168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1715330455.603178:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 4218880 granted 798066368 pending 303759360 free 3055284224 avail 2823761920 00000100:00100000:3.0:1715330455.603217:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006c455500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942551168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330455.603224:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00080000:1.0:1715330455.603289:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330425 00000100:00100000:0.0:1715330455.603342:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801213d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942551168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1715330455.603536:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1715330455.603545:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801213d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942551232:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1715330455.603565:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330455.603613:0:9400:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942551232 00000100:00100000:3.0:1715330455.603616:0:9400:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942551232 00000100:00100000:3.0:1715330455.603632:0:9400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1715330455.603635:0:9400:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006c455880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942551232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1715330455.603644:0:9400:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 4218880 granted 798066368 pending 303759360 free 3055284224 avail 2823761920 00000100:00100000:3.0:1715330455.603665:0:9400:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006c455880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942551232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 29us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330455.603670:0:9400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00080000:1.0:1715330455.603715:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330425 00000100:00100000:0.0:1715330455.603805:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801213d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942551232:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1715330455.624907:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330455.625015:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938167296 00000100:00100000:3.0:1715330455.625024:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938167296 00002000:00100000:3.0:1715330455.625062:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (939524096->943718399) req@ffff88006c455c00 x1798653938167296/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:666/0 lens 488/0 e 0 to 0 dl 1715330466 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330455.625071:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88006c455c00 with x1798653938167296 ext(939524096->943718399) 00002000:00010000:3.0:1715330455.625076:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88006c455c00 00000100:00100000:3.0:1715330455.625160:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 312 00000100:00100000:3.0:1715330455.625169:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006c455c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+151:2013:x1798653938167296:12345-192.168.204.49@tcp:4:dd.0 00010000:00010000:2.0:1715330455.645699:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330455.677832:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330455.678656:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006c455c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+153:2013:x1798653938167296:12345-192.168.204.49@tcp:4:dd.0 Request processed in 53484us (53752us total) trans 4294970178 rc 0/0 00000100:00100000:2.0:1715330455.678671:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 312 00002000:00100000:2.0:1715330455.678685:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (939524096->943718399) req@ffff88006c455c00 x1798653938167296/t4294970178(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:666/0 lens 488/448 e 0 to 0 dl 1715330466 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330455.678695:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88006c455c00 with x1798653938167296 ext(939524096->943718399) 00002000:00010000:2.0:1715330455.678701:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88006c455c00 00000100:00100000:2.0:1715330455.679671:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938167424 00000100:00100000:2.0:1715330455.679681:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938167424 00002000:00100000:2.0:1715330455.679712:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (943718400->947912703) req@ffff8801213d2d80 x1798653938167424/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:666/0 lens 488/0 e 0 to 0 dl 1715330466 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330455.679721:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801213d2d80 with x1798653938167424 ext(943718400->947912703) 00002000:00010000:2.0:1715330455.679724:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801213d2d80 00000100:00100000:2.0:1715330455.679755:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 313 00000100:00100000:2.0:1715330455.679759:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801213d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+153:2013:x1798653938167424:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330455.720393:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801213d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+155:2013:x1798653938167424:12345-192.168.204.49@tcp:4:dd.0 Request processed in 40623us (42560us total) trans 4294970179 rc 0/0 00000100:00100000:2.0:1715330455.720406:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 313 00002000:00100000:2.0:1715330455.720418:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (943718400->947912703) req@ffff8801213d2d80 x1798653938167424/t4294970179(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:666/0 lens 488/448 e 0 to 0 dl 1715330466 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330455.720428:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801213d2d80 with x1798653938167424 ext(943718400->947912703) 00002000:00010000:2.0:1715330455.720433:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801213d2d80 00000100:00100000:2.0:1715330455.758034:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330455.758118:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938167552 00000100:00100000:0.0:1715330455.758127:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938167552 00002000:00100000:0.0:1715330455.758164:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (947912704->952107007) req@ffff8800877eea00 x1798653938167552/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:666/0 lens 488/0 e 0 to 0 dl 1715330466 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330455.758174:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800877eea00 with x1798653938167552 ext(947912704->952107007) 00002000:00010000:0.0:1715330455.758179:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800877eea00 00000100:00100000:0.0:1715330455.758212:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 314 00000100:00100000:0.0:1715330455.758219:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+155:2014:x1798653938167552:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330455.796412:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330455.798615:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938167680 00000100:00100000:1.0:1715330455.798625:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938167680 00002000:00100000:1.0:1715330455.798663:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (952107008->956301311) req@ffff8801213d3100 x1798653938167680/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:666/0 lens 488/0 e 0 to 0 dl 1715330466 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330455.798672:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801213d3100 with x1798653938167680 ext(952107008->956301311) 00002000:00010000:1.0:1715330455.798677:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801213d3100 00000100:00100000:1.0:1715330455.798703:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 315 00000100:00100000:1.0:1715330455.798708:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801213d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+157:2014:x1798653938167680:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330455.814095:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+159:2014:x1798653938167552:12345-192.168.204.49@tcp:4:dd.0 Request processed in 55865us (56057us total) trans 4294970180 rc 0/0 00000100:00100000:1.0:1715330455.814108:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 314 00002000:00100000:1.0:1715330455.814120:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (947912704->952107007) req@ffff8800877eea00 x1798653938167552/t4294970180(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:666/0 lens 488/448 e 0 to 0 dl 1715330466 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330455.814136:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800877eea00 with x1798653938167552 ext(947912704->952107007) 00002000:00010000:1.0:1715330455.814141:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800877eea00 00000100:00100000:0.0:1715330455.852237:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801213d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+159:2014:x1798653938167680:12345-192.168.204.49@tcp:4:dd.0 Request processed in 53514us (55818us total) trans 4294970181 rc 0/0 00000100:00100000:0.0:1715330455.852254:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 315 00002000:00100000:0.0:1715330455.852267:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (952107008->956301311) req@ffff8801213d3100 x1798653938167680/t4294970181(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:666/0 lens 488/448 e 0 to 0 dl 1715330466 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330455.852278:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801213d3100 with x1798653938167680 ext(952107008->956301311) 00002000:00010000:0.0:1715330455.852285:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801213d3100 00000100:00100000:3.0:1715330455.877082:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330455.877155:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938167808 00000100:00100000:0.0:1715330455.877165:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938167808 00002000:00100000:0.0:1715330455.877206:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (956301312->960495615) req@ffff88008d55f100 x1798653938167808/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:666/0 lens 488/0 e 0 to 0 dl 1715330466 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330455.877216:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d55f100 with x1798653938167808 ext(956301312->960495615) 00002000:00010000:0.0:1715330455.877222:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d55f100 00000100:00100000:1.0:1715330455.878354:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 316 00000100:00100000:1.0:1715330455.878362:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d55f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+159:2011:x1798653938167808:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330455.921086:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d55f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+161:2011:x1798653938167808:12345-192.168.204.49@tcp:4:dd.0 Request processed in 42715us (44007us total) trans 4294970182 rc 0/0 00000100:00100000:1.0:1715330455.921099:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 316 00002000:00100000:1.0:1715330455.921111:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (956301312->960495615) req@ffff88008d55f100 x1798653938167808/t4294970182(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:666/0 lens 488/448 e 0 to 0 dl 1715330466 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330455.921121:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d55f100 with x1798653938167808 ext(956301312->960495615) 00002000:00010000:1.0:1715330455.921127:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d55f100 00000100:00100000:3.0:1715330455.932691:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330455.932821:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938167936 00000100:00100000:1.0:1715330455.932830:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938167936 00002000:00100000:1.0:1715330455.932869:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (960495616->964689919) req@ffff88008d55f480 x1798653938167936/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:666/0 lens 488/0 e 0 to 0 dl 1715330466 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330455.932879:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d55f480 with x1798653938167936 ext(960495616->964689919) 00002000:00010000:1.0:1715330455.932884:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d55f480 00000100:00100000:1.0:1715330455.932913:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 317 00000100:00100000:1.0:1715330455.932919:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d55f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+161:2011:x1798653938167936:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330455.968205:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d55f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+163:2011:x1798653938167936:12345-192.168.204.49@tcp:4:dd.0 Request processed in 35275us (35511us total) trans 4294970183 rc 0/0 00000100:00100000:0.0:1715330455.968218:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 317 00002000:00100000:0.0:1715330455.968232:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (960495616->964689919) req@ffff88008d55f480 x1798653938167936/t4294970183(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:666/0 lens 488/448 e 0 to 0 dl 1715330466 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330455.968241:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d55f480 with x1798653938167936 ext(960495616->964689919) 00002000:00010000:0.0:1715330455.968246:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d55f480 00000100:00100000:2.0:1715330455.980006:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330455.980081:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938168064 00000100:00100000:0.0:1715330455.980090:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938168064 00002000:00100000:0.0:1715330455.980127:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (964689920->968884223) req@ffff8800877ece00 x1798653938168064/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:666/0 lens 488/0 e 0 to 0 dl 1715330466 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330455.980136:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800877ece00 with x1798653938168064 ext(964689920->968884223) 00002000:00010000:0.0:1715330455.980141:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800877ece00 00000100:00100000:0.0:1715330455.980169:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 318 00000100:00100000:0.0:1715330455.980175:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+163:2011:x1798653938168064:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330456.034916:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330456.035110:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938168192 00000100:00100000:2.0:1715330456.035118:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938168192 00002000:00100000:2.0:1715330456.035149:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (968884224->973078527) req@ffff88008d609c00 x1798653938168192/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:667/0 lens 488/0 e 0 to 0 dl 1715330467 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330456.035158:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d609c00 with x1798653938168192 ext(968884224->973078527) 00002000:00010000:2.0:1715330456.035162:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d609c00 00000100:00100000:2.0:1715330456.035189:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 319 00000100:00100000:2.0:1715330456.035195:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+166:2013:x1798653938168192:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330456.041834:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+166:2011:x1798653938168064:12345-192.168.204.49@tcp:4:dd.0 Request processed in 61649us (61827us total) trans 4294970184 rc 0/0 00000100:00100000:1.0:1715330456.041847:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 318 00002000:00100000:1.0:1715330456.041860:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (964689920->968884223) req@ffff8800877ece00 x1798653938168064/t4294970184(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:666/0 lens 488/448 e 0 to 0 dl 1715330466 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330456.041869:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800877ece00 with x1798653938168064 ext(964689920->968884223) 00002000:00010000:1.0:1715330456.041874:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800877ece00 00000100:00100000:0.0:1715330456.090776:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+167:2013:x1798653938168192:12345-192.168.204.49@tcp:4:dd.0 Request processed in 55572us (55858us total) trans 4294970185 rc 0/0 00000100:00100000:0.0:1715330456.090788:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 319 00002000:00100000:0.0:1715330456.090800:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (968884224->973078527) req@ffff88008d609c00 x1798653938168192/t4294970185(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:667/0 lens 488/448 e 0 to 0 dl 1715330467 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330456.090808:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d609c00 with x1798653938168192 ext(968884224->973078527) 00002000:00010000:0.0:1715330456.090814:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d609c00 00000100:00100000:3.0:1715330456.106159:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330456.106255:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938168320 00000100:00100000:0.0:1715330456.106262:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938168320 00002000:00100000:0.0:1715330456.106294:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (973078528->977272831) req@ffff88008d608e00 x1798653938168320/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:667/0 lens 488/0 e 0 to 0 dl 1715330467 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330456.106302:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d608e00 with x1798653938168320 ext(973078528->977272831) 00002000:00010000:0.0:1715330456.106307:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d608e00 00000100:00100000:0.0:1715330456.106332:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 320 00000100:00100000:0.0:1715330456.106337:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d608e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+167:2013:x1798653938168320:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330456.162955:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d608e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+169:2013:x1798653938168320:12345-192.168.204.49@tcp:4:dd.0 Request processed in 56609us (56794us total) trans 4294970186 rc 0/0 00000100:00100000:0.0:1715330456.162968:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 320 00002000:00100000:0.0:1715330456.162979:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (973078528->977272831) req@ffff88008d608e00 x1798653938168320/t4294970186(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:667/0 lens 488/448 e 0 to 0 dl 1715330467 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330456.162988:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008d608e00 with x1798653938168320 ext(973078528->977272831) 00002000:00010000:0.0:1715330456.162993:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008d608e00 00000100:00100000:1.0:1715330456.164162:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330456.164282:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938168448 00000100:00100000:0.0:1715330456.164289:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938168448 00002000:00100000:0.0:1715330456.164312:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (977272832->981467135) req@ffff88006c455f80 x1798653938168448/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:667/0 lens 488/0 e 0 to 0 dl 1715330467 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330456.164320:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88006c455f80 with x1798653938168448 ext(977272832->981467135) 00002000:00010000:0.0:1715330456.164324:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88006c455f80 00000100:00100000:0.0:1715330456.164337:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 321 00000100:00100000:0.0:1715330456.164341:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006c455f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+169:2014:x1798653938168448:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330456.191084:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330456.191470:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938168576 00000100:00100000:0.0:1715330456.191488:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938168576 00000100:00100000:0.0:1715330456.191538:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5351 00000100:00100000:0.0:1715330456.191545:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006c456300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72de1896-1df4-4b3a-930a-9116d2c66168+171:2012:x1798653938168576:12345-192.168.204.49@tcp:16:kworker.0 00000100:00100000:2.0:1715330456.208579:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330456.208625:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938168512 00000100:00100000:2.0:1715330456.208631:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938168512 00002000:00100000:2.0:1715330456.208663:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (981467136->983564287) req@ffff880067c64000 x1798653938168512/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:667/0 lens 488/0 e 0 to 0 dl 1715330467 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330456.208672:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880067c64000 with x1798653938168512 ext(981467136->983564287) 00002000:00010000:2.0:1715330456.208676:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880067c64000 00000100:00100000:2.0:1715330456.208704:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 322 00000100:00100000:2.0:1715330456.208709:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880067c64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+172:2011:x1798653938168512:12345-192.168.204.49@tcp:4:dd.0 00000001:00080000:0.0:1715330456.221989:0:9395:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0000: transno 4294970186 is committed 00000100:00100000:2.0:1715330456.222328:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006c456300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72de1896-1df4-4b3a-930a-9116d2c66168+13:2012:x1798653938168576:12345-192.168.204.49@tcp:16:kworker.0 Request processed in 30776us (31248us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330456.222339:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5351 00000100:00100000:1.0:1715330456.225493:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006c455f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+11:2014:x1798653938168448:12345-192.168.204.49@tcp:4:dd.0 Request processed in 61126us (61310us total) trans 4294970187 rc 0/0 00000100:00100000:1.0:1715330456.225509:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 321 00002000:00100000:1.0:1715330456.225524:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (977272832->981467135) req@ffff88006c455f80 x1798653938168448/t4294970187(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:667/0 lens 488/448 e 0 to 0 dl 1715330467 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330456.225534:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88006c455f80 with x1798653938168448 ext(977272832->981467135) 00002000:00010000:1.0:1715330456.225541:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88006c455f80 00000100:00100000:3.0:1715330456.230170:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880067c64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+11:2011:x1798653938168512:12345-192.168.204.49@tcp:4:dd.0 Request processed in 21449us (21587us total) trans 4294970188 rc 0/0 00000100:00100000:3.0:1715330456.230184:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 322 00002000:00100000:3.0:1715330456.230197:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (981467136->983564287) req@ffff880067c64000 x1798653938168512/t4294970188(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:667/0 lens 488/448 e 0 to 0 dl 1715330467 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330456.230206:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880067c64000 with x1798653938168512 ext(981467136->983564287) 00002000:00010000:3.0:1715330456.230211:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880067c64000 00000100:00100000:2.0:1715330456.254677:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330456.254759:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938168704 00000100:00100000:3.0:1715330456.254767:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938168704 00002000:00100000:3.0:1715330456.254802:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (985661440->989855743) req@ffff880067c64380 x1798653938168704/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:667/0 lens 488/0 e 0 to 0 dl 1715330467 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330456.254811:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880067c64380 with x1798653938168704 ext(985661440->989855743) 00002000:00010000:3.0:1715330456.254816:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880067c64380 00000100:00100000:3.0:1715330456.254844:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 323 00000100:00100000:3.0:1715330456.254849:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880067c64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+11:2014:x1798653938168704:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330456.288640:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880067c64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+13:2014:x1798653938168704:12345-192.168.204.49@tcp:4:dd.0 Request processed in 33781us (33962us total) trans 4294970189 rc 0/0 00000100:00100000:3.0:1715330456.288654:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 323 00002000:00100000:3.0:1715330456.288665:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (985661440->989855743) req@ffff880067c64380 x1798653938168704/t4294970189(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:667/0 lens 488/448 e 0 to 0 dl 1715330467 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330456.288674:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880067c64380 with x1798653938168704 ext(985661440->989855743) 00002000:00010000:3.0:1715330456.288679:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880067c64380 00000100:00100000:2.0:1715330456.319805:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330456.321776:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938168832 00000100:00100000:3.0:1715330456.321787:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938168832 00002000:00100000:3.0:1715330456.321826:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (989855744->994050047) req@ffff880067c64700 x1798653938168832/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:667/0 lens 488/0 e 0 to 0 dl 1715330467 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330456.321836:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880067c64700 with x1798653938168832 ext(989855744->994050047) 00002000:00010000:3.0:1715330456.321841:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880067c64700 00000100:00100000:3.0:1715330456.321878:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 324 00000100:00100000:3.0:1715330456.321885:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880067c64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+13:2014:x1798653938168832:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330456.369342:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330456.369717:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330456.369751:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330456.369774:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938169024 00000100:00100000:2.0:1715330456.369781:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938169024 00000100:00100000:2.0:1715330456.369818:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938168960 00000100:00100000:2.0:1715330456.369820:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938168960 00000100:00100000:2.0:1715330456.369835:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 500 00000100:00100000:2.0:1715330456.369841:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880067c64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+6:2011:x1798653938169024:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:2.0:1715330456.369893:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880067c64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+6:2011:x1798653938169024:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 52us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330456.369898:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 500 00000100:00100000:2.0:1715330456.369911:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 501 00000100:00100000:2.0:1715330456.369914:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880067c64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+17:2011:x1798653938168960:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:0.0:1715330456.370462:0:7129:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938168896 00000100:00100000:0.0:1715330456.370467:0:7129:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938168896 00000100:00100000:0.0:1715330456.370501:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 396 00000100:00100000:0.0:1715330456.370505:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2011:x1798653938168896:12345-192.168.204.49@tcp:400:kworker.0 00000100:00080000:1.0:1715330456.370570:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330426 00000100:00080000:1.0:1715330456.370574:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330426 00000100:00080000:1.0:1715330456.370576:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330426 00000100:00100000:2.0:1715330456.374142:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880067c64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+17:2011:x1798653938168960:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 4213us (4377us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330456.374158:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 501 00000100:00100000:0.0:1715330456.374277:0:7129:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2011:x1798653938168896:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 3768us (4940us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330456.374286:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 396 00000100:00100000:1.0:1715330456.374395:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330456.374466:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938169088 00000100:00100000:0.0:1715330456.374480:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938169088 00000100:00100000:0.0:1715330456.374525:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 354 00000100:00100000:0.0:1715330456.374530:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006c456680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72de1896-1df4-4b3a-930a-9116d2c66168+6:2011:x1798653938169088:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:0.0:1715330456.374564:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006c456680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72de1896-1df4-4b3a-930a-9116d2c66168+6:2011:x1798653938169088:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 34us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330456.374569:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 354 00000100:00080000:1.0:1715330456.374610:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330426 00000100:00100000:3.0:1715330456.384502:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880067c64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+15:2014:x1798653938168832:12345-192.168.204.49@tcp:4:dd.0 Request processed in 62605us (64694us total) trans 4294970190 rc 0/0 00000100:00100000:3.0:1715330456.384516:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 324 00002000:00100000:3.0:1715330456.384529:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (989855744->994050047) req@ffff880067c64700 x1798653938168832/t4294970190(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:667/0 lens 488/448 e 0 to 0 dl 1715330467 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330456.384537:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880067c64700 with x1798653938168832 ext(989855744->994050047) 00002000:00010000:3.0:1715330456.384542:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880067c64700 00000100:00100000:0.0:1715330456.413190:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330456.413265:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938169216 00000100:00100000:3.0:1715330456.413274:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938169216 00002000:00100000:3.0:1715330456.413314:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (994050048->998244351) req@ffff8801213d3480 x1798653938169216/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:667/0 lens 488/0 e 0 to 0 dl 1715330467 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330456.413325:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801213d3480 with x1798653938169216 ext(994050048->998244351) 00002000:00010000:3.0:1715330456.413332:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801213d3480 00000100:00100000:3.0:1715330456.414102:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 325 00000100:00100000:3.0:1715330456.414110:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801213d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+15:2014:x1798653938169216:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330456.478048:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330456.478634:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938169344 00000100:00100000:1.0:1715330456.478646:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938169344 00002000:00100000:1.0:1715330456.478691:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (998244352->1002438655) req@ffff8801213d3800 x1798653938169344/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:667/0 lens 488/0 e 0 to 0 dl 1715330467 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330456.478702:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801213d3800 with x1798653938169344 ext(998244352->1002438655) 00002000:00010000:1.0:1715330456.478708:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801213d3800 00000100:00100000:2.0:1715330456.479259:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801213d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+18:2014:x1798653938169216:12345-192.168.204.49@tcp:4:dd.0 Request processed in 65148us (66074us total) trans 4294970191 rc 0/0 00000100:00100000:2.0:1715330456.479268:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 325 00002000:00100000:2.0:1715330456.479274:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (994050048->998244351) req@ffff8801213d3480 x1798653938169216/t4294970191(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:667/0 lens 488/448 e 0 to 0 dl 1715330467 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330456.479288:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801213d3480 with x1798653938169216 ext(994050048->998244351) 00002000:00010000:2.0:1715330456.479291:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801213d3480 00000100:00100000:2.0:1715330456.479308:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 326 00000100:00100000:2.0:1715330456.479313:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801213d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+17:2014:x1798653938169344:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330456.517209:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330456.517301:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938169472 00000100:00100000:3.0:1715330456.517311:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938169472 00002000:00100000:3.0:1715330456.517348:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (1002438656->1006632959) req@ffff88006c456a00 x1798653938169472/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:667/0 lens 488/0 e 0 to 0 dl 1715330467 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330456.517358:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88006c456a00 with x1798653938169472 ext(1002438656->1006632959) 00002000:00010000:3.0:1715330456.517363:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88006c456a00 00000100:00100000:3.0:1715330456.517382:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 327 00000100:00100000:3.0:1715330456.517388:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006c456a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+21:2013:x1798653938169472:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:0.0:1715330456.528847:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801213d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+21:2014:x1798653938169344:12345-192.168.204.49@tcp:4:dd.0 Request processed in 49526us (50802us total) trans 4294970192 rc 0/0 00000100:00100000:0.0:1715330456.528859:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 326 00002000:00100000:0.0:1715330456.528870:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (998244352->1002438655) req@ffff8801213d3800 x1798653938169344/t4294970192(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:667/0 lens 488/448 e 0 to 0 dl 1715330467 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330456.528879:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801213d3800 with x1798653938169344 ext(998244352->1002438655) 00002000:00010000:0.0:1715330456.528885:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801213d3800 00000100:00100000:3.0:1715330456.582091:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006c456a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+21:2013:x1798653938169472:12345-192.168.204.49@tcp:4:dd.0 Request processed in 64692us (64883us total) trans 4294970193 rc 0/0 00000100:00100000:3.0:1715330456.582106:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 327 00002000:00100000:3.0:1715330456.582117:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (1002438656->1006632959) req@ffff88006c456a00 x1798653938169472/t4294970193(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:667/0 lens 488/448 e 0 to 0 dl 1715330467 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330456.582126:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88006c456a00 with x1798653938169472 ext(1002438656->1006632959) 00002000:00010000:3.0:1715330456.582131:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88006c456a00 00000100:00100000:2.0:1715330456.608721:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330456.608926:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938169600 00000100:00100000:3.0:1715330456.608936:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938169600 00002000:00100000:3.0:1715330456.608986:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (1006632960->1010827263) req@ffff880067c65180 x1798653938169600/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:667/0 lens 488/0 e 0 to 0 dl 1715330467 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330456.608995:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880067c65180 with x1798653938169600 ext(1006632960->1010827263) 00002000:00010000:3.0:1715330456.609001:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880067c65180 00000100:00100000:3.0:1715330456.609029:0:31376:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 328 00000100:00100000:3.0:1715330456.609036:0:31376:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880067c65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+21:2011:x1798653938169600:12345-192.168.204.49@tcp:4:dd.0 00010000:00010000:3.0:1715330456.648024:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330456.670336:0:31376:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880067c65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72de1896-1df4-4b3a-930a-9116d2c66168+23:2011:x1798653938169600:12345-192.168.204.49@tcp:4:dd.0 Request processed in 61291us (61613us total) trans 4294970194 rc 0/0 00000100:00100000:3.0:1715330456.670348:0:31376:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 328 00002000:00100000:3.0:1715330456.670359:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (1006632960->1010827263) req@ffff880067c65180 x1798653938169600/t4294970194(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:667/0 lens 488/448 e 0 to 0 dl 1715330467 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330456.670367:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880067c65180 with x1798653938169600 ext(1006632960->1010827263) 00002000:00010000:3.0:1715330456.670373:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880067c65180 00000100:00100000:2.0:1715330456.685313:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330456.685404:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938169792 00000100:00100000:3.0:1715330456.685412:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938169792 00002000:00100000:3.0:1715330456.685447:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (1010827264->1015021567) req@ffff880067c65500 x1798653938169792/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:667/0 lens 488/0 e 0 to 0 dl 1715330467 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330456.685455:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880067c65500 with x1798653938169792 ext(1010827264->1015021567) 00002000:00010000:3.0:1715330456.685459:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880067c65500 00000100:00100000:0.0:1715330456.686613:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 329 00000100:00100000:0.0:1715330456.686620:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880067c65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+23:2011:x1798653938169792:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330456.786719:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880067c65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+25:2011:x1798653938169792:12345-192.168.204.49@tcp:4:dd.0 Request processed in 100089us (101404us total) trans 4294970195 rc 0/0 00000100:00100000:3.0:1715330456.786747:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 329 00002000:00100000:3.0:1715330456.786760:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (1010827264->1015021567) req@ffff880067c65500 x1798653938169792/t4294970195(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:667/0 lens 488/448 e 0 to 0 dl 1715330467 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330456.786768:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880067c65500 with x1798653938169792 ext(1010827264->1015021567) 00002000:00010000:3.0:1715330456.786773:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880067c65500 00000100:00100000:2.0:1715330456.790372:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330456.790421:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330456.790464:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938169984 00000100:00100000:2.0:1715330456.790480:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938169984 00002000:00100000:2.0:1715330456.790524:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (1019215872->1023410175) req@ffff880067c65880 x1798653938169984/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:667/0 lens 488/0 e 0 to 0 dl 1715330467 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330456.790534:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880067c65880 with x1798653938169984 ext(1019215872->1023410175) 00002000:00010000:2.0:1715330456.790542:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880067c65880 00000100:00100000:2.0:1715330456.790570:0:31376:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938169920 00000100:00100000:2.0:1715330456.790572:0:31376:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938169920 00002000:00100000:2.0:1715330456.790584:0:31376:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa02:0x0] (1015021568->1019215871) req@ffff880067c65c00 x1798653938169920/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:667/0 lens 488/0 e 0 to 0 dl 1715330467 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330456.790591:0:31376:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880067c65c00 with x1798653938169920 ext(1015021568->1019215871) 00002000:00010000:2.0:1715330456.790593:0:31376:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880067c65c00 00000100:00100000:2.0:1715330456.790613:0:9403:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 330 00000100:00100000:2.0:1715330456.790619:0:9403:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880067c65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+26:2012:x1798653938169984:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330456.792550:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 331 00000100:00100000:1.0:1715330456.792559:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880067c65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+26:2012:x1798653938169920:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330456.834889:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d609880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3689:1798653942551296:0@lo:400:kworker.0 00000100:00100000:3.0:1715330456.834930:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d60b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3690:1798653942551360:0@lo:400:kworker.0 00000100:00100000:1.0:1715330456.834940:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330456.834962:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330456.834966:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800661b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942551552:0@lo:400:kworker.0 00000100:00100000:3.0:1715330456.834977:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800661b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3690:1798653942551616:0@lo:400:kworker.0 00000100:00100000:1.0:1715330456.834988:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330456.834990:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330456.834997:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800661b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3690:1798653942551872:0@lo:400:kworker.0 00000100:00100000:1.0:1715330456.835001:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800661b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942551808:0@lo:400:kworker.0 00000100:00100000:3.0:1715330456.835009:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330456.835018:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330456.835021:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1715330456.835025:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d60b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942551424:0@lo:400:kworker.0 00000100:00100000:1.0:1715330456.835028:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800661b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942552064:0@lo:400:kworker.0 00000100:00100000:3.0:1715330456.835040:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330456.835041:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330456.835051:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800661b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3690:1798653942551680:0@lo:400:kworker.0 00000100:00100000:1.0:1715330456.835053:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1715330456.835057:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3689:1798653942551488:0@lo:400:kworker.0 00000100:00100000:3.0:1715330456.835064:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330456.835071:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330456.835072:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800661b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3690:1798653942551936:0@lo:400:kworker.0 00000100:00100000:1.0:1715330456.835080:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800661b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942551744:0@lo:400:kworker.0 00000100:00100000:3.0:1715330456.835086:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330456.835093:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330456.835102:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800661b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942552000:0@lo:400:kworker.0 00000100:00100000:3.0:1715330456.835109:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942551360 00000100:00100000:3.0:1715330456.835114:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942551360 00000100:00100000:1.0:1715330456.835120:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330456.835138:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942551616 00000100:00100000:3.0:1715330456.835140:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942551616 00000100:00100000:1.0:1715330456.835142:0:7129:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942551296 00000100:00100000:1.0:1715330456.835145:0:7129:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942551296 00000100:00100000:3.0:1715330456.835151:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942551872 00000100:00100000:3.0:1715330456.835153:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942551872 00000100:00100000:3.0:1715330456.835161:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942551680 00000100:00100000:3.0:1715330456.835162:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942551680 00000100:00100000:1.0:1715330456.835168:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1715330456.835169:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942551488 00000100:00100000:3.0:1715330456.835170:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942551488 00000100:00100000:1.0:1715330456.835174:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3689:x1798653942551296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330456.835176:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942551936 00000100:00100000:3.0:1715330456.835178:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942551936 00000100:00100000:3.0:1715330456.835185:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:3.0:1715330456.835189:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800661b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3690:x1798653942551360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330456.835206:0:7129:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3689:x1798653942551296:12345-0@lo:400:kworker.0 Request processed in 32us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330456.835212:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1715330456.835217:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800661b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3690:x1798653942551360:12345-0@lo:400:kworker.0 Request processed in 27us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330456.835222:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000100:00100000:3.0:1715330456.835233:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 503 00000100:00100000:3.0:1715330456.835236:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800661b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3690:x1798653942551616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330456.835236:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942551808 00000100:00100000:1.0:1715330456.835239:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942551808 00000100:00100000:1.0:1715330456.835252:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942552064 00000100:00100000:3.0:1715330456.835254:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800661b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3690:x1798653942551616:12345-0@lo:400:kworker.0 Request processed in 17us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330456.835254:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942552064 00000100:00100000:3.0:1715330456.835257:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 503 00000100:00100000:1.0:1715330456.835264:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942551744 00000100:00100000:3.0:1715330456.835265:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 504 00000100:00100000:1.0:1715330456.835265:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942551744 00000100:00100000:3.0:1715330456.835268:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800661b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3690:x1798653942551872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330456.835273:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942552000 00000100:00100000:1.0:1715330456.835274:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942552000 00000100:00100000:3.0:1715330456.835282:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800661b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3690:x1798653942551872:12345-0@lo:400:kworker.0 Request processed in 14us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330456.835283:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1715330456.835286:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 504 00000100:00100000:1.0:1715330456.835287:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006c457100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942551808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330456.835293:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 505 00000100:00100000:3.0:1715330456.835296:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800661b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3690:x1798653942551680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330456.835311:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006c457100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942551808:12345-0@lo:400:kworker.0 Request processed in 23us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330456.835314:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800661b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3690:x1798653942551680:12345-0@lo:400:kworker.0 Request processed in 16us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330456.835316:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1715330456.835318:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 505 00000100:00100000:3.0:1715330456.835325:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00000100:00100000:1.0:1715330456.835326:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1715330456.835328:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006c457800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3689:x1798653942551488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330456.835329:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006c457480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942552064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330456.835345:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006c457800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3689:x1798653942551488:12345-0@lo:400:kworker.0 Request processed in 17us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330456.835349:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00000100:00100000:1.0:1715330456.835350:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006c457480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942552064:12345-0@lo:400:kworker.0 Request processed in 19us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330456.835354:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1715330456.835357:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:3.0:1715330456.835360:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800661b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3690:x1798653942551936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330456.835361:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1715330456.835364:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006c457b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942551744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330456.835377:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800661b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3690:x1798653942551936:12345-0@lo:400:kworker.0 Request processed in 17us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330456.835381:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000100:00100000:1.0:1715330456.835389:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006c457b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942551744:12345-0@lo:400:kworker.0 Request processed in 24us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330456.835394:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1715330456.835395:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942551552 00000100:00100000:3.0:1715330456.835397:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942551552 00000100:00100000:1.0:1715330456.835401:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1715330456.835404:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880066240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942552000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330456.835414:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942551424 00000100:00100000:3.0:1715330456.835416:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942551424 00000100:00100000:1.0:1715330456.835419:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880066240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942552000:12345-0@lo:400:kworker.0 Request processed in 13us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330456.835425:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1715330456.835426:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3158 00000100:00100000:3.0:1715330456.835430:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006c456d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942551552:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1715330456.835439:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330426 00000100:00080000:1.0:1715330456.835442:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330426 00000100:00080000:1.0:1715330456.835444:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330426 00000100:00080000:1.0:1715330456.835445:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330426 00000100:00100000:3.0:1715330456.835451:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006c456d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942551552:12345-0@lo:400:kworker.0 Request processed in 21us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330456.835455:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3158 00000100:00100000:3.0:1715330456.835463:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3159 00000100:00100000:3.0:1715330456.835475:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800661b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942551424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330456.835481:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012fa86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3689:1798653942551488:0@lo:400:kworker.0 00000100:00100000:1.0:1715330456.835490:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800661b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942551744:0@lo:400:kworker.0 00000100:00100000:3.0:1715330456.835493:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800661b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942551424:12345-0@lo:400:kworker.0 Request processed in 26us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330456.835496:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3159 00000100:00100000:1.0:1715330456.835497:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800661b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942552000:0@lo:400:kworker.0 00000100:00100000:1.0:1715330456.835503:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800661b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942551552:0@lo:400:kworker.0 00000100:00100000:1.0:1715330456.835509:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800661b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942551808:0@lo:400:kworker.0 00000100:00100000:1.0:1715330456.835515:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800661b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942552064:0@lo:400:kworker.0 00000100:00100000:1.0:1715330456.835522:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d609880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3689:1798653942551296:0@lo:400:kworker.0 00000100:00100000:3.0:1715330456.835525:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d60b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942551424:0@lo:400:kworker.0 00000100:00100000:3.0:1715330456.835533:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800661b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3690:1798653942551680:0@lo:400:kworker.0 00000100:00100000:3.0:1715330456.835539:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800661b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3690:1798653942551936:0@lo:400:kworker.0 00000100:00100000:3.0:1715330456.835544:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d60b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3690:1798653942551360:0@lo:400:kworker.0 00000100:00100000:3.0:1715330456.835550:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800661b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3690:1798653942551616:0@lo:400:kworker.0 00000100:00100000:3.0:1715330456.835555:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800661b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3690:1798653942551872:0@lo:400:kworker.0 00000100:00100000:0.0:1715330456.857716:0:9403:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880067c65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+29:2012:x1798653938169984:12345-192.168.204.49@tcp:4:dd.0 Request processed in 67088us (67347us total) trans 4294970196 rc 0/0 00000100:00100000:0.0:1715330456.857728:0:9403:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 330 00002000:00100000:0.0:1715330456.857758:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa02:0x0] (1019215872->1023410175) req@ffff880067c65880 x1798653938169984/t4294970196(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:667/0 lens 488/448 e 0 to 0 dl 1715330467 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330456.857767:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880067c65880 with x1798653938169984 ext(1019215872->1023410175) 00002000:00010000:0.0:1715330456.857772:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880067c65880 00000100:00100000:0.0:1715330456.874772:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330456.874931:0:9403:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938170176 00000100:00100000:2.0:1715330456.874939:0:9403:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938170176 00002000:00100000:2.0:1715330456.874971:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa02:0x0] (1023410176->1027604479) req@ffff8801213d3b80 x1798653938170176/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:667/0 lens 488/0 e 0 to 0 dl 1715330467 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330456.874981:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801213d3b80 with x1798653938170176 ext(1023410176->1027604479) 00002000:00010000:2.0:1715330456.874986:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801213d3b80 00000100:00100000:2.0:1715330456.875016:0:9403:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 332 00000100:00100000:2.0:1715330456.875023:0:9403:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801213d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+31:2011:x1798653938170176:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330456.885442:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880067c65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+31:2012:x1798653938169920:12345-192.168.204.49@tcp:4:dd.0 Request processed in 92873us (95009us total) trans 4294970197 rc 0/0 00000100:00100000:1.0:1715330456.885457:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 331 00002000:00100000:1.0:1715330456.885480:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (1015021568->1019215871) req@ffff880067c65c00 x1798653938169920/t4294970197(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:667/0 lens 488/448 e 0 to 0 dl 1715330467 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330456.885488:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880067c65c00 with x1798653938169920 ext(1015021568->1019215871) 00002000:00010000:1.0:1715330456.885494:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880067c65c00 00000100:00100000:3.0:1715330456.899449:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800660e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942552128:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1715330456.899520:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330456.899624:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942552128 00000100:00100000:2.0:1715330456.899631:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942552128 00000100:00100000:2.0:1715330456.899672:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1715330456.899678:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800661b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942552128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1715330456.899748:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 172032 granted 317126336 pending 0 free 3923546112 avail 3692023808 00000100:00100000:2.0:1715330456.899783:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800661b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942552128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330456.899789:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1715330456.899829:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800660e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942552128:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1715330456.899992:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1715330456.900000:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800660e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942552192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1715330456.900020:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330456.900057:0:9400:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942552192 00000100:00100000:3.0:1715330456.900060:0:9400:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942552192 00000100:00100000:3.0:1715330456.900077:0:9400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1715330456.900080:0:9400:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880067c65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942552192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1715330456.900089:0:9400:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 172032 granted 317126336 pending 0 free 3923546112 avail 3692023808 00000100:00100000:3.0:1715330456.900120:0:9400:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880067c65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942552192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330456.900127:0:9400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1715330456.900143:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800660e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942552192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1715330456.911564:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330456.913626:0:27574:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938170304 00000100:00100000:1.0:1715330456.913639:0:27574:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938170304 00002000:00100000:1.0:1715330456.913683:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (1027604480->1031798783) req@ffff8800660e8380 x1798653938170304/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:667/0 lens 488/0 e 0 to 0 dl 1715330467 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330456.913693:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800660e8380 with x1798653938170304 ext(1027604480->1031798783) 00002000:00010000:1.0:1715330456.913698:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800660e8380 00000100:00100000:1.0:1715330456.913758:0:27574:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 333 00000100:00100000:1.0:1715330456.913765:0:27574:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800660e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+31:2014:x1798653938170304:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330456.949613:0:9403:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801213d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72de1896-1df4-4b3a-930a-9116d2c66168+33:2011:x1798653938170176:12345-192.168.204.49@tcp:4:dd.0 Request processed in 74580us (74872us total) trans 4294970198 rc 0/0 00000100:00100000:2.0:1715330456.949628:0:9403:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 332 00002000:00100000:2.0:1715330456.949640:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa02:0x0] (1023410176->1027604479) req@ffff8801213d3b80 x1798653938170176/t4294970198(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:667/0 lens 488/448 e 0 to 0 dl 1715330467 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330456.949649:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8801213d3b80 with x1798653938170176 ext(1023410176->1027604479) 00002000:00010000:2.0:1715330456.949655:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801213d3b80 00000100:00100000:0.0:1715330456.954143:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330456.954201:0:9403:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938170432 00000100:00100000:2.0:1715330456.954208:0:9403:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938170432 00002000:00100000:2.0:1715330456.954238:0:9403:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa02:0x0] (1031798784->1035993087) req@ffff8800660e8700 x1798653938170432/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:667/0 lens 488/0 e 0 to 0 dl 1715330467 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330456.954250:0:9403:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800660e8700 with x1798653938170432 ext(1031798784->1035993087) 00002000:00010000:2.0:1715330456.954255:0:9403:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800660e8700 00000100:00100000:2.0:1715330456.954279:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 334 00000100:00100000:2.0:1715330456.954284:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800660e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+33:2013:x1798653938170432:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:1.0:1715330456.962420:0:27574:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800660e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72de1896-1df4-4b3a-930a-9116d2c66168+34:2014:x1798653938170304:12345-192.168.204.49@tcp:4:dd.0 Request processed in 48645us (50852us total) trans 4294970199 rc 0/0 00000100:00100000:1.0:1715330456.962431:0:27574:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 333 00002000:00100000:1.0:1715330456.962442:0:27574:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa02:0x0] (1027604480->1031798783) req@ffff8800660e8380 x1798653938170304/t4294970199(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:667/0 lens 488/448 e 0 to 0 dl 1715330467 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1715330456.962451:0:27574:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800660e8380 with x1798653938170304 ext(1027604480->1031798783) 00002000:00010000:1.0:1715330456.962457:0:27574:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800660e8380 00000100:00100000:0.0:1715330457.008234:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800660e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+35:2013:x1798653938170432:12345-192.168.204.49@tcp:4:dd.0 Request processed in 53938us (54087us total) trans 4294970200 rc 0/0 00000100:00100000:0.0:1715330457.008248:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 334 00002000:00100000:0.0:1715330457.008259:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (1031798784->1035993087) req@ffff8800660e8700 x1798653938170432/t4294970200(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:667/0 lens 488/448 e 0 to 0 dl 1715330467 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1715330457.008269:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800660e8700 with x1798653938170432 ext(1031798784->1035993087) 00002000:00010000:0.0:1715330457.008274:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800660e8700 00000100:00100000:0.0:1715330457.018323:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330457.018423:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938170560 00000100:00100000:3.0:1715330457.018432:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938170560 00002000:00100000:3.0:1715330457.019571:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (1035993088->1040187391) req@ffff8800660e8a80 x1798653938170560/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:668/0 lens 488/0 e 0 to 0 dl 1715330468 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330457.019581:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800660e8a80 with x1798653938170560 ext(1035993088->1040187391) 00002000:00010000:3.0:1715330457.019586:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800660e8a80 00000100:00080000:1.0:1715330457.019760:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330427 00000100:00100000:3.0:1715330457.019857:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 335 00000100:00100000:3.0:1715330457.019863:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800660e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+35:2014:x1798653938170560:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330457.055498:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800660e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+37:2014:x1798653938170560:12345-192.168.204.49@tcp:4:dd.0 Request processed in 35627us (37175us total) trans 4294970201 rc 0/0 00000100:00100000:2.0:1715330457.055510:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 335 00002000:00100000:2.0:1715330457.055522:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (1035993088->1040187391) req@ffff8800660e8a80 x1798653938170560/t4294970201(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:668/0 lens 488/448 e 0 to 0 dl 1715330468 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330457.055531:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800660e8a80 with x1798653938170560 ext(1035993088->1040187391) 00002000:00010000:2.0:1715330457.055535:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800660e8a80 00000100:00100000:0.0:1715330457.083549:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330457.083618:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938170688 00000100:00100000:2.0:1715330457.083628:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938170688 00002000:00100000:2.0:1715330457.083663:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (1040187392->1044381695) req@ffff8800660e8e00 x1798653938170688/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:668/0 lens 488/0 e 0 to 0 dl 1715330468 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330457.083672:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800660e8e00 with x1798653938170688 ext(1040187392->1044381695) 00002000:00010000:2.0:1715330457.083677:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800660e8e00 00000100:00100000:2.0:1715330457.083705:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 336 00000100:00100000:2.0:1715330457.083710:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800660e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+37:2013:x1798653938170688:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:3.0:1715330457.121779:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800660e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+39:2013:x1798653938170688:12345-192.168.204.49@tcp:4:dd.0 Request processed in 38055us (38224us total) trans 4294970202 rc 0/0 00000100:00100000:3.0:1715330457.121794:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 336 00002000:00100000:3.0:1715330457.121807:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (1040187392->1044381695) req@ffff8800660e8e00 x1798653938170688/t4294970202(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:668/0 lens 488/448 e 0 to 0 dl 1715330468 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330457.121816:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800660e8e00 with x1798653938170688 ext(1040187392->1044381695) 00002000:00010000:3.0:1715330457.121822:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800660e8e00 00000100:00100000:1.0:1715330457.122789:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330457.122921:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938170944 00000100:00100000:2.0:1715330457.122928:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938170944 00000100:00100000:2.0:1715330457.123009:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5225 00000100:00100000:2.0:1715330457.123016:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880066240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+17:24565:x1798653938170944:12345-192.168.204.49@tcp:35:dd.0 00000001:00080000:2.0:1715330457.123235:0:7137:0:(tgt_lastrcvd.c:2108:tgt_txn_stop_cb()) More than one transaction 4294984134 00000100:00100000:2.0:1715330457.124072:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880066240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+19:24565:x1798653938170944:12345-192.168.204.49@tcp:35:dd.0 Request processed in 1054us (1284us total) trans 4294984135 rc 0/0 00000100:00100000:2.0:1715330457.124079:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5225 00000020:00080000:2.0:1715330457.124083:0:7137:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1715330457.124449:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330457.124524:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938170816 00000100:00100000:3.0:1715330457.124528:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938170816 00002000:00100000:3.0:1715330457.124553:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (1044381696->1048575999) req@ffff8800660e9180 x1798653938170816/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:668/0 lens 488/0 e 0 to 0 dl 1715330468 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1715330457.124719:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800660e9180 with x1798653938170816 ext(1044381696->1048575999) 00002000:00010000:3.0:1715330457.124723:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800660e9180 00000100:00100000:3.0:1715330457.124795:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 337 00000100:00100000:3.0:1715330457.124800:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800660e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+39:2013:x1798653938170816:12345-192.168.204.49@tcp:4:dd.0 00000100:00100000:2.0:1715330457.164324:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800660e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+41:2013:x1798653938170816:12345-192.168.204.49@tcp:4:dd.0 Request processed in 39512us (39864us total) trans 4294970203 rc 0/0 00000100:00100000:2.0:1715330457.164338:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 337 00002000:00100000:2.0:1715330457.164347:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (1044381696->1048575999) req@ffff8800660e9180 x1798653938170816/t4294970203(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:668/0 lens 488/448 e 0 to 0 dl 1715330468 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330457.164356:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800660e9180 with x1798653938170816 ext(1044381696->1048575999) 00002000:00010000:2.0:1715330457.164361:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800660e9180 00010000:00010000:2.0:1715330457.651680:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330458.290961:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1715330458.290984:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880066240700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942552256:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1715330458.291042:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330458.291241:0:7139:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942552256 00000100:00100000:3.0:1715330458.291247:0:7139:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942552256 00000100:00100000:3.0:1715330458.291288:0:7139:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3160 00000100:00100000:3.0:1715330458.291294:0:7139:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800660e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:3689:x1798653942552256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1715330458.291320:0:7139:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444089856 avail 1314627584 00000100:00100000:3.0:1715330458.291359:0:7139:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800660e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:3689:x1798653942552256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 65us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330458.291364:0:7139:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3160 00000100:00100000:1.0:1715330458.291420:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880066240700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942552256:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1715330458.624647:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330458.624945:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330458.625018:0:17215:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938171072 00000100:00100000:0.0:1715330458.625027:0:17215:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938171072 00000100:00100000:0.0:1715330458.625062:0:17215:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5352 00000100:00100000:0.0:1715330458.625068:0:17215:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880066240a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:72de1896-1df4-4b3a-930a-9116d2c66168+41:2013:x1798653938171072:12345-192.168.204.49@tcp:16:kworker.0 00000100:00100000:2.0:1715330458.625323:0:9402:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938171008 00000100:00100000:2.0:1715330458.625328:0:9402:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938171008 00002000:00100000:2.0:1715330458.625350:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (983564288->985661439) req@ffff880066240700 x1798653938171008/t0(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:669/0 lens 488/0 e 0 to 0 dl 1715330469 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330458.625359:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880066240700 with x1798653938171008 ext(983564288->985661439) 00002000:00010000:2.0:1715330458.625363:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880066240700 00000100:00100000:2.0:1715330458.625377:0:9402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 338 00000100:00100000:2.0:1715330458.625381:0:9402:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880066240700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+42:2013:x1798653938171008:12345-192.168.204.49@tcp:4:dd.0 00000001:00080000:2.0:1715330458.627772:0:9395:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0000: transno 4294970203 is committed 00000100:00100000:0.0:1715330458.628122:0:17215:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880066240a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:72de1896-1df4-4b3a-930a-9116d2c66168+9:2013:x1798653938171072:12345-192.168.204.49@tcp:16:kworker.0 Request processed in 3049us (3173us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330458.628133:0:17215:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5352 00000100:00100000:2.0:1715330458.647525:0:9402:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880066240700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72de1896-1df4-4b3a-930a-9116d2c66168+9:2013:x1798653938171008:12345-192.168.204.49@tcp:4:dd.0 Request processed in 22132us (22875us total) trans 4294970204 rc 0/0 00000100:00100000:2.0:1715330458.647538:0:9402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 338 00002000:00100000:2.0:1715330458.647550:0:9402:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa02:0x0] (983564288->985661439) req@ffff880066240700 x1798653938171008/t4294970204(0) o4->72de1896-1df4-4b3a-930a-9116d2c66168@192.168.204.49@tcp:669/0 lens 488/448 e 0 to 0 dl 1715330469 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715330458.647559:0:9402:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880066240700 with x1798653938171008 ext(983564288->985661439) 00002000:00010000:2.0:1715330458.647565:0:9402:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880066240700 00010000:00010000:1.0:1715330458.653045:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330458.679317:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330458.680169:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938171136 00000100:00100000:3.0:1715330458.680177:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938171136 00000100:00100000:3.0:1715330458.680220:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23870 00000100:00100000:3.0:1715330458.680227:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880066240e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+19:24797:x1798653938171136:12345-192.168.204.49@tcp:101:lfs.0 00010000:00010000:3.0:1715330458.680248:0:9622:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330458.680286:0:9622:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da806c0/0xd895711d66dbf50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbf92 expref: -99 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330458.680332:0:9622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81680/0xd895711d66dbf57 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330458.680342:0:9622:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81680/0xd895711d66dbf57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330458.680350:0:9622:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81680/0xd895711d66dbf57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00000100:00080000:1.0:1715330458.680444:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330428 00000004:00200000:3.0:1715330458.680534:0:9622:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 270336 00000004:00200000:3.0:1715330458.680537:0:9622:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1715330458.680554:0:9622:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81680/0xd895711d66dbf57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9622 initiator: MDT0 00010000:00010000:3.0:1715330458.680573:0:9622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da806c0/0xd895711d66dbf50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf92 expref: 21 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330458.680874:0:9622:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81680/0xd895711d66dbf57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf92 expref: 20 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330458.680882:0:9622:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:3.0:1715330458.680884:0:9622:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1715330458.680887:0:9622:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011da81680, rc 0) 00000100:00100000:3.0:1715330458.680951:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880066240e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+20:24797:x1798653938171136:12345-192.168.204.49@tcp:101:lfs.0 Request processed in 722us (1641us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330458.680957:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23870 00000100:00100000:1.0:1715330458.685590:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330458.685677:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938171200 00000100:00100000:3.0:1715330458.685684:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938171200 00000100:00100000:3.0:1715330458.685828:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23871 00000100:00100000:3.0:1715330458.685835:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880066241180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+20:24797:x1798653938171200:12345-192.168.204.49@tcp:41:lfs.0 00000004:00000024:3.0:1715330458.685868:0:9622:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444089856 avail 1314627584 00000100:00100000:3.0:1715330458.685925:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880066241180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+20:24797:x1798653938171200:12345-192.168.204.49@tcp:41:lfs.0 Request processed in 89us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330458.685932:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23871 00000100:00100000:2.0:1715330458.688370:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330458.688438:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938171264 00000100:00100000:0.0:1715330458.688445:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938171264 00000100:00100000:0.0:1715330458.688687:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23872 00000100:00100000:0.0:1715330458.688693:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880067c66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+6:24797:x1798653938171264:12345-192.168.204.49@tcp:41:lfs.0 00000004:00000024:0.0:1715330458.688720:0:25569:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445060608 avail 1315598336 00000100:00080000:1.0:1715330458.688758:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330428 00000100:00100000:0.0:1715330458.688829:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880067c66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+6:24797:x1798653938171264:12345-192.168.204.49@tcp:41:lfs.0 Request processed in 135us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330458.688836:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23872 00000100:00100000:1.0:1715330458.692040:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330458.692187:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938171328 00000100:00100000:2.0:1715330458.692195:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938171328 00000100:00100000:2.0:1715330458.692245:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 284 00000100:00100000:2.0:1715330458.692251:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880066241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:72de1896-1df4-4b3a-930a-9116d2c66168+9:24797:x1798653938171328:12345-192.168.204.49@tcp:13:lfs.0 00002000:00000024:2.0:1715330458.692272:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 494331584 pending 2121728 free 2877026304 avail 2575880192 00000100:00100000:2.0:1715330458.692585:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880066241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:72de1896-1df4-4b3a-930a-9116d2c66168+9:24797:x1798653938171328:12345-192.168.204.49@tcp:13:lfs.0 Request processed in 332us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330458.692591:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 284 00000100:00100000:1.0:1715330458.694251:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330458.694365:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938171392 00000100:00100000:2.0:1715330458.694373:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938171392 00000100:00100000:2.0:1715330458.694421:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 285 00000100:00100000:2.0:1715330458.694427:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880066241880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:72de1896-1df4-4b3a-930a-9116d2c66168+6:24797:x1798653938171392:12345-192.168.204.49@tcp:13:lfs.0 00002000:00000024:2.0:1715330458.694463:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 172032 granted 317126336 pending 0 free 3923546112 avail 3692023808 00000100:00100000:2.0:1715330458.694525:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880066241880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:72de1896-1df4-4b3a-930a-9116d2c66168+6:24797:x1798653938171392:12345-192.168.204.49@tcp:13:lfs.0 Request processed in 96us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330458.694532:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 285 00000100:00080000:1.0:1715330458.694614:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330428 00010000:00010000:2.0:1715330459.656015:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330459.718657:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880066241c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942552320:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1715330459.718727:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330459.718835:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942552320 00000100:00100000:0.0:1715330459.718843:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942552320 00000100:00100000:0.0:1715330459.718888:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3161 00000100:00100000:0.0:1715330459.718894:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880067c66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942552320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1715330459.718927:0:19960:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445060608 avail 1315598336 00000100:00100000:0.0:1715330459.719188:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880067c66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942552320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 293us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330459.719194:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3161 00000100:00100000:2.0:1715330459.719256:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880066241c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942552320:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1715330460.611127:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800660e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942552384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1715330460.611183:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330460.612409:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880067c66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942552448:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1715330460.613045:0:9400:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942552384 00000100:00100000:3.0:1715330460.613059:0:9400:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942552384 00000100:00080000:0.0:1715330460.613085:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330430 00000100:00100000:3.0:1715330460.613099:0:9400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1715330460.613106:0:9400:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880066241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942552384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1715330460.613132:0:9400:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 494331584 pending 2121728 free 2874929152 avail 2643406848 00000100:00100000:3.0:1715330460.613174:0:9400:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880066241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942552384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (1990us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330460.613312:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800660e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942552384:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1715330460.613320:0:9400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1715330460.613367:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330460.613395:0:9400:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942552448 00000100:00100000:3.0:1715330460.613406:0:9400:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942552448 00000100:00100000:3.0:1715330460.613433:0:9400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1715330460.613436:0:9400:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880067c66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942552448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1715330460.613445:0:9400:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 494331584 pending 2121728 free 2874929152 avail 2643406848 00000100:00100000:3.0:1715330460.613480:0:9400:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880067c66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942552448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330460.613485:0:9400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1715330460.613500:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880067c66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942552448:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1715330460.613527:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330430 00010000:00010000:3.0:1715330460.657299:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330461.360410:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330461.360447:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330461.360469:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330461.360483:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330461.360503:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330461.360529:0:17197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938171648 00000100:00100000:2.0:1715330461.360535:0:17197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938171648 00000100:00100000:2.0:1715330461.360578:0:17197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938171712 00000100:00100000:2.0:1715330461.360580:0:17197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938171712 00000100:00100000:2.0:1715330461.360594:0:17197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 359 00000100:00100000:2.0:1715330461.360602:0:17197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880067c67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:72de1896-1df4-4b3a-930a-9116d2c66168+9:2011:x1798653938171648:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:2.0:1715330461.360656:0:17197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880067c67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:72de1896-1df4-4b3a-930a-9116d2c66168+9:2011:x1798653938171648:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 55us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330461.360661:0:17197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 359 00000100:00100000:2.0:1715330461.360674:0:17197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 360 00000100:00100000:2.0:1715330461.360677:0:17197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880067c67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:72de1896-1df4-4b3a-930a-9116d2c66168+6:2011:x1798653938171712:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:2.0:1715330461.360693:0:17197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880067c67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:72de1896-1df4-4b3a-930a-9116d2c66168+6:2011:x1798653938171712:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 15us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330461.360701:0:17197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 360 00000100:00080000:2.0:1715330461.360711:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330431 00000100:00080000:2.0:1715330461.360714:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330431 00000100:00100000:3.0:1715330461.360785:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938171520 00000100:00100000:3.0:1715330461.360789:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938171520 00000100:00100000:3.0:1715330461.360816:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938171584 00000100:00100000:3.0:1715330461.360817:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938171584 00000100:00100000:3.0:1715330461.360830:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 508 00000100:00100000:3.0:1715330461.360835:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880067c66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+20:2011:x1798653938171520:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:3.0:1715330461.360862:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880067c66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+20:2011:x1798653938171520:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 27us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330461.360867:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 508 00000100:00100000:3.0:1715330461.360876:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 509 00000100:00100000:3.0:1715330461.360879:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880067c67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+6:2011:x1798653938171584:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:3.0:1715330461.360898:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880067c67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+6:2011:x1798653938171584:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 19us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330461.360902:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 509 00000100:00100000:1.0:1715330461.361360:0:7130:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938171456 00000100:00100000:1.0:1715330461.361364:0:7130:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938171456 00000100:00100000:1.0:1715330461.361400:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 398 00000100:00100000:1.0:1715330461.361404:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2011:x1798653938171456:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:1.0:1715330461.361425:0:7130:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2011:x1798653938171456:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 21us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330461.361429:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 398 00000100:00080000:2.0:1715330461.362962:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330431 00000100:00080000:2.0:1715330461.362970:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330431 00000100:00080000:2.0:1715330461.362972:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330431 00000100:00100000:2.0:1715330461.446423:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330461.446556:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938171776 00000100:00100000:0.0:1715330461.446567:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938171776 00000100:00100000:0.0:1715330461.446610:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23873 00000100:00100000:0.0:1715330461.446616:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880067c67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+20:25157:x1798653938171776:12345-192.168.204.49@tcp:101:rm.0 00010000:00010000:0.0:1715330461.446631:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715330461.446648:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087726ac0/0xd895711d66dbf5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbf99 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330461.446694:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880087725200/0xd895711d66dbf65 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.446704:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087725200/0xd895711d66dbf65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.446712:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087725200/0xd895711d66dbf65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.446721:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880087724480/0xd895711d66dbf6c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x67bc6aa0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.446726:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087724480/0xd895711d66dbf6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67bc6aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.446752:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087724480/0xd895711d66dbf6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67bc6aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.446804:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880087727cc0/0xd895711d66dbf73 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x159c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.446810:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087727cc0/0xd895711d66dbf73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x159c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.446815:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087727cc0/0xd895711d66dbf73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x159c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00000004:00200000:0.0:1715330461.446846:0:25569:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000402:0x159c:0x0]: returning size 1048576000 00000004:00200000:0.0:1715330461.446850:0:25569:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1715330461.446865:0:25569:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880087727cc0/0xd895711d66dbf73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x159c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.446873:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087727cc0/0xd895711d66dbf73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x159c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.446880:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880087725200/0xd895711d66dbf65 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.446884:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880087725200/0xd895711d66dbf65 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.446889:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880087725200/0xd895711d66dbf65 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.446893:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880087725200/0xd895711d66dbf65 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.446897:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087725200 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330461.446900:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087725200/0xd895711d66dbf65 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.446905:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087725200/0xd895711d66dbf65 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.446914:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:0.0:1715330461.446916:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330461.446919:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880087725200/0xd895711d66dbf65 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.446924:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087725200/0xd895711d66dbf65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.446932:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880087724480/0xd895711d66dbf6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67bc6aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.446936:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880087724480/0xd895711d66dbf6c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67bc6aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.446940:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880087724480/0xd895711d66dbf6c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67bc6aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.446943:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087724480 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330461.446945:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087724480/0xd895711d66dbf6c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67bc6aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.446949:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087724480/0xd895711d66dbf6c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67bc6aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.446954:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x67bc6aa0 (ffff880093b42e00) 00010000:00010000:0.0:1715330461.446955:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330461.446957:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880087724480/0xd895711d66dbf6c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x67bc6aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.446960:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087724480/0xd895711d66dbf6c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x67bc6aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.446978:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087726ac0/0xd895711d66dbf5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf99 expref: 22 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330461.446987:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880087727cc0/0xd895711d66dbf73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x159c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf99 expref: 21 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330461.446993:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159c:0x0].0x0 (ffff88009d618e00) 00010000:00010000:0.0:1715330461.446995:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715330461.446997:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880087727cc0, rc 0) 00000100:00100000:0.0:1715330461.447035:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880067c67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+21:25157:x1798653938171776:12345-192.168.204.49@tcp:101:rm.0 Request processed in 419us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330461.447041:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23873 00000100:00100000:0.0:1715330461.450886:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330461.450912:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938171904 00000100:00100000:0.0:1715330461.450919:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938171904 00000100:00100000:0.0:1715330461.450951:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23874 00000100:00100000:0.0:1715330461.450958:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800660e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+21:25157:x1798653938171904:12345-192.168.204.49@tcp:36:rm.0 00010000:00010000:0.0:1715330461.450995:0:25569:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1715330461.451015:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087727cc0/0xd895711d66dbf73 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x159c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf99 expref: 21 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330461.451029:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6f40/0xd895711d66dbf3b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x159c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf84 expref: 20 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330461.451038:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b46c0/0xd895711d66dbefc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x159c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf6f expref: 19 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330461.451046:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159c:0x0].0x0 (ffff88009d618e00) 00010000:00010000:0.0:1715330461.451058:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81680/0xd895711d66dbf57 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf92 expref: 18 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330461.451065:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:0.0:1715330461.451067:0:25569:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715330461.451085:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087724900/0xd895711d66dbf7a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.451097:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087724900/0xd895711d66dbf7a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.451104:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087724900/0xd895711d66dbf7a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.451112:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087727a80/0xd895711d66dbf81 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x67bc6aa0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.451117:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087727a80/0xd895711d66dbf81 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x67bc6aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.451122:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087727a80/0xd895711d66dbf81 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x67bc6aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.451161:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800877258c0/0xd895711d66dbf88 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x159c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.451166:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800877258c0/0xd895711d66dbf88 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.451171:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800877258c0/0xd895711d66dbf88 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00000040:00080000:0.0:1715330461.451334:0:25569:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].52, 64 off11520 00000004:00080000:0.0:1715330461.451339:0:25569:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 435927607027ns, next at 436927605962ns, rc = 0 00010000:00010000:0.0:1715330461.451374:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087725680/0xd895711d66dbf8f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x159c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.451380:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087725680/0xd895711d66dbf8f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x159c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.451397:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880087725680/0xd895711d66dbf8f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x159c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.451407:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087725680/0xd895711d66dbf8f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x159c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.451412:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087725680/0xd895711d66dbf8f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x159c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.451416:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880087725680/0xd895711d66dbf8f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x159c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.451421:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880087725680/0xd895711d66dbf8f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x159c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.451426:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087725680 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:0.0:1715330461.451429:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087725680/0xd895711d66dbf8f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x159c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.451435:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087725680/0xd895711d66dbf8f lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x159c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.451441:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159c:0x0].0x0 (ffff880093b42300) 00010000:00010000:0.0:1715330461.451444:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1715330461.451446:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880087725680/0xd895711d66dbf8f lrc: 3/0,0 mode: --/PW res: [0x200000402:0x159c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.451451:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087725680/0xd895711d66dbf8f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x159c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.451468:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800877258c0/0xd895711d66dbf88 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.451472:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800877258c0/0xd895711d66dbf88 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x159c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.451477:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800877258c0/0xd895711d66dbf88 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x159c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.451481:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800877258c0 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330461.451483:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800877258c0/0xd895711d66dbf88 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x159c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.451487:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800877258c0/0xd895711d66dbf88 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x159c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.451492:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159c:0x0].0x0 (ffff880093b42300) 00010000:00010000:0.0:1715330461.451494:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715330461.451497:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800877258c0/0xd895711d66dbf88 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x159c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.451501:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800877258c0/0xd895711d66dbf88 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x159c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.451608:0:25569:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087724900/0xd895711d66dbf7a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.451612:0:25569:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880087724900/0xd895711d66dbf7a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.451616:0:25569:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880087724900/0xd895711d66dbf7a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.451621:0:25569:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880087724900/0xd895711d66dbf7a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.451625:0:25569:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087724900 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:0.0:1715330461.451627:0:25569:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087724900/0xd895711d66dbf7a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.451631:0:25569:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087724900/0xd895711d66dbf7a lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.451640:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:0.0:1715330461.451642:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715330461.451644:0:25569:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880087724900/0xd895711d66dbf7a lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.451648:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087724900/0xd895711d66dbf7a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00000004:00010000:0.0:1715330461.451653:0:25569:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8800660e9c00 reply state ffff880091c78000 transno 4294984136 ns: mdt-lustre-MDT0000_UUID lock: ffff880087727a80/0xd895711d66dbf81 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x67bc6aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.451660:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880087727a80/0xd895711d66dbf81 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x67bc6aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:0.0:1715330461.451664:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x67bc6aa0 (ffff880093b42f00) 00010000:00010000:0.0:1715330461.451666:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715330461.451667:0:25569:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1715330461.451712:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800660e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+19:25157:x1798653938171904:12345-192.168.204.49@tcp:36:rm.0 Request processed in 754us (831us total) trans 4294984136 rc 0/0 00000100:00100000:0.0:1715330461.451718:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23874 00010000:00010000:2.0:1715330461.659697:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330461.842970:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800661b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3689:1798653942552576:0@lo:400:kworker.0 00000100:00100000:0.0:1715330461.842970:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800661b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3688:1798653942552512:0@lo:400:kworker.0 00000100:00100000:1.0:1715330461.843033:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800661b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942552640:0@lo:400:kworker.0 00000100:00100000:3.0:1715330461.843035:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800661b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3691:1798653942552704:0@lo:400:kworker.0 00000100:00100000:2.0:1715330461.843037:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330461.843062:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330461.843063:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330461.843067:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800661b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3689:1798653942552832:0@lo:400:kworker.0 00000100:00100000:1.0:1715330461.843077:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800661b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3690:1798653942552896:0@lo:400:kworker.0 00000100:00100000:3.0:1715330461.843079:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800661b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942552960:0@lo:400:kworker.0 00000100:00100000:2.0:1715330461.843083:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330461.843091:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330461.843093:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800661b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3689:1798653942553088:0@lo:400:kworker.0 00000100:00100000:3.0:1715330461.843095:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330461.843100:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800661b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3690:1798653942553152:0@lo:400:kworker.0 00000100:00100000:3.0:1715330461.843103:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880065128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942553216:0@lo:400:kworker.0 00000100:00100000:2.0:1715330461.843107:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330461.843112:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330461.843120:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1715330461.843121:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942552576 00000100:00100000:2.0:1715330461.843124:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800661b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942552768:0@lo:400:kworker.0 00000100:00100000:1.0:1715330461.843127:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942552576 00000100:00100000:3.0:1715330461.843129:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942552704 00000100:00100000:3.0:1715330461.843132:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942552704 00000100:00100000:2.0:1715330461.843138:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330461.843147:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800661b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942553024:0@lo:400:kworker.0 00000100:00100000:3.0:1715330461.843150:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942552832 00000100:00100000:3.0:1715330461.843151:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942552832 00000100:00100000:1.0:1715330461.843151:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942552896 00000100:00100000:1.0:1715330461.843153:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942552896 00000100:00100000:3.0:1715330461.843159:0:11283:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942553088 00000100:00100000:3.0:1715330461.843160:0:11283:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942553088 00000100:00100000:2.0:1715330461.843161:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330461.843164:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 510 00000100:00100000:2.0:1715330461.843169:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880065128380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942553280:0@lo:400:kworker.0 00000100:00100000:3.0:1715330461.843176:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 511 00000100:00100000:1.0:1715330461.843176:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880065128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3691:x1798653942552704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330461.843179:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800657f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1798653942552576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330461.843181:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330461.843200:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:2.0:1715330461.843203:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800657f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1798653942552832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330461.843210:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800657f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1798653942552576:12345-0@lo:400:kworker.0 Request processed in 29us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330461.843216:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 511 00000100:00100000:2.0:1715330461.843228:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800657f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1798653942552832:12345-0@lo:400:kworker.0 Request processed in 24us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330461.843230:0:11283:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 513 00000100:00100000:3.0:1715330461.843233:0:11283:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880066242680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3690:x1798653942552896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330461.843235:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00000100:00100000:2.0:1715330461.843247:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 514 00000100:00100000:2.0:1715330461.843250:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800657f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3689:x1798653942553088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330461.843253:0:11283:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880066242680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3690:x1798653942552896:12345-0@lo:400:kworker.0 Request processed in 19us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330461.843262:0:11283:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 513 00000100:00100000:2.0:1715330461.843268:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800657f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3689:x1798653942553088:12345-0@lo:400:kworker.0 Request processed in 17us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330461.843273:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 514 00000100:00100000:3.0:1715330461.843278:0:7139:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942552640 00000100:00100000:3.0:1715330461.843281:0:7139:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942552640 00000100:00080000:2.0:1715330461.843286:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330431 00000100:00080000:2.0:1715330461.843289:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330431 00000100:00100000:2.0:1715330461.843296:0:17217:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942552960 00000100:00100000:3.0:1715330461.843297:0:7139:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942552768 00000100:00100000:3.0:1715330461.843298:0:7139:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942552768 00000100:00100000:2.0:1715330461.843299:0:17217:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942552960 00000100:00100000:3.0:1715330461.843308:0:7139:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3162 00000100:00100000:3.0:1715330461.843311:0:7139:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880066242300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942552640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330461.843315:0:17217:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942553216 00000100:00100000:2.0:1715330461.843316:0:17217:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942553216 00000100:00100000:2.0:1715330461.843328:0:17217:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942553024 00000100:00100000:2.0:1715330461.843329:0:17217:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942553024 00000100:00100000:3.0:1715330461.843334:0:7139:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880066242300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942552640:12345-0@lo:400:kworker.0 Request processed in 22us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330461.843337:0:17217:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942553280 00000100:00100000:3.0:1715330461.843338:0:7139:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3162 00000100:00100000:2.0:1715330461.843338:0:17217:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942553280 00000100:00100000:3.0:1715330461.843345:0:7139:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3163 00000100:00100000:3.0:1715330461.843348:0:7139:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800657f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942552768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330461.843348:0:17217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1715330461.843351:0:17217:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880065128a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942552960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330461.843362:0:7139:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800657f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942552768:12345-0@lo:400:kworker.0 Request processed in 14us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330461.843366:0:7139:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3163 00000100:00100000:2.0:1715330461.843406:0:17217:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880065128a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942552960:12345-0@lo:400:kworker.0 Request processed in 53us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330461.843410:0:17217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1715330461.843412:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800661b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942552960:0@lo:400:kworker.0 00000100:00100000:2.0:1715330461.843420:0:17217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1715330461.843423:0:17217:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880065128e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942553216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330461.843433:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800661b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942552768:0@lo:400:kworker.0 00000100:00100000:3.0:1715330461.843440:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800661b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3689:1798653942552832:0@lo:400:kworker.0 00000100:00100000:2.0:1715330461.843446:0:17217:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880065128e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942553216:12345-0@lo:400:kworker.0 Request processed in 21us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330461.843448:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800661b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3689:1798653942553088:0@lo:400:kworker.0 00000100:00100000:2.0:1715330461.843450:0:17217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1715330461.843455:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800661b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3689:1798653942552576:0@lo:400:kworker.0 00000100:00100000:2.0:1715330461.843458:0:17217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1715330461.843461:0:17217:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942553024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330461.843464:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880065128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3691:x1798653942552704:12345-0@lo:400:kworker.0 Request processed in 294us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330461.843469:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 510 00000100:00100000:1.0:1715330461.843484:0:12304:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1715330461.843485:0:17217:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942553024:12345-0@lo:400:kworker.0 Request processed in 23us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330461.843488:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800661b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3691:1798653942552704:0@lo:400:kworker.0 00000100:00100000:1.0:1715330461.843488:0:12304:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800657f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942553280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330461.843490:0:17217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1715330461.843495:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880065128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942553216:0@lo:400:kworker.0 00000100:00100000:3.0:1715330461.843511:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800661b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942553024:0@lo:400:kworker.0 00000100:00100000:1.0:1715330461.843515:0:12304:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800657f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942553280:12345-0@lo:400:kworker.0 Request processed in 26us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330461.843517:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880065128380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942553280:0@lo:400:kworker.0 00000100:00100000:1.0:1715330461.843520:0:12304:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1715330461.843552:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330461.843581:0:7129:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942552512 00000100:00100000:0.0:1715330461.843584:0:7129:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942552512 00000100:00100000:0.0:1715330461.843602:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:0.0:1715330461.843605:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3688:x1798653942552512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330461.843626:0:7129:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3688:x1798653942552512:12345-0@lo:400:kworker.0 Request processed in 20us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330461.843630:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:0.0:1715330461.843651:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800661b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3688:1798653942552512:0@lo:400:kworker.0 00000100:00100000:1.0:1715330461.844047:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330461.844078:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800661b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942552640:0@lo:400:kworker.0 00000100:00080000:2.0:1715330461.844079:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330431 00000100:00080000:2.0:1715330461.844081:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330431 00000100:00100000:1.0:1715330461.844086:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800661b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3690:1798653942552896:0@lo:400:kworker.0 00000100:00100000:3.0:1715330461.844162:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942553152 00000100:00100000:3.0:1715330461.844165:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942553152 00000100:00100000:3.0:1715330461.844191:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 515 00000100:00100000:3.0:1715330461.844195:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880066242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3690:x1798653942553152:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1715330461.844198:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330431 00000100:00100000:3.0:1715330461.844290:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880066242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3690:x1798653942553152:12345-0@lo:400:kworker.0 Request processed in 95us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330461.844295:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 515 00000100:00100000:0.0:1715330461.844347:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800661b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3690:1798653942553152:0@lo:400:kworker.0 00000100:00100000:1.0:1715330461.906950:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1715330461.906969:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800660e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942553344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1715330461.907020:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330461.909090:0:9400:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942553344 00000100:00100000:2.0:1715330461.909100:0:9400:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942553344 00000100:00100000:2.0:1715330461.909138:0:9400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1715330461.909144:0:9400:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880066242d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942553344:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1715330461.909148:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800660ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942553408:0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1715330461.909173:0:9400:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 172032 granted 317126336 pending 0 free 3923546112 avail 3692023808 00000100:00100000:0.0:1715330461.909193:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330461.909208:0:9400:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880066242d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942553344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (2188us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330461.909215:0:9400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1715330461.909222:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942553408 00000100:00100000:0.0:1715330461.909225:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942553408 00000100:00100000:0.0:1715330461.909238:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1715330461.909241:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800660ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942553408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1715330461.909249:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 172032 granted 317126336 pending 0 free 3923546112 avail 3692023808 00000100:00100000:2.0:1715330461.909250:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800660e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942553344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1715330461.909268:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800660ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942553408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 25us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330461.909273:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1715330461.909423:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800660ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942553408:0@lo:13:osp-pre-1-1.0 00000001:00080000:0.0:1715330462.232832:0:7116:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984136 is committed 00000004:00080000:0.0:1715330462.232843:0:7116:0:(osp_sync.c:1604:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 35 committed 00010000:00010000:3.0:1715330462.233884:0:3675:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880087727a80/0xd895711d66dbf81 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x67bc6aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330462.233895:0:3675:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880087727a80/0xd895711d66dbf81 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x67bc6aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330462.233901:0:3675:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880087727a80/0xd895711d66dbf81 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x67bc6aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330462.233906:0:3675:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880087727a80 already unused, calling callback (ffffffffa0ee8730) 00010000:00010000:3.0:1715330462.233909:0:3675:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087727a80/0xd895711d66dbf81 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x67bc6aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330462.233915:0:3675:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880087727a80/0xd895711d66dbf81 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x67bc6aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330462.233929:0:3675:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x67bc6aa0 (ffff880093b42f00) 00010000:00010000:3.0:1715330462.233932:0:3675:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715330462.233935:0:3675:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880087727a80/0xd895711d66dbf81 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x67bc6aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330462.233939:0:3675:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087727a80/0xd895711d66dbf81 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x67bc6aa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25569 initiator: MDT0 00000100:00100000:0.0:1715330462.236583:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1715330462.236604:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800657f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942553472:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1715330462.236657:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330462.237179:0:17217:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942553472 00000100:00100000:2.0:1715330462.237187:0:17217:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942553472 00000100:00100000:2.0:1715330462.237600:0:17217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5353 00000100:00100000:2.0:1715330462.237607:0:17217:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800660ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942553472:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1715330462.237631:0:17217:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2562 count 1 00010000:00010000:2.0:1715330462.237655:0:17217:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800938b7840/0xd895711d66dbf96 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa02:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330462.237671:0:17217:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800877261c0/0xd895711d66dbf49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf8b expref: 8 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330462.237683:0:17217:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1715330462.237685:0:17217:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1715330462.237688:0:17217:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800938b7840/0xd895711d66dbf96 lrc: 4/0,1 mode: --/PW res: [0x280000401:0xa02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330462.237711:0:17217:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800877261c0/0xd895711d66dbf49 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf8b expref: 8 pid: 9398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330462.237721:0:17217:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800877261c0/0xd895711d66dbf49 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf8b expref: 8 pid: 9398 timeout: 536 lvb_type: 0 00000100:00080000:3.0:1715330462.237848:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330432 00000100:00100000:2.0:1715330462.237886:0:17217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800657f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:17217:1798653942553536:192.168.204.49@tcp:104: 00000100:00100000:2.0:1715330462.237975:0:17217:0:(client.c:2542:ptlrpc_set_wait()) set ffff880091f68480 going to sleep for 11 seconds 00000100:00100000:2.0:1715330462.243921:0:17217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800657f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:17217:1798653942553536:192.168.204.49@tcp:104: 00010000:00010000:2.0:1715330462.243946:0:17217:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800938b7840/0xd895711d66dbf96 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330462.660927:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330462.686605:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330462.687439:0:10673:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938171968 00000100:00100000:3.0:1715330462.687449:0:10673:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938171968 00010000:00010000:3.0:1715330462.687482:0:10673:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800877261c0/0xd895711d66dbf49 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf8b expref: 9 pid: 9398 timeout: 536 lvb_type: 0 00000100:00100000:3.0:1715330462.687521:0:10673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1593 00000100:00100000:3.0:1715330462.687528:0:10673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800657f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:72de1896-1df4-4b3a-930a-9116d2c66168+9:2012:x1798653938171968:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1715330462.687542:0:10673:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715330462.687546:0:10673:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff8800877261c0/0xd895711d66dbf49 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa02:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf8b expref: 9 pid: 9398 timeout: 536 lvb_type: 0 00010000:00010000:3.0:1715330462.687557:0:10673:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800877261c0/0xd895711d66dbf49 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa02:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf8b expref: 9 pid: 9398 timeout: 536 lvb_type: 0 00010000:00010000:3.0:1715330462.687579:0:10673:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800877261c0/0xd895711d66dbf49 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa02:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf8b expref: 9 pid: 9398 timeout: 536 lvb_type: 0 00010000:00010000:3.0:1715330462.689575:0:10673:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330462.689580:0:10673:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715330462.689585:0:10673:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800938b7840/0xd895711d66dbf96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330462.689596:0:10673:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800938b7840/0xd895711d66dbf96 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xa02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330462.689677:0:10673:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715330462.690844:0:10673:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800657f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:72de1896-1df4-4b3a-930a-9116d2c66168+8:2012:x1798653938171968:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 3308us (4238us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330462.690858:0:10673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1593 00010000:00010000:2.0:1715330462.691022:0:17217:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800938b7840/0xd895711d66dbf96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330462.691031:0:17217:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800938b7840/0xd895711d66dbf96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330462.691039:0:17217:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800938b7840/0xd895711d66dbf96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330462.691046:0:17217:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800938b7840/0xd895711d66dbf96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330462.691053:0:17217:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800938b7840/0xd895711d66dbf96 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330462.691058:0:17217:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800938b7840 already unused, calling callback (ffffffffa07e2af0) 00010000:00010000:2.0:1715330462.691061:0:17217:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800938b7840/0xd895711d66dbf96 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330462.691068:0:17217:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800938b7840/0xd895711d66dbf96 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330462.691083:0:17217:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800938b7840/0xd895711d66dbf96 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330462.691087:0:17217:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800938b7840/0xd895711d66dbf96 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330463.299388:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800657f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942553600:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1715330463.299442:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330463.299478:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942553600 00000100:00100000:3.0:1715330463.299483:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942553600 00000100:00100000:3.0:1715330463.299510:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3164 00000100:00100000:3.0:1715330463.299516:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880065128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942553600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1715330463.299541:0:19960:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444089856 avail 1314627584 00000100:00100000:3.0:1715330463.299569:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880065128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3688:x1798653942553600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330463.299574:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3164 00000100:00100000:3.0:1715330463.299603:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800657f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942553600:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1715330463.663932:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715330463.715273:0:17217:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800660ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3690:x1798653942553472:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1477659us (1478607us total) trans 4294970205 rc 0/0 00000100:00100000:3.0:1715330463.715286:0:17217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5353 00000004:00080000:3.0:1715330463.715355:0:3690:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800657f1180/2, rc 0, transno 2909 00000100:00100000:3.0:1715330463.715360:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800657f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942553472:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1715330463.719692:0:9395:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0000: transno 4294970205 is committed 00000001:00080000:3.0:1715330463.719700:0:9395:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0000: transno 4294970204 is committed 00000004:00080000:3.0:1715330464.163791:0:2420:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 438640057297ns, next at 436927605962ns, rc = 0 00080000:00080000:3.0:1715330464.163806:0:2420:0:(osd_handler.c:2696:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1715330464.163894:0:2420:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 438640162569ns, next at 280791889157ns, rc = 0 00080000:00080000:3.0:1715330464.163900:0:2420:0:(osd_handler.c:2696:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:3.0:1715330464.163981:0:2420:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 438640249019ns, next at 376592231385ns, rc = 0 00080000:00080000:3.0:1715330464.163986:0:2420:0:(osd_handler.c:2696:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1715330464.164042:0:2420:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 438640310172ns, next at 287080664640ns, rc = 0 00080000:00080000:3.0:1715330464.164046:0:2420:0:(osd_handler.c:2696:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:1.0:1715330464.166221:0:7116:0:(osp_sync.c:1604:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 36 committed 00000004:00080000:1.0:1715330464.166246:0:7116:0:(osp_sync.c:1604:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 36 committed 00000004:00080000:2.0:1715330464.166593:0:8267:0:(osp_sync.c:1604:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 8 committed 00000004:00080000:2.0:1715330464.166602:0:8267:0:(osp_sync.c:1604:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 7 committed 00010000:00010000:3.0:1715330464.665433:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330464.722914:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1715330464.722932:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800657f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942553664:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1715330464.722990:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330464.723027:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942553664 00000100:00100000:2.0:1715330464.723032:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942553664 00000100:00100000:2.0:1715330464.723066:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3165 00000100:00100000:2.0:1715330464.723072:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800657f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942553664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1715330464.723102:0:8592:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445060608 avail 1315598336 00000100:00100000:2.0:1715330464.723133:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800657f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942553664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330464.723139:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3165 00000100:00100000:2.0:1715330464.723172:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800657f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942553664:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1715330465.618871:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1715330465.618888:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800657f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942553728:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1715330465.619125:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330465.619149:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800660eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942553792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1715330465.619155:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942553728 00000100:00100000:1.0:1715330465.619163:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942553728 00000100:00100000:2.0:1715330465.619168:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1715330465.619490:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330435 00000100:00100000:0.0:1715330465.620453:0:16983:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942553792 00000100:00100000:0.0:1715330465.620458:0:16983:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942553792 00000100:00100000:0.0:1715330465.620501:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1715330465.620507:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800657f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942553728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1715330465.620535:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 492209856 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1715330465.620573:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800657f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942553728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (1449us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330465.620582:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1715330465.620595:0:16983:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1715330465.620598:0:16983:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800657f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942553792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1715330465.620604:0:16983:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 492209856 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1715330465.620616:0:16983:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800657f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942553792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 17us (1447us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330465.620620:0:16983:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1715330465.620649:0:3691:0:(client.c:2956:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294970205 gen 2 00000004:00080000:0.0:1715330465.620654:0:3691:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800657f1180, transno 4294970205 00000100:00100000:0.0:1715330465.620666:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800660eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942553792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1715330465.620676:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800657f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942553728:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1715330465.621352:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330435 00010000:00010000:2.0:1715330465.668670:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715330466.372469:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330466.372500:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330466.372513:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330466.372527:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330466.372595:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330466.372622:0:7130:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938172032 00000100:00100000:1.0:1715330466.372631:0:7130:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938172032 00000100:00100000:1.0:1715330466.372683:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 400 00000100:00100000:1.0:1715330466.372689:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2012:x1798653938172032:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:3.0:1715330466.372887:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938172096 00000100:00100000:3.0:1715330466.372890:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938172096 00000100:00100000:3.0:1715330466.372911:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938172160 00000100:00100000:3.0:1715330466.372913:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938172160 00000100:00100000:2.0:1715330466.374092:0:17217:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938172288 00000100:00100000:2.0:1715330466.374099:0:17217:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938172288 00000100:00100000:2.0:1715330466.374125:0:17217:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938172224 00000100:00100000:2.0:1715330466.374127:0:17217:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938172224 00000100:00100000:2.0:1715330466.374143:0:17217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 365 00000100:00100000:2.0:1715330466.374149:0:17217:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880066243800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:72de1896-1df4-4b3a-930a-9116d2c66168+6:2012:x1798653938172288:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:1.0:1715330466.374715:0:7130:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2012:x1798653938172032:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 2022us (2210us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330466.374725:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 400 00000100:00100000:2.0:1715330466.374809:0:17217:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880066243800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:72de1896-1df4-4b3a-930a-9116d2c66168+6:2012:x1798653938172288:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 658us (2279us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330466.374816:0:17217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 365 00000100:00100000:2.0:1715330466.374827:0:17217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 366 00000100:00100000:2.0:1715330466.374832:0:17217:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880066243b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:72de1896-1df4-4b3a-930a-9116d2c66168+6:2011:x1798653938172224:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:2.0:1715330466.374858:0:17217:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880066243b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:72de1896-1df4-4b3a-930a-9116d2c66168+6:2011:x1798653938172224:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 25us (2262us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330466.374863:0:17217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 366 00000100:00080000:2.0:1715330466.374875:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330436 00000100:00080000:2.0:1715330466.374879:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330436 00000100:00080000:2.0:1715330466.374881:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330436 00000100:00080000:2.0:1715330466.374883:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330436 00000100:00080000:2.0:1715330466.374885:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330436 00000100:00100000:3.0:1715330466.374973:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 516 00000100:00100000:3.0:1715330466.374979:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880066243100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+15:2011:x1798653938172096:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:3.0:1715330466.375012:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880066243100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+15:2011:x1798653938172096:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 33us (2555us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330466.375017:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 516 00000100:00100000:3.0:1715330466.375028:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 517 00000100:00100000:3.0:1715330466.375032:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880066243480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+6:2012:x1798653938172160:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:3.0:1715330466.375051:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880066243480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+6:2012:x1798653938172160:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 18us (2538us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330466.375055:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 517 00010000:00010000:1.0:1715330466.670901:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330466.852032:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880065128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3688:1798653942553856:0@lo:400:kworker.0 00000100:00100000:2.0:1715330466.852114:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330466.852240:0:7130:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942553856 00000100:00100000:1.0:1715330466.852248:0:7130:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942553856 00000100:00080000:2.0:1715330466.852371:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330436 00000100:00100000:0.0:1715330466.852462:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880065129180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3689:1798653942553920:0@lo:400:kworker.0 00000100:00100000:0.0:1715330466.852496:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330466.852529:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942553920 00000100:00100000:0.0:1715330466.852532:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942553920 00000100:00100000:0.0:1715330466.852559:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 518 00000100:00100000:0.0:1715330466.852566:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800660eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1798653942553920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330466.852616:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800660eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1798653942553920:12345-0@lo:400:kworker.0 Request processed in 50us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330466.852621:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 518 00000100:00100000:0.0:1715330466.852656:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880065129180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3689:1798653942553920:0@lo:400:kworker.0 00000100:00100000:0.0:1715330466.852691:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880065129500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942553984:0@lo:400:kworker.0 00000100:00100000:0.0:1715330466.852713:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330466.852760:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942553984 00000100:00100000:0.0:1715330466.852763:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942553984 00000100:00100000:0.0:1715330466.852782:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3166 00000100:00100000:0.0:1715330466.852786:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800660ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942553984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715330466.852814:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800660ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942553984:12345-0@lo:400:kworker.0 Request processed in 27us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330466.852819:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3166 00000100:00100000:0.0:1715330466.852836:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880065129500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942553984:0@lo:400:kworker.0 00000100:00100000:1.0:1715330466.852956:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:1.0:1715330466.852961:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3688:x1798653942553856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330466.853003:0:7130:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3688:x1798653942553856:12345-0@lo:400:kworker.0 Request processed in 41us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330466.853008:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:2.0:1715330466.853072:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880065128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3688:1798653942553856:0@lo:400:kworker.0 00000100:00100000:3.0:1715330466.853312:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880065129f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3689:1798653942554176:0@lo:400:kworker.0 00000100:00100000:3.0:1715330466.853332:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330466.853342:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88006512ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3689:1798653942554432:0@lo:400:kworker.0 00000100:00100000:3.0:1715330466.853353:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330466.853361:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1715330466.853365:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880065129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942554112:0@lo:400:kworker.0 00000100:00100000:3.0:1715330466.853377:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330466.853383:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88006512aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942554368:0@lo:400:kworker.0 00000100:00100000:3.0:1715330466.853397:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330466.853404:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88006512b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942554624:0@lo:400:kworker.0 00000100:00100000:3.0:1715330466.853414:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330466.853429:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942554368 00000100:00100000:3.0:1715330466.853431:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942554368 00000100:00100000:3.0:1715330466.853447:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942554624 00000100:00100000:3.0:1715330466.853448:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942554624 00000100:00100000:3.0:1715330466.853461:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1715330466.853464:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880065129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942554368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330466.853486:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880065129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942554368:12345-0@lo:400:kworker.0 Request processed in 21us (88us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330466.853491:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1715330466.853498:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1715330466.853501:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880065128a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942554624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330466.853514:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880065128a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942554624:12345-0@lo:400:kworker.0 Request processed in 13us (99us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330466.853518:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1715330466.853529:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942554176 00000100:00100000:3.0:1715330466.853530:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942554176 00000100:00100000:3.0:1715330466.853542:0:7133:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942554432 00000100:00100000:3.0:1715330466.853543:0:7133:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942554432 00000100:00100000:3.0:1715330466.853552:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00000100:00100000:3.0:1715330466.853554:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006512bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1798653942554176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330466.853570:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006512bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1798653942554176:12345-0@lo:400:kworker.0 Request processed in 15us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330466.853577:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00000100:00100000:3.0:1715330466.853582:0:7133:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:3.0:1715330466.853585:0:7133:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880065128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3689:x1798653942554432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330466.853596:0:7133:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880065128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3689:x1798653942554432:12345-0@lo:400:kworker.0 Request processed in 11us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330466.853600:0:7133:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00000100:00080000:3.0:1715330466.853609:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330436 00000100:00080000:3.0:1715330466.853611:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330436 00000100:00100000:3.0:1715330466.853621:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88006512aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942554368:0@lo:400:kworker.0 00000100:00100000:3.0:1715330466.853626:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88006512b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942554624:0@lo:400:kworker.0 00000100:00100000:3.0:1715330466.853632:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880065129f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3689:1798653942554176:0@lo:400:kworker.0 00000100:00100000:3.0:1715330466.853638:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88006512ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3689:1798653942554432:0@lo:400:kworker.0 00000100:00100000:3.0:1715330466.853667:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88006512a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3690:1798653942554240:0@lo:400:kworker.0 00000100:00100000:3.0:1715330466.853684:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330466.853692:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88006512b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3690:1798653942554496:0@lo:400:kworker.0 00000100:00100000:3.0:1715330466.853704:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330466.853711:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1715330466.853715:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880065129880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3690:1798653942554048:0@lo:400:kworker.0 00000100:00100000:3.0:1715330466.853727:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330466.853756:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88006512a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942554304:0@lo:400:kworker.0 00000100:00100000:3.0:1715330466.853770:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330466.853778:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88006512b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942554560:0@lo:400:kworker.0 00000100:00100000:3.0:1715330466.853793:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330466.853807:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942554240 00000100:00100000:3.0:1715330466.853810:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942554240 00000100:00100000:3.0:1715330466.853827:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942554496 00000100:00100000:3.0:1715330466.853829:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942554496 00000100:00100000:3.0:1715330466.853836:0:7134:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942554048 00000100:00100000:3.0:1715330466.853837:0:7134:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942554048 00000100:00100000:3.0:1715330466.853845:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 521 00000100:00100000:3.0:1715330466.853848:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006512ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3690:x1798653942554240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330466.853873:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006512ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3690:x1798653942554240:12345-0@lo:400:kworker.0 Request processed in 24us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330466.853878:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 521 00000100:00100000:3.0:1715330466.853886:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 522 00000100:00100000:3.0:1715330466.853889:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880065129f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3690:x1798653942554496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330466.853906:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880065129f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3690:x1798653942554496:12345-0@lo:400:kworker.0 Request processed in 16us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330466.853910:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 522 00000100:00100000:3.0:1715330466.853918:0:7134:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 523 00000100:00100000:3.0:1715330466.853921:0:7134:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006512b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3690:x1798653942554048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330466.853938:0:7134:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006512b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3690:x1798653942554048:12345-0@lo:400:kworker.0 Request processed in 16us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330466.853943:0:7134:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 523 00000100:00100000:3.0:1715330466.853959:0:9398:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942554304 00000100:00100000:3.0:1715330466.853961:0:9398:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942554304 00000100:00100000:3.0:1715330466.853973:0:9398:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942554560 00000100:00100000:3.0:1715330466.853974:0:9398:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942554560 00000100:00100000:3.0:1715330466.853985:0:9398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1715330466.853988:0:9398:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006512aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942554304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330466.854013:0:9398:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006512aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942554304:12345-0@lo:400:kworker.0 Request processed in 24us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330466.854170:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942554112 00000100:00100000:0.0:1715330466.854173:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942554112 00000100:00100000:0.0:1715330466.855454:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3167 00000100:00100000:3.0:1715330466.855457:0:9398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1715330466.855465:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880065129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942554112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715330466.855467:0:12304:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1715330466.855477:0:12304:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880065128e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942554560:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1715330466.855496:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330436 00000100:00080000:3.0:1715330466.855500:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330436 00000100:00100000:2.0:1715330466.855518:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880065129880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3690:1798653942554048:0@lo:400:kworker.0 00000100:00100000:2.0:1715330466.855531:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88006512a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942554304:0@lo:400:kworker.0 00000100:00100000:0.0:1715330466.855531:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880065129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942554112:12345-0@lo:400:kworker.0 Request processed in 70us (2152us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330466.855537:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3167 00000100:00100000:3.0:1715330466.855542:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880065129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942554112:0@lo:400:kworker.0 00000100:00100000:2.0:1715330466.855629:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88006512a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3690:1798653942554240:0@lo:400:kworker.0 00000100:00100000:2.0:1715330466.855639:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88006512b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3690:1798653942554496:0@lo:400:kworker.0 00000100:00100000:1.0:1715330466.855639:0:12304:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880065128e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3690:x1798653942554560:12345-0@lo:400:kworker.0 Request processed in 164us (1843us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330466.855646:0:12304:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1715330466.855657:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88006512b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942554560:0@lo:400:kworker.0 00000100:00100000:0.0:1715330466.914835:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1715330466.914842:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800657f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942554688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1715330466.914847:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800660eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942554752:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1715330466.914957:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330466.914989:0:9400:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942554688 00000100:00100000:2.0:1715330466.914994:0:9400:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942554688 00000100:00100000:2.0:1715330466.915032:0:9400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1715330466.915038:0:9400:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800657f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942554688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1715330466.915063:0:9400:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 172032 granted 317126336 pending 0 free 3923546112 avail 3692023808 00000100:00100000:2.0:1715330466.915093:0:9400:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800657f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3690:x1798653942554688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330466.915099:0:9400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1715330466.915130:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800657f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3690:1798653942554688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1715330466.915143:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330466.915153:0:9400:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942554752 00000100:00100000:2.0:1715330466.915155:0:9400:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942554752 00000100:00100000:2.0:1715330466.915169:0:9400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1715330466.915172:0:9400:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800660eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942554752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1715330466.915179:0:9400:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 172032 granted 317126336 pending 0 free 3923546112 avail 3692023808 00000100:00100000:2.0:1715330466.915206:0:9400:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800660eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1798653942554752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (64us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330466.915211:0:9400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1715330466.915222:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800660eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3688:1798653942554752:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1715330467.673976:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330468.307939:0:3690:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1715330468.307968:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800657f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942554816:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1715330468.308050:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330468.308075:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942554816 00000100:00100000:0.0:1715330468.308083:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942554816 00000100:00100000:0.0:1715330468.308122:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3168 00000100:00100000:0.0:1715330468.308129:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800657f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942554816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1715330468.308209:0:19960:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444089856 avail 1314627584 00000100:00100000:0.0:1715330468.308901:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800657f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3690:x1798653942554816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 770us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330468.308912:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3168 00000100:00100000:2.0:1715330468.309355:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800657f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3690:1798653942554816:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1715330468.675016:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330469.682363:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330469.731992:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1715330469.732007:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800657f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942554880:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1715330469.732055:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330469.735615:0:8592:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942554880 00000100:00100000:2.0:1715330469.735625:0:8592:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942554880 00000100:00100000:2.0:1715330469.735663:0:8592:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3169 00000100:00100000:2.0:1715330469.735669:0:8592:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800657f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942554880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1715330469.735701:0:8592:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445060608 avail 1315598336 00000100:00100000:2.0:1715330469.735771:0:8592:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800657f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3689:x1798653942554880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (3716us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330469.735778:0:8592:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3169 00000100:00100000:3.0:1715330469.735879:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800657f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3689:1798653942554880:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1715330470.626983:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1715330470.627001:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800660eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942554944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1715330470.627037:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1715330470.627047:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800657f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942555008:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1715330470.627058:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330470.627074:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330470.627089:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942554944 00000100:00100000:1.0:1715330470.627094:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942554944 00000100:00080000:2.0:1715330470.627255:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330440 00000100:00100000:1.0:1715330470.627316:0:11701:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942555008 00000100:00100000:1.0:1715330470.627320:0:11701:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942555008 00000100:00100000:1.0:1715330470.627340:0:11701:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1715330470.627345:0:11701:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880066240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942554944:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1715330470.627355:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330440 00002000:00000024:1.0:1715330470.627367:0:11701:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 492209856 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1715330470.627375:0:9401:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1715330470.627380:0:9401:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800657f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942555008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1715330470.627390:0:9401:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 492209856 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1715330470.627398:0:11701:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880066240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942554944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330470.627404:0:11701:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1715330470.627413:0:9401:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800657f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942555008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 33us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330470.627419:0:9401:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1715330470.627437:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800660eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942554944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1715330470.627445:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800657f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942555008:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1715330470.683769:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1715330471.147054:0:3071:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 64e: check grant consumption (no grant allocation) ========================================================== 04:41:10 (1715330470) 00000100:00100000:0.0:1715330471.313393:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330471.313454:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938172352 00000100:00100000:3.0:1715330471.313463:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938172352 00000100:00080000:2.0:1715330471.313528:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330441 00000100:00100000:3.0:1715330471.313555:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23875 00000100:00100000:3.0:1715330471.313566:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800660eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+15:25677:x1798653938172352:12345-192.168.204.49@tcp:101:lsof.0 00010000:00010000:3.0:1715330471.313586:0:25569:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715330471.313602:0:25569:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da821c0/0xd895711d66dbf9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbfa0 expref: -99 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330471.313649:0:25569:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81440/0xd895711d66dbfa4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330471.313660:0:25569:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81440/0xd895711d66dbfa4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330471.313668:0:25569:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81440/0xd895711d66dbfa4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00000004:00200000:3.0:1715330471.313703:0:25569:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 270336 00000004:00200000:3.0:1715330471.313707:0:25569:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1715330471.313768:0:25569:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81440/0xd895711d66dbfa4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25569 initiator: MDT0 00010000:00010000:3.0:1715330471.313788:0:25569:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da821c0/0xd895711d66dbf9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbfa0 expref: 17 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330471.313808:0:25569:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81440/0xd895711d66dbfa4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbfa0 expref: 16 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330471.313815:0:25569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:3.0:1715330471.313818:0:25569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1715330471.313820:0:25569:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011da81440, rc 0) 00000100:00100000:3.0:1715330471.314144:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800660eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+16:25677:x1798653938172352:12345-192.168.204.49@tcp:101:lsof.0 Request processed in 581us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330471.314150:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23875 00000100:00100000:0.0:1715330471.378232:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330471.378277:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330471.378311:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330471.378341:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330471.378377:0:7129:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938172416 00000100:00100000:0.0:1715330471.378383:0:7129:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938172416 00000100:00100000:0.0:1715330471.378422:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 402 00000100:00100000:0.0:1715330471.378428:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2014:x1798653938172416:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:0.0:1715330471.378477:0:7129:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2014:x1798653938172416:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 49us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330471.378483:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 402 00000100:00080000:0.0:1715330471.378583:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330441 00000100:00100000:1.0:1715330471.378764:0:12304:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938172608 00000100:00100000:1.0:1715330471.378768:0:12304:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938172608 00000100:00100000:1.0:1715330471.378790:0:12304:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938172544 00000100:00100000:1.0:1715330471.378792:0:12304:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938172544 00000100:00100000:1.0:1715330471.378804:0:12304:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 371 00000100:00100000:1.0:1715330471.378807:0:12304:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800660eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938172608:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:1.0:1715330471.378836:0:12304:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800660eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938172608:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 27us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330471.378841:0:12304:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 371 00000100:00100000:1.0:1715330471.378851:0:12304:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 372 00000100:00100000:1.0:1715330471.378854:0:12304:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800660e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938172544:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:1.0:1715330471.378871:0:12304:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800660e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938172544:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 16us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330471.378875:0:12304:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 372 00000100:00100000:3.0:1715330471.379029:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938172480 00000100:00100000:3.0:1715330471.379033:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938172480 00000100:00100000:3.0:1715330471.379056:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 524 00000100:00100000:3.0:1715330471.379060:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800660ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938172480:12345-192.168.204.49@tcp:400:kworker.0 00000100:00100000:3.0:1715330471.379083:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800660ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:72de1896-1df4-4b3a-930a-9116d2c66168+6:2014:x1798653938172480:12345-192.168.204.49@tcp:400:kworker.0 Request processed in 23us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330471.379088:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 524 00000100:00080000:0.0:1715330471.379183:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330441 00000100:00080000:0.0:1715330471.379186:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715330441 00000100:00080000:0.0:1715330471.379187:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330441 00000100:00100000:0.0:1715330471.643164:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330471.643316:0:7137:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938172736 00000100:00100000:2.0:1715330471.643324:0:7137:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938172736 00000100:00100000:2.0:1715330471.643361:0:7137:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5226 00000100:00100000:2.0:1715330471.643369:0:7137:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800660e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+16:25685:x1798653938172736:12345-192.168.204.49@tcp:35:umount.0 00000100:00100000:2.0:1715330471.644289:0:7137:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800660e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72de1896-1df4-4b3a-930a-9116d2c66168+17:25685:x1798653938172736:12345-192.168.204.49@tcp:35:umount.0 Request processed in 917us (1129us total) trans 4294984137 rc 0/0 00000100:00100000:2.0:1715330471.644297:0:7137:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5226 00000100:00100000:0.0:1715330471.669024:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330471.669297:0:10673:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938172800 00000100:00100000:0.0:1715330471.669300:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330471.669306:0:10673:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938172800 00000100:00100000:0.0:1715330471.669333:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330471.669352:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938172928 00000100:00100000:1.0:1715330471.669356:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938172928 00000100:00100000:0.0:1715330471.669378:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:1.0:1715330471.669385:0:10674:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938172864 00000100:00100000:1.0:1715330471.669387:0:10674:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938172864 00000100:00100000:0.0:1715330471.669412:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1422 00000100:00100000:0.0:1715330471.669419:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5224850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:febdcf8a-e6cf-428d-9354-a75e9703e3d2+11:2013:x1798653938172928:12345-192.168.204.49@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1715330471.669431:0:17217:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938173056 00010000:00010000:0.0:1715330471.669431:0:7122:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1715330471.669434:0:17217:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938173056 00010000:00010000:0.0:1715330471.669446:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880078ab6880/0xd895711d664d550 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bde0eb expref: 11 pid: 7130 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715330471.669455:0:17217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5354 00000100:00100000:2.0:1715330471.669459:0:17217:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:72de1896-1df4-4b3a-930a-9116d2c66168+6:25685:x1798653938173056:12345-192.168.204.49@tcp:9:umount.0 00010000:00010000:0.0:1715330471.669462:0:7122:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00000080:2.0:1715330471.669478:0:17217:0:(genops.c:1395:class_disconnect()) disconnect: cookie 0xd895711d66c51c8 00000020:00010000:2.0:1715330471.669483:0:17217:0:(genops.c:1814:obd_stale_export_put()) Put export ffff88011db3a000: total 0 00000100:00080000:2.0:1715330471.669487:0:17217:0:(import.c:86:import_set_state_nolock()) ffff88011db38000 ÿÿÿÿ: changing import state from FULL to CLOSED 00000100:00100000:0.0:1715330471.669493:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5224850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:febdcf8a-e6cf-428d-9354-a75e9703e3d2+10:2013:x1798653938172928:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 75us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330471.669498:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1422 00000001:00000004:2.0:1715330471.669522:0:17217:0:(tgt_lastrcvd.c:715:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294970021 00000100:00100000:2.0:1715330471.669613:0:17217:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:72de1896-1df4-4b3a-930a-9116d2c66168+4:25685:x1798653938173056:12345-192.168.204.49@tcp:9:umount.0 Request processed in 153us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330471.669619:0:17217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5354 00000020:00010000:2.0:1715330471.669630:0:9415:0:(genops.c:1800:obd_stale_export_get()) Get export ffff88011db3a000: total 0 00010000:00010000:2.0:1715330471.669645:0:9415:0:(ldlm_lock.c:2705:ldlm_export_cancel_blocked_locks()) Export ffff88011db3a000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1715330471.669688:0:9415:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011da82880/0xd895711d66dbea8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf53 expref: 3 pid: 9633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330471.669708:0:9415:0:(ldlm_lock.c:2733:ldlm_export_cancel_locks()) Export ffff88011db3a000, canceled 1 locks, left on hash table 0. 00000100:00100000:3.0:1715330471.669710:0:10673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1423 00000100:00100000:3.0:1715330471.669714:0:10673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800660e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:febdcf8a-e6cf-428d-9354-a75e9703e3d2+9:2013:x1798653938172800:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1715330471.669717:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330471.669719:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715330471.669721:0:10673:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715330471.669721:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715330471.669728:0:10673:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880078ab4000/0xd895711d664d423 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bde0ac expref: 9 pid: 7130 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715330471.669837:0:10674:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 1424 00000100:00100000:1.0:1715330471.669841:0:10674:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:febdcf8a-e6cf-428d-9354-a75e9703e3d2+8:2013:x1798653938172864:12345-192.168.204.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1715330471.669848:0:10674:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715330471.669854:0:10674:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880078ab7cc0/0xd895711d664d366 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bde06d expref: 8 pid: 7130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715330471.669863:0:10674:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715330471.669879:0:10674:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:febdcf8a-e6cf-428d-9354-a75e9703e3d2+7:2013:x1798653938172864:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 38us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1715330471.669884:0:10674:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1424 00010000:00010000:3.0:1715330471.669935:0:10673:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715330471.669955:0:10673:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800660e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:febdcf8a-e6cf-428d-9354-a75e9703e3d2+6:2013:x1798653938172800:12345-192.168.204.49@tcp:103:ldlm_bl.0 Request processed in 240us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330471.669961:0:10673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 1423 00000100:00100000:0.0:1715330471.673605:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330471.673727:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938173184 00000100:00100000:2.0:1715330471.673773:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938173184 00000100:00100000:2.0:1715330471.673804:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 5355 00000100:00100000:2.0:1715330471.673810:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72de1896-1df4-4b3a-930a-9116d2c66168+6:25685:x1798653938173184:12345-192.168.204.49@tcp:9:umount.0 00000020:00000080:2.0:1715330471.673832:0:9633:0:(genops.c:1395:class_disconnect()) disconnect: cookie 0xd895711d664d661 00000020:00010000:2.0:1715330471.673837:0:9633:0:(genops.c:1814:obd_stale_export_put()) Put export ffff88009d624800: total 0 00000100:00080000:2.0:1715330471.673841:0:9633:0:(import.c:86:import_set_state_nolock()) ffff88009d627000 ÿÿÿÿ: changing import state from FULL to CLOSED 00000001:00000004:2.0:1715330471.673931:0:9633:0:(tgt_lastrcvd.c:715:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294970205 00000020:00010000:3.0:1715330471.674061:0:9414:0:(genops.c:1800:obd_stale_export_get()) Get export ffff88009d624800: total 0 00010000:00010000:3.0:1715330471.674096:0:9414:0:(ldlm_lock.c:2705:ldlm_export_cancel_blocked_locks()) Export ffff88009d624800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1715330471.674138:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800938b7a80/0xd895711d66dbb13 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe50 expref: 5 pid: 17217 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330471.674157:0:9414:0:(ldlm_lock.c:2733:ldlm_export_cancel_locks()) Export ffff88009d624800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1715330471.674166:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715330471.674168:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715330471.674170:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330471.674346:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72de1896-1df4-4b3a-930a-9116d2c66168+2:25685:x1798653938173184:12345-192.168.204.49@tcp:9:umount.0 Request processed in 534us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330471.674356:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 5355 00000100:00100000:0.0:1715330471.680452:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330471.680628:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938173760 00000100:00100000:3.0:1715330471.680637:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938173760 00000100:00100000:3.0:1715330471.680683:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23876 00000100:00100000:3.0:1715330471.680689:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+17:25685:x1798653938173760:12345-192.168.204.49@tcp:39:umount.0 00000020:00000080:3.0:1715330471.680722:0:9622:0:(genops.c:1395:class_disconnect()) disconnect: cookie 0xd895711d664d374 00000020:00010000:3.0:1715330471.680727:0:9622:0:(genops.c:1814:obd_stale_export_put()) Put export ffff88009b4c9000: total 0 00000100:00080000:3.0:1715330471.680753:0:9622:0:(import.c:86:import_set_state_nolock()) ffff88009b4c8800 ÿÿÿÿ: changing import state from FULL to CLOSED 00000001:00000004:3.0:1715330471.680800:0:9622:0:(tgt_lastrcvd.c:715:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294984137 00000020:00010000:2.0:1715330471.680851:0:7123:0:(genops.c:1800:obd_stale_export_get()) Get export ffff88009b4c9000: total 0 00010000:00010000:2.0:1715330471.680886:0:7123:0:(ldlm_lock.c:2705:ldlm_export_cancel_blocked_locks()) Export ffff88009b4c9000, canceled 0 locks, left on hash table 11. 00010000:00010000:2.0:1715330471.680915:0:7123:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x138e:0x0].0x0 (ffff88009d696e00) 00010000:00010000:2.0:1715330471.680918:0:7123:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1715330471.680924:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f1200/0xd895711d66c51dd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x138e:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bf7bc9 expref: 15 pid: 7134 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715330471.680949:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+14:25685:x1798653938173760:12345-192.168.204.49@tcp:39:umount.0 Request processed in 259us (504us total) trans 0 rc 0/0 00010000:00010000:2.0:1715330471.680953:0:7123:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x138d:0x0].0x0 (ffff88009d696d00) 00010000:00010000:2.0:1715330471.680955:0:7123:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 11 00000100:00100000:3.0:1715330471.680956:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23876 00010000:00010000:2.0:1715330471.680958:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457fcc0/0xd895711d66c5182 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x138d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bf7ba6 expref: 14 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330471.681004:0:7123:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1590:0x0].0x0 (ffff88012ca48000) 00010000:00010000:2.0:1715330471.681007:0:7123:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1715330471.681010:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da83840/0xd895711d66dbb75 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1590:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe73 expref: 12 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330471.681024:0:7123:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158f:0x0].0x0 (ffff8800b4207c00) 00010000:00010000:2.0:1715330471.681026:0:7123:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330471.681029:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880087724fc0/0xd895711d66dbb05 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x158f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe42 expref: 11 pid: 7133 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330471.681043:0:7123:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008b374300) 00010000:00010000:2.0:1715330471.681045:0:7123:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1715330471.681047:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011da81440/0xd895711d66dbfa4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbfa0 expref: 10 pid: 25569 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330471.681070:0:7123:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff88009d618400) 00010000:00010000:2.0:1715330471.681072:0:7123:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1715330471.681074:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db67840/0xd895711d66d9f52 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x152a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbb63 expref: 9 pid: 11283 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330471.681108:0:7123:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159b:0x0].0x0 (ffff88008b0d2300) 00010000:00010000:2.0:1715330471.681111:0:7123:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330471.681114:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c5fa80/0xd895711d66dbe9a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x159b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbf4c expref: 8 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330471.681128:0:7123:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1590:0x0].0x0 (ffff88012ca48000) 00010000:00010000:2.0:1715330471.681130:0:7123:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1715330471.681132:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b4d80/0xd895711d66dbb67 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1590:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe6c expref: 7 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330471.681143:0:7123:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff88012d446b00) 00010000:00010000:2.0:1715330471.681144:0:7123:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330471.681147:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad9f3600/0xd895711d664d653 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bde12a expref: 6 pid: 7135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330471.681162:0:7123:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1590:0x0].0x0 (ffff88012ca48000) 00010000:00010000:2.0:1715330471.681164:0:7123:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330471.681166:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b6d00/0xd895711d66dbb91 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1590:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbe7a expref: 5 pid: 9622 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330471.681180:0:7123:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x138e:0x0].0x0 (ffff88009d696e00) 00010000:00010000:2.0:1715330471.681181:0:7123:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715330471.681184:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013457d440/0xd895711d66c51ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x138e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bf7bbb expref: 4 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330471.681225:0:7123:0:(ldlm_lock.c:2733:ldlm_export_cancel_locks()) Export ffff88009b4c9000, canceled 11 locks, left on hash table 0. 00010000:00010000:2.0:1715330471.681235:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330471.681237:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330471.681238:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715330471.685042:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330471.690325:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:3.0:1715330471.690370:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938173888 00000100:00100000:3.0:1715330471.690379:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938173888 00000100:00100000:3.0:1715330471.690424:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 23877 00000100:00100000:3.0:1715330471.690431:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+6:25685:x1798653938173888:12345-192.168.204.49@tcp:39:umount.0 00000020:00000080:3.0:1715330471.690463:0:9622:0:(genops.c:1395:class_disconnect()) disconnect: cookie 0xd895711d664d37b 00000020:00010000:3.0:1715330471.690468:0:9622:0:(genops.c:1814:obd_stale_export_put()) Put export ffff88009b4c8000: total 0 00000100:00080000:3.0:1715330471.690472:0:9622:0:(import.c:86:import_set_state_nolock()) ffff88009b4cf000 ÿÿÿÿ: changing import state from FULL to CLOSED 00000001:00000004:3.0:1715330471.690526:0:9622:0:(tgt_lastrcvd.c:715:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294968499 00000100:00100000:3.0:1715330471.690650:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72de1896-1df4-4b3a-930a-9116d2c66168+4:25685:x1798653938173888:12345-192.168.204.49@tcp:39:umount.0 Request processed in 217us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330471.690657:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 23877 00000020:00010000:2.0:1715330471.690811:0:9415:0:(genops.c:1800:obd_stale_export_get()) Get export ffff88009b4c8000: total 0 00010000:00010000:2.0:1715330471.690815:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330471.690846:0:9415:0:(ldlm_lock.c:2705:ldlm_export_cancel_blocked_locks()) Export ffff88009b4c8000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1715330471.690871:0:9415:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x2:0x0].0x0 (ffff88012ca48500) 00010000:00010000:2.0:1715330471.690874:0:9415:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1715330471.690881:0:9415:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88013457cb40/0xd895711d66c519e lrc: 0/0,0 mode: --/PR res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bf7bb4 expref: 3 pid: 7134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330471.690899:0:9415:0:(ldlm_lock.c:2733:ldlm_export_cancel_locks()) Export ffff88009b4c8000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1715330471.690908:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330471.690910:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715330471.690911:0:9415:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715330471.716816:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330471.717350:0:7130:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938174016 00000100:00100000:2.0:1715330471.717360:0:7130:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938174016 00000100:00100000:2.0:1715330471.717403:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 403 00000100:00100000:2.0:1715330471.717409:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:febdcf8a-e6cf-428d-9354-a75e9703e3d2+6:25685:x1798653938174016:12345-192.168.204.49@tcp:251:umount.0 00000020:00000080:2.0:1715330471.717455:0:7130:0:(genops.c:1395:class_disconnect()) disconnect: cookie 0xd895711d664d351 00000020:00010000:2.0:1715330471.717464:0:7130:0:(genops.c:1814:obd_stale_export_put()) Put export ffff88009d5cb800: total 0 00000100:00080000:2.0:1715330471.717468:0:7130:0:(import.c:86:import_set_state_nolock()) ffff88009d5cb000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1715330471.717544:0:7130:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:febdcf8a-e6cf-428d-9354-a75e9703e3d2+3:25685:x1798653938174016:12345-192.168.204.49@tcp:251:umount.0 Request processed in 134us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330471.717551:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 403 00000020:00010000:3.0:1715330471.718683:0:9414:0:(genops.c:1800:obd_stale_export_get()) Get export ffff88009d5cb800: total 0 00010000:00010000:3.0:1715330471.718727:0:9414:0:(ldlm_lock.c:2705:ldlm_export_cancel_blocked_locks()) Export ffff88009d5cb800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1715330471.718792:0:9414:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880078ab4480/0xd895711d664d42a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bde0b3 expref: 2 pid: 7128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715330471.718815:0:9414:0:(ldlm_lock.c:2733:ldlm_export_cancel_locks()) Export ffff88009d5cb800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1715330471.718825:0:9414:0:(genops.c:924:class_export_put()) final put ffff88009d5cb800/febdcf8a-e6cf-428d-9354-a75e9703e3d2 00010000:00010000:3.0:1715330471.718843:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715330471.718845:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715330471.718846:0:9414:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1715330471.718935:0:2902:0:(genops.c:882:class_export_destroy()) destroying export ffff88009d5cb800/febdcf8a-e6cf-428d-9354-a75e9703e3d2 for MGS 00000020:00000080:1.0:1715330471.718977:0:2902:0:(genops.c:1112:obd_zombie_import_free()) destroying import ffff88009d5cb000 for MGS 00000100:00100000:0.0:1715330471.815957:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330471.816246:0:7129:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938174080 00000100:00100000:2.0:1715330471.816254:0:7129:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938174080 00000100:00100000:2.0:1715330471.816287:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 404 00000100:00100000:2.0:1715330471.816294:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007666fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2010:x1798653938174080:12345-192.168.204.49@tcp:250:mount.lustre.0 00010000:00080000:2.0:1715330471.816318:0:7129:0:(ldlm_lib.c:1360:target_handle_connect()) MGS: connection from 834ee110-72f3-4e00-9b18-50715d919a60@192.168.204.49@tcp t0 exp (null) cur 446 last 0 00000020:00000080:2.0:1715330471.816339:0:7129:0:(genops.c:1312:class_connect()) connect: client 834ee110-72f3-4e00-9b18-50715d919a60, cookie 0xd895711d66dbfab 00000020:01000000:2.0:1715330471.816344:0:7129:0:(lprocfs_status_server.c:574:lprocfs_exp_setup()) using hash ffff88012e177000 00000100:00080000:2.0:1715330471.816371:0:7129:0:(import.c:86:import_set_state_nolock()) ffff880091e5a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1715330471.817961:0:7129:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007666fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ee110-72f3-4e00-9b18-50715d919a60+4:2010:x1798653938174080:12345-192.168.204.49@tcp:250:mount.lustre.0 Request processed in 1661us (2006us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330471.817972:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 404 00000100:00100000:0.0:1715330471.822987:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330471.824355:0:7129:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938174144 00000100:00100000:2.0:1715330471.824364:0:7129:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938174144 00000100:00100000:2.0:1715330471.824856:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 405 00000100:00100000:2.0:1715330471.824874:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007666f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ee110-72f3-4e00-9b18-50715d919a60+4:25696:x1798653938174144:12345-192.168.204.49@tcp:101:mount.lustre.0 00010000:00010000:2.0:1715330471.824887:0:7129:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330471.824903:0:7129:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8800938b7840/0xd895711d66dbfb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbfb5 expref: -99 pid: 7129 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330471.824925:0:7129:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8800938b7840/0xd895711d66dbfb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbfb5 expref: 5 pid: 7129 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330471.824933:0:7129:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8800938b7840/0xd895711d66dbfb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbfb5 expref: 5 pid: 7129 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330471.824939:0:7129:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938b7840, rc 0) 00000100:00100000:2.0:1715330471.824989:0:7129:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007666f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ee110-72f3-4e00-9b18-50715d919a60+5:25696:x1798653938174144:12345-192.168.204.49@tcp:101:mount.lustre.0 Request processed in 126us (2011us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330471.824997:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 405 00000100:00100000:1.0:1715330471.831356:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330471.831485:0:7129:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938174208 00000100:00100000:2.0:1715330471.831495:0:7129:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938174208 00000100:00100000:2.0:1715330471.831940:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 406 00000100:00100000:2.0:1715330471.831948:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007666f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ee110-72f3-4e00-9b18-50715d919a60+5:25696:x1798653938174208:12345-192.168.204.49@tcp:501:mount.lustre.0 00000100:00100000:2.0:1715330471.833016:0:7129:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007666f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ee110-72f3-4e00-9b18-50715d919a60+5:25696:x1798653938174208:12345-192.168.204.49@tcp:501:mount.lustre.0 Request processed in 1064us (1663us total) trans 0 rc -2/-2 00000100:00100000:2.0:1715330471.833024:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 406 00000100:00100000:0.0:1715330471.836337:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330471.836430:0:7129:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938174272 00000100:00100000:2.0:1715330471.836438:0:7129:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938174272 00000100:00100000:2.0:1715330471.836470:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 407 00000100:00100000:2.0:1715330471.836477:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007666f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ee110-72f3-4e00-9b18-50715d919a60+5:25696:x1798653938174272:12345-192.168.204.49@tcp:101:mount.lustre.0 00010000:00010000:2.0:1715330471.836490:0:7129:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715330471.836506:0:7129:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8800938b5680/0xd895711d66dbfb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ad5aefca0bfbfbc expref: -99 pid: 7129 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330471.836528:0:7129:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8800938b5680/0xd895711d66dbfb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbfbc expref: 6 pid: 7129 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330471.836535:0:7129:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8800938b5680/0xd895711d66dbfb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbfbc expref: 6 pid: 7129 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715330471.836541:0:7129:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938b5680, rc 0) 00000100:00100000:2.0:1715330471.836588:0:7129:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007666f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ee110-72f3-4e00-9b18-50715d919a60+6:25696:x1798653938174272:12345-192.168.204.49@tcp:101:mount.lustre.0 Request processed in 111us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330471.836593:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 407 00000100:00100000:0.0:1715330471.842576:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330471.844002:0:7130:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938174336 00000100:00100000:2.0:1715330471.844047:0:7130:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938174336 00000100:00100000:2.0:1715330471.844091:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 408 00000100:00100000:2.0:1715330471.844098:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007666ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ee110-72f3-4e00-9b18-50715d919a60+6:25696:x1798653938174336:12345-192.168.204.49@tcp:501:mount.lustre.0 00000100:00100000:2.0:1715330471.844251:0:7130:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007666ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ee110-72f3-4e00-9b18-50715d919a60+7:25696:x1798653938174336:12345-192.168.204.49@tcp:501:mount.lustre.0 Request processed in 152us (1679us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330471.844258:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 408 00000100:00100000:1.0:1715330471.852441:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330471.852643:0:7129:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938174400 00000100:00100000:0.0:1715330471.852651:0:7129:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938174400 00000100:00100000:0.0:1715330471.852700:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 409 00000100:00100000:0.0:1715330471.852706:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007666e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ee110-72f3-4e00-9b18-50715d919a60+7:25696:x1798653938174400:12345-192.168.204.49@tcp:503:mount.lustre.0 00000100:00100000:0.0:1715330471.852848:0:7129:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007666e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ee110-72f3-4e00-9b18-50715d919a60+7:25696:x1798653938174400:12345-192.168.204.49@tcp:503:mount.lustre.0 Request processed in 141us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330471.852855:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 409 00000100:00100000:0.0:1715330471.861073:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330471.861240:0:7130:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938174464 00000100:00100000:2.0:1715330471.861249:0:7130:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938174464 00000100:00100000:2.0:1715330471.862954:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 410 00000100:00100000:2.0:1715330471.862964:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007666e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ee110-72f3-4e00-9b18-50715d919a60+7:25712:x1798653938174464:12345-192.168.204.49@tcp:502:llog_process_th.0 00000100:00100000:2.0:1715330471.863114:0:7130:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007666e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ee110-72f3-4e00-9b18-50715d919a60+7:25712:x1798653938174464:12345-192.168.204.49@tcp:502:llog_process_th.0 Request processed in 151us (2047us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330471.863121:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 410 00000100:00100000:2.0:1715330471.864070:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880065129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3691:1798653942555072:0@lo:400:kworker.0 00000100:00100000:2.0:1715330471.864108:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330471.864190:0:7129:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942555072 00000100:00100000:0.0:1715330471.864209:0:7129:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942555072 00000100:00080000:0.0:1715330471.864223:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715330441 00000100:00100000:0.0:1715330471.864304:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:0.0:1715330471.864309:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007666e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3691:x1798653942555072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330471.864521:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88006512b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942555200:0@lo:400:kworker.0 00000100:00100000:2.0:1715330471.864546:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330471.864559:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1715330471.864564:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88006512b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3689:1798653942555136:0@lo:400:kworker.0 00000100:00100000:2.0:1715330471.864583:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330471.864602:0:25569:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942555136 00000100:00100000:2.0:1715330471.864605:0:25569:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942555136 00000100:00100000:2.0:1715330471.864626:0:25569:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 525 00000100:00100000:2.0:1715330471.864629:0:25569:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800657f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1798653942555136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330471.864657:0:25569:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800657f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1798653942555136:12345-0@lo:400:kworker.0 Request processed in 26us (72us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330471.864663:0:25569:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 525 00000100:00100000:2.0:1715330471.864690:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88006512b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3689:1798653942555136:0@lo:400:kworker.0 00000100:00100000:2.0:1715330471.864715:0:3690:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88006512a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3690:1798653942555264:0@lo:400:kworker.0 00000100:00100000:2.0:1715330471.864749:0:3690:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330471.864766:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942555264 00000100:00100000:2.0:1715330471.864768:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942555264 00000100:00100000:2.0:1715330471.864781:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 526 00000100:00100000:2.0:1715330471.864785:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800657f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3690:x1798653942555264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330471.864807:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800657f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3690:x1798653942555264:12345-0@lo:400:kworker.0 Request processed in 21us (58us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330471.864812:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 526 00000100:00100000:2.0:1715330471.864827:0:3690:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88006512a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3690:1798653942555264:0@lo:400:kworker.0 00000100:00100000:2.0:1715330471.864845:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942555200 00000100:00100000:2.0:1715330471.864847:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942555200 00000100:00100000:2.0:1715330471.864862:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3170 00000100:00100000:2.0:1715330471.864866:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800657f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3689:x1798653942555200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330471.864892:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800657f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3689:x1798653942555200:12345-0@lo:400:kworker.0 Request processed in 26us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330471.864897:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3170 00000100:00100000:2.0:1715330471.864912:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88006512b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942555200:0@lo:400:kworker.0 00000100:00100000:0.0:1715330471.864984:0:7129:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007666e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e4eb42f-2543-4d25-b40c-8ace386a04cf+23:3691:x1798653942555072:12345-0@lo:400:kworker.0 Request processed in 674us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330471.864990:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00100000:3.0:1715330471.865095:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88006512a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942555328:0@lo:400:kworker.0 00000100:00100000:3.0:1715330471.865116:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330471.865128:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88006512b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942555584:0@lo:400:kworker.0 00000100:00100000:3.0:1715330471.865143:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330471.865153:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800661b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942555840:0@lo:400:kworker.0 00000100:00100000:3.0:1715330471.865165:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330471.865177:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880065129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3e4eb42f-2543-4d25-b40c-8ace386a04cf:3691:1798653942555072:0@lo:400:kworker.0 00000100:00100000:3.0:1715330471.865204:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1715330471.865209:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88006512a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942555520:0@lo:400:kworker.0 00000100:00100000:3.0:1715330471.865225:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330471.865235:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800661b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942555776:0@lo:400:kworker.0 00000100:00100000:3.0:1715330471.865248:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330471.865265:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942555584 00000100:00100000:3.0:1715330471.865268:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942555584 00000100:00100000:3.0:1715330471.865284:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942555840 00000100:00100000:3.0:1715330471.865285:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942555840 00000100:00100000:3.0:1715330471.865296:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942555520 00000100:00100000:3.0:1715330471.865297:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942555520 00000100:00100000:3.0:1715330471.865305:0:9633:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942555776 00000100:00100000:3.0:1715330471.865307:0:9633:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942555776 00000100:00100000:3.0:1715330471.865316:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1715330471.865319:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800661b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942555584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330471.865344:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800661b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942555584:12345-0@lo:400:kworker.0 Request processed in 24us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330471.865348:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1715330471.865358:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1715330471.865361:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800661b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942555840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330471.865380:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800661b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942555840:12345-0@lo:400:kworker.0 Request processed in 18us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330471.865385:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1715330471.865392:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1715330471.865395:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800661b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942555520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330471.865413:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800661b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942555520:12345-0@lo:400:kworker.0 Request processed in 18us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330471.865417:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1715330471.865425:0:9633:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1715330471.865428:0:9633:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800661b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942555776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330471.865445:0:9633:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800661b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3691:x1798653942555776:12345-0@lo:400:kworker.0 Request processed in 16us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330471.865449:0:9633:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1715330471.865471:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88006512a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942555520:0@lo:400:kworker.0 00000100:00100000:3.0:1715330471.865478:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800661b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942555776:0@lo:400:kworker.0 00000100:00100000:3.0:1715330471.865484:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88006512b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942555584:0@lo:400:kworker.0 00000100:00100000:3.0:1715330471.865490:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800661b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942555840:0@lo:400:kworker.0 00000100:00080000:3.0:1715330471.865518:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715330441 00000100:00100000:1.0:1715330471.865927:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880065129880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3688:1798653942555392:0@lo:400:kworker.0 00000100:00100000:1.0:1715330471.865951:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715330471.865965:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880093371180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3688:1798653942555648:0@lo:400:kworker.0 00000100:00100000:1.0:1715330471.865979:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330471.866150:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942555328 00000100:00100000:2.0:1715330471.866154:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942555328 00000100:00100000:2.0:1715330471.866172:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3171 00000100:00100000:2.0:1715330471.866176:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800661b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942555328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330471.867484:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800661b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3691:x1798653942555328:12345-0@lo:400:kworker.0 Request processed in 1304us (2363us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330471.867492:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3171 00000100:00100000:2.0:1715330471.867517:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88006512b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3689:1798653942555456:0@lo:400:kworker.0 00000100:00100000:2.0:1715330471.867566:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88006512a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3691:1798653942555328:0@lo:400:kworker.0 00000100:00100000:2.0:1715330471.867655:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330471.867657:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942555392 00000100:00100000:3.0:1715330471.867663:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942555392 00000100:00100000:2.0:1715330471.867671:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800660e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3689:1798653942555712:0@lo:400:kworker.0 00000100:00100000:2.0:1715330471.867687:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715330471.867696:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942555648 00000100:00100000:3.0:1715330471.867698:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942555648 00000100:00100000:2.0:1715330471.867707:0:7135:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942555456 00000100:00100000:3.0:1715330471.867709:0:9622:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942555712 00000100:00100000:2.0:1715330471.867709:0:7135:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942555456 00000100:00100000:3.0:1715330471.867710:0:9622:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942555712 00000100:00100000:3.0:1715330471.867720:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 527 00000100:00100000:2.0:1715330471.867724:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00000100:00100000:3.0:1715330471.867725:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880066240a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1798653942555392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330471.867752:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880066241c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3688:x1798653942555648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330471.867780:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880066241c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3688:x1798653942555648:12345-0@lo:400:kworker.0 Request processed in 51us (1800us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330471.867781:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880066240a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1798653942555392:12345-0@lo:400:kworker.0 Request processed in 55us (1828us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330471.867785:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00000100:00100000:3.0:1715330471.867787:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 527 00000100:00100000:2.0:1715330471.867794:0:7135:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 529 00000100:00100000:2.0:1715330471.867797:0:7135:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800657f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3689:x1798653942555712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715330471.867798:0:9622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 530 00000100:00100000:3.0:1715330471.867801:0:9622:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800657f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1798653942555456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715330471.867818:0:7135:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800657f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3689:x1798653942555712:12345-0@lo:400:kworker.0 Request processed in 20us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1715330471.867823:0:9622:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800657f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1798653942555456:12345-0@lo:400:kworker.0 Request processed in 21us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330471.867823:0:7135:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 529 00000100:00100000:3.0:1715330471.867831:0:9622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 530 00000100:00100000:2.0:1715330471.867845:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88006512b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3689:1798653942555456:0@lo:400:kworker.0 00000100:00080000:3.0:1715330471.867848:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715330441 00000100:00080000:3.0:1715330471.867851:0:7131:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715330441 00000100:00100000:2.0:1715330471.867852:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800660e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3689:1798653942555712:0@lo:400:kworker.0 00000100:00100000:0.0:1715330471.867913:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880065129880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3688:1798653942555392:0@lo:400:kworker.0 00000100:00100000:0.0:1715330471.867923:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880093371180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3688:1798653942555648:0@lo:400:kworker.0 00000100:00100000:0.0:1715330471.880131:0:3682:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:2.0:1715330471.880233:0:7129:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938174528 00000100:00100000:2.0:1715330471.880240:0:7129:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938174528 00000100:00100000:2.0:1715330471.880272:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 412 00000100:00100000:2.0:1715330471.880277:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007666dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ee110-72f3-4e00-9b18-50715d919a60+7:25712:x1798653938174528:12345-192.168.204.49@tcp:502:llog_process_th.0 00000100:00100000:2.0:1715330471.880393:0:7129:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007666dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ee110-72f3-4e00-9b18-50715d919a60+7:25712:x1798653938174528:12345-192.168.204.49@tcp:502:llog_process_th.0 Request processed in 115us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330471.880400:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 412 00000100:00100000:1.0:1715330471.899307:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330471.899384:0:7130:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938174592 00000100:00100000:0.0:1715330471.899392:0:7130:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938174592 00000100:00100000:0.0:1715330471.899438:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 413 00000100:00100000:0.0:1715330471.899445:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007666d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ee110-72f3-4e00-9b18-50715d919a60+7:2010:x1798653938174592:12345-192.168.204.49@tcp:250:kworker.0 00010000:02000400:0.0:1715330471.899468:0:7130:0:(ldlm_lib.c:898:target_handle_reconnect()) MGS: Client 834ee110-72f3-4e00-9b18-50715d919a60 (at 192.168.204.49@tcp) reconnecting 00010000:00080000:0.0:1715330471.903273:0:7130:0:(ldlm_lib.c:1360:target_handle_connect()) MGS: connection from 834ee110-72f3-4e00-9b18-50715d919a60@192.168.204.49@tcp t0 exp ffff880091e5a000 cur 446 last 1715330471 00000100:00080000:0.0:1715330471.903304:0:7130:0:(import.c:86:import_set_state_nolock()) ffff880091e5a800 : changing import state from FULL to RECOVER 00000100:00080000:0.0:1715330471.903314:0:7130:0:(import.c:86:import_set_state_nolock()) ffff880091e5a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1715330471.903397:0:7130:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007666d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:834ee110-72f3-4e00-9b18-50715d919a60+7:2010:x1798653938174592:12345-192.168.204.49@tcp:250:kworker.0 Request processed in 3951us (4094us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330471.903407:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 413 00000100:00100000:3.0:1715330471.922932:0:3689:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1715330471.922955:0:3689:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091d85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942555904:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1715330471.923011:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330471.923183:0:9400:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942555904 00000100:00100000:0.0:1715330471.923189:0:9400:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942555904 00000100:00100000:0.0:1715330471.923239:0:9400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1715330471.923246:0:9400:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800661b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942555904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1715330471.923272:0:9400:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 206528 pending 0 free 3923546112 avail 3692023808 00000100:00100000:0.0:1715330471.923315:0:9400:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800661b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1798653942555904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330471.923321:0:9400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1715330471.923388:0:3689:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091d85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3689:1798653942555904:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1715330471.924490:0:3688:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1715330471.924497:0:3688:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800661b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942555968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1715330471.924520:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715330471.924556:0:9400:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942555968 00000100:00100000:0.0:1715330471.924561:0:9400:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942555968 00000100:00100000:0.0:1715330471.924680:0:9400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1715330471.924685:0:9400:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800661b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942555968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1715330471.924697:0:9400:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 206528 pending 0 free 3923546112 avail 3692023808 00000100:00100000:0.0:1715330471.924749:0:9400:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800661b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1798653942555968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1715330471.924755:0:9400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1715330471.925081:0:3688:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800661b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3688:1798653942555968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1715330471.930355:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.49@tcp (source: 12345-192.168.204.49@tcp) 00000100:00100000:0.0:1715330471.930684:0:7130:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653938174656 00000100:00100000:0.0:1715330471.930692:0:7130:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653938174656 00000100:00100000:2.0:1715330471.931409:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.49@tcp, seq: 414 00000100:00100000:2.0:1715330471.931416:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007666d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ee110-72f3-4e00-9b18-50715d919a60+7:25696:x1798653938174656:12345-192.168.204.49@tcp:251:mount.lustre.0 00000020:00000080:2.0:1715330471.931448:0:7129:0:(genops.c:1395:class_disconnect()) disconnect: cookie 0xd895711d66dbfab 00000020:00010000:2.0:1715330471.931806:0:7129:0:(genops.c:1814:obd_stale_export_put()) Put export ffff880091e5a000: total 0 00000100:00080000:2.0:1715330471.931812:0:7129:0:(import.c:86:import_set_state_nolock()) ffff880091e5a800 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1715330471.931883:0:7123:0:(genops.c:1800:obd_stale_export_get()) Get export ffff880091e5a000: total 0 00010000:00010000:0.0:1715330471.931927:0:7123:0:(ldlm_lock.c:2705:ldlm_export_cancel_blocked_locks()) Export ffff880091e5a000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1715330471.931950:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800938b7840/0xd895711d66dbfb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbfb5 expref: 4 pid: 7129 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330471.933268:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800938b5680/0xd895711d66dbfb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.49@tcp remote: 0x6ad5aefca0bfbfbc expref: 3 pid: 7129 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715330471.933280:0:7123:0:(ldlm_lock.c:2733:ldlm_export_cancel_locks()) Export ffff880091e5a000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1715330471.933301:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330471.933302:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715330471.933304:0:7123:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330471.933526:0:7129:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007666d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:834ee110-72f3-4e00-9b18-50715d919a60+1:25696:x1798653938174656:12345-192.168.204.49@tcp:251:mount.lustre.0 Request processed in 2107us (3176us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330471.933535:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.49@tcp, seq: 414 00000020:00000080:2.0:1715330471.933544:0:7129:0:(genops.c:924:class_export_put()) final put ffff880091e5a000/834ee110-72f3-4e00-9b18-50715d919a60 00000020:00000080:3.0:1715330471.933636:0:313:0:(genops.c:882:class_export_destroy()) destroying export ffff880091e5a000/834ee110-72f3-4e00-9b18-50715d919a60 for MGS 00000020:00000080:3.0:1715330471.933660:0:313:0:(genops.c:1112:obd_zombie_import_free()) destroying import ffff880091e5a800 for MGS 00000001:02000400:2.0:1715330472.665325:0:3136:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity test_64e: @@@@@@ FAIL: mount failed 00010000:00010000:0.0:1715330472.687765:0:7124:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715330473.315038:0:3691:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1715330473.315053:0:3691:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800657f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942556032:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1715330473.315103:0:3691:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715330473.315132:0:19960:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798653942556032 00000100:00100000:2.0:1715330473.315138:0:19960:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798653942556032 00000100:00100000:2.0:1715330473.315166:0:19960:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3172 00000100:00100000:2.0:1715330473.315181:0:19960:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800660e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3691:x1798653942556032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1715330473.315208:0:19960:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1444089856 avail 1314627584 00000100:00100000:2.0:1715330473.315241:0:19960:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800660e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:3691:x1798653942556032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1715330473.315248:0:19960:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3172 00000100:00100000:2.0:1715330473.315282:0:3691:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800657f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3691:1798653942556032:0@lo:41:osp-pre-0-1.0 Debug log: 71208 lines, 71208 kept, 0 dropped, 0 bad.